2021-09-10 16:46:26.204 4088 3038191778280 MainThread DEBUG os_vif [-] Loaded VIF plugin class '' with name 'linux_bridge' initialize c:\python37\lib\site-packages\os_vif\__init__.py:46 2021-09-10 16:46:26.204 4088 3038191778280 MainThread DEBUG os_vif [-] Loaded VIF plugin class '' with name 'noop' initialize c:\python37\lib\site-packages\os_vif\__init__.py:46 2021-09-10 16:46:26.220 4088 3038191778280 MainThread DEBUG os_vif [-] Loaded VIF plugin class '' with name 'ovs' initialize c:\python37\lib\site-packages\os_vif\__init__.py:46 2021-09-10 16:46:26.220 4088 3038191778280 MainThread INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs 2021-09-10 16:46:27.798 4088 3038191778280 MainThread INFO nova.virt.driver [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] Loading compute driver 'hyperv.driver.HyperVDriver' 2021-09-10 16:46:28.891 4088 3038191778280 MainThread INFO nova.compute.provider_config [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_concurrency.lockutils [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] Acquired lock "singleton_lock" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_concurrency.lockutils [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] Releasing lock "singleton_lock" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] Full set of CONF: _wait_for_exit_or_signal c:\python37\lib\site-packages\oslo_service\service.py:362 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ******************************************************************************** log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2589 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] Configuration options gathered from: log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2590 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] command line args: ['--config-file', 'c:\\openstack\\etc\\nova.conf'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2591 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] config files: ['c:\\openstack\\etc\\nova.conf'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2593 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ================================================================================ log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2594 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] allow_resize_to_same_host = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] arq_binding_timeout = 300 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] backdoor_port = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] backdoor_socket = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] block_device_allocate_retries = 60 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] block_device_allocate_retries_interval = 3 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cert = self.pem log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] compute_driver = hyperv.driver.HyperVDriver log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] compute_monitors = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] config_dir = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] config_drive_format = iso9660 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.905 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] config_file = ['c:\\openstack\\etc\\nova.conf'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] config_source = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] console_host = n-h2-808474-1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] control_exchange = nova log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cpu_allocation_ratio = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] daemon = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] debug = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] default_access_ip_network_name = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] default_availability_zone = nova log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] default_ephemeral_format = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] default_schedule_zone = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] disk_allocation_ratio = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] enable_new_services = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] enabled_apis = ['osapi_compute', 'metadata'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] enabled_ssl_apis = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] flat_injected = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] force_config_drive = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] force_raw_images = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] graceful_shutdown_timeout = 60 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] heal_instance_info_cache_interval = 60 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] host = n-h2-808474-1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] initial_cpu_allocation_ratio = 16.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] initial_disk_allocation_ratio = 1.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.921 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] initial_ram_allocation_ratio = 1.5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] injected_network_template = c:\openstack\build\nova\nova/virt/interfaces.template log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] instance_build_timeout = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] instance_delete_interval = 300 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] instance_format = [instance: %(uuid)s] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] instance_name_template = instance-%08x log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] instance_usage_audit = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] instance_usage_audit_period = hour log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] instance_uuid_format = [instance: %(uuid)s] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] instances_path = C:\openstack\instances log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] internal_service_availability_zone = internal log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] key = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] live_migration_retry_count = 30 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] log_config_append = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] log_date_format = %Y-%m-%d %H:%M:%S log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] log_dir = c:\openstack\log log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] log_file = nova-compute.log log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] log_options = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] log_rotate_interval = 1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] log_rotate_interval_type = days log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] log_rotation_type = none log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.937 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] logging_context_format_string = %(asctime)s.%(msecs)03d %(process)d %(thread)d %(threadName)s %(levelname)s %(name)s [%(request_id)s %(user_identity)s] %(instance)s%(message)s log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] logging_debug_format_suffix = %(funcName)s %(pathname)s:%(lineno)d log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] logging_default_format_string = %(asctime)s.%(msecs)03d %(process)d %(thread)d %(threadName)s %(levelname)s %(name)s [-] %(instance)s%(message)s log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d %(thread)d %(threadName)s TRACE %(name)s %(instance)s log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] long_rpc_timeout = 1800 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] max_concurrent_builds = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] max_concurrent_live_migrations = 1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] max_concurrent_snapshots = 5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] max_local_block_devices = 3 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] max_logfile_count = 30 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] max_logfile_size_mb = 200 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] maximum_instance_delete_attempts = 5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] metadata_listen = 0.0.0.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] metadata_listen_port = 8775 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] metadata_workers = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] migrate_max_retries = -1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] mkisofs_cmd = c:\openstack\bin\mkisofs.exe log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] my_block_storage_ip = 10.222.0.47 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] my_ip = 10.222.0.47 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] network_allocate_retries = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] osapi_compute_listen = 0.0.0.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.952 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] osapi_compute_listen_port = 8774 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] osapi_compute_unique_server_name_scope = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] osapi_compute_workers = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] password_length = 12 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] periodic_enable = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] periodic_fuzzy_delay = 60 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] pointer_model = usbtablet log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] preallocate_images = none log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] publish_errors = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] pybasedir = c:\openstack\build\nova log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ram_allocation_ratio = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] rate_limit_burst = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] rate_limit_except_level = CRITICAL log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] rate_limit_interval = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] reboot_timeout = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] reclaim_instance_interval = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] record = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] report_interval = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] rescue_timeout = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] reserved_host_cpus = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] reserved_host_disk_mb = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] reserved_host_memory_mb = 512 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] reserved_huge_pages = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] resize_confirm_window = 5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] resize_fs_using_block_device = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] resume_guests_state_on_host_boot = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] rootwrap_config = /etc/nova/rootwrap.conf log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] rpc_response_timeout = 600 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] run_external_periodic_tasks = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] running_deleted_instance_action = reap log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] running_deleted_instance_poll_interval = 120 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] running_deleted_instance_timeout = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] scheduler_instance_sync_interval = 120 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] service_down_time = 60 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] servicegroup_driver = db log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.967 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] shelved_offload_time = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.991 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] shelved_poll_interval = 3600 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.991 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] shutdown_timeout = 60 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.991 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] source_is_ipv6 = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.991 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ssl_only = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.991 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] state_path = c:\openstack\build\nova log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.991 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] sync_power_state_interval = 600 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.991 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] sync_power_state_pool_size = 1000 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.991 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] syslog_log_facility = LOG_USER log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.991 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] tempdir = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.991 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] timeout_nbd = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.991 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] transport_url = **** log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.991 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] update_resources_interval = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] use_cow_images = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] use_eventlog = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] use_journal = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] use_json = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] use_rootwrap_daemon = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] use_stderr = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] use_syslog = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vcpu_pin_set = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vif_plugging_is_fatal = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vif_plugging_timeout = 60 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] virt_mkfs = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] volume_usage_poll_interval = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] watch_log_file = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] web = /usr/share/spice-html5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2603 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_concurrency.disable_process_locking = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_concurrency.lock_path = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_metrics.metrics_buffer_size = 1000 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_metrics.metrics_enabled = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_metrics.metrics_process_name = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:28.999 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.auth_strategy = keystone log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.compute_link_prefix = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.dhcp_domain = novalocal log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.enable_instance_password = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.glance_link_prefix = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.instance_list_cells_batch_fixed_size = 100 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.instance_list_cells_batch_strategy = distributed log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.instance_list_per_project_cells = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.list_records_by_skipping_down_cells = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.local_metadata_per_cell = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.max_limit = 1000 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.metadata_cache_expiration = 15 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.neutron_default_tenant_id = default log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.use_forwarded_for = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.use_neutron_default_nets = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.vendordata_dynamic_connect_timeout = 5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.vendordata_dynamic_failure_fatal = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.vendordata_dynamic_read_timeout = 5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.vendordata_dynamic_ssl_certfile = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.vendordata_dynamic_targets = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.vendordata_jsonfile_path = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.015 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api.vendordata_providers = ['StaticJSON'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.backend = dogpile.cache.null log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.backend_argument = **** log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.config_prefix = cache.oslo log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.debug_cache_backend = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.enabled = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.expiration_time = 600 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.memcache_dead_retry = 300 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.memcache_pool_connection_get_timeout = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.memcache_pool_flush_on_reconnect = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.memcache_pool_maxsize = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.memcache_pool_unused_timeout = 60 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.memcache_servers = ['localhost:11211'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.memcache_socket_timeout = 1.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.proxies = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.tls_allowed_ciphers = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.tls_cafile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.tls_certfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.tls_enabled = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cache.tls_keyfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cinder.auth_section = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cinder.auth_type = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cinder.cafile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cinder.catalog_info = volumev3::publicURL log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cinder.certfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cinder.collect_timing = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cinder.cross_az_attach = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cinder.endpoint_template = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cinder.http_retries = 3 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cinder.insecure = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cinder.keyfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cinder.os_region_name = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cinder.split_loggers = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cinder.timeout = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] compute.consecutive_build_service_disable_threshold = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] compute.cpu_dedicated_set = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] compute.cpu_shared_set = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] compute.image_type_exclude_list = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] compute.live_migration_wait_for_vif_plug = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] compute.max_concurrent_disk_ops = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] compute.max_disk_devices_to_attach = -1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] compute.provider_config_location = /etc/nova/provider_config/ log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] compute.resource_provider_association_refresh = 300 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] compute.shutdown_retry_interval = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.031 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] conductor.workers = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.061 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] console.allowed_origins = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.061 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] console.ssl_ciphers = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.063 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] console.ssl_minimum_version = default log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.063 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] consoleauth.token_ttl = 600 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.063 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.cafile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.063 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.certfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.063 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.collect_timing = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.063 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.connect_retries = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.063 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.connect_retry_delay = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.063 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.endpoint_override = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.063 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.insecure = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.063 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.keyfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.063 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.max_version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.063 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.min_version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.region_name = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.service_name = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.service_type = accelerator log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.split_loggers = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.status_code_retries = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.status_code_retry_delay = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.timeout = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.valid_interfaces = ['internal', 'public'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] cyborg.version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.backend = sqlalchemy log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.connection = **** log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.connection_debug = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.connection_parameters = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.connection_recycle_time = 3600 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.connection_trace = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.db_inc_retry_interval = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.db_max_retries = 20 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.db_max_retry_interval = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.db_retry_interval = 1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.max_overflow = 50 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.max_pool_size = 5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.max_retries = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.077 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.mysql_enable_ndb = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.mysql_sql_mode = TRADITIONAL log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.pool_timeout = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.retry_interval = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.slave_connection = **** log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] database.sqlite_synchronous = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.backend = sqlalchemy log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.connection = **** log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.connection_debug = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.connection_parameters = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.connection_recycle_time = 3600 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.connection_trace = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.db_inc_retry_interval = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.db_max_retries = 20 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.db_max_retry_interval = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.db_retry_interval = 1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.max_overflow = 50 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.max_pool_size = 5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.max_retries = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.mysql_enable_ndb = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.mysql_sql_mode = TRADITIONAL log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.pool_timeout = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.retry_interval = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.slave_connection = **** log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.093 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] api_database.sqlite_synchronous = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] devices.enabled_mdev_types = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ephemeral_storage_encryption.cipher = aes-xts-plain64 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ephemeral_storage_encryption.enabled = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ephemeral_storage_encryption.key_size = 512 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread WARNING oslo_config.cfg [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] Deprecated: Option "api_servers" from group "glance" is deprecated for removal ( Support for image service configuration via standard keystoneauth1 Adapter options was added in the 17.0.0 Queens release. The api_servers option was retained temporarily to allow consumers time to cut over to a real load balancing solution. ). Its value may be silently ignored in the future. 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.api_servers = ['http://10.222.0.55/image'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.cafile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.certfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.collect_timing = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.connect_retries = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.connect_retry_delay = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.debug = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.default_trusted_certificate_ids = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.enable_certificate_validation = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.enable_rbd_download = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.endpoint_override = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.insecure = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.keyfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.max_version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.min_version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.109 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.num_retries = 3 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.rbd_ceph_conf = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.rbd_connect_timeout = 5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.rbd_pool = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.rbd_user = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.region_name = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.service_name = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.service_type = image log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.split_loggers = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.status_code_retries = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.status_code_retry_delay = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.timeout = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.valid_interfaces = ['internal', 'public'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.verify_glance_signatures = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] glance.version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] guestfs.debug = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] hyperv.config_drive_cdrom = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] hyperv.config_drive_inject_password = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] hyperv.dynamic_memory_ratio = 1.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] hyperv.enable_instance_metrics_collection = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] hyperv.enable_remotefx = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] hyperv.instances_path_share = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] hyperv.iscsi_initiator_list = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.124 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] hyperv.limit_cpu_features = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.141 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] hyperv.mounted_disk_query_retry_count = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.141 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] hyperv.mounted_disk_query_retry_interval = 5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.141 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] hyperv.power_state_check_timeframe = 60 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.141 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] hyperv.power_state_event_polling_interval = 2 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.141 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] hyperv.qemu_img_cmd = c:\openstack\bin\qemu-img.exe log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.141 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] hyperv.use_multipath_io = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.141 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] hyperv.volume_attach_retry_count = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.141 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] hyperv.volume_attach_retry_interval = 5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.141 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] hyperv.vswitch_name = br-data log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.141 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] hyperv.wait_soft_reboot_seconds = 60 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.141 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] mks.enabled = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.141 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] mks.mksproxy_base_url = http://127.0.0.1:6090/ log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] image_cache.manager_interval = 2400 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] image_cache.precache_concurrency = 1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] image_cache.remove_unused_base_images = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] image_cache.remove_unused_original_minimum_age_seconds = 86400 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] image_cache.remove_unused_resized_minimum_age_seconds = 3600 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] image_cache.subdirectory_name = _base log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.api_max_retries = 60 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.api_retry_interval = 2 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.auth_section = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.auth_type = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.cafile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.certfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.collect_timing = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.connect_retries = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.connect_retry_delay = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.endpoint_override = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.insecure = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.keyfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.max_version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.min_version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.partition_key = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.peer_list = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.region_name = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.serial_console_state_timeout = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.service_name = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.service_type = baremetal log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.split_loggers = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.status_code_retries = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.156 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.status_code_retry_delay = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.176 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.timeout = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.176 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.valid_interfaces = ['internal', 'public'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.176 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ironic.version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.176 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] key_manager.backend = barbican log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.176 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] key_manager.fixed_key = **** log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.176 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican.auth_endpoint = http://localhost/identity/v3 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.176 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican.barbican_api_version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.176 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican.barbican_endpoint = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.176 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican.barbican_endpoint_type = public log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.176 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican.barbican_region_name = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.176 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican.cafile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.176 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican.certfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.176 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican.collect_timing = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.176 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican.insecure = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.176 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican.keyfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.176 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican.number_of_retries = 60 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican.retry_delay = 1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican.send_service_user_token = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican.split_loggers = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican.timeout = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican.verify_ssl = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican.verify_ssl_path = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican_service_user.auth_section = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican_service_user.auth_type = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican_service_user.cafile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican_service_user.certfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican_service_user.collect_timing = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican_service_user.insecure = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican_service_user.keyfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican_service_user.split_loggers = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] barbican_service_user.timeout = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vault.approle_role_id = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vault.approle_secret_id = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vault.cafile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vault.certfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vault.collect_timing = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vault.insecure = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vault.keyfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vault.kv_mountpoint = secret log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vault.kv_version = 2 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.186 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vault.root_token_id = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vault.split_loggers = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vault.ssl_ca_crt_file = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vault.timeout = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vault.use_ssl = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vault.vault_url = http://127.0.0.1:8200 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.cafile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.certfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.collect_timing = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.connect_retries = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.connect_retry_delay = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.endpoint_override = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.insecure = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.keyfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.max_version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.min_version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.region_name = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.service_name = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.service_type = identity log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.split_loggers = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.status_code_retries = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.status_code_retry_delay = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.204 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.timeout = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.valid_interfaces = ['internal', 'public'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] keystone.version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.connection_uri = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.cpu_mode = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.cpu_model_extra_flags = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.cpu_models = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.device_detach_attempts = 8 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.device_detach_timeout = 20 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.disk_cachemodes = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.disk_prefix = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.enabled_perf_events = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.file_backed_memory = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.gid_maps = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.hw_disk_discard = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.hw_machine_type = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.images_rbd_ceph_conf = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.images_rbd_glance_copy_poll_interval = 15 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.images_rbd_glance_copy_timeout = 600 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.images_rbd_glance_store_name = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.images_rbd_pool = rbd log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.images_type = default log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.images_volume_group = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.219 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.inject_key = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.234 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.inject_partition = -2 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.234 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.inject_password = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.234 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.iscsi_iface = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.234 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.iser_use_multipath = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.234 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.live_migration_bandwidth = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.234 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.live_migration_completion_timeout = 800 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.234 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.live_migration_downtime = 500 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.234 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.live_migration_downtime_delay = 75 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.234 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.live_migration_downtime_steps = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.234 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.live_migration_inbound_addr = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.234 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.live_migration_permit_auto_converge = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.234 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.live_migration_permit_post_copy = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.234 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.live_migration_scheme = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.234 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.live_migration_timeout_action = abort log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.234 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.live_migration_tunnelled = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.234 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.live_migration_uri = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.live_migration_with_native_tls = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.max_queues = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.mem_stats_period_seconds = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.nfs_mount_options = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.nfs_mount_point_base = c:\openstack\build\nova\mnt log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.num_aoe_discover_tries = 3 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.num_iser_scan_tries = 5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.num_memory_encrypted_guests = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.num_nvme_discover_tries = 5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.num_pcie_ports = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.num_volume_scan_tries = 5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.pmem_namespaces = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.quobyte_client_cfg = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.quobyte_mount_point_base = c:\openstack\build\nova\mnt log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.rbd_connect_timeout = 5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.rbd_destroy_volume_retries = 12 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.rbd_destroy_volume_retry_interval = 5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.rbd_secret_uuid = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.rbd_user = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.realtime_scheduler_priority = 1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.remote_filesystem_transport = ssh log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.250 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.rescue_image_id = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.rescue_kernel_id = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.rescue_ramdisk_id = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.rng_dev_path = /dev/urandom log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.rx_queue_size = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.smbfs_mount_options = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.smbfs_mount_point_base = c:\openstack\build\nova\mnt log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.snapshot_compression = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.snapshot_image_format = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.snapshots_directory = C:\openstack\instances/snapshots log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.sparse_logical_volumes = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.swtpm_enabled = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.swtpm_group = tss log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.swtpm_user = tss log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.sysinfo_serial = unique log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.tx_queue_size = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.uid_maps = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.use_virtio_for_bridges = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.virt_type = kvm log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.volume_clear = zero log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.volume_clear_size = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.volume_use_multipath = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.266 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.vzstorage_cache_path = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.vzstorage_mount_group = qemu log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.vzstorage_mount_opts = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.vzstorage_mount_perms = 0770 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.vzstorage_mount_point_base = c:\openstack\build\nova\mnt log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.vzstorage_mount_user = stack log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] libvirt.wait_soft_reboot_seconds = 120 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.auth_section = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread WARNING oslo_config.cfg [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] Deprecated: Option "auth_plugin" from group "neutron" is deprecated. Use option "auth_type" from group "neutron". 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.auth_type = v3password log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.cafile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.certfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.collect_timing = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.connect_retries = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.connect_retry_delay = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.default_floating_pool = nova log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.endpoint_override = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.extension_sync_interval = 600 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.http_retries = 3 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.insecure = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.281 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.keyfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.max_version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.metadata_proxy_shared_secret = **** log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.min_version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.ovs_bridge = br-int log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.physnets = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.region_name = RegionOne log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.service_metadata_proxy = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.service_name = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.service_type = network log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.split_loggers = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.status_code_retries = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.status_code_retry_delay = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.timeout = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.valid_interfaces = ['internal', 'public'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] neutron.version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] notifications.bdms_in_notifications = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] notifications.default_level = INFO log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] notifications.notification_format = unversioned log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread WARNING oslo_config.cfg [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] Deprecated: Option "notify_on_state_change" from group "DEFAULT" is deprecated. Use option "notify_on_state_change" from group "notifications". 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] notifications.notify_on_state_change = vm_and_task_state log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] notifications.versioned_notifications_topics = ['versioned_notifications'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] pci.alias = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.296 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] pci.passthrough_whitelist = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.auth_section = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.auth_type = password log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.auth_url = http://10.222.0.55/identity/v3 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.cafile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.certfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.collect_timing = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.connect_retries = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.connect_retry_delay = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.default_domain_id = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.default_domain_name = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.domain_id = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.domain_name = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.endpoint_override = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.insecure = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.keyfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.max_version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.min_version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.password = **** log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.project_domain_id = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.project_domain_name = Default log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.project_id = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.project_name = service log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.region_name = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.311 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.service_name = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.329 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.service_type = placement log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.329 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.split_loggers = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.329 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.status_code_retries = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.329 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.status_code_retry_delay = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.329 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.system_scope = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.329 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.timeout = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.329 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.trust_id = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.329 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.user_domain_id = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.329 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.user_domain_name = Default log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.329 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.user_id = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.329 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.username = placement log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.329 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.valid_interfaces = ['internal', 'public'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.329 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] placement.version = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.329 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] powervm.disk_driver = localdisk log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] powervm.proc_units_factor = 0.1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] powervm.volume_group_name = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] quota.cores = 20 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] quota.count_usage_from_placement = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] quota.driver = nova.quota.DbQuotaDriver log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] quota.injected_file_content_bytes = 10240 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] quota.injected_file_path_length = 255 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] quota.injected_files = 5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] quota.instances = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] quota.key_pairs = 100 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] quota.metadata_items = 128 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] quota.ram = 51200 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] quota.recheck_quota = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] quota.server_group_members = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] quota.server_groups = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] rdp.enabled = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] scheduler.discover_hosts_in_cells_interval = -1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] scheduler.enable_isolated_aggregate_filtering = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.346 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] scheduler.image_metadata_prefilter = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] scheduler.limit_tenants_to_placement_aggregate = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] scheduler.max_attempts = 3 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] scheduler.max_placement_results = 1000 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] scheduler.placement_aggregate_required_for_tenants = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] scheduler.query_placement_for_availability_zone = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] scheduler.query_placement_for_image_type_support = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] scheduler.query_placement_for_routed_network_aggregates = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] scheduler.workers = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.aggregate_image_properties_isolation_namespace = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.aggregate_image_properties_isolation_separator = . log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.build_failure_weight_multiplier = 1000000.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.cpu_weight_multiplier = 1.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.disk_weight_multiplier = 1.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.host_subset_size = 1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.image_properties_default_architecture = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.io_ops_weight_multiplier = -1.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.isolated_hosts = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.isolated_images = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.max_instances_per_host = 50 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.360 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.max_io_ops_per_host = 8 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.pci_weight_multiplier = 1.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.ram_weight_multiplier = 1.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.shuffle_best_same_weighed_hosts = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.soft_affinity_weight_multiplier = 1.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.track_instance_changes = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] metrics.required = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] metrics.weight_multiplier = 1.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] metrics.weight_of_unavailable = -10000.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] metrics.weight_setting = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] serial_console.base_url = ws://127.0.0.1:6083/ log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] serial_console.enabled = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] serial_console.port_range = 10000:20000 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] serial_console.proxyclient_address = 127.0.0.1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] serial_console.serialproxy_host = 0.0.0.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] serial_console.serialproxy_port = 6083 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] service_user.auth_section = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] service_user.auth_type = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] service_user.cafile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.376 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] service_user.certfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] service_user.collect_timing = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] service_user.insecure = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] service_user.keyfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] service_user.send_service_user_token = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] service_user.split_loggers = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] service_user.timeout = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] spice.agent_enabled = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] spice.enabled = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] spice.html5proxy_host = 0.0.0.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] spice.html5proxy_port = 6082 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] spice.server_listen = 127.0.0.1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] spice.server_proxyclient_address = 127.0.0.1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] upgrade_levels.baseapi = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] upgrade_levels.cert = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] upgrade_levels.compute = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] upgrade_levels.conductor = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] upgrade_levels.scheduler = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vendordata_dynamic_auth.auth_section = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vendordata_dynamic_auth.auth_type = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vendordata_dynamic_auth.cafile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vendordata_dynamic_auth.certfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.391 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vendordata_dynamic_auth.collect_timing = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vendordata_dynamic_auth.insecure = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vendordata_dynamic_auth.keyfile = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vendordata_dynamic_auth.split_loggers = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vendordata_dynamic_auth.timeout = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.api_retry_count = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.ca_file = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.cache_prefix = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.cluster_name = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.connection_pool_size = 10 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.console_delay_seconds = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.datastore_regex = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.host_ip = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.host_password = **** log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.host_port = 443 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.host_username = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.insecure = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.integration_bridge = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.maximum_objects = 100 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.pbm_default_policy = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.pbm_enabled = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.pbm_wsdl_location = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.serial_log_dir = /opt/vmware/vspc log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.serial_port_proxy_uri = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.serial_port_service_uri = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.task_poll_interval = 0.5 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.use_linked_clone = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.vnc_keymap = en-us log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.vnc_port = 5900 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vmware.vnc_port_total = 10000 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vnc.auth_schemes = ['none'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vnc.enabled = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vnc.novncproxy_host = 0.0.0.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.406 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vnc.novncproxy_port = 6080 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.436 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vnc.server_listen = 127.0.0.1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.436 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vnc.server_proxyclient_address = 127.0.0.1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.436 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vnc.vencrypt_ca_certs = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.436 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vnc.vencrypt_client_cert = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.436 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vnc.vencrypt_client_key = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.436 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] workarounds.disable_fallback_pcpu_query = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] workarounds.disable_group_policy_check_upcall = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] workarounds.disable_libvirt_livesnapshot = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] workarounds.disable_rootwrap = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] workarounds.enable_numa_live_migration = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] workarounds.handle_virt_lifecycle_events = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] workarounds.libvirt_disable_apic = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] workarounds.never_download_image_if_on_rbd = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] workarounds.reserve_disk_resource_for_image_cache = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] wsgi.api_paste_config = api-paste.ini log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] wsgi.client_socket_timeout = 900 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] wsgi.default_pool_size = 1000 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] wsgi.keep_alive = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] wsgi.max_header_line = 16384 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] wsgi.secure_proxy_ssl_header = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] wsgi.ssl_ca_file = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] wsgi.ssl_cert_file = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] wsgi.ssl_key_file = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.441 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] wsgi.tcp_keepidle = 600 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] zvm.ca_file = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] zvm.cloud_connector_url = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] zvm.image_tmp_path = c:\openstack\build\nova\images log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] zvm.reachable_timeout = 300 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_policy.enforce_new_defaults = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_policy.enforce_scope = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_policy.policy_default_rule = default log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_policy.policy_dirs = ['policy.d'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_policy.policy_file = c:\openstack\etc\policy.json log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_policy.remote_content_type = application/x-www-form-urlencoded log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_policy.remote_ssl_ca_crt_file = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_policy.remote_ssl_client_crt_file = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_policy.remote_ssl_client_key_file = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_policy.remote_ssl_verify_server_crt = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_versionedobjects.fatal_exception_format_errors = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] profiler.connection_string = messaging:// log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] profiler.enabled = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] profiler.es_doc_type = notification log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] profiler.es_scroll_size = 10000 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] profiler.es_scroll_time = 2m log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] profiler.filter_error_trace = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] profiler.hmac_keys = SECRET_KEY log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] profiler.sentinel_service_name = mymaster log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] profiler.socket_timeout = 0.1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] profiler.trace_sqlalchemy = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] remote_debug.host = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] remote_debug.port = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.amqp_auto_delete = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.amqp_durable_queues = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.conn_pool_min_size = 2 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.conn_pool_ttl = 1200 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.direct_mandatory_flag = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.enable_cancel_on_failover = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.455 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.heartbeat_in_pthread = True log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.478 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.heartbeat_rate = 2 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.478 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.478 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.kombu_compression = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.478 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.kombu_failover_strategy = round-robin log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.478 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.478 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.478 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.rabbit_ha_queues = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.478 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.rabbit_interval_max = 30 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.478 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.rabbit_retry_backoff = 2 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.rabbit_retry_interval = 1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.rpc_conn_pool_size = 30 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.ssl = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.ssl_ca_file = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.ssl_cert_file = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.ssl_key_file = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_rabbit.ssl_version = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_notifications.driver = [] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_notifications.retry = -1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_notifications.topics = ['notifications'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_messaging_notifications.transport_url = **** log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_reports.file_event_handler = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_reports.file_event_handler_interval = 1 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] oslo_reports.log_dir = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vif_plug_linux_bridge_privileged.capabilities = [12] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vif_plug_linux_bridge_privileged.group = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vif_plug_linux_bridge_privileged.helper_command = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vif_plug_linux_bridge_privileged.thread_pool_size = 6 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.483 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vif_plug_linux_bridge_privileged.user = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.501 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vif_plug_ovs_privileged.capabilities = [12] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.501 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vif_plug_ovs_privileged.group = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.501 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vif_plug_ovs_privileged.helper_command = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.501 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.501 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vif_plug_ovs_privileged.thread_pool_size = 6 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.501 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] vif_plug_ovs_privileged.user = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.501 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_vif_linux_bridge.flat_interface = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.501 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_vif_linux_bridge.forward_bridge_interface = ['all'] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.501 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_vif_linux_bridge.iptables_bottom_regex = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.501 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_vif_linux_bridge.iptables_drop_action = DROP log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.501 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_vif_linux_bridge.iptables_top_regex = log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.501 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_vif_linux_bridge.network_device_mtu = 1500 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.501 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_vif_linux_bridge.use_ipv6 = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.501 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_vif_linux_bridge.vlan_interface = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.501 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_vif_ovs.isolate_vif = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.501 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_vif_ovs.network_device_mtu = 1500 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.516 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_vif_ovs.ovs_vsctl_timeout = 120 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.516 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_vif_ovs.ovsdb_connection = tcp:127.0.0.1:6640 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.516 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_vif_ovs.ovsdb_interface = native log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.516 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_vif_ovs.per_port_bridge = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.516 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] privsep_osbrick.capabilities = [21] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.516 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] privsep_osbrick.group = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.516 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] privsep_osbrick.helper_command = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.516 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] privsep_osbrick.logger_name = oslo_privsep.daemon log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.516 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] privsep_osbrick.thread_pool_size = 6 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.516 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] privsep_osbrick.user = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.516 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] nova_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.516 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] nova_sys_admin.group = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.516 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] nova_sys_admin.helper_command = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.516 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] nova_sys_admin.logger_name = oslo_privsep.daemon log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.516 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] nova_sys_admin.thread_pool_size = 6 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.516 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] nova_sys_admin.user = None log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.516 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_win.cache_temporary_wmi_objects = False log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.516 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_win.connect_cluster_timeout = 0 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.531 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_win.file_in_use_timeout = 15 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.531 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_win.hbaapi_lib_path = hbaapi.dll log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.531 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] os_win.wmi_job_terminate_timeout = 120 log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2611 2021-09-10 16:46:29.531 4088 3038191778280 MainThread DEBUG oslo_service.service [req-e0caaa15-1a98-4e0e-924b-6d44cc19baa2 - - - - -] ******************************************************************************** log_opt_values c:\python37\lib\site-packages\oslo_config\cfg.py:2613 2021-09-10 16:46:29.531 4088 3038296622712 GreenThread-1 INFO nova.service [-] Starting compute node (version 23.1.0) 2021-09-10 16:46:29.766 4088 3038296622712 GreenThread-1 WARNING nova.compute.manager [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Compute node n-h2-808474-1 not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host n-h2-808474-1 could not be found. 2021-09-10 16:46:29.875 4088 3038296622712 GreenThread-1 INFO nova.compute.manager [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host 2021-09-10 16:46:29.922 4088 3038296622712 GreenThread-1 WARNING nova.compute.manager [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] No compute node record found for host n-h2-808474-1. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host n-h2-808474-1 could not be found. 2021-09-10 16:46:29.922 4088 3038296622712 GreenThread-1 DEBUG oslo_concurrency.lockutils [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:46:29.922 4088 3038296622712 GreenThread-1 DEBUG oslo_concurrency.lockutils [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:46:29.922 4088 3038296622712 GreenThread-1 DEBUG nova.compute.resource_tracker [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 16:46:29.922 4088 3038296622712 GreenThread-1 DEBUG nova.virt.hyperv.hostops [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:46:29.938 4088 3038296622712 GreenThread-1 DEBUG nova.virt.hyperv.hostops [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:46:31.266 4088 3038296622712 GreenThread-1 DEBUG nova.compute.resource_tracker [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=14981MB free_disk=65GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 16:46:31.266 4088 3038296622712 GreenThread-1 DEBUG oslo_concurrency.lockutils [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:46:31.298 4088 3038296622712 GreenThread-1 WARNING nova.compute.resource_tracker [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] No compute node record for n-h2-808474-1:n-h2-808474-1: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host n-h2-808474-1 could not be found. 2021-09-10 16:46:31.313 4088 3038296622712 GreenThread-1 INFO nova.compute.resource_tracker [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Compute node record created for n-h2-808474-1:n-h2-808474-1 with uuid: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 2021-09-10 16:46:31.344 4088 3038296622712 GreenThread-1 DEBUG nova.compute.resource_tracker [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Total usable vcpus: 6, total allocated vcpus: 0 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 16:46:31.344 4088 3038296622712 GreenThread-1 DEBUG nova.compute.resource_tracker [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=512MB phys_disk=79GB used_disk=0GB total_vcpus=6 used_vcpus=0 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 16:46:31.469 4088 3038296622712 GreenThread-1 INFO nova.scheduler.client.report [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] [req-a1298857-e078-46fc-ae65-93882a24414c] Created resource provider record via placement API for resource provider with UUID 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 and name n-h2-808474-1. 2021-09-10 16:46:31.469 4088 3038296622712 GreenThread-1 DEBUG nova.virt.hyperv.hostops [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:46:31.484 4088 3038296622712 GreenThread-1 DEBUG nova.virt.hyperv.hostops [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:46:31.671 4088 3038296622712 GreenThread-1 DEBUG nova.compute.provider_tree [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Updating inventory in ProviderTree for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 with inventory: {'VCPU': {'total': 6, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0, 'reserved': 0}, 'MEMORY_MB': {'total': 16383, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5, 'reserved': 512}, 'DISK_GB': {'total': 79, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:176 2021-09-10 16:46:31.723 4088 3038296622712 GreenThread-1 DEBUG nova.scheduler.client.report [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Updated inventory for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 with generation 0 in Placement from set_inventory_for_provider using data: {'VCPU': {'total': 6, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0, 'reserved': 0}, 'MEMORY_MB': {'total': 16383, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5, 'reserved': 512}, 'DISK_GB': {'total': 79, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:912 2021-09-10 16:46:31.723 4088 3038296622712 GreenThread-1 DEBUG nova.compute.provider_tree [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Updating resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 generation from 0 to 1 during operation: update_inventory _update_generation c:\openstack\build\nova\nova\compute\provider_tree.py:165 2021-09-10 16:46:31.723 4088 3038296622712 GreenThread-1 DEBUG nova.compute.provider_tree [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Updating inventory in ProviderTree for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 with inventory: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:176 2021-09-10 16:46:31.768 4088 3038296622712 GreenThread-1 DEBUG nova.compute.provider_tree [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Updating resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 generation from 1 to 2 during operation: update_traits _update_generation c:\openstack\build\nova\nova\compute\provider_tree.py:165 2021-09-10 16:46:31.768 4088 3038296622712 GreenThread-1 DEBUG nova.compute.resource_tracker [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 16:46:31.768 4088 3038296622712 GreenThread-1 DEBUG oslo_concurrency.lockutils [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:46:31.768 4088 3038296622712 GreenThread-1 DEBUG nova.service [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Creating RPC server for service compute start c:\openstack\build\nova\nova\service.py:182 2021-09-10 16:46:31.813 4088 3038296622712 GreenThread-1 DEBUG nova.service [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] Join ServiceGroup membership for this service compute start c:\openstack\build\nova\nova\service.py:200 2021-09-10 16:46:31.813 4088 3038296622712 GreenThread-1 DEBUG nova.servicegroup.drivers.db [req-2df74606-7061-4979-a240-1f3fb444292c - - - - -] DB_Driver: join new ServiceGroup member n-h2-808474-1 to the compute group, service = join c:\openstack\build\nova\nova\servicegroup\drivers\db.py:47 2021-09-10 16:46:32.811 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_power_states run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:46:32.844 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:47:27.590 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:47:27.590 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:47:27.590 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 16:47:27.593 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9342 2021-09-10 16:47:27.593 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Didn't find any instances for network info cache update. _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9424 2021-09-10 16:47:27.593 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:47:27.593 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:47:27.593 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:47:27.621 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:47:27.642 4088 3038296676664 GreenThread-2 INFO nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running instance usage audit for host n-h2-808474-1 from 2021-09-10 15:00:00 to 2021-09-10 16:00:00. 0 instances. 2021-09-10 16:47:27.656 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:47:27.656 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:47:27.656 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 16:47:27.656 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:47:27.684 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:47:27.684 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:47:27.684 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 16:47:27.684 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:47:27.700 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:47:27.919 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=14848MB free_disk=65GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 16:47:27.919 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:47:27.986 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 0 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 16:47:27.986 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=512MB phys_disk=79GB used_disk=0GB total_vcpus=6 used_vcpus=0 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 16:47:28.013 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:47:28.013 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:47:28.201 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:47:28.236 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:47:28.236 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 16:47:28.236 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:48:28.226 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:48:28.244 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:48:28.570 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:48:28.570 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 16:48:28.570 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9342 2021-09-10 16:48:28.586 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Didn't find any instances for network info cache update. _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9424 2021-09-10 16:48:28.586 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:48:28.586 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:48:28.586 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:48:28.586 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:48:28.601 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 16:48:29.579 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:48:29.579 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:48:29.588 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:48:29.607 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:48:29.607 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:48:29.607 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 16:48:29.607 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:48:29.636 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:48:29.854 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=14961MB free_disk=65GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 16:48:29.854 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:48:29.946 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 0 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 16:48:29.946 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=512MB phys_disk=79GB used_disk=0GB total_vcpus=6 used_vcpus=0 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 16:48:29.994 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:48:30.008 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:48:30.183 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:48:30.211 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:48:30.211 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 16:48:30.211 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:48:32.852 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:48:51.385 4088 3038296677368 MainThread DEBUG oslo_concurrency.lockutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:48:51.432 4088 3038296677368 MainThread DEBUG nova.compute.manager [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:48:51.792 4088 3038296677368 MainThread DEBUG oslo_concurrency.lockutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:48:51.792 4088 3038296677368 MainThread DEBUG nova.virt.hardware [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:48:51.792 4088 3038296677368 MainThread INFO nova.compute.claims [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Claim successful on node n-h2-808474-1 2021-09-10 16:48:52.119 4088 3038296677368 MainThread DEBUG nova.virt.hyperv.hostops [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:48:52.135 4088 3038296677368 MainThread DEBUG nova.virt.hyperv.hostops [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:48:52.322 4088 3038296677368 MainThread DEBUG nova.compute.provider_tree [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:48:52.339 4088 3038296677368 MainThread DEBUG nova.scheduler.client.report [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:48:52.339 4088 3038296677368 MainThread DEBUG oslo_concurrency.lockutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:48:52.339 4088 3038296677368 MainThread DEBUG nova.compute.manager [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:48:52.651 4088 3038296677368 MainThread DEBUG nova.compute.utils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:48:52.680 4088 3038296676840 GreenThread-3 DEBUG nova.compute.manager [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:48:52.680 4088 3038296676840 GreenThread-3 DEBUG nova.network.neutron [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:48:52.682 4088 3038296677368 MainThread DEBUG nova.compute.manager [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:48:53.073 4088 3038296677368 MainThread DEBUG nova.compute.manager [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:48:53.120 4088 3038296676840 GreenThread-3 WARNING oslo_policy.policy [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. 2021-09-10 16:48:53.120 4088 3038296676840 GreenThread-3 WARNING oslo_policy.policy [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. 2021-09-10 16:48:53.120 4088 3038296676840 GreenThread-3 WARNING oslo_policy.policy [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Policy Rules ['context_is_admin', 'admin_or_owner', 'admin_api'] specified in policy files are the same as the defaults provided by the service. You can remove these rules from policy files which will make maintenance easier. You can detect these redundant rules by ``oslopolicy-list-redundant`` tool also. 2021-09-10 16:48:53.167 4088 3038296676840 GreenThread-3 DEBUG nova.policy [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34cd40c589284ea9b37a6a75b63fd6b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606d7457fc884b1c8b24fa368c946f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:48:53.167 4088 3038296677368 MainThread INFO nova.virt.hyperv.vmops [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Spawning new instance 2021-09-10 16:48:53.167 4088 3038296677368 MainThread DEBUG oslo_concurrency.lockutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "instance-00000001" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:48:53.167 4088 3038296677368 MainThread DEBUG oslo_concurrency.lockutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "instance-00000001" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:48:53.197 4088 3038296677368 MainThread DEBUG nova.block_device [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:48:53.197 4088 3038296677368 MainThread DEBUG os_win.utils.pathutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Creating directory: C:\openstack\instances\_base check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:48:53.197 4088 3038296677368 MainThread DEBUG oslo_concurrency.lockutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:48:58.229 4088 3038296676840 GreenThread-3 DEBUG nova.network.neutron [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Successfully created port: 829c891f-1877-4967-a719-113170bb7add _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:49:03.072 4088 3038296676840 GreenThread-3 DEBUG nova.network.neutron [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Successfully updated port: 829c891f-1877-4967-a719-113170bb7add _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:49:03.103 4088 3038296676840 GreenThread-3 DEBUG oslo_concurrency.lockutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Acquired lock "refresh_cache-18930e09-cd62-4d3e-b27f-e9541dfa3efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:49:03.103 4088 3038296676840 GreenThread-3 DEBUG nova.network.neutron [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:49:03.294 4088 3038296676840 GreenThread-3 DEBUG nova.network.neutron [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:49:05.183 4088 3038296676840 GreenThread-3 DEBUG nova.network.neutron [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Updating instance_info_cache with network_info: [{"id": "829c891f-1877-4967-a719-113170bb7add", "address": "fa:16:3e:5d:ef:74", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap829c891f-18", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:49:05.243 4088 3038296676840 GreenThread-3 DEBUG oslo_concurrency.lockutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Releasing lock "refresh_cache-18930e09-cd62-4d3e-b27f-e9541dfa3efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:49:05.243 4088 3038296676840 GreenThread-3 DEBUG nova.compute.manager [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Instance network_info: |[{"id": "829c891f-1877-4967-a719-113170bb7add", "address": "fa:16:3e:5d:ef:74", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap829c891f-18", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:49:06.168 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-e20455eb-0f0c-47d4-8f3f-3c5e1916402f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Received event network-changed-829c891f-1877-4967-a719-113170bb7add external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:49:06.168 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-e20455eb-0f0c-47d4-8f3f-3c5e1916402f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Refreshing instance network info cache due to event network-changed-829c891f-1877-4967-a719-113170bb7add. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:49:06.168 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-e20455eb-0f0c-47d4-8f3f-3c5e1916402f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-18930e09-cd62-4d3e-b27f-e9541dfa3efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:49:06.168 4088 3038296678248 MainThread DEBUG nova.network.neutron [req-e20455eb-0f0c-47d4-8f3f-3c5e1916402f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Refreshing network info cache for port 829c891f-1877-4967-a719-113170bb7add _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:49:08.060 4088 3038296678248 MainThread DEBUG nova.network.neutron [req-e20455eb-0f0c-47d4-8f3f-3c5e1916402f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Updated VIF entry in instance network info cache for port 829c891f-1877-4967-a719-113170bb7add. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:49:08.060 4088 3038296678248 MainThread DEBUG nova.network.neutron [req-e20455eb-0f0c-47d4-8f3f-3c5e1916402f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Updating instance_info_cache with network_info: [{"id": "829c891f-1877-4967-a719-113170bb7add", "address": "fa:16:3e:5d:ef:74", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap829c891f-18", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:49:08.060 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-e20455eb-0f0c-47d4-8f3f-3c5e1916402f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-18930e09-cd62-4d3e-b27f-e9541dfa3efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:49:11.883 4088 3038296677368 MainThread DEBUG oslo_concurrency.lockutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 18.687s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:11.902 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:11.916 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:49:12.010 4088 3038296677368 MainThread DEBUG os_win.utils.pathutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Creating directory: C:\openstack\instances\instance-00000001 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:49:12.010 4088 3038296677368 MainThread DEBUG nova.virt.hyperv.vmops [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000001\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:49:12.104 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:12.104 4088 3038296678072 MainThread DEBUG nova.virt.hardware [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:49:12.104 4088 3038296678072 MainThread INFO nova.compute.claims [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Claim successful on node n-h2-808474-1 2021-09-10 16:49:12.149 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "e81b57e5-a1e7-417d-9607-9f17f3aeafdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:12.188 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:49:12.415 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.hostops [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:49:12.431 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.hostops [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:49:12.446 4088 3038296677368 MainThread DEBUG nova.virt.hyperv.vmops [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Resizing VHD C:\openstack\instances\instance-00000001\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:49:12.667 4088 3038296677368 MainThread DEBUG nova.compute.manager [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Preparing to wait for external event network-vif-plugged-829c891f-1877-4967-a719-113170bb7add prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:49:12.688 4088 3038296677368 MainThread DEBUG oslo_concurrency.lockutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:12.688 4088 3038296677368 MainThread DEBUG oslo_concurrency.lockutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:12.688 4088 3038296677368 MainThread DEBUG os_win.utils.compute.vmutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Creating VM instance-00000001 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:49:12.697 4088 3038296678072 MainThread DEBUG nova.compute.provider_tree [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:49:12.719 4088 3038296678072 MainThread DEBUG nova.scheduler.client.report [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:49:12.719 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.609s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:12.719 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:49:12.719 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.265s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:12.719 4088 3038296677896 MainThread DEBUG nova.virt.hardware [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:49:12.719 4088 3038296677896 MainThread INFO nova.compute.claims [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Claim successful on node n-h2-808474-1 2021-09-10 16:49:12.844 4088 3038296678072 MainThread DEBUG nova.compute.utils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:49:12.844 4088 3038296678248 GreenThread-4 DEBUG nova.compute.manager [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:49:12.844 4088 3038296678248 GreenThread-4 DEBUG nova.network.neutron [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:49:12.875 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:49:13.000 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.hostops [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:49:13.015 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.hostops [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:49:13.090 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:49:13.110 4088 3038296678072 MainThread INFO nova.virt.hyperv.vmops [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Spawning new instance 2021-09-10 16:49:13.321 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "instance-00000003" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:13.321 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "instance-00000003" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:13.321 4088 3038296678072 MainThread DEBUG nova.block_device [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:49:13.321 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:13.321 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:13.343 4088 3038296677896 MainThread DEBUG nova.compute.provider_tree [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:49:13.343 4088 3038296678248 GreenThread-4 DEBUG nova.policy [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36997d263ab641e1b1795fe750910e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dd22cbf0e64cd6ac8defc3abc48a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:49:13.356 4088 3038296678072 MainThread DEBUG os_win.utils.pathutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Creating directory: C:\openstack\instances\instance-00000003 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:49:13.356 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000003\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:49:13.356 4088 3038296677896 MainThread DEBUG nova.scheduler.client.report [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:49:13.356 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.641s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:13.356 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:49:13.480 4088 3038296677896 MainThread DEBUG nova.compute.utils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:49:13.480 4088 3038300664056 GreenThread-5 DEBUG nova.compute.manager [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:49:13.480 4088 3038300664056 GreenThread-5 DEBUG nova.network.neutron [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:49:13.512 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:49:13.714 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Resizing VHD C:\openstack\instances\instance-00000003\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:49:13.727 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:49:13.727 4088 3038300664056 GreenThread-5 DEBUG nova.policy [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fac7f2174628404cb8576928225b4394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8236f1477243dfafd0682b608fc659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:49:13.793 4088 3038296677896 MainThread INFO nova.virt.hyperv.vmops [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Spawning new instance 2021-09-10 16:49:13.793 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "instance-00000004" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:13.808 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "instance-00000004" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:13.808 4088 3038296677896 MainThread DEBUG nova.block_device [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:49:13.808 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:13.808 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:13.808 4088 3038296677896 MainThread DEBUG os_win.utils.pathutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Creating directory: C:\openstack\instances\instance-00000004 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:49:13.822 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.vmops [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000004\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:49:14.103 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.vmops [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Resizing VHD C:\openstack\instances\instance-00000004\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:49:14.755 4088 3038296677368 MainThread DEBUG nova.virt.hyperv.vmops [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:49:15.712 4088 3038300664056 GreenThread-5 DEBUG nova.network.neutron [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Successfully created port: 5cc5f59c-ef6e-4ba0-b041-e283e7d8339a _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:49:16.454 4088 3038296678248 GreenThread-4 DEBUG nova.network.neutron [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Successfully created port: e94d3f34-4aa5-46a2-9cf3-221c28446067 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:49:17.970 4088 3038300664056 GreenThread-5 DEBUG nova.network.neutron [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Successfully updated port: 5cc5f59c-ef6e-4ba0-b041-e283e7d8339a _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:49:17.993 4088 3038300664056 GreenThread-5 DEBUG oslo_concurrency.lockutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Acquired lock "refresh_cache-e81b57e5-a1e7-417d-9607-9f17f3aeafdd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:49:17.993 4088 3038300664056 GreenThread-5 DEBUG nova.network.neutron [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:49:18.134 4088 3038300664760 MainThread DEBUG nova.compute.manager [req-7fc6caee-7f0e-49fa-9e98-72842c3a88e5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Received event network-changed-5cc5f59c-ef6e-4ba0-b041-e283e7d8339a external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:49:18.134 4088 3038300664760 MainThread DEBUG nova.compute.manager [req-7fc6caee-7f0e-49fa-9e98-72842c3a88e5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Refreshing instance network info cache due to event network-changed-5cc5f59c-ef6e-4ba0-b041-e283e7d8339a. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:49:18.298 4088 3038296678248 GreenThread-4 DEBUG nova.network.neutron [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Successfully updated port: e94d3f34-4aa5-46a2-9cf3-221c28446067 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:49:18.330 4088 3038300664056 GreenThread-5 DEBUG nova.network.neutron [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:49:18.337 4088 3038296678248 GreenThread-4 DEBUG oslo_concurrency.lockutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Acquired lock "refresh_cache-ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:49:18.337 4088 3038296678248 GreenThread-4 DEBUG nova.network.neutron [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:49:18.914 4088 3038296678248 GreenThread-4 DEBUG nova.network.neutron [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:49:19.391 4088 3038300664056 GreenThread-5 DEBUG nova.network.neutron [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Updating instance_info_cache with network_info: [{"id": "5cc5f59c-ef6e-4ba0-b041-e283e7d8339a", "address": "fa:16:3e:3e:97:15", "network": {"id": "03c1eefd-030f-414f-b7f8-81ed611f877f", "bridge": null, "label": "tempest-LiveMigrationTest-812207682-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fa8236f1477243dfafd0682b608fc659", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap5cc5f59c-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:49:19.416 4088 3038300664056 GreenThread-5 DEBUG oslo_concurrency.lockutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Releasing lock "refresh_cache-e81b57e5-a1e7-417d-9607-9f17f3aeafdd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:49:19.416 4088 3038300664056 GreenThread-5 DEBUG nova.compute.manager [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Instance network_info: |[{"id": "5cc5f59c-ef6e-4ba0-b041-e283e7d8339a", "address": "fa:16:3e:3e:97:15", "network": {"id": "03c1eefd-030f-414f-b7f8-81ed611f877f", "bridge": null, "label": "tempest-LiveMigrationTest-812207682-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fa8236f1477243dfafd0682b608fc659", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap5cc5f59c-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:49:19.416 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Preparing to wait for external event network-vif-plugged-5cc5f59c-ef6e-4ba0-b041-e283e7d8339a prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:49:19.416 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "e81b57e5-a1e7-417d-9607-9f17f3aeafdd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:19.416 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "e81b57e5-a1e7-417d-9607-9f17f3aeafdd-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:19.416 4088 3038296677896 MainThread DEBUG os_win.utils.compute.vmutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Creating VM instance-00000004 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:49:19.416 4088 3038300664760 MainThread DEBUG oslo_concurrency.lockutils [req-7fc6caee-7f0e-49fa-9e98-72842c3a88e5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-e81b57e5-a1e7-417d-9607-9f17f3aeafdd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:49:19.416 4088 3038300664760 MainThread DEBUG nova.network.neutron [req-7fc6caee-7f0e-49fa-9e98-72842c3a88e5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Refreshing network info cache for port 5cc5f59c-ef6e-4ba0-b041-e283e7d8339a _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:49:19.915 4088 3038296678248 GreenThread-4 DEBUG nova.network.neutron [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Updating instance_info_cache with network_info: [{"id": "e94d3f34-4aa5-46a2-9cf3-221c28446067", "address": "fa:16:3e:bd:9b:a0", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape94d3f34-4a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:49:19.966 4088 3038296678248 GreenThread-4 DEBUG oslo_concurrency.lockutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Releasing lock "refresh_cache-ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:49:19.966 4088 3038296678248 GreenThread-4 DEBUG nova.compute.manager [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Instance network_info: |[{"id": "e94d3f34-4aa5-46a2-9cf3-221c28446067", "address": "fa:16:3e:bd:9b:a0", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape94d3f34-4a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:49:19.966 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Preparing to wait for external event network-vif-plugged-e94d3f34-4aa5-46a2-9cf3-221c28446067 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:49:19.966 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:19.966 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:19.966 4088 3038296678072 MainThread DEBUG os_win.utils.compute.vmutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Creating VM instance-00000003 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:49:20.822 4088 3038300664408 MainThread DEBUG nova.compute.manager [req-a97ae2eb-60a7-4927-a1cb-cd76d308f230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Received event network-changed-e94d3f34-4aa5-46a2-9cf3-221c28446067 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:49:20.822 4088 3038300664408 MainThread DEBUG nova.compute.manager [req-a97ae2eb-60a7-4927-a1cb-cd76d308f230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Refreshing instance network info cache due to event network-changed-e94d3f34-4aa5-46a2-9cf3-221c28446067. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:49:20.822 4088 3038300664408 MainThread DEBUG oslo_concurrency.lockutils [req-a97ae2eb-60a7-4927-a1cb-cd76d308f230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:49:20.840 4088 3038300664408 MainThread DEBUG nova.network.neutron [req-a97ae2eb-60a7-4927-a1cb-cd76d308f230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Refreshing network info cache for port e94d3f34-4aa5-46a2-9cf3-221c28446067 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:49:21.149 4088 3038300664760 MainThread DEBUG nova.network.neutron [req-7fc6caee-7f0e-49fa-9e98-72842c3a88e5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Updated VIF entry in instance network info cache for port 5cc5f59c-ef6e-4ba0-b041-e283e7d8339a. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:49:21.149 4088 3038300664760 MainThread DEBUG nova.network.neutron [req-7fc6caee-7f0e-49fa-9e98-72842c3a88e5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Updating instance_info_cache with network_info: [{"id": "5cc5f59c-ef6e-4ba0-b041-e283e7d8339a", "address": "fa:16:3e:3e:97:15", "network": {"id": "03c1eefd-030f-414f-b7f8-81ed611f877f", "bridge": null, "label": "tempest-LiveMigrationTest-812207682-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fa8236f1477243dfafd0682b608fc659", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap5cc5f59c-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:49:21.196 4088 3038300664760 MainThread DEBUG oslo_concurrency.lockutils [req-7fc6caee-7f0e-49fa-9e98-72842c3a88e5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-e81b57e5-a1e7-417d-9607-9f17f3aeafdd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:49:21.539 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.vmops [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:49:21.886 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:49:22.336 4088 3038300664408 MainThread DEBUG nova.network.neutron [req-a97ae2eb-60a7-4927-a1cb-cd76d308f230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Updated VIF entry in instance network info cache for port e94d3f34-4aa5-46a2-9cf3-221c28446067. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:49:22.336 4088 3038300664408 MainThread DEBUG nova.network.neutron [req-a97ae2eb-60a7-4927-a1cb-cd76d308f230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Updating instance_info_cache with network_info: [{"id": "e94d3f34-4aa5-46a2-9cf3-221c28446067", "address": "fa:16:3e:bd:9b:a0", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape94d3f34-4a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:49:22.368 4088 3038300664408 MainThread DEBUG oslo_concurrency.lockutils [req-a97ae2eb-60a7-4927-a1cb-cd76d308f230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:49:25.228 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-dd9652a1-3fd0-4f0a-ac0a-384e357fb723 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Received event network-vif-plugged-829c891f-1877-4967-a719-113170bb7add external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:49:25.228 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-dd9652a1-3fd0-4f0a-ac0a-384e357fb723 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:25.228 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-dd9652a1-3fd0-4f0a-ac0a-384e357fb723 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:25.228 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-dd9652a1-3fd0-4f0a-ac0a-384e357fb723 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Processing event network-vif-plugged-829c891f-1877-4967-a719-113170bb7add _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:49:25.289 4088 3038296677368 MainThread INFO nova.virt.hyperv.vmops [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Using config drive for instance 2021-09-10 16:49:25.555 4088 3038296677368 MainThread INFO nova.virt.hyperv.vmops [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Creating config drive at C:\openstack\instances\instance-00000001\configdrive.iso 2021-09-10 16:49:25.650 4088 3038296677368 MainThread DEBUG oslo_concurrency.processutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000001\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp_fzqfu2x execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:49:26.260 4088 3038296677368 MainThread DEBUG oslo_concurrency.processutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000001\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp_fzqfu2x" returned: 0 in 0.609s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:49:26.712 4088 3038296677368 MainThread DEBUG nova.virt.hyperv.vmops [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Setting boot order for instance: instance-00000001: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:49:26.806 4088 3038296677368 MainThread DEBUG nova.virt.hyperv.vmops [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:49:26.869 4088 3038296677368 MainThread DEBUG os_win.utils.jobutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Waiting for WMI job: {'InstanceID': '50A0C272-9861-4290-9F72-2F09D115FB6C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21033), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:49:27.836 4088 3038296677368 MainThread DEBUG os_win.utils.jobutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] WMI job succeeded: {'InstanceID': '50A0C272-9861-4290-9F72-2F09D115FB6C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=979274), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:49:27.836 4088 3038296677368 MainThread DEBUG os_win.utils.compute.vmutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Successfully changed vm state of instance-00000001 to 2 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:49:27.836 4088 3038296677368 MainThread DEBUG nova.virt.hyperv.vmops [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Successfully changed state of VM instance-00000001 to: 2 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:49:27.836 4088 3038296677368 MainThread INFO nova.compute.manager [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Took 34.77 seconds to spawn the instance on the hypervisor. 2021-09-10 16:49:27.836 4088 3038296677368 MainThread DEBUG nova.compute.manager [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:49:27.836 4088 3038296677368 MainThread DEBUG nova.virt.hyperv.vmops [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:49:27.836 4088 3038296678248 MainThread DEBUG nova.virt.driver [-] Emitting event Started> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:49:27.859 4088 3038296678248 MainThread INFO nova.compute.manager [-] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] VM Started (Lifecycle Event) 2021-09-10 16:49:27.859 4088 3038300758088 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000001" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:27.883 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-1bd94860-e09c-447e-acb3-74f77de5c0bb - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:49:27.883 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-1bd94860-e09c-447e-acb3-74f77de5c0bb - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:49:27.903 4088 3038300758088 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000001" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.047s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:27.950 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-1bd94860-e09c-447e-acb3-74f77de5c0bb - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:49:28.009 4088 3038296678248 MainThread INFO nova.compute.manager [req-1bd94860-e09c-447e-acb3-74f77de5c0bb - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:49:28.104 4088 3038296677368 MainThread INFO nova.compute.manager [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Took 36.37 seconds to build instance. 2021-09-10 16:49:28.149 4088 3038296677368 MainThread DEBUG oslo_concurrency.lockutils [req-5602d68a-14ce-47c4-9d65-7f7691f28237 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 36.766s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:28.610 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:49:29.075 4088 3038296677368 MainThread DEBUG nova.compute.manager [req-c4ccd7ea-f4e9-4293-ac50-baeae894b01d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Received event network-vif-plugged-5cc5f59c-ef6e-4ba0-b041-e283e7d8339a external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:49:29.075 4088 3038296677368 MainThread DEBUG oslo_concurrency.lockutils [req-c4ccd7ea-f4e9-4293-ac50-baeae894b01d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "e81b57e5-a1e7-417d-9607-9f17f3aeafdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:29.075 4088 3038296677368 MainThread DEBUG oslo_concurrency.lockutils [req-c4ccd7ea-f4e9-4293-ac50-baeae894b01d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "e81b57e5-a1e7-417d-9607-9f17f3aeafdd-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:29.075 4088 3038296677368 MainThread DEBUG nova.compute.manager [req-c4ccd7ea-f4e9-4293-ac50-baeae894b01d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Processing event network-vif-plugged-5cc5f59c-ef6e-4ba0-b041-e283e7d8339a _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:49:29.108 4088 3038296677896 MainThread INFO nova.virt.hyperv.vmops [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Using config drive for instance 2021-09-10 16:49:29.481 4088 3038296677896 MainThread INFO nova.virt.hyperv.vmops [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Creating config drive at C:\openstack\instances\instance-00000004\configdrive.iso 2021-09-10 16:49:29.575 4088 3038296677896 MainThread DEBUG oslo_concurrency.processutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000004\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpxp8e8sj7 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:49:29.717 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:49:29.717 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:49:29.717 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:49:29.744 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:49:29.759 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:49:29.759 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:49:29.759 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 16:49:29.915 4088 3038296677896 MainThread DEBUG oslo_concurrency.processutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000004\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpxp8e8sj7" returned: 0 in 0.343s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:49:30.275 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.vmops [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Setting boot order for instance: instance-00000004: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:49:30.360 4088 3038296677368 MainThread DEBUG oslo_concurrency.lockutils [req-39508c7c-f0d5-4a89-854b-b6571cc499dd bcf379ccbce7472ea38ae42b26805a62 2d3bdc7b0e1b47dba055ecd8a8506532 - default default] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:30.360 4088 3038296677368 MainThread DEBUG oslo_concurrency.lockutils [req-39508c7c-f0d5-4a89-854b-b6571cc499dd bcf379ccbce7472ea38ae42b26805a62 2d3bdc7b0e1b47dba055ecd8a8506532 - default default] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:30.360 4088 3038296677368 MainThread DEBUG oslo_concurrency.lockutils [req-39508c7c-f0d5-4a89-854b-b6571cc499dd bcf379ccbce7472ea38ae42b26805a62 2d3bdc7b0e1b47dba055ecd8a8506532 - default default] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:30.360 4088 3038296677368 MainThread ERROR nova.compute.manager [req-39508c7c-f0d5-4a89-854b-b6571cc499dd bcf379ccbce7472ea38ae42b26805a62 2d3bdc7b0e1b47dba055ecd8a8506532 - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Setting instance vm_state to ERROR: NameError: name 'instant' is not defined 2021-09-10 16:49:30.360 4088 3038296677368 MainThread TRACE nova.compute.manager [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Traceback (most recent call last): 2021-09-10 16:49:30.360 4088 3038296677368 MainThread TRACE nova.compute.manager [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:49:30.360 4088 3038296677368 MainThread TRACE nova.compute.manager [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] self._delete_instance(context, instance, bdms) 2021-09-10 16:49:30.360 4088 3038296677368 MainThread TRACE nova.compute.manager [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:49:30.360 4088 3038296677368 MainThread TRACE nova.compute.manager [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:49:30.360 4088 3038296677368 MainThread TRACE nova.compute.manager [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] NameError: name 'instant' is not defined 2021-09-10 16:49:30.360 4088 3038296677368 MainThread TRACE nova.compute.manager [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] 2021-09-10 16:49:30.385 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.vmops [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:49:30.399 4088 3038296677896 MainThread DEBUG os_win.utils.jobutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Waiting for WMI job: {'InstanceID': 'C1453C84-D012-467E-B714-B2BDE3DA0FE1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17061), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:49:30.507 4088 3038296677368 MainThread DEBUG oslo_concurrency.lockutils [req-39508c7c-f0d5-4a89-854b-b6571cc499dd bcf379ccbce7472ea38ae42b26805a62 2d3bdc7b0e1b47dba055ecd8a8506532 - default default] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc" released by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 0.156s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:30.570 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:49:30.570 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 16:49:30.570 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9342 2021-09-10 16:49:30.590 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Skipping network cache update for instance because it is being deleted. _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9356 2021-09-10 16:49:30.590 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Skipping network cache update for instance because it is Building. _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9352 2021-09-10 16:49:30.590 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Skipping network cache update for instance because it is Building. _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9352 2021-09-10 16:49:30.590 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Didn't find any instances for network info cache update. _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9424 2021-09-10 16:49:30.617 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:49:30.636 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:30.636 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:30.636 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 16:49:30.636 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:49:30.658 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:49:30.679 4088 3038296677368 MainThread DEBUG oslo_concurrency.lockutils [req-39508c7c-f0d5-4a89-854b-b6571cc499dd bcf379ccbce7472ea38ae42b26805a62 2d3bdc7b0e1b47dba055ecd8a8506532 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:30.700 4088 3038296677368 MainThread DEBUG nova.virt.hyperv.hostops [req-39508c7c-f0d5-4a89-854b-b6571cc499dd bcf379ccbce7472ea38ae42b26805a62 2d3bdc7b0e1b47dba055ecd8a8506532 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:49:30.729 4088 3038296677368 MainThread DEBUG nova.virt.hyperv.hostops [req-39508c7c-f0d5-4a89-854b-b6571cc499dd bcf379ccbce7472ea38ae42b26805a62 2d3bdc7b0e1b47dba055ecd8a8506532 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:49:30.774 4088 3038296678248 MainThread DEBUG nova.virt.driver [-] Emitting event Started> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:49:30.774 4088 3038296678248 MainThread INFO nova.compute.manager [-] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] VM Started (Lifecycle Event) 2021-09-10 16:49:30.774 4088 3038300758088 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000004" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:30.809 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-ca8ba5bb-8400-4677-b67a-711b729fbc11 - - - - -] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:49:30.809 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-ca8ba5bb-8400-4677-b67a-711b729fbc11 - - - - -] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:49:30.809 4088 3038296677896 MainThread DEBUG os_win.utils.jobutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] WMI job succeeded: {'InstanceID': 'C1453C84-D012-467E-B714-B2BDE3DA0FE1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=339917), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:49:30.809 4088 3038296677896 MainThread DEBUG os_win.utils.compute.vmutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Successfully changed vm state of instance-00000004 to 2 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:49:30.809 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.vmops [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Successfully changed state of VM instance-00000004 to: 2 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:49:30.809 4088 3038296677896 MainThread INFO nova.compute.manager [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Took 17.08 seconds to spawn the instance on the hypervisor. 2021-09-10 16:49:30.809 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:49:30.809 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.vmops [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:49:30.853 4088 3038300758088 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000004" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.078s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:30.906 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-ca8ba5bb-8400-4677-b67a-711b729fbc11 - - - - -] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:49:30.947 4088 3038296678248 MainThread INFO nova.compute.manager [req-ca8ba5bb-8400-4677-b67a-711b729fbc11 - - - - -] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:49:31.008 4088 3038296677368 MainThread DEBUG nova.compute.provider_tree [req-39508c7c-f0d5-4a89-854b-b6571cc499dd bcf379ccbce7472ea38ae42b26805a62 2d3bdc7b0e1b47dba055ecd8a8506532 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:49:31.024 4088 3038296677896 MainThread INFO nova.compute.manager [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Took 18.62 seconds to build instance. 2021-09-10 16:49:31.024 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=12816MB free_disk=62GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 16:49:31.024 4088 3038296677368 MainThread DEBUG nova.scheduler.client.report [req-39508c7c-f0d5-4a89-854b-b6571cc499dd bcf379ccbce7472ea38ae42b26805a62 2d3bdc7b0e1b47dba055ecd8a8506532 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:49:31.024 4088 3038296677368 MainThread DEBUG oslo_concurrency.lockutils [req-39508c7c-f0d5-4a89-854b-b6571cc499dd bcf379ccbce7472ea38ae42b26805a62 2d3bdc7b0e1b47dba055ecd8a8506532 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:31.024 4088 3038296677368 MainThread INFO nova.compute.manager [req-39508c7c-f0d5-4a89-854b-b6571cc499dd bcf379ccbce7472ea38ae42b26805a62 2d3bdc7b0e1b47dba055ecd8a8506532 - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Successfully reverted task state from deleting on failure for instance. 2021-09-10 16:49:31.024 4088 3038296677368 MainThread ERROR oslo_messaging.rpc.server [req-39508c7c-f0d5-4a89-854b-b6571cc499dd bcf379ccbce7472ea38ae42b26805a62 2d3bdc7b0e1b47dba055ecd8a8506532 - default default] Exception during message handling: NameError: name 'instant' is not defined 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server Traceback (most recent call last): 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 72, in wrapped 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server context, exc, binary) 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server return f(self, context, *args, **kw) 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 184, in decorated_function 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server "Error: %s", e, instance=instance) 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 154, in decorated_function 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\utils.py", line 1433, in decorated_function 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 200, in decorated_function 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3106, in terminate_instance 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server do_terminate_instance(instance, bdms) 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_concurrency\lockutils.py", line 360, in inner 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server return f(*args, **kwargs) 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3104, in do_terminate_instance 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server self._set_instance_obj_error_state(instance) 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server self._delete_instance(context, instance, bdms) 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server NameError: name 'instant' is not defined 2021-09-10 16:49:31.024 4088 3038296677368 MainThread TRACE oslo_messaging.rpc.server 2021-09-10 16:49:31.086 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.062s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:31.101 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-116226ad-5625-4dae-a076-ce8ba71e1407 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "e81b57e5-a1e7-417d-9607-9f17f3aeafdd" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.953s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:31.211 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:49:31.211 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:49:31.211 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance e81b57e5-a1e7-417d-9607-9f17f3aeafdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:49:31.211 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 3 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 16:49:31.211 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=3584MB phys_disk=79GB used_disk=3GB total_vcpus=6 used_vcpus=3 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 16:49:31.243 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:49:31.259 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:49:31.292 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-2bd761fc-1692-4ed1-89f9-2e5ba74a03cf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Received event network-vif-plugged-e94d3f34-4aa5-46a2-9cf3-221c28446067 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:49:31.292 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-2bd761fc-1692-4ed1-89f9-2e5ba74a03cf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:31.292 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-2bd761fc-1692-4ed1-89f9-2e5ba74a03cf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:31.292 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-2bd761fc-1692-4ed1-89f9-2e5ba74a03cf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Processing event network-vif-plugged-e94d3f34-4aa5-46a2-9cf3-221c28446067 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:49:31.310 4088 3038296678072 MainThread INFO nova.virt.hyperv.vmops [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Using config drive for instance 2021-09-10 16:49:31.501 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:49:31.514 4088 3038296678072 MainThread INFO nova.virt.hyperv.vmops [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Creating config drive at C:\openstack\instances\instance-00000003\configdrive.iso 2021-09-10 16:49:31.591 4088 3038296678072 MainThread DEBUG oslo_concurrency.processutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000003\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmppivr2jwl execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:49:31.732 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:49:31.732 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 16:49:31.732 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.641s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:31.976 4088 3038296678072 MainThread DEBUG oslo_concurrency.processutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000003\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmppivr2jwl" returned: 0 in 0.391s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:49:32.308 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Setting boot order for instance: instance-00000003: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:49:32.398 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:49:32.454 4088 3038296678072 MainThread DEBUG os_win.utils.jobutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Waiting for WMI job: {'InstanceID': '73997FE4-D529-4AD4-B05F-9770E0E02A85', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=23699), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:49:32.853 4088 3038296678248 MainThread DEBUG nova.virt.driver [-] Emitting event Started> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:49:32.853 4088 3038296678248 MainThread INFO nova.compute.manager [-] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] VM Started (Lifecycle Event) 2021-09-10 16:49:32.853 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000003" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:32.853 4088 3038296678072 MainThread DEBUG os_win.utils.jobutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] WMI job succeeded: {'InstanceID': '73997FE4-D529-4AD4-B05F-9770E0E02A85', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=394038), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:49:32.853 4088 3038296678072 MainThread DEBUG os_win.utils.compute.vmutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Successfully changed vm state of instance-00000003 to 2 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:49:32.853 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Successfully changed state of VM instance-00000003 to: 2 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:49:32.853 4088 3038296678072 MainThread INFO nova.compute.manager [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Took 19.77 seconds to spawn the instance on the hypervisor. 2021-09-10 16:49:32.853 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:49:32.853 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:49:32.869 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-b90e8b7b-5095-416d-a281-8365dbb7d1c5 - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:49:32.869 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-b90e8b7b-5095-416d-a281-8365dbb7d1c5 - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:49:32.884 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000003" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:32.931 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-b90e8b7b-5095-416d-a281-8365dbb7d1c5 - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:49:32.962 4088 3038296678248 MainThread INFO nova.compute.manager [req-b90e8b7b-5095-416d-a281-8365dbb7d1c5 - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:49:33.008 4088 3038296678072 MainThread INFO nova.compute.manager [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Took 20.97 seconds to build instance. 2021-09-10 16:49:33.039 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-00b2b184-d423-4f80-a694-f694a0221c34 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 21.140s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:33.852 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:33.867 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:49:33.961 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:33.976 4088 3038296678248 MainThread DEBUG nova.virt.hardware [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:49:33.976 4088 3038296678248 MainThread INFO nova.compute.claims [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Claim successful on node n-h2-808474-1 2021-09-10 16:49:34.103 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.hostops [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:49:34.118 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.hostops [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:49:34.352 4088 3038296678248 MainThread DEBUG nova.compute.provider_tree [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:49:34.385 4088 3038296678248 MainThread DEBUG nova.scheduler.client.report [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:49:34.385 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:34.385 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:49:34.470 4088 3038296678248 MainThread DEBUG nova.compute.utils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:49:34.476 4088 3038296678072 GreenThread-6 DEBUG nova.compute.manager [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:49:34.476 4088 3038296678072 GreenThread-6 DEBUG nova.network.neutron [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:49:34.493 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:49:34.648 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:49:34.673 4088 3038296678248 MainThread INFO nova.virt.hyperv.vmops [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Spawning new instance 2021-09-10 16:49:34.680 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "instance-00000008" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:34.680 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "instance-00000008" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:34.680 4088 3038296678248 MainThread DEBUG nova.block_device [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:49:34.680 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:34.680 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:34.698 4088 3038296678248 MainThread DEBUG os_win.utils.pathutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Creating directory: C:\openstack\instances\instance-00000008 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:49:34.698 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000008\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:49:34.836 4088 3038296678072 GreenThread-6 DEBUG nova.policy [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34cd40c589284ea9b37a6a75b63fd6b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606d7457fc884b1c8b24fa368c946f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:49:34.970 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Resizing VHD C:\openstack\instances\instance-00000008\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:49:35.530 4088 3038296678072 GreenThread-6 DEBUG nova.network.neutron [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Successfully created port: fecb5a04-48f6-4c8b-bb0f-748b812daefa _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:49:35.714 4088 3038300758792 MainThread DEBUG nova.virt.hyperv.livemigrationops [req-746bde86-693a-418e-8dd5-2f2943af58a4 631464703d054b39ab2dbb2ef12349bf 65f9947f24f541579df4a582376707cc - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] check_can_live_migrate_source called check_can_live_migrate_source c:\openstack\build\nova\nova\virt\hyperv\livemigrationops.py:153 2021-09-10 16:49:35.714 4088 3038300758792 MainThread DEBUG nova.compute.manager [req-746bde86-693a-418e-8dd5-2f2943af58a4 631464703d054b39ab2dbb2ef12349bf 65f9947f24f541579df4a582376707cc - default default] source check data is HyperVLiveMigrateData(is_shared_instance_path=False,is_volume_backed=False,migration=,old_vol_attachment_ids=,vifs=,wait_for_vif_plugged=) check_can_live_migrate_source c:\openstack\build\nova\nova\compute\manager.py:8151 2021-09-10 16:49:36.351 4088 3038296678072 GreenThread-6 DEBUG nova.network.neutron [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Successfully updated port: fecb5a04-48f6-4c8b-bb0f-748b812daefa _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:49:36.384 4088 3038296678072 GreenThread-6 DEBUG oslo_concurrency.lockutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Acquired lock "refresh_cache-66c5445c-c347-4833-8af8-58ba8ff6d95e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:49:36.384 4088 3038296678072 GreenThread-6 DEBUG nova.network.neutron [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:49:36.495 4088 3038296678072 GreenThread-6 DEBUG nova.network.neutron [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:49:36.557 4088 3038300759144 MainThread DEBUG oslo_concurrency.lockutils [-] Acquired lock "compute-rpcapi-router" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:49:36.557 4088 3038300759144 MainThread DEBUG oslo_concurrency.lockutils [-] Releasing lock "compute-rpcapi-router" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:49:36.918 4088 3038300758792 MainThread DEBUG nova.compute.manager [req-93b1d8c0-b079-46df-bd0d-bef57be8dcb9 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Received event network-changed-fecb5a04-48f6-4c8b-bb0f-748b812daefa external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:49:36.918 4088 3038300758792 MainThread DEBUG nova.compute.manager [req-93b1d8c0-b079-46df-bd0d-bef57be8dcb9 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Refreshing instance network info cache due to event network-changed-fecb5a04-48f6-4c8b-bb0f-748b812daefa. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:49:37.358 4088 3038296678072 GreenThread-6 DEBUG nova.network.neutron [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Updating instance_info_cache with network_info: [{"id": "fecb5a04-48f6-4c8b-bb0f-748b812daefa", "address": "fa:16:3e:2d:da:04", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfecb5a04-48", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:49:37.389 4088 3038296678072 GreenThread-6 DEBUG oslo_concurrency.lockutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Releasing lock "refresh_cache-66c5445c-c347-4833-8af8-58ba8ff6d95e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:49:37.389 4088 3038296678072 GreenThread-6 DEBUG nova.compute.manager [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Instance network_info: |[{"id": "fecb5a04-48f6-4c8b-bb0f-748b812daefa", "address": "fa:16:3e:2d:da:04", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfecb5a04-48", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:49:37.389 4088 3038300758792 MainThread DEBUG oslo_concurrency.lockutils [req-93b1d8c0-b079-46df-bd0d-bef57be8dcb9 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-66c5445c-c347-4833-8af8-58ba8ff6d95e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:49:37.389 4088 3038300758792 MainThread DEBUG nova.network.neutron [req-93b1d8c0-b079-46df-bd0d-bef57be8dcb9 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Refreshing network info cache for port fecb5a04-48f6-4c8b-bb0f-748b812daefa _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:49:37.389 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Preparing to wait for external event network-vif-plugged-fecb5a04-48f6-4c8b-bb0f-748b812daefa prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:49:37.389 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:37.400 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:37.400 4088 3038296678248 MainThread DEBUG os_win.utils.compute.vmutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Creating VM instance-00000008 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:49:38.750 4088 3038300758792 MainThread DEBUG nova.network.neutron [req-93b1d8c0-b079-46df-bd0d-bef57be8dcb9 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Updated VIF entry in instance network info cache for port fecb5a04-48f6-4c8b-bb0f-748b812daefa. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:49:38.750 4088 3038300758792 MainThread DEBUG nova.network.neutron [req-93b1d8c0-b079-46df-bd0d-bef57be8dcb9 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Updating instance_info_cache with network_info: [{"id": "fecb5a04-48f6-4c8b-bb0f-748b812daefa", "address": "fa:16:3e:2d:da:04", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfecb5a04-48", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:49:38.767 4088 3038300758792 MainThread DEBUG oslo_concurrency.lockutils [req-93b1d8c0-b079-46df-bd0d-bef57be8dcb9 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-66c5445c-c347-4833-8af8-58ba8ff6d95e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:49:39.072 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:39.088 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:49:39.258 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:39.258 4088 3038296678072 MainThread DEBUG nova.virt.hardware [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:49:39.258 4088 3038296678072 MainThread INFO nova.compute.claims [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Claim successful on node n-h2-808474-1 2021-09-10 16:49:39.407 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.hostops [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:49:39.413 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:49:39.434 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.hostops [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:49:39.695 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-d0773c27-c8fa-45a9-9a0b-8f277e9571f3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Received event network-vif-unplugged-5cc5f59c-ef6e-4ba0-b041-e283e7d8339a external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:49:39.720 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-d0773c27-c8fa-45a9-9a0b-8f277e9571f3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "e81b57e5-a1e7-417d-9607-9f17f3aeafdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:39.720 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-d0773c27-c8fa-45a9-9a0b-8f277e9571f3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "e81b57e5-a1e7-417d-9607-9f17f3aeafdd-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:39.726 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-d0773c27-c8fa-45a9-9a0b-8f277e9571f3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] No waiting events found dispatching network-vif-unplugged-5cc5f59c-ef6e-4ba0-b041-e283e7d8339a pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 16:49:39.726 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-d0773c27-c8fa-45a9-9a0b-8f277e9571f3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Received event network-vif-unplugged-5cc5f59c-ef6e-4ba0-b041-e283e7d8339a for instance with task_state migrating. _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10284 2021-09-10 16:49:39.726 4088 3038296678072 MainThread DEBUG nova.compute.provider_tree [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:49:39.746 4088 3038296678072 MainThread DEBUG nova.scheduler.client.report [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:49:39.746 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:39.746 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:49:39.837 4088 3038296678072 MainThread DEBUG nova.compute.utils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:49:39.837 4088 3038296677896 GreenThread-7 DEBUG nova.compute.manager [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:49:39.837 4088 3038296677896 GreenThread-7 DEBUG nova.network.neutron [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:49:39.868 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:49:40.102 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:49:40.133 4088 3038296678072 MainThread INFO nova.virt.hyperv.vmops [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Spawning new instance 2021-09-10 16:49:40.148 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "instance-00000009" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:40.148 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "instance-00000009" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:40.148 4088 3038296678072 MainThread DEBUG nova.block_device [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:49:40.148 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:40.148 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:40.164 4088 3038296678072 MainThread DEBUG os_win.utils.pathutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Creating directory: C:\openstack\instances\instance-00000009 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:49:40.164 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000009\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:49:40.524 4088 3038296677896 GreenThread-7 DEBUG nova.policy [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36997d263ab641e1b1795fe750910e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dd22cbf0e64cd6ac8defc3abc48a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:49:40.555 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Resizing VHD C:\openstack\instances\instance-00000009\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:49:40.639 4088 3038300759144 MainThread INFO nova.compute.manager [-] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Took 4.08 seconds for pre_live_migration on destination host n-h1-808474-1. 2021-09-10 16:49:40.670 4088 3038300759144 MainThread DEBUG nova.compute.manager [-] live_migration data is HyperVLiveMigrateData(is_shared_instance_path=False,is_volume_backed=False,migration=Migration(787c7022-786b-4bc3-8329-7c8c19b247fc),old_vol_attachment_ids={},vifs=[VIFMigrateData],wait_for_vif_plugged=True) _do_live_migration c:\openstack\build\nova\nova\compute\manager.py:8499 2021-09-10 16:49:40.670 4088 3038300759144 MainThread DEBUG nova.virt.hyperv.livemigrationops [-] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] live_migration called live_migration c:\openstack\build\nova\nova\virt\hyperv\livemigrationops.py:52 2021-09-10 16:49:40.670 4088 3038300759144 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000004" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:40.670 4088 3038300759144 MainThread INFO nova.virt.hyperv.serialconsoleops [-] Stopping instance instance-00000004 serial console handler. 2021-09-10 16:49:40.670 4088 3038300759144 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000004" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:40.704 4088 3038300759144 MainThread DEBUG os_win.utils.pathutils [-] Creating directory: \\n-h1-808474-1\C$\openstack\instances\instance-00000004 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:49:41.039 4088 3038300759144 MainThread DEBUG os_win.utils.compute.livemigrationutils [-] Getting live migration networks for host: n-h1-808474-1 _get_ip_address_list c:\openstack\build\os-win\os_win\utils\compute\livemigrationutils.py:172 2021-09-10 16:49:41.172 4088 3038300759144 MainThread DEBUG os_win.utils.compute.livemigrationutils [-] Starting live migration for VM: instance-00000004 _live_migrate_vm c:\openstack\build\os-win\os_win\utils\compute\livemigrationutils.py:162 2021-09-10 16:49:41.258 4088 3038300759144 MainThread DEBUG os_win.utils.jobutils [-] Waiting for WMI job: {'InstanceID': '05C8BAEA-3230-4BF6-95D6-B7C4CC60D234', 'Description': 'Moving Virtual Machine and Storage', 'ElementName': 'Moving Virtual Machine and Storage', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=32671), 'Cancellable': True, 'JobType': 306, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:49:41.949 4088 3038296677896 GreenThread-7 DEBUG nova.network.neutron [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Successfully created port: 83b451dc-a198-4ccd-9f65-c8fe6343aea3 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:49:42.304 4088 3038300758616 MainThread DEBUG nova.compute.manager [req-a9763130-b6fa-44a7-9034-13b1ed882e6c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Received event network-changed-5cc5f59c-ef6e-4ba0-b041-e283e7d8339a external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:49:42.304 4088 3038300758616 MainThread DEBUG nova.compute.manager [req-a9763130-b6fa-44a7-9034-13b1ed882e6c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Refreshing instance network info cache due to event network-changed-5cc5f59c-ef6e-4ba0-b041-e283e7d8339a. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:49:42.304 4088 3038300758616 MainThread DEBUG oslo_concurrency.lockutils [req-a9763130-b6fa-44a7-9034-13b1ed882e6c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-e81b57e5-a1e7-417d-9607-9f17f3aeafdd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:49:42.304 4088 3038300758616 MainThread DEBUG nova.network.neutron [req-a9763130-b6fa-44a7-9034-13b1ed882e6c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Refreshing network info cache for port 5cc5f59c-ef6e-4ba0-b041-e283e7d8339a _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:49:44.976 4088 3038296677896 GreenThread-7 DEBUG nova.network.neutron [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Successfully updated port: 83b451dc-a198-4ccd-9f65-c8fe6343aea3 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:49:44.992 4088 3038300758616 MainThread DEBUG nova.network.neutron [req-a9763130-b6fa-44a7-9034-13b1ed882e6c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Updated VIF entry in instance network info cache for port 5cc5f59c-ef6e-4ba0-b041-e283e7d8339a. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:49:44.992 4088 3038300758616 MainThread DEBUG nova.network.neutron [req-a9763130-b6fa-44a7-9034-13b1ed882e6c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Updating instance_info_cache with network_info: [{"id": "5cc5f59c-ef6e-4ba0-b041-e283e7d8339a", "address": "fa:16:3e:3e:97:15", "network": {"id": "03c1eefd-030f-414f-b7f8-81ed611f877f", "bridge": null, "label": "tempest-LiveMigrationTest-812207682-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fa8236f1477243dfafd0682b608fc659", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap5cc5f59c-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {"migrating_to": "n-h1-808474-1"}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:49:45.009 4088 3038296677896 GreenThread-7 DEBUG oslo_concurrency.lockutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Acquired lock "refresh_cache-18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:49:45.009 4088 3038296677896 GreenThread-7 DEBUG nova.network.neutron [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:49:45.023 4088 3038300758616 MainThread DEBUG oslo_concurrency.lockutils [req-a9763130-b6fa-44a7-9034-13b1ed882e6c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-e81b57e5-a1e7-417d-9607-9f17f3aeafdd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:49:45.431 4088 3038296677896 GreenThread-7 DEBUG nova.network.neutron [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:49:45.803 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:45.835 4088 3038300759320 MainThread DEBUG nova.compute.manager [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:49:45.985 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:45.985 4088 3038300759320 MainThread DEBUG nova.virt.hardware [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:49:45.985 4088 3038300759320 MainThread INFO nova.compute.claims [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Claim successful on node n-h2-808474-1 2021-09-10 16:49:46.087 4088 3038300758968 MainThread DEBUG nova.compute.manager [req-780fab1c-708f-4dde-8ded-106cfe072445 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Received event network-changed-83b451dc-a198-4ccd-9f65-c8fe6343aea3 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:49:46.087 4088 3038300758968 MainThread DEBUG nova.compute.manager [req-780fab1c-708f-4dde-8ded-106cfe072445 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Refreshing instance network info cache due to event network-changed-83b451dc-a198-4ccd-9f65-c8fe6343aea3. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:49:46.169 4088 3038300759320 MainThread DEBUG nova.virt.hyperv.hostops [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:49:46.183 4088 3038300759320 MainThread DEBUG nova.virt.hyperv.hostops [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:49:46.259 4088 3038300759144 MainThread DEBUG os_win.utils.jobutils [-] WMI job succeeded: {'InstanceID': '05C8BAEA-3230-4BF6-95D6-B7C4CC60D234', 'Description': 'Moving Virtual Machine and Storage', 'ElementName': 'Moving Virtual Machine and Storage', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(seconds=5, microseconds=4409), 'Cancellable': True, 'JobType': 306, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:49:46.259 4088 3038300759144 MainThread DEBUG nova.virt.hyperv.livemigrationops [-] Calling live migration post_method for instance: instance-00000004 live_migration c:\openstack\build\nova\nova\virt\hyperv\livemigrationops.py:86 2021-09-10 16:49:46.259 4088 3038300759144 MainThread INFO nova.compute.manager [-] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] _post_live_migration() is started.. 2021-09-10 16:49:46.259 4088 3038300759144 MainThread DEBUG os_win.utils.pathutils [-] Removing directory: C:\openstack\instances\instance-00000004 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:49:46.259 4088 3038300759144 MainThread DEBUG os_brick.utils [-] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:49:46.399 4088 3038300759144 MainThread DEBUG os_brick.utils [-] <== get_connector_properties: return (140ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:49:46.586 4088 3038300759320 MainThread DEBUG nova.compute.provider_tree [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:49:46.624 4088 3038300759320 MainThread DEBUG nova.scheduler.client.report [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:49:46.624 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:46.624 4088 3038300759320 MainThread DEBUG nova.compute.manager [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:49:46.682 4088 3038300760376 MainThread DEBUG nova.compute.manager [req-c1ab2a96-ec6d-4774-9495-b3e79074b70b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Received event network-vif-plugged-fecb5a04-48f6-4c8b-bb0f-748b812daefa external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:49:46.682 4088 3038300760376 MainThread DEBUG oslo_concurrency.lockutils [req-c1ab2a96-ec6d-4774-9495-b3e79074b70b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:46.682 4088 3038300760376 MainThread DEBUG oslo_concurrency.lockutils [req-c1ab2a96-ec6d-4774-9495-b3e79074b70b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:46.682 4088 3038300760376 MainThread DEBUG nova.compute.manager [req-c1ab2a96-ec6d-4774-9495-b3e79074b70b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Processing event network-vif-plugged-fecb5a04-48f6-4c8b-bb0f-748b812daefa _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:49:46.748 4088 3038296678248 MainThread INFO nova.virt.hyperv.vmops [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Using config drive for instance 2021-09-10 16:49:46.748 4088 3038296677896 GreenThread-7 DEBUG nova.network.neutron [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Updating instance_info_cache with network_info: [{"id": "83b451dc-a198-4ccd-9f65-c8fe6343aea3", "address": "fa:16:3e:44:7f:92", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap83b451dc-a1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:49:46.790 4088 3038300759320 MainThread DEBUG nova.compute.utils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:49:46.790 4088 3038300760376 GreenThread-8 DEBUG nova.compute.manager [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:49:46.790 4088 3038300760376 GreenThread-8 DEBUG nova.network.neutron [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:49:46.836 4088 3038296677896 GreenThread-7 DEBUG oslo_concurrency.lockutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Releasing lock "refresh_cache-18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:49:46.836 4088 3038296677896 GreenThread-7 DEBUG nova.compute.manager [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Instance network_info: |[{"id": "83b451dc-a198-4ccd-9f65-c8fe6343aea3", "address": "fa:16:3e:44:7f:92", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap83b451dc-a1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:49:46.836 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Preparing to wait for external event network-vif-plugged-83b451dc-a198-4ccd-9f65-c8fe6343aea3 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:49:46.836 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:46.836 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:46.836 4088 3038296678072 MainThread DEBUG os_win.utils.compute.vmutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Creating VM instance-00000009 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:49:46.836 4088 3038300758968 MainThread DEBUG oslo_concurrency.lockutils [req-780fab1c-708f-4dde-8ded-106cfe072445 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:49:46.836 4088 3038300758968 MainThread DEBUG nova.network.neutron [req-780fab1c-708f-4dde-8ded-106cfe072445 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Refreshing network info cache for port 83b451dc-a198-4ccd-9f65-c8fe6343aea3 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:49:46.853 4088 3038300759320 MainThread DEBUG nova.compute.manager [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:49:47.093 4088 3038296678248 MainThread INFO nova.virt.hyperv.vmops [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Creating config drive at C:\openstack\instances\instance-00000008\configdrive.iso 2021-09-10 16:49:47.195 4088 3038296678248 MainThread DEBUG oslo_concurrency.processutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000008\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp_mzvd6lx execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:49:47.376 4088 3038300760376 GreenThread-8 DEBUG nova.policy [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '629a58532a634973a9ee2b10acefe414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f46359cd494289810bf96e1168e5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:49:47.383 4088 3038300759320 MainThread DEBUG nova.compute.manager [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:49:47.406 4088 3038300759320 MainThread INFO nova.virt.hyperv.vmops [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Spawning new instance 2021-09-10 16:49:47.416 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Lock "instance-0000000b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:47.416 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Lock "instance-0000000b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:47.416 4088 3038300759320 MainThread DEBUG nova.block_device [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:49:47.416 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:47.416 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:47.416 4088 3038300759320 MainThread DEBUG os_win.utils.pathutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Creating directory: C:\openstack\instances\instance-0000000b check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:49:47.416 4088 3038300759320 MainThread DEBUG nova.virt.hyperv.vmops [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000000b\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:49:47.585 4088 3038296678248 MainThread DEBUG oslo_concurrency.processutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000008\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp_mzvd6lx" returned: 0 in 0.390s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:49:47.745 4088 3038300759320 MainThread DEBUG nova.virt.hyperv.vmops [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Resizing VHD C:\openstack\instances\instance-0000000b\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:49:47.820 4088 3038300759144 MainThread DEBUG nova.network.neutron [-] Activated binding for port 5cc5f59c-ef6e-4ba0-b041-e283e7d8339a and host n-h1-808474-1 migrate_instance_start c:\openstack\build\nova\nova\network\neutron.py:3012 2021-09-10 16:49:47.820 4088 3038300759144 MainThread DEBUG nova.compute.manager [-] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Calling driver.post_live_migration_at_source with original source VIFs from migrate_data: [{"id": "5cc5f59c-ef6e-4ba0-b041-e283e7d8339a", "address": "fa:16:3e:3e:97:15", "network": {"id": "03c1eefd-030f-414f-b7f8-81ed611f877f", "bridge": null, "label": "tempest-LiveMigrationTest-812207682-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fa8236f1477243dfafd0682b608fc659", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap5cc5f59c-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] _post_live_migration c:\openstack\build\nova\nova\compute\manager.py:8815 2021-09-10 16:49:47.820 4088 3038300759144 MainThread DEBUG nova.compute.manager [-] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Hypervisor driver does not support post_live_migration_at_source method _post_live_migration c:\openstack\build\nova\nova\compute\manager.py:8819 2021-09-10 16:49:47.820 4088 3038300759144 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.free_pci_device_allocations_for_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:47.820 4088 3038300759144 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.free_pci_device_allocations_for_instance" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:47.820 4088 3038300759144 MainThread DEBUG nova.objects.instance [-] Lazy-loading 'migration_context' on Instance uuid e81b57e5-a1e7-417d-9607-9f17f3aeafdd obj_load_attr c:\openstack\build\nova\nova\objects\instance.py:1101 2021-09-10 16:49:47.836 4088 3038300759144 MainThread DEBUG nova.compute.manager [-] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Calling driver.cleanup from _post_live_migration _post_live_migration c:\openstack\build\nova\nova\compute\manager.py:8837 2021-09-10 16:49:48.039 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Setting boot order for instance: instance-00000008: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:49:48.148 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:49:48.243 4088 3038296678248 MainThread DEBUG os_win.utils.jobutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Waiting for WMI job: {'InstanceID': '1B558ECD-5116-4326-86C8-BAAB528E5D1D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=27282), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:49:48.607 4088 3038300758968 MainThread DEBUG nova.network.neutron [req-780fab1c-708f-4dde-8ded-106cfe072445 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Updated VIF entry in instance network info cache for port 83b451dc-a198-4ccd-9f65-c8fe6343aea3. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:49:48.607 4088 3038300758968 MainThread DEBUG nova.network.neutron [req-780fab1c-708f-4dde-8ded-106cfe072445 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Updating instance_info_cache with network_info: [{"id": "83b451dc-a198-4ccd-9f65-c8fe6343aea3", "address": "fa:16:3e:44:7f:92", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap83b451dc-a1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:49:48.607 4088 3038296678248 MainThread DEBUG os_win.utils.jobutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] WMI job succeeded: {'InstanceID': '1B558ECD-5116-4326-86C8-BAAB528E5D1D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=344994), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:49:48.607 4088 3038296678248 MainThread DEBUG os_win.utils.compute.vmutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Successfully changed vm state of instance-00000008 to 2 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:49:48.626 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Successfully changed state of VM instance-00000008 to: 2 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:49:48.626 4088 3038296678248 MainThread INFO nova.compute.manager [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Took 13.98 seconds to spawn the instance on the hypervisor. 2021-09-10 16:49:48.626 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:49:48.626 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:49:48.633 4088 3038300758968 MainThread DEBUG oslo_concurrency.lockutils [req-780fab1c-708f-4dde-8ded-106cfe072445 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:49:48.695 4088 3038300758968 MainThread DEBUG nova.virt.driver [-] Emitting event Started> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:49:48.695 4088 3038300758968 MainThread INFO nova.compute.manager [-] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] VM Started (Lifecycle Event) 2021-09-10 16:49:48.714 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000008" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:48.743 4088 3038300758968 MainThread DEBUG nova.compute.manager [req-730648e5-a272-44ef-837d-f1f16c7f2964 - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:49:48.743 4088 3038300758968 MainThread DEBUG nova.virt.hyperv.vmops [req-730648e5-a272-44ef-837d-f1f16c7f2964 - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:49:48.761 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000008" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.047s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:48.791 4088 3038300758968 MainThread DEBUG nova.compute.manager [req-730648e5-a272-44ef-837d-f1f16c7f2964 - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:49:48.838 4088 3038300760376 GreenThread-8 DEBUG nova.network.neutron [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Successfully created port: 66953b8a-00d2-4045-8dae-abe4c015822d _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:49:48.838 4088 3038300758968 MainThread INFO nova.compute.manager [req-730648e5-a272-44ef-837d-f1f16c7f2964 - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:49:48.898 4088 3038296678248 MainThread INFO nova.compute.manager [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Took 14.95 seconds to build instance. 2021-09-10 16:49:48.930 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:49:48.930 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-2a4fa5c8-b130-4f37-91ff-e6f94c1bee4a 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.078s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:49.961 4088 3038300760376 GreenThread-8 DEBUG nova.network.neutron [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Successfully updated port: 66953b8a-00d2-4045-8dae-abe4c015822d _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:49:49.995 4088 3038300760376 GreenThread-8 DEBUG oslo_concurrency.lockutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Acquired lock "refresh_cache-9db39d70-5120-4de4-bb87-480a6efb8a3a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:49:49.995 4088 3038300760376 GreenThread-8 DEBUG nova.network.neutron [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:49:50.211 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-77cfe436-5d4b-48a3-996d-fa1e08392cc0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Received event network-changed-66953b8a-00d2-4045-8dae-abe4c015822d external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:49:50.211 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-77cfe436-5d4b-48a3-996d-fa1e08392cc0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Refreshing instance network info cache due to event network-changed-66953b8a-00d2-4045-8dae-abe4c015822d. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:49:50.257 4088 3038300760376 GreenThread-8 DEBUG nova.network.neutron [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:49:50.382 4088 3038300759144 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "e81b57e5-a1e7-417d-9607-9f17f3aeafdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:50.382 4088 3038300759144 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "e81b57e5-a1e7-417d-9607-9f17f3aeafdd-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:50.401 4088 3038300759144 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:50.401 4088 3038300759144 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:50.401 4088 3038300759144 MainThread DEBUG nova.compute.resource_tracker [-] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 16:49:50.401 4088 3038300759144 MainThread DEBUG nova.virt.hyperv.hostops [-] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:49:50.430 4088 3038300759144 MainThread DEBUG nova.virt.hyperv.hostops [-] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:49:50.695 4088 3038300759144 MainThread DEBUG nova.compute.resource_tracker [-] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=11744MB free_disk=61GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 16:49:50.695 4088 3038300759144 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:50.742 4088 3038300760376 GreenThread-8 DEBUG nova.network.neutron [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Updating instance_info_cache with network_info: [{"id": "66953b8a-00d2-4045-8dae-abe4c015822d", "address": "fa:16:3e:7a:90:37", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap66953b8a-00", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:49:50.778 4088 3038300760376 GreenThread-8 DEBUG oslo_concurrency.lockutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Releasing lock "refresh_cache-9db39d70-5120-4de4-bb87-480a6efb8a3a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:49:50.778 4088 3038300760376 GreenThread-8 DEBUG nova.compute.manager [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Instance network_info: |[{"id": "66953b8a-00d2-4045-8dae-abe4c015822d", "address": "fa:16:3e:7a:90:37", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap66953b8a-00", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:49:50.778 4088 3038300759320 MainThread DEBUG nova.compute.manager [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Preparing to wait for external event network-vif-plugged-66953b8a-00d2-4045-8dae-abe4c015822d prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:49:50.778 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:50.778 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:50.778 4088 3038300759320 MainThread DEBUG os_win.utils.compute.vmutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Creating VM instance-0000000b create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:49:50.778 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-77cfe436-5d4b-48a3-996d-fa1e08392cc0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-9db39d70-5120-4de4-bb87-480a6efb8a3a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:49:50.778 4088 3038300760904 MainThread DEBUG nova.network.neutron [req-77cfe436-5d4b-48a3-996d-fa1e08392cc0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Refreshing network info cache for port 66953b8a-00d2-4045-8dae-abe4c015822d _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:49:50.852 4088 3038300759144 MainThread DEBUG nova.compute.resource_tracker [-] Migration for instance e81b57e5-a1e7-417d-9607-9f17f3aeafdd refers to another host's instance! _pair_instances_to_migrations c:\openstack\build\nova\nova\compute\resource_tracker.py:911 2021-09-10 16:49:50.901 4088 3038300759144 MainThread DEBUG nova.compute.resource_tracker [-] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Skipping migration as instance is neither resizing nor live-migrating. _update_usage_from_migrations c:\openstack\build\nova\nova\compute\resource_tracker.py:1390 2021-09-10 16:49:51.055 4088 3038300759144 MainThread DEBUG nova.compute.resource_tracker [-] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:49:51.055 4088 3038300759144 MainThread DEBUG nova.compute.resource_tracker [-] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:49:51.055 4088 3038300759144 MainThread DEBUG nova.compute.resource_tracker [-] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:49:51.055 4088 3038300759144 MainThread DEBUG nova.compute.resource_tracker [-] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:49:51.055 4088 3038300759144 MainThread DEBUG nova.compute.resource_tracker [-] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:49:51.055 4088 3038300759144 MainThread DEBUG nova.compute.resource_tracker [-] Migration 787c7022-786b-4bc3-8329-7c8c19b247fc is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1537 2021-09-10 16:49:51.055 4088 3038300759144 MainThread DEBUG nova.compute.resource_tracker [-] Total usable vcpus: 6, total allocated vcpus: 5 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 16:49:51.055 4088 3038300759144 MainThread DEBUG nova.compute.resource_tracker [-] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=5632MB phys_disk=79GB used_disk=5GB total_vcpus=6 used_vcpus=5 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 16:49:51.117 4088 3038300759144 MainThread DEBUG nova.virt.hyperv.hostops [-] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:49:51.133 4088 3038300759144 MainThread DEBUG nova.virt.hyperv.hostops [-] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:49:51.417 4088 3038300759144 MainThread DEBUG nova.compute.provider_tree [-] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:49:51.430 4088 3038300759144 MainThread DEBUG nova.scheduler.client.report [-] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:49:51.430 4088 3038300759144 MainThread DEBUG nova.compute.resource_tracker [-] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 16:49:51.430 4088 3038300759144 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.734s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:51.430 4088 3038300759144 MainThread INFO nova.compute.manager [-] [instance: e81b57e5-a1e7-417d-9607-9f17f3aeafdd] Migrating instance to n-h1-808474-1 finished successfully. 2021-09-10 16:49:51.465 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-37699747-5a52-4b05-9930-c67ae97d565b 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:51.465 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-37699747-5a52-4b05-9930-c67ae97d565b 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:51.465 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-37699747-5a52-4b05-9930-c67ae97d565b 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:51.465 4088 3038296677896 MainThread ERROR nova.compute.manager [req-37699747-5a52-4b05-9930-c67ae97d565b 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Setting instance vm_state to ERROR: NameError: name 'instant' is not defined 2021-09-10 16:49:51.465 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Traceback (most recent call last): 2021-09-10 16:49:51.465 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:49:51.465 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] self._delete_instance(context, instance, bdms) 2021-09-10 16:49:51.465 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:49:51.465 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:49:51.465 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] NameError: name 'instant' is not defined 2021-09-10 16:49:51.465 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] 2021-09-10 16:49:51.542 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-37699747-5a52-4b05-9930-c67ae97d565b 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e" released by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 0.078s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:51.641 4088 3038300759144 MainThread INFO nova.scheduler.client.report [-] Deleted allocation for migration 787c7022-786b-4bc3-8329-7c8c19b247fc 2021-09-10 16:49:51.654 4088 3038300760904 MainThread DEBUG nova.network.neutron [req-77cfe436-5d4b-48a3-996d-fa1e08392cc0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Updated VIF entry in instance network info cache for port 66953b8a-00d2-4045-8dae-abe4c015822d. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:49:51.654 4088 3038300760904 MainThread DEBUG nova.network.neutron [req-77cfe436-5d4b-48a3-996d-fa1e08392cc0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Updating instance_info_cache with network_info: [{"id": "66953b8a-00d2-4045-8dae-abe4c015822d", "address": "fa:16:3e:7a:90:37", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap66953b8a-00", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:49:51.664 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-77cfe436-5d4b-48a3-996d-fa1e08392cc0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-9db39d70-5120-4de4-bb87-480a6efb8a3a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:49:51.711 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-37699747-5a52-4b05-9930-c67ae97d565b 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:51.711 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.hostops [req-37699747-5a52-4b05-9930-c67ae97d565b 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:49:51.743 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.hostops [req-37699747-5a52-4b05-9930-c67ae97d565b 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:49:52.038 4088 3038296677896 MainThread DEBUG nova.compute.provider_tree [req-37699747-5a52-4b05-9930-c67ae97d565b 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:49:52.055 4088 3038296677896 MainThread DEBUG nova.scheduler.client.report [req-37699747-5a52-4b05-9930-c67ae97d565b 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:49:52.055 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-37699747-5a52-4b05-9930-c67ae97d565b 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:52.055 4088 3038296677896 MainThread INFO nova.compute.manager [req-37699747-5a52-4b05-9930-c67ae97d565b 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Successfully reverted task state from deleting on failure for instance. 2021-09-10 16:49:52.055 4088 3038296677896 MainThread ERROR oslo_messaging.rpc.server [req-37699747-5a52-4b05-9930-c67ae97d565b 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Exception during message handling: NameError: name 'instant' is not defined 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server Traceback (most recent call last): 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 72, in wrapped 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server context, exc, binary) 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server return f(self, context, *args, **kw) 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 184, in decorated_function 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server "Error: %s", e, instance=instance) 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 154, in decorated_function 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\utils.py", line 1433, in decorated_function 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 200, in decorated_function 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3106, in terminate_instance 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server do_terminate_instance(instance, bdms) 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_concurrency\lockutils.py", line 360, in inner 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server return f(*args, **kwargs) 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3104, in do_terminate_instance 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self._set_instance_obj_error_state(instance) 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self._delete_instance(context, instance, bdms) 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server NameError: name 'instant' is not defined 2021-09-10 16:49:52.055 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server 2021-09-10 16:49:52.667 4088 3038300759320 MainThread DEBUG nova.virt.hyperv.vmops [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:49:52.759 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:52.791 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:49:52.931 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:52.931 4088 3038296678248 MainThread DEBUG nova.virt.hardware [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:49:52.948 4088 3038296678248 MainThread INFO nova.compute.claims [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Claim successful on node n-h2-808474-1 2021-09-10 16:49:53.085 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.hostops [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:49:53.102 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.hostops [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:49:53.449 4088 3038296678248 MainThread DEBUG nova.compute.provider_tree [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:49:53.463 4088 3038296678248 MainThread DEBUG nova.scheduler.client.report [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:49:53.463 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:53.477 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:49:53.556 4088 3038296678248 MainThread DEBUG nova.compute.utils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:49:53.556 4088 3038296677896 GreenThread-9 DEBUG nova.compute.manager [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:49:53.556 4088 3038296677896 GreenThread-9 DEBUG nova.network.neutron [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:49:53.570 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:49:53.726 4088 3038296677896 GreenThread-9 DEBUG nova.policy [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fac7f2174628404cb8576928225b4394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8236f1477243dfafd0682b608fc659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:49:53.726 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:49:53.759 4088 3038296678248 MainThread INFO nova.virt.hyperv.vmops [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Spawning new instance 2021-09-10 16:49:53.773 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "instance-0000000c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:53.773 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "instance-0000000c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:53.773 4088 3038296678248 MainThread DEBUG nova.block_device [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:49:53.773 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:53.773 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:53.804 4088 3038296678248 MainThread DEBUG os_win.utils.pathutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Creating directory: C:\openstack\instances\instance-0000000c check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:49:53.804 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000000c\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:49:54.055 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Resizing VHD C:\openstack\instances\instance-0000000c\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:49:54.648 4088 3038296677896 GreenThread-9 DEBUG nova.network.neutron [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Successfully created port: 02ca13c3-f2a9-4341-b400-dd8762c5f142 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:49:55.463 4088 3038296677896 GreenThread-9 DEBUG nova.network.neutron [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Successfully updated port: 02ca13c3-f2a9-4341-b400-dd8762c5f142 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:49:55.509 4088 3038296677896 GreenThread-9 DEBUG oslo_concurrency.lockutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Acquired lock "refresh_cache-2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:49:55.509 4088 3038296677896 GreenThread-9 DEBUG nova.network.neutron [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:49:55.554 4088 3038300760376 MainThread DEBUG nova.compute.manager [req-44bd4464-e251-4b33-83f7-e58d17759ce5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Received event network-changed-02ca13c3-f2a9-4341-b400-dd8762c5f142 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:49:55.554 4088 3038300760376 MainThread DEBUG nova.compute.manager [req-44bd4464-e251-4b33-83f7-e58d17759ce5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Refreshing instance network info cache due to event network-changed-02ca13c3-f2a9-4341-b400-dd8762c5f142. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:49:55.610 4088 3038296677896 GreenThread-9 DEBUG nova.network.neutron [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:49:56.086 4088 3038296677896 GreenThread-9 DEBUG nova.network.neutron [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Updating instance_info_cache with network_info: [{"id": "02ca13c3-f2a9-4341-b400-dd8762c5f142", "address": "fa:16:3e:01:92:31", "network": {"id": "03c1eefd-030f-414f-b7f8-81ed611f877f", "bridge": null, "label": "tempest-LiveMigrationTest-812207682-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fa8236f1477243dfafd0682b608fc659", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap02ca13c3-f2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:49:56.102 4088 3038296677896 GreenThread-9 DEBUG oslo_concurrency.lockutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Releasing lock "refresh_cache-2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:49:56.117 4088 3038296677896 GreenThread-9 DEBUG nova.compute.manager [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Instance network_info: |[{"id": "02ca13c3-f2a9-4341-b400-dd8762c5f142", "address": "fa:16:3e:01:92:31", "network": {"id": "03c1eefd-030f-414f-b7f8-81ed611f877f", "bridge": null, "label": "tempest-LiveMigrationTest-812207682-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fa8236f1477243dfafd0682b608fc659", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap02ca13c3-f2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:49:56.117 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Preparing to wait for external event network-vif-plugged-02ca13c3-f2a9-4341-b400-dd8762c5f142 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:49:56.117 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:56.117 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:56.133 4088 3038296678248 MainThread DEBUG os_win.utils.compute.vmutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Creating VM instance-0000000c create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:49:56.133 4088 3038300760376 MainThread DEBUG oslo_concurrency.lockutils [req-44bd4464-e251-4b33-83f7-e58d17759ce5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:49:56.133 4088 3038300760376 MainThread DEBUG nova.network.neutron [req-44bd4464-e251-4b33-83f7-e58d17759ce5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Refreshing network info cache for port 02ca13c3-f2a9-4341-b400-dd8762c5f142 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:49:56.753 4088 3038300759144 MainThread DEBUG nova.compute.manager [req-62830dc2-c7d1-489b-bebf-52094dea5141 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Received event network-vif-plugged-83b451dc-a198-4ccd-9f65-c8fe6343aea3 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:49:56.753 4088 3038300759144 MainThread DEBUG oslo_concurrency.lockutils [req-62830dc2-c7d1-489b-bebf-52094dea5141 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:56.753 4088 3038300759144 MainThread DEBUG oslo_concurrency.lockutils [req-62830dc2-c7d1-489b-bebf-52094dea5141 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:56.753 4088 3038300759144 MainThread DEBUG nova.compute.manager [req-62830dc2-c7d1-489b-bebf-52094dea5141 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Processing event network-vif-plugged-83b451dc-a198-4ccd-9f65-c8fe6343aea3 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:49:56.792 4088 3038296678072 MainThread INFO nova.virt.hyperv.vmops [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Using config drive for instance 2021-09-10 16:49:57.054 4088 3038300760376 MainThread DEBUG nova.network.neutron [req-44bd4464-e251-4b33-83f7-e58d17759ce5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Updated VIF entry in instance network info cache for port 02ca13c3-f2a9-4341-b400-dd8762c5f142. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:49:57.069 4088 3038300760376 MainThread DEBUG nova.network.neutron [req-44bd4464-e251-4b33-83f7-e58d17759ce5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Updating instance_info_cache with network_info: [{"id": "02ca13c3-f2a9-4341-b400-dd8762c5f142", "address": "fa:16:3e:01:92:31", "network": {"id": "03c1eefd-030f-414f-b7f8-81ed611f877f", "bridge": null, "label": "tempest-LiveMigrationTest-812207682-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fa8236f1477243dfafd0682b608fc659", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap02ca13c3-f2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:49:57.086 4088 3038300760376 MainThread DEBUG oslo_concurrency.lockutils [req-44bd4464-e251-4b33-83f7-e58d17759ce5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:49:57.102 4088 3038296678072 MainThread INFO nova.virt.hyperv.vmops [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Creating config drive at C:\openstack\instances\instance-00000009\configdrive.iso 2021-09-10 16:49:57.213 4088 3038296678072 MainThread DEBUG oslo_concurrency.processutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000009\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp5kmbo99v execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:49:57.554 4088 3038296678072 MainThread DEBUG oslo_concurrency.processutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000009\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp5kmbo99v" returned: 0 in 0.344s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:49:58.010 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Setting boot order for instance: instance-00000009: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:49:58.134 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:49:58.180 4088 3038296678072 MainThread DEBUG os_win.utils.jobutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Waiting for WMI job: {'InstanceID': '677AB7A8-F756-48AC-B21D-2ECEC7C10709', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16361), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:49:58.229 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:49:58.528 4088 3038300759144 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000009" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:58.528 4088 3038296677896 MainThread DEBUG nova.virt.driver [-] Emitting event Started> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:49:58.528 4088 3038296677896 MainThread INFO nova.compute.manager [-] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] VM Started (Lifecycle Event) 2021-09-10 16:49:58.555 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-02c3fe20-a826-438a-8fee-c94601c5eeec - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:49:58.555 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.vmops [req-02c3fe20-a826-438a-8fee-c94601c5eeec - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:49:58.569 4088 3038296678072 MainThread DEBUG os_win.utils.jobutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] WMI job succeeded: {'InstanceID': '677AB7A8-F756-48AC-B21D-2ECEC7C10709', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=335614), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:49:58.569 4088 3038296678072 MainThread DEBUG os_win.utils.compute.vmutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Successfully changed vm state of instance-00000009 to 2 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:49:58.569 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Successfully changed state of VM instance-00000009 to: 2 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:49:58.569 4088 3038296678072 MainThread INFO nova.compute.manager [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Took 18.44 seconds to spawn the instance on the hypervisor. 2021-09-10 16:49:58.569 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:49:58.588 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:49:58.588 4088 3038300759144 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000009" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.062s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:58.617 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-02c3fe20-a826-438a-8fee-c94601c5eeec - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:49:58.664 4088 3038296677896 MainThread INFO nova.compute.manager [req-02c3fe20-a826-438a-8fee-c94601c5eeec - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:49:58.727 4088 3038296678072 MainThread INFO nova.compute.manager [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Took 19.53 seconds to build instance. 2021-09-10 16:49:58.744 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-77aaa5e1-c0bb-4eb8-b96e-dacdc79ed9cb 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.672s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:58.897 4088 3038300759144 MainThread DEBUG nova.compute.manager [req-440a1e21-00ee-4bc6-b66b-01c4e95ff9c1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Received event network-vif-plugged-66953b8a-00d2-4045-8dae-abe4c015822d external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:49:58.913 4088 3038300759144 MainThread DEBUG oslo_concurrency.lockutils [req-440a1e21-00ee-4bc6-b66b-01c4e95ff9c1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:49:58.913 4088 3038300759144 MainThread DEBUG oslo_concurrency.lockutils [req-440a1e21-00ee-4bc6-b66b-01c4e95ff9c1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:49:58.913 4088 3038300759144 MainThread DEBUG nova.compute.manager [req-440a1e21-00ee-4bc6-b66b-01c4e95ff9c1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Processing event network-vif-plugged-66953b8a-00d2-4045-8dae-abe4c015822d _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:49:58.937 4088 3038300759320 MainThread INFO nova.virt.hyperv.vmops [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Using config drive for instance 2021-09-10 16:49:59.055 4088 3038300759320 MainThread INFO nova.virt.hyperv.vmops [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Creating config drive at C:\openstack\instances\instance-0000000b\configdrive.iso 2021-09-10 16:49:59.148 4088 3038300759320 MainThread DEBUG oslo_concurrency.processutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000000b\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp30urxhis execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:49:59.340 4088 3038300759496 MainThread DEBUG nova.virt.hyperv.vmops [req-f9370e72-c72d-4f69-80ac-749c1fff6e95 6feda1ff37db4ce591cf6b1a1e9104ef e563d5856d3f491b8b07157b601eabe6 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Suspend instance suspend c:\openstack\build\nova\nova\virt\hyperv\vmops.py:820 2021-09-10 16:49:59.383 4088 3038300759496 MainThread DEBUG os_win.utils.jobutils [req-f9370e72-c72d-4f69-80ac-749c1fff6e95 6feda1ff37db4ce591cf6b1a1e9104ef e563d5856d3f491b8b07157b601eabe6 - default default] Waiting for WMI job: {'InstanceID': '7338ECD8-6665-4753-8FC1-F7FDFB533E6F', 'Description': 'Saving Virtual Machine', 'ElementName': 'Saving', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=32529), 'Cancellable': True, 'JobType': 14, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 23}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:49:59.586 4088 3038300759320 MainThread DEBUG oslo_concurrency.processutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000000b\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp30urxhis" returned: 0 in 0.437s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:50:00.009 4088 3038300759320 MainThread DEBUG nova.virt.hyperv.vmops [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Setting boot order for instance: instance-0000000b: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:50:00.118 4088 3038300759496 MainThread DEBUG os_win.utils.jobutils [req-f9370e72-c72d-4f69-80ac-749c1fff6e95 6feda1ff37db4ce591cf6b1a1e9104ef e563d5856d3f491b8b07157b601eabe6 - default default] WMI job succeeded: {'InstanceID': '7338ECD8-6665-4753-8FC1-F7FDFB533E6F', 'Description': 'Saving Virtual Machine', 'ElementName': 'Saving', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=710662), 'Cancellable': True, 'JobType': 14, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:50:00.118 4088 3038300759496 MainThread DEBUG os_win.utils.compute.vmutils [req-f9370e72-c72d-4f69-80ac-749c1fff6e95 6feda1ff37db4ce591cf6b1a1e9104ef e563d5856d3f491b8b07157b601eabe6 - default default] Successfully changed vm state of instance-00000009 to 32769 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:50:00.118 4088 3038300759496 MainThread DEBUG nova.virt.hyperv.vmops [req-f9370e72-c72d-4f69-80ac-749c1fff6e95 6feda1ff37db4ce591cf6b1a1e9104ef e563d5856d3f491b8b07157b601eabe6 - default default] Successfully changed state of VM instance-00000009 to: 32769 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:50:00.118 4088 3038300759496 MainThread DEBUG nova.compute.manager [req-f9370e72-c72d-4f69-80ac-749c1fff6e95 6feda1ff37db4ce591cf6b1a1e9104ef e563d5856d3f491b8b07157b601eabe6 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:50:00.118 4088 3038300759496 MainThread DEBUG nova.virt.hyperv.vmops [req-f9370e72-c72d-4f69-80ac-749c1fff6e95 6feda1ff37db4ce591cf6b1a1e9104ef e563d5856d3f491b8b07157b601eabe6 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:50:00.168 4088 3038300759320 MainThread DEBUG nova.virt.hyperv.vmops [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:50:00.216 4088 3038300759320 MainThread DEBUG os_win.utils.jobutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Waiting for WMI job: {'InstanceID': 'ECD3B219-753F-4BCF-BB54-36B29C6295F6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20143), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:50:00.555 4088 3038296678072 MainThread DEBUG nova.virt.driver [-] Emitting event Started> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:50:00.555 4088 3038296678072 MainThread INFO nova.compute.manager [-] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] VM Started (Lifecycle Event) 2021-09-10 16:50:00.570 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000000b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:00.588 4088 3038300759320 MainThread DEBUG os_win.utils.jobutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] WMI job succeeded: {'InstanceID': 'ECD3B219-753F-4BCF-BB54-36B29C6295F6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=349803), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:50:00.588 4088 3038300759320 MainThread DEBUG os_win.utils.compute.vmutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Successfully changed vm state of instance-0000000b to 2 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:50:00.588 4088 3038300759320 MainThread DEBUG nova.virt.hyperv.vmops [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Successfully changed state of VM instance-0000000b to: 2 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:50:00.588 4088 3038300759320 MainThread INFO nova.compute.manager [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Took 13.20 seconds to spawn the instance on the hypervisor. 2021-09-10 16:50:00.588 4088 3038300759320 MainThread DEBUG nova.compute.manager [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:50:00.588 4088 3038300759320 MainThread DEBUG nova.virt.hyperv.vmops [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:50:00.588 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-a1c0112d-c119-460f-b863-9c8cfdf60dc3 - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:50:00.588 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-a1c0112d-c119-460f-b863-9c8cfdf60dc3 - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:50:00.604 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000000b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:00.663 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-a1c0112d-c119-460f-b863-9c8cfdf60dc3 - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:50:00.711 4088 3038296678072 MainThread INFO nova.compute.manager [req-a1c0112d-c119-460f-b863-9c8cfdf60dc3 - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:50:00.792 4088 3038300759320 MainThread INFO nova.compute.manager [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Took 14.86 seconds to build instance. 2021-09-10 16:50:00.820 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-b5023d8b-8e3f-4be9-b2ff-91c11998dc3a 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:01.789 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-3d95c08a-b5ae-490c-9519-490f191b9fdb 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:01.789 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-3d95c08a-b5ae-490c-9519-490f191b9fdb 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:01.789 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-3d95c08a-b5ae-490c-9519-490f191b9fdb 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:01.789 4088 3038296678072 MainThread ERROR nova.compute.manager [req-3d95c08a-b5ae-490c-9519-490f191b9fdb 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Setting instance vm_state to ERROR: NameError: name 'instant' is not defined 2021-09-10 16:50:01.789 4088 3038296678072 MainThread TRACE nova.compute.manager [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Traceback (most recent call last): 2021-09-10 16:50:01.789 4088 3038296678072 MainThread TRACE nova.compute.manager [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:50:01.789 4088 3038296678072 MainThread TRACE nova.compute.manager [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] self._delete_instance(context, instance, bdms) 2021-09-10 16:50:01.789 4088 3038296678072 MainThread TRACE nova.compute.manager [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:50:01.789 4088 3038296678072 MainThread TRACE nova.compute.manager [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:50:01.789 4088 3038296678072 MainThread TRACE nova.compute.manager [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] NameError: name 'instant' is not defined 2021-09-10 16:50:01.789 4088 3038296678072 MainThread TRACE nova.compute.manager [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] 2021-09-10 16:50:01.850 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-3d95c08a-b5ae-490c-9519-490f191b9fdb 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a" released by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 0.063s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:01.932 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-4fd8c9fe-d28c-4720-8917-0d9f32b7adff 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:01.932 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-4fd8c9fe-d28c-4720-8917-0d9f32b7adff 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:01.953 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-4fd8c9fe-d28c-4720-8917-0d9f32b7adff 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:01.953 4088 3038296677896 MainThread ERROR nova.compute.manager [req-4fd8c9fe-d28c-4720-8917-0d9f32b7adff 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Setting instance vm_state to ERROR: NameError: name 'instant' is not defined 2021-09-10 16:50:01.953 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Traceback (most recent call last): 2021-09-10 16:50:01.953 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:50:01.953 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] self._delete_instance(context, instance, bdms) 2021-09-10 16:50:01.953 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:50:01.953 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:50:01.953 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] NameError: name 'instant' is not defined 2021-09-10 16:50:01.953 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] 2021-09-10 16:50:01.992 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-3d95c08a-b5ae-490c-9519-490f191b9fdb 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:02.022 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.hostops [req-3d95c08a-b5ae-490c-9519-490f191b9fdb 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:50:02.039 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.hostops [req-3d95c08a-b5ae-490c-9519-490f191b9fdb 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:50:02.039 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-4fd8c9fe-d28c-4720-8917-0d9f32b7adff 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" released by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 0.109s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:02.288 4088 3038296678072 MainThread DEBUG nova.compute.provider_tree [req-3d95c08a-b5ae-490c-9519-490f191b9fdb 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:50:02.304 4088 3038296678072 MainThread DEBUG nova.scheduler.client.report [req-3d95c08a-b5ae-490c-9519-490f191b9fdb 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:50:02.304 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-3d95c08a-b5ae-490c-9519-490f191b9fdb 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:02.304 4088 3038296678072 MainThread INFO nova.compute.manager [req-3d95c08a-b5ae-490c-9519-490f191b9fdb 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Successfully reverted task state from deleting on failure for instance. 2021-09-10 16:50:02.304 4088 3038296678072 MainThread ERROR oslo_messaging.rpc.server [req-3d95c08a-b5ae-490c-9519-490f191b9fdb 629a58532a634973a9ee2b10acefe414 74f46359cd494289810bf96e1168e5b2 - default default] Exception during message handling: NameError: name 'instant' is not defined 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server Traceback (most recent call last): 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 72, in wrapped 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server context, exc, binary) 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server return f(self, context, *args, **kw) 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 184, in decorated_function 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server "Error: %s", e, instance=instance) 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 154, in decorated_function 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\utils.py", line 1433, in decorated_function 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 200, in decorated_function 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3106, in terminate_instance 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server do_terminate_instance(instance, bdms) 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_concurrency\lockutils.py", line 360, in inner 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server return f(*args, **kwargs) 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3104, in do_terminate_instance 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server self._set_instance_obj_error_state(instance) 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server self._delete_instance(context, instance, bdms) 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server NameError: name 'instant' is not defined 2021-09-10 16:50:02.304 4088 3038296678072 MainThread TRACE oslo_messaging.rpc.server 2021-09-10 16:50:02.304 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-4fd8c9fe-d28c-4720-8917-0d9f32b7adff 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.156s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:02.337 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.hostops [req-4fd8c9fe-d28c-4720-8917-0d9f32b7adff 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:50:02.371 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.hostops [req-4fd8c9fe-d28c-4720-8917-0d9f32b7adff 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:50:02.588 4088 3038296677896 MainThread DEBUG nova.compute.provider_tree [req-4fd8c9fe-d28c-4720-8917-0d9f32b7adff 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:50:02.600 4088 3038296677896 MainThread DEBUG nova.scheduler.client.report [req-4fd8c9fe-d28c-4720-8917-0d9f32b7adff 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:50:02.617 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-4fd8c9fe-d28c-4720-8917-0d9f32b7adff 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:02.617 4088 3038296677896 MainThread INFO nova.compute.manager [req-4fd8c9fe-d28c-4720-8917-0d9f32b7adff 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Successfully reverted task state from deleting on failure for instance. 2021-09-10 16:50:02.617 4088 3038296677896 MainThread ERROR oslo_messaging.rpc.server [req-4fd8c9fe-d28c-4720-8917-0d9f32b7adff 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Exception during message handling: NameError: name 'instant' is not defined 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server Traceback (most recent call last): 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 72, in wrapped 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server context, exc, binary) 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server return f(self, context, *args, **kw) 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 184, in decorated_function 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server "Error: %s", e, instance=instance) 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 154, in decorated_function 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\utils.py", line 1433, in decorated_function 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 200, in decorated_function 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3106, in terminate_instance 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server do_terminate_instance(instance, bdms) 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_concurrency\lockutils.py", line 360, in inner 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server return f(*args, **kwargs) 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3104, in do_terminate_instance 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self._set_instance_obj_error_state(instance) 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self._delete_instance(context, instance, bdms) 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server NameError: name 'instant' is not defined 2021-09-10 16:50:02.617 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server 2021-09-10 16:50:02.632 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-36818663-96fc-4b0e-9c68-ed729d03350e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Received event network-vif-plugged-02ca13c3-f2a9-4341-b400-dd8762c5f142 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:50:02.632 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-36818663-96fc-4b0e-9c68-ed729d03350e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:02.632 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-36818663-96fc-4b0e-9c68-ed729d03350e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:02.632 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-36818663-96fc-4b0e-9c68-ed729d03350e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Processing event network-vif-plugged-02ca13c3-f2a9-4341-b400-dd8762c5f142 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:50:02.664 4088 3038296678248 MainThread INFO nova.virt.hyperv.vmops [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Using config drive for instance 2021-09-10 16:50:02.788 4088 3038296678248 MainThread INFO nova.virt.hyperv.vmops [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Creating config drive at C:\openstack\instances\instance-0000000c\configdrive.iso 2021-09-10 16:50:02.891 4088 3038296678248 MainThread DEBUG oslo_concurrency.processutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000000c\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp1vgfh6n4 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:50:03.273 4088 3038296678248 MainThread DEBUG oslo_concurrency.processutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000000c\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp1vgfh6n4" returned: 0 in 0.375s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:50:03.666 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-fc081f97-28ea-4cf2-9bc7-be3920b8d284 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:03.666 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-fc081f97-28ea-4cf2-9bc7-be3920b8d284 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:03.666 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-fc081f97-28ea-4cf2-9bc7-be3920b8d284 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:03.678 4088 3038296677896 MainThread ERROR nova.compute.manager [req-fc081f97-28ea-4cf2-9bc7-be3920b8d284 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Setting instance vm_state to ERROR: NameError: name 'instant' is not defined 2021-09-10 16:50:03.678 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Traceback (most recent call last): 2021-09-10 16:50:03.678 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:50:03.678 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] self._delete_instance(context, instance, bdms) 2021-09-10 16:50:03.678 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:50:03.678 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:50:03.678 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] NameError: name 'instant' is not defined 2021-09-10 16:50:03.678 4088 3038296677896 MainThread TRACE nova.compute.manager [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] 2021-09-10 16:50:03.726 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Setting boot order for instance: instance-0000000c: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:50:03.741 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-fc081f97-28ea-4cf2-9bc7-be3920b8d284 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" released by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 0.079s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:03.850 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-fc081f97-28ea-4cf2-9bc7-be3920b8d284 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:03.850 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:50:03.885 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.hostops [req-fc081f97-28ea-4cf2-9bc7-be3920b8d284 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:50:03.885 4088 3038296678248 MainThread DEBUG os_win.utils.jobutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Waiting for WMI job: {'InstanceID': 'C48167C2-9891-44C8-BB6C-F61F3F3199F5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16591), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:50:03.899 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.hostops [req-fc081f97-28ea-4cf2-9bc7-be3920b8d284 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:50:04.281 4088 3038296677896 MainThread DEBUG nova.compute.provider_tree [req-fc081f97-28ea-4cf2-9bc7-be3920b8d284 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:50:04.290 4088 3038296677896 MainThread DEBUG nova.scheduler.client.report [req-fc081f97-28ea-4cf2-9bc7-be3920b8d284 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:50:04.290 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-fc081f97-28ea-4cf2-9bc7-be3920b8d284 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:04.290 4088 3038296677896 MainThread INFO nova.compute.manager [req-fc081f97-28ea-4cf2-9bc7-be3920b8d284 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Successfully reverted task state from deleting on failure for instance. 2021-09-10 16:50:04.304 4088 3038296677896 MainThread ERROR oslo_messaging.rpc.server [req-fc081f97-28ea-4cf2-9bc7-be3920b8d284 36997d263ab641e1b1795fe750910e43 98dd22cbf0e64cd6ac8defc3abc48a19 - default default] Exception during message handling: NameError: name 'instant' is not defined 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server Traceback (most recent call last): 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 72, in wrapped 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server context, exc, binary) 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server return f(self, context, *args, **kw) 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 184, in decorated_function 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server "Error: %s", e, instance=instance) 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 154, in decorated_function 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\utils.py", line 1433, in decorated_function 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 200, in decorated_function 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3106, in terminate_instance 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server do_terminate_instance(instance, bdms) 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_concurrency\lockutils.py", line 360, in inner 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server return f(*args, **kwargs) 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3104, in do_terminate_instance 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self._set_instance_obj_error_state(instance) 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self._delete_instance(context, instance, bdms) 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server NameError: name 'instant' is not defined 2021-09-10 16:50:04.304 4088 3038296677896 MainThread TRACE oslo_messaging.rpc.server 2021-09-10 16:50:04.304 4088 3038296677896 MainThread DEBUG nova.virt.driver [-] Emitting event Started> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:50:04.304 4088 3038296677896 MainThread INFO nova.compute.manager [-] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] VM Started (Lifecycle Event) 2021-09-10 16:50:04.332 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000000c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:04.336 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-4b6437af-bb94-4283-8c9f-f733fb871442 - - - - -] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:50:04.336 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.vmops [req-4b6437af-bb94-4283-8c9f-f733fb871442 - - - - -] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:50:04.385 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000000c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.047s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:04.385 4088 3038296678248 MainThread DEBUG os_win.utils.jobutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] WMI job succeeded: {'InstanceID': 'C48167C2-9891-44C8-BB6C-F61F3F3199F5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=402434), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:50:04.385 4088 3038296678248 MainThread DEBUG os_win.utils.compute.vmutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Successfully changed vm state of instance-0000000c to 2 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:50:04.385 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Successfully changed state of VM instance-0000000c to: 2 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:50:04.385 4088 3038296678248 MainThread INFO nova.compute.manager [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Took 10.66 seconds to spawn the instance on the hypervisor. 2021-09-10 16:50:04.385 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:50:04.397 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:50:04.429 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-4b6437af-bb94-4283-8c9f-f733fb871442 - - - - -] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:50:04.481 4088 3038296677896 MainThread INFO nova.compute.manager [req-4b6437af-bb94-4283-8c9f-f733fb871442 - - - - -] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:50:04.586 4088 3038296678248 MainThread INFO nova.compute.manager [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Took 11.70 seconds to build instance. 2021-09-10 16:50:04.620 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-bdbe4efc-755f-40e9-9a89-43ee385d26cf fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 11.860s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:06.432 4088 3038296678248 MainThread INFO nova.compute.manager [req-7e67a8de-743c-4505-8a96-608fe6f5774f 631464703d054b39ab2dbb2ef12349bf 65f9947f24f541579df4a582376707cc - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Pausing 2021-09-10 16:50:06.432 4088 3038296678248 MainThread DEBUG nova.objects.instance [req-7e67a8de-743c-4505-8a96-608fe6f5774f 631464703d054b39ab2dbb2ef12349bf 65f9947f24f541579df4a582376707cc - default default] Lazy-loading 'flavor' on Instance uuid 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4 obj_load_attr c:\openstack\build\nova\nova\objects\instance.py:1101 2021-09-10 16:50:06.517 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-7e67a8de-743c-4505-8a96-608fe6f5774f 631464703d054b39ab2dbb2ef12349bf 65f9947f24f541579df4a582376707cc - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Pause instance pause c:\openstack\build\nova\nova\virt\hyperv\vmops.py:808 2021-09-10 16:50:06.562 4088 3038296678248 MainThread DEBUG os_win.utils.jobutils [req-7e67a8de-743c-4505-8a96-608fe6f5774f 631464703d054b39ab2dbb2ef12349bf 65f9947f24f541579df4a582376707cc - default default] WMI job succeeded: {'InstanceID': '875796DD-2904-4F96-94A4-9E00893453DA', 'Description': 'Pausing Virtual Machine', 'ElementName': 'Pausing', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=5335), 'Cancellable': False, 'JobType': 20, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:50:06.562 4088 3038296678248 MainThread DEBUG os_win.utils.compute.vmutils [req-7e67a8de-743c-4505-8a96-608fe6f5774f 631464703d054b39ab2dbb2ef12349bf 65f9947f24f541579df4a582376707cc - default default] Successfully changed vm state of instance-0000000c to 32768 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:50:06.569 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-7e67a8de-743c-4505-8a96-608fe6f5774f 631464703d054b39ab2dbb2ef12349bf 65f9947f24f541579df4a582376707cc - default default] Successfully changed state of VM instance-0000000c to: 32768 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:50:06.569 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-7e67a8de-743c-4505-8a96-608fe6f5774f 631464703d054b39ab2dbb2ef12349bf 65f9947f24f541579df4a582376707cc - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:50:06.569 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-7e67a8de-743c-4505-8a96-608fe6f5774f 631464703d054b39ab2dbb2ef12349bf 65f9947f24f541579df4a582376707cc - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:50:07.733 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:07.758 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:50:07.884 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:07.884 4088 3038296677896 MainThread DEBUG nova.virt.hardware [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:50:07.884 4088 3038296677896 MainThread INFO nova.compute.claims [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Claim successful on node n-h2-808474-1 2021-09-10 16:50:08.038 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.hostops [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:50:08.085 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.hostops [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:50:08.322 4088 3038296677896 MainThread DEBUG nova.compute.provider_tree [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:50:08.352 4088 3038296677896 MainThread DEBUG nova.scheduler.client.report [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:50:08.352 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:08.352 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:50:08.418 4088 3038296677896 MainThread DEBUG nova.compute.utils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:50:08.418 4088 3038296678248 GreenThread-10 DEBUG nova.compute.manager [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:50:08.418 4088 3038296678248 GreenThread-10 DEBUG nova.network.neutron [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:50:08.445 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:50:08.586 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:50:08.616 4088 3038296678248 GreenThread-10 DEBUG nova.policy [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf4dce0601aa49c0b9ea6c48f2953557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae864ac350142778dcbcb12a8b3800e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:50:08.616 4088 3038296677896 MainThread INFO nova.virt.hyperv.vmops [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Spawning new instance 2021-09-10 16:50:08.632 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "instance-0000000d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:08.632 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "instance-0000000d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:08.632 4088 3038296677896 MainThread DEBUG nova.block_device [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:50:08.632 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:08.632 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:08.649 4088 3038296677896 MainThread DEBUG os_win.utils.pathutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Creating directory: C:\openstack\instances\instance-0000000d check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:50:08.649 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.vmops [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000000d\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:50:08.975 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.vmops [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Resizing VHD C:\openstack\instances\instance-0000000d\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:50:09.226 4088 3038300760376 MainThread DEBUG nova.virt.hyperv.livemigrationops [req-8b838353-e342-487e-8147-64d0ab7cf83e 631464703d054b39ab2dbb2ef12349bf 65f9947f24f541579df4a582376707cc - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] check_can_live_migrate_source called check_can_live_migrate_source c:\openstack\build\nova\nova\virt\hyperv\livemigrationops.py:153 2021-09-10 16:50:09.226 4088 3038300760376 MainThread DEBUG nova.compute.manager [req-8b838353-e342-487e-8147-64d0ab7cf83e 631464703d054b39ab2dbb2ef12349bf 65f9947f24f541579df4a582376707cc - default default] source check data is HyperVLiveMigrateData(is_shared_instance_path=False,is_volume_backed=False,migration=,old_vol_attachment_ids=,vifs=,wait_for_vif_plugged=) check_can_live_migrate_source c:\openstack\build\nova\nova\compute\manager.py:8151 2021-09-10 16:50:09.462 4088 3038296678248 GreenThread-10 DEBUG nova.network.neutron [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Successfully created port: a8d3d6fd-c535-4f42-b11d-348191f22a38 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:50:10.444 4088 3038296678248 GreenThread-10 DEBUG nova.network.neutron [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Successfully updated port: a8d3d6fd-c535-4f42-b11d-348191f22a38 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:50:10.460 4088 3038296678248 GreenThread-10 DEBUG oslo_concurrency.lockutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Acquired lock "refresh_cache-0e77fafa-3f8a-4513-bb64-518c77e99029" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:50:10.460 4088 3038296678248 GreenThread-10 DEBUG nova.network.neutron [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:50:10.539 4088 3038296678248 GreenThread-10 DEBUG nova.network.neutron [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:50:10.647 4088 3038300760376 MainThread DEBUG nova.compute.manager [req-7d7d7636-ebbc-407b-9067-3834425829ad 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Received event network-changed-a8d3d6fd-c535-4f42-b11d-348191f22a38 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:50:10.647 4088 3038300760376 MainThread DEBUG nova.compute.manager [req-7d7d7636-ebbc-407b-9067-3834425829ad 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Refreshing instance network info cache due to event network-changed-a8d3d6fd-c535-4f42-b11d-348191f22a38. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:50:11.202 4088 3038296678248 GreenThread-10 DEBUG nova.network.neutron [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Updating instance_info_cache with network_info: [{"id": "a8d3d6fd-c535-4f42-b11d-348191f22a38", "address": "fa:16:3e:61:e8:c4", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa8d3d6fd-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:50:11.272 4088 3038296678248 GreenThread-10 DEBUG oslo_concurrency.lockutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Releasing lock "refresh_cache-0e77fafa-3f8a-4513-bb64-518c77e99029" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:50:11.272 4088 3038296678248 GreenThread-10 DEBUG nova.compute.manager [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Instance network_info: |[{"id": "a8d3d6fd-c535-4f42-b11d-348191f22a38", "address": "fa:16:3e:61:e8:c4", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa8d3d6fd-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:50:11.272 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Preparing to wait for external event network-vif-plugged-a8d3d6fd-c535-4f42-b11d-348191f22a38 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:50:11.272 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:11.272 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:11.272 4088 3038296677896 MainThread DEBUG os_win.utils.compute.vmutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Creating VM instance-0000000d create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:50:11.272 4088 3038300760376 MainThread DEBUG oslo_concurrency.lockutils [req-7d7d7636-ebbc-407b-9067-3834425829ad 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-0e77fafa-3f8a-4513-bb64-518c77e99029" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:50:11.272 4088 3038300760376 MainThread DEBUG nova.network.neutron [req-7d7d7636-ebbc-407b-9067-3834425829ad 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Refreshing network info cache for port a8d3d6fd-c535-4f42-b11d-348191f22a38 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:50:11.991 4088 3038300760376 MainThread DEBUG nova.network.neutron [req-7d7d7636-ebbc-407b-9067-3834425829ad 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Updated VIF entry in instance network info cache for port a8d3d6fd-c535-4f42-b11d-348191f22a38. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:50:11.991 4088 3038300760376 MainThread DEBUG nova.network.neutron [req-7d7d7636-ebbc-407b-9067-3834425829ad 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Updating instance_info_cache with network_info: [{"id": "a8d3d6fd-c535-4f42-b11d-348191f22a38", "address": "fa:16:3e:61:e8:c4", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa8d3d6fd-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:50:12.007 4088 3038300760376 MainThread DEBUG oslo_concurrency.lockutils [req-7d7d7636-ebbc-407b-9067-3834425829ad 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-0e77fafa-3f8a-4513-bb64-518c77e99029" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:50:13.366 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-8835e1c4-f502-4055-949a-c42f480b4dc0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Received event network-vif-unplugged-02ca13c3-f2a9-4341-b400-dd8762c5f142 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:50:13.366 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-8835e1c4-f502-4055-949a-c42f480b4dc0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:13.366 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-8835e1c4-f502-4055-949a-c42f480b4dc0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:13.366 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-8835e1c4-f502-4055-949a-c42f480b4dc0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] No waiting events found dispatching network-vif-unplugged-02ca13c3-f2a9-4341-b400-dd8762c5f142 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 16:50:13.366 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-8835e1c4-f502-4055-949a-c42f480b4dc0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Received event network-vif-unplugged-02ca13c3-f2a9-4341-b400-dd8762c5f142 for instance with task_state migrating. _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10284 2021-09-10 16:50:13.585 4088 3038296678072 MainThread INFO nova.compute.manager [-] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Took 2.28 seconds for pre_live_migration on destination host n-h1-808474-1. 2021-09-10 16:50:13.603 4088 3038296678072 MainThread DEBUG nova.compute.manager [-] live_migration data is HyperVLiveMigrateData(is_shared_instance_path=False,is_volume_backed=False,migration=Migration(bf5ceb7e-70d8-4d4a-b896-d11c22d752df),old_vol_attachment_ids={},vifs=[VIFMigrateData],wait_for_vif_plugged=True) _do_live_migration c:\openstack\build\nova\nova\compute\manager.py:8499 2021-09-10 16:50:13.603 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.livemigrationops [-] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] live_migration called live_migration c:\openstack\build\nova\nova\virt\hyperv\livemigrationops.py:52 2021-09-10 16:50:13.603 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000000c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:13.603 4088 3038296678072 MainThread INFO nova.virt.hyperv.serialconsoleops [-] Stopping instance instance-0000000c serial console handler. 2021-09-10 16:50:13.603 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000000c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:13.619 4088 3038296678072 MainThread DEBUG os_win.utils.pathutils [-] Creating directory: \\n-h1-808474-1\C$\openstack\instances\instance-0000000c check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:50:13.649 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.vmops [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:50:13.851 4088 3038296678072 MainThread DEBUG os_win.utils.compute.livemigrationutils [-] Getting live migration networks for host: n-h1-808474-1 _get_ip_address_list c:\openstack\build\os-win\os_win\utils\compute\livemigrationutils.py:172 2021-09-10 16:50:13.962 4088 3038296678072 MainThread DEBUG os_win.utils.compute.livemigrationutils [-] Starting live migration for VM: instance-0000000c _live_migrate_vm c:\openstack\build\os-win\os_win\utils\compute\livemigrationutils.py:162 2021-09-10 16:50:14.044 4088 3038296678072 MainThread DEBUG os_win.utils.jobutils [-] Waiting for WMI job: {'InstanceID': '0F58B9C7-79E6-4211-9659-6017182548C1', 'Description': 'Moving Virtual Machine and Storage', 'ElementName': 'Moving Virtual Machine and Storage', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21457), 'Cancellable': True, 'JobType': 306, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 1}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:50:15.508 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-c00ec5ea-318c-4da4-87ac-1b4a51a7917b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Received event network-changed-02ca13c3-f2a9-4341-b400-dd8762c5f142 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:50:15.508 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-c00ec5ea-318c-4da4-87ac-1b4a51a7917b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Refreshing instance network info cache due to event network-changed-02ca13c3-f2a9-4341-b400-dd8762c5f142. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:50:15.508 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-c00ec5ea-318c-4da4-87ac-1b4a51a7917b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:50:15.508 4088 3038296678248 MainThread DEBUG nova.network.neutron [req-c00ec5ea-318c-4da4-87ac-1b4a51a7917b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Refreshing network info cache for port 02ca13c3-f2a9-4341-b400-dd8762c5f142 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:50:16.056 4088 3038296678248 MainThread DEBUG nova.network.neutron [req-c00ec5ea-318c-4da4-87ac-1b4a51a7917b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Updated VIF entry in instance network info cache for port 02ca13c3-f2a9-4341-b400-dd8762c5f142. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:50:16.056 4088 3038296678248 MainThread DEBUG nova.network.neutron [req-c00ec5ea-318c-4da4-87ac-1b4a51a7917b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Updating instance_info_cache with network_info: [{"id": "02ca13c3-f2a9-4341-b400-dd8762c5f142", "address": "fa:16:3e:01:92:31", "network": {"id": "03c1eefd-030f-414f-b7f8-81ed611f877f", "bridge": null, "label": "tempest-LiveMigrationTest-812207682-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fa8236f1477243dfafd0682b608fc659", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap02ca13c3-f2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {"migrating_to": "n-h1-808474-1"}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:50:16.085 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-c00ec5ea-318c-4da4-87ac-1b4a51a7917b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:50:18.994 4088 3038296678072 MainThread DEBUG os_win.utils.jobutils [-] WMI job succeeded: {'InstanceID': '0F58B9C7-79E6-4211-9659-6017182548C1', 'Description': 'Moving Virtual Machine and Storage', 'ElementName': 'Moving Virtual Machine and Storage', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(seconds=4, microseconds=954217), 'Cancellable': True, 'JobType': 306, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:50:18.994 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.livemigrationops [-] Calling live migration post_method for instance: instance-0000000c live_migration c:\openstack\build\nova\nova\virt\hyperv\livemigrationops.py:86 2021-09-10 16:50:18.994 4088 3038296678072 MainThread INFO nova.compute.manager [-] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] _post_live_migration() is started.. 2021-09-10 16:50:18.994 4088 3038296678072 MainThread DEBUG os_win.utils.pathutils [-] Removing directory: C:\openstack\instances\instance-0000000c check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:50:19.006 4088 3038296678072 MainThread DEBUG os_brick.utils [-] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:50:19.022 4088 3038296678072 MainThread DEBUG os_brick.utils [-] <== get_connector_properties: return (15ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:50:19.727 4088 3038296678072 MainThread DEBUG nova.network.neutron [-] Activated binding for port 02ca13c3-f2a9-4341-b400-dd8762c5f142 and host n-h1-808474-1 migrate_instance_start c:\openstack\build\nova\nova\network\neutron.py:3012 2021-09-10 16:50:19.727 4088 3038296678072 MainThread DEBUG nova.compute.manager [-] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Calling driver.post_live_migration_at_source with original source VIFs from migrate_data: [{"id": "02ca13c3-f2a9-4341-b400-dd8762c5f142", "address": "fa:16:3e:01:92:31", "network": {"id": "03c1eefd-030f-414f-b7f8-81ed611f877f", "bridge": null, "label": "tempest-LiveMigrationTest-812207682-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fa8236f1477243dfafd0682b608fc659", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap02ca13c3-f2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] _post_live_migration c:\openstack\build\nova\nova\compute\manager.py:8815 2021-09-10 16:50:19.727 4088 3038296678072 MainThread DEBUG nova.compute.manager [-] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Hypervisor driver does not support post_live_migration_at_source method _post_live_migration c:\openstack\build\nova\nova\compute\manager.py:8819 2021-09-10 16:50:19.727 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.free_pci_device_allocations_for_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:19.727 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.free_pci_device_allocations_for_instance" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:19.727 4088 3038296678072 MainThread DEBUG nova.objects.instance [-] Lazy-loading 'migration_context' on Instance uuid 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4 obj_load_attr c:\openstack\build\nova\nova\objects\instance.py:1101 2021-09-10 16:50:19.747 4088 3038296678072 MainThread DEBUG nova.compute.manager [-] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Calling driver.cleanup from _post_live_migration _post_live_migration c:\openstack\build\nova\nova\compute\manager.py:8837 2021-09-10 16:50:21.429 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:21.429 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:21.461 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:21.461 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:21.461 4088 3038296678072 MainThread DEBUG nova.compute.resource_tracker [-] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 16:50:21.461 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.hostops [-] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:50:21.461 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.hostops [-] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:50:21.693 4088 3038296678072 MainThread DEBUG nova.compute.resource_tracker [-] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=10680MB free_disk=60GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 16:50:21.693 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:21.765 4088 3038296678072 MainThread DEBUG nova.compute.resource_tracker [-] Migration for instance 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4 refers to another host's instance! _pair_instances_to_migrations c:\openstack\build\nova\nova\compute\resource_tracker.py:911 2021-09-10 16:50:21.787 4088 3038296678072 MainThread DEBUG nova.compute.resource_tracker [-] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Skipping migration as instance is neither resizing nor live-migrating. _update_usage_from_migrations c:\openstack\build\nova\nova\compute\resource_tracker.py:1390 2021-09-10 16:50:21.820 4088 3038296678072 MainThread DEBUG nova.compute.resource_tracker [-] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:50:21.820 4088 3038296678072 MainThread DEBUG nova.compute.resource_tracker [-] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:50:21.820 4088 3038296678072 MainThread DEBUG nova.compute.resource_tracker [-] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:50:21.820 4088 3038296678072 MainThread DEBUG nova.compute.resource_tracker [-] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:50:21.820 4088 3038296678072 MainThread DEBUG nova.compute.resource_tracker [-] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:50:21.820 4088 3038296678072 MainThread DEBUG nova.compute.resource_tracker [-] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:50:21.836 4088 3038296678072 MainThread DEBUG nova.compute.resource_tracker [-] Migration bf5ceb7e-70d8-4d4a-b896-d11c22d752df is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1537 2021-09-10 16:50:21.836 4088 3038296678072 MainThread DEBUG nova.compute.resource_tracker [-] Total usable vcpus: 6, total allocated vcpus: 6 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 16:50:21.836 4088 3038296678072 MainThread DEBUG nova.compute.resource_tracker [-] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=6656MB phys_disk=79GB used_disk=6GB total_vcpus=6 used_vcpus=6 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 16:50:21.868 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.hostops [-] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:50:21.884 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.hostops [-] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:50:22.086 4088 3038296678072 MainThread DEBUG nova.compute.provider_tree [-] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:50:22.117 4088 3038296678072 MainThread DEBUG nova.scheduler.client.report [-] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:50:22.117 4088 3038296678072 MainThread DEBUG nova.compute.resource_tracker [-] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 16:50:22.136 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.437s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:22.136 4088 3038296678072 MainThread INFO nova.compute.manager [-] [instance: 2b09c2b7-7d01-4ecb-b8d5-3e937fcf9ab4] Migrating instance to n-h1-808474-1 finished successfully. 2021-09-10 16:50:22.352 4088 3038296678072 MainThread INFO nova.scheduler.client.report [-] Deleted allocation for migration bf5ceb7e-70d8-4d4a-b896-d11c22d752df 2021-09-10 16:50:23.261 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-90c14128-569a-494f-a09c-e5403415fb75 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Received event network-vif-plugged-a8d3d6fd-c535-4f42-b11d-348191f22a38 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:50:23.272 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-90c14128-569a-494f-a09c-e5403415fb75 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:23.272 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-90c14128-569a-494f-a09c-e5403415fb75 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:23.272 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-90c14128-569a-494f-a09c-e5403415fb75 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Processing event network-vif-plugged-a8d3d6fd-c535-4f42-b11d-348191f22a38 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:50:23.318 4088 3038296677896 MainThread INFO nova.virt.hyperv.vmops [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Using config drive for instance 2021-09-10 16:50:23.746 4088 3038296677896 MainThread INFO nova.virt.hyperv.vmops [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Creating config drive at C:\openstack\instances\instance-0000000d\configdrive.iso 2021-09-10 16:50:23.834 4088 3038296677896 MainThread DEBUG oslo_concurrency.processutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000000d\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpfu97uotv execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:50:23.991 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "17abaf80-43c7-4c09-b4a2-c12636cd0cc3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:24.023 4088 3038300759320 MainThread DEBUG nova.compute.manager [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:50:24.149 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:24.149 4088 3038300759320 MainThread DEBUG nova.virt.hardware [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:50:24.149 4088 3038300759320 MainThread INFO nova.compute.claims [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Claim successful on node n-h2-808474-1 2021-09-10 16:50:24.193 4088 3038296677896 MainThread DEBUG oslo_concurrency.processutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000000d\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpfu97uotv" returned: 0 in 0.360s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:50:24.319 4088 3038300759320 MainThread DEBUG nova.virt.hyperv.hostops [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:50:24.338 4088 3038300759320 MainThread DEBUG nova.virt.hyperv.hostops [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:50:24.602 4088 3038300759320 MainThread DEBUG nova.compute.provider_tree [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:50:24.602 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.vmops [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Setting boot order for instance: instance-0000000d: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:50:24.631 4088 3038300759320 MainThread DEBUG nova.scheduler.client.report [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:50:24.631 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:24.631 4088 3038300759320 MainThread DEBUG nova.compute.manager [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:50:24.730 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.vmops [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:50:24.730 4088 3038300759320 MainThread DEBUG nova.compute.utils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:50:24.745 4088 3038296678072 GreenThread-11 DEBUG nova.compute.manager [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:50:24.745 4088 3038296678072 GreenThread-11 DEBUG nova.network.neutron [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:50:24.762 4088 3038300759320 MainThread DEBUG nova.compute.manager [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:50:24.790 4088 3038296677896 MainThread DEBUG os_win.utils.jobutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Waiting for WMI job: {'InstanceID': '27D733BB-6EEE-4690-917E-1F33D167B754', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=25470), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:50:24.930 4088 3038296678072 GreenThread-11 DEBUG nova.policy [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fac7f2174628404cb8576928225b4394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8236f1477243dfafd0682b608fc659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:50:24.991 4088 3038300759320 MainThread DEBUG nova.compute.manager [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:50:24.991 4088 3038300759320 MainThread INFO nova.virt.hyperv.vmops [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Spawning new instance 2021-09-10 16:50:25.015 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "instance-0000000e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:25.015 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "instance-0000000e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:25.015 4088 3038300759320 MainThread DEBUG nova.block_device [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:50:25.022 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:25.022 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:25.037 4088 3038300759320 MainThread DEBUG os_win.utils.pathutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Creating directory: C:\openstack\instances\instance-0000000e check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:50:25.037 4088 3038300759320 MainThread DEBUG nova.virt.hyperv.vmops [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000000e\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:50:25.178 4088 3038300758968 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000000d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:25.178 4088 3038300760904 MainThread DEBUG nova.virt.driver [-] Emitting event Started> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:50:25.178 4088 3038300760904 MainThread INFO nova.compute.manager [-] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] VM Started (Lifecycle Event) 2021-09-10 16:50:25.193 4088 3038296677896 MainThread DEBUG os_win.utils.jobutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] WMI job succeeded: {'InstanceID': '27D733BB-6EEE-4690-917E-1F33D167B754', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=381394), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:50:25.193 4088 3038296677896 MainThread DEBUG os_win.utils.compute.vmutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Successfully changed vm state of instance-0000000d to 2 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:50:25.193 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.vmops [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Successfully changed state of VM instance-0000000d to: 2 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:50:25.193 4088 3038296677896 MainThread INFO nova.compute.manager [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Took 16.61 seconds to spawn the instance on the hypervisor. 2021-09-10 16:50:25.193 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:50:25.212 4088 3038296677896 MainThread DEBUG nova.virt.hyperv.vmops [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:50:25.212 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-794f4768-51b7-41c1-b7ae-cb63be76c2e6 - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:50:25.212 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.vmops [req-794f4768-51b7-41c1-b7ae-cb63be76c2e6 - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:50:25.224 4088 3038300758968 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000000d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.047s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:25.274 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-794f4768-51b7-41c1-b7ae-cb63be76c2e6 - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:50:25.324 4088 3038300760904 MainThread INFO nova.compute.manager [req-794f4768-51b7-41c1-b7ae-cb63be76c2e6 - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:50:25.383 4088 3038300759320 MainThread DEBUG nova.virt.hyperv.vmops [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Resizing VHD C:\openstack\instances\instance-0000000e\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:50:25.383 4088 3038296677896 MainThread INFO nova.compute.manager [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Took 17.55 seconds to build instance. 2021-09-10 16:50:25.415 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-4794d6ae-eb9c-4553-b316-57c88fbd2a1e bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.687s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:25.709 4088 3038296678072 GreenThread-11 DEBUG nova.network.neutron [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Successfully created port: 9ce6624e-4307-41bc-9d39-c5c0bd6572b9 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:50:26.412 4088 3038296678072 GreenThread-11 DEBUG nova.network.neutron [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Successfully updated port: 9ce6624e-4307-41bc-9d39-c5c0bd6572b9 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:50:26.429 4088 3038296678072 GreenThread-11 DEBUG oslo_concurrency.lockutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Acquired lock "refresh_cache-17abaf80-43c7-4c09-b4a2-c12636cd0cc3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:50:26.429 4088 3038296678072 GreenThread-11 DEBUG nova.network.neutron [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:50:26.506 4088 3038296678072 GreenThread-11 DEBUG nova.network.neutron [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:50:26.697 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-1e453f38-e482-4d89-9d94-9d2fb2474245 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Received event network-changed-9ce6624e-4307-41bc-9d39-c5c0bd6572b9 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:50:26.697 4088 3038296677896 MainThread DEBUG nova.compute.manager [req-1e453f38-e482-4d89-9d94-9d2fb2474245 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Refreshing instance network info cache due to event network-changed-9ce6624e-4307-41bc-9d39-c5c0bd6572b9. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:50:26.929 4088 3038296678072 GreenThread-11 DEBUG nova.network.neutron [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Updating instance_info_cache with network_info: [{"id": "9ce6624e-4307-41bc-9d39-c5c0bd6572b9", "address": "fa:16:3e:1a:ba:e3", "network": {"id": "03c1eefd-030f-414f-b7f8-81ed611f877f", "bridge": null, "label": "tempest-LiveMigrationTest-812207682-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fa8236f1477243dfafd0682b608fc659", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9ce6624e-43", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:50:26.949 4088 3038296678072 GreenThread-11 DEBUG oslo_concurrency.lockutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Releasing lock "refresh_cache-17abaf80-43c7-4c09-b4a2-c12636cd0cc3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:50:26.949 4088 3038296678072 GreenThread-11 DEBUG nova.compute.manager [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Instance network_info: |[{"id": "9ce6624e-4307-41bc-9d39-c5c0bd6572b9", "address": "fa:16:3e:1a:ba:e3", "network": {"id": "03c1eefd-030f-414f-b7f8-81ed611f877f", "bridge": null, "label": "tempest-LiveMigrationTest-812207682-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fa8236f1477243dfafd0682b608fc659", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9ce6624e-43", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:50:26.949 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-1e453f38-e482-4d89-9d94-9d2fb2474245 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-17abaf80-43c7-4c09-b4a2-c12636cd0cc3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:50:26.949 4088 3038296677896 MainThread DEBUG nova.network.neutron [req-1e453f38-e482-4d89-9d94-9d2fb2474245 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Refreshing network info cache for port 9ce6624e-4307-41bc-9d39-c5c0bd6572b9 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:50:26.949 4088 3038300759320 MainThread DEBUG nova.compute.manager [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Preparing to wait for external event network-vif-plugged-9ce6624e-4307-41bc-9d39-c5c0bd6572b9 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:50:26.949 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "17abaf80-43c7-4c09-b4a2-c12636cd0cc3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:26.949 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "17abaf80-43c7-4c09-b4a2-c12636cd0cc3-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:26.949 4088 3038300759320 MainThread DEBUG os_win.utils.compute.vmutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Creating VM instance-0000000e create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:50:27.521 4088 3038296677896 MainThread DEBUG nova.network.neutron [req-1e453f38-e482-4d89-9d94-9d2fb2474245 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Updated VIF entry in instance network info cache for port 9ce6624e-4307-41bc-9d39-c5c0bd6572b9. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:50:27.521 4088 3038296677896 MainThread DEBUG nova.network.neutron [req-1e453f38-e482-4d89-9d94-9d2fb2474245 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Updating instance_info_cache with network_info: [{"id": "9ce6624e-4307-41bc-9d39-c5c0bd6572b9", "address": "fa:16:3e:1a:ba:e3", "network": {"id": "03c1eefd-030f-414f-b7f8-81ed611f877f", "bridge": null, "label": "tempest-LiveMigrationTest-812207682-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fa8236f1477243dfafd0682b608fc659", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9ce6624e-43", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:50:27.542 4088 3038296677896 MainThread DEBUG oslo_concurrency.lockutils [req-1e453f38-e482-4d89-9d94-9d2fb2474245 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-17abaf80-43c7-4c09-b4a2-c12636cd0cc3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:50:29.324 4088 3038300759320 MainThread DEBUG nova.virt.hyperv.vmops [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:50:29.757 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:29.789 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:50:29.861 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "98da4c02-e4db-4a02-a807-c737f9038672" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:29.866 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:50:29.974 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:29.974 4088 3038296678072 MainThread DEBUG nova.virt.hardware [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:50:29.974 4088 3038296678072 MainThread INFO nova.compute.claims [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Claim successful on node n-h2-808474-1 2021-09-10 16:50:30.135 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.hostops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:50:30.146 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.hostops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:50:30.396 4088 3038296678072 MainThread DEBUG nova.compute.provider_tree [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:50:30.414 4088 3038296678072 MainThread DEBUG nova.scheduler.client.report [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:50:30.414 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:30.414 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.296s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:30.433 4088 3038296678248 MainThread DEBUG nova.virt.hardware [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:50:30.433 4088 3038296678248 MainThread INFO nova.compute.claims [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Claim successful on node n-h2-808474-1 2021-09-10 16:50:30.467 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "530129da-d865-4265-be47-ffd4ce0f4ae1" acquired by "nova.compute.manager.ComputeManager._validate_instance_group_policy.._do_validation" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:30.506 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "530129da-d865-4265-be47-ffd4ce0f4ae1" released by "nova.compute.manager.ComputeManager._validate_instance_group_policy.._do_validation" :: held 0.047s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:30.506 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:50:30.601 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.hostops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:50:30.617 4088 3038296678072 MainThread DEBUG nova.compute.utils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:50:30.617 4088 3038296677896 GreenThread-12 DEBUG nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:50:30.617 4088 3038296677896 GreenThread-12 DEBUG nova.network.neutron [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:50:30.630 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.hostops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:50:30.649 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:50:30.674 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:50:30.674 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:50:30.677 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 16:50:30.677 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9342 2021-09-10 16:50:30.730 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Skipping network cache update for instance because it is Building. _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9352 2021-09-10 16:50:30.730 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Skipping network cache update for instance because it is Building. _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9352 2021-09-10 16:50:30.730 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Skipping network cache update for instance because it is Building. _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9352 2021-09-10 16:50:30.835 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:50:30.849 4088 3038296678072 MainThread INFO nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Spawning new instance 2021-09-10 16:50:30.865 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "instance-00000010" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:30.865 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "instance-00000010" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:30.865 4088 3038296678072 MainThread DEBUG nova.block_device [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:50:30.865 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:30.865 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:30.880 4088 3038296678248 MainThread DEBUG nova.compute.provider_tree [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:50:30.880 4088 3038296678072 MainThread DEBUG os_win.utils.pathutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Creating directory: C:\openstack\instances\instance-00000010 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:50:30.880 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000010\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:50:30.898 4088 3038296678248 MainThread DEBUG nova.scheduler.client.report [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:50:30.898 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:30.952 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "530129da-d865-4265-be47-ffd4ce0f4ae1" acquired by "nova.compute.manager.ComputeManager._validate_instance_group_policy.._do_validation" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:30.992 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "530129da-d865-4265-be47-ffd4ce0f4ae1" released by "nova.compute.manager.ComputeManager._validate_instance_group_policy.._do_validation" :: held 0.032s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:30.992 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:50:31.085 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-18930e09-cd62-4d3e-b27f-e9541dfa3efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:50:31.085 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 16:50:31.085 4088 3038296676664 GreenThread-2 DEBUG nova.objects.instance [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lazy-loading 'info_cache' on Instance uuid 18930e09-cd62-4d3e-b27f-e9541dfa3efc obj_load_attr c:\openstack\build\nova\nova\objects\instance.py:1101 2021-09-10 16:50:31.100 4088 3038296677896 GreenThread-12 DEBUG nova.policy [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf4dce0601aa49c0b9ea6c48f2953557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae864ac350142778dcbcb12a8b3800e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:50:31.232 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Resizing VHD C:\openstack\instances\instance-00000010\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:50:31.256 4088 3038296678248 MainThread DEBUG nova.compute.utils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:50:31.271 4088 3038300758616 GreenThread-13 DEBUG nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:50:31.271 4088 3038300758616 GreenThread-13 DEBUG nova.network.neutron [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:50:31.318 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:50:31.570 4088 3038300758616 GreenThread-13 DEBUG nova.policy [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf4dce0601aa49c0b9ea6c48f2953557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae864ac350142778dcbcb12a8b3800e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:50:31.662 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:50:31.686 4088 3038296678248 MainThread INFO nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Spawning new instance 2021-09-10 16:50:31.696 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "instance-00000011" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:31.696 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "instance-00000011" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:31.696 4088 3038296678248 MainThread DEBUG nova.block_device [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:50:31.696 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:31.696 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:31.712 4088 3038296678248 MainThread DEBUG os_win.utils.pathutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Creating directory: C:\openstack\instances\instance-00000011 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:50:31.712 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000011\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:50:32.040 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Resizing VHD C:\openstack\instances\instance-00000011\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:50:32.943 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Updating instance_info_cache with network_info: [{"id": "829c891f-1877-4967-a719-113170bb7add", "address": "fa:16:3e:5d:ef:74", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap829c891f-18", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:50:32.985 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-18930e09-cd62-4d3e-b27f-e9541dfa3efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:50:32.985 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 16:50:32.985 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:50:32.985 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:50:32.985 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:50:33.008 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:50:33.024 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:50:33.024 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:50:33.024 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 16:50:33.024 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:50:33.039 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:33.039 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:33.039 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 16:50:33.039 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:50:33.093 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:50:33.333 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=9629MB free_disk=59GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 16:50:33.333 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:33.467 4088 3038296677896 GreenThread-12 DEBUG nova.network.neutron [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Successfully created port: ad57189e-6845-4bd3-a7d1-681004b754a9 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:50:33.506 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:50:33.506 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:50:33.506 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:50:33.506 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:50:33.506 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:50:33.506 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:50:33.506 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:50:33.506 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:50:33.506 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 17abaf80-43c7-4c09-b4a2-c12636cd0cc3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:50:33.506 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 9 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 16:50:33.506 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=9728MB phys_disk=79GB used_disk=9GB total_vcpus=6 used_vcpus=9 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 16:50:33.561 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:50:33.584 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:50:33.913 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:50:33.958 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:50:33.958 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 16:50:33.958 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.625s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:33.958 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:50:34.240 4088 3038300758616 GreenThread-13 DEBUG nova.network.neutron [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Successfully created port: 51e81291-5d40-4203-b72f-f016060edd87 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:50:35.147 4088 3038300758968 MainThread DEBUG nova.compute.manager [req-e5ade082-e5b9-42d8-a237-b482dbfcc8a6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Received event network-vif-plugged-9ce6624e-4307-41bc-9d39-c5c0bd6572b9 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:50:35.147 4088 3038300758968 MainThread DEBUG oslo_concurrency.lockutils [req-e5ade082-e5b9-42d8-a237-b482dbfcc8a6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "17abaf80-43c7-4c09-b4a2-c12636cd0cc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:35.147 4088 3038300758968 MainThread DEBUG oslo_concurrency.lockutils [req-e5ade082-e5b9-42d8-a237-b482dbfcc8a6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "17abaf80-43c7-4c09-b4a2-c12636cd0cc3-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:35.147 4088 3038300758968 MainThread DEBUG nova.compute.manager [req-e5ade082-e5b9-42d8-a237-b482dbfcc8a6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Processing event network-vif-plugged-9ce6624e-4307-41bc-9d39-c5c0bd6572b9 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:50:35.202 4088 3038296677896 GreenThread-12 DEBUG nova.network.neutron [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Successfully updated port: ad57189e-6845-4bd3-a7d1-681004b754a9 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:50:35.212 4088 3038300759320 MainThread INFO nova.virt.hyperv.vmops [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Using config drive for instance 2021-09-10 16:50:35.212 4088 3038296677896 GreenThread-12 DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Acquired lock "refresh_cache-50586591-86ba-41be-b4e1-5004ea0d76dd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:50:35.212 4088 3038296677896 GreenThread-12 DEBUG nova.network.neutron [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:50:35.429 4088 3038296677896 GreenThread-12 DEBUG nova.network.neutron [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:50:35.665 4088 3038300759320 MainThread INFO nova.virt.hyperv.vmops [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Creating config drive at C:\openstack\instances\instance-0000000e\configdrive.iso 2021-09-10 16:50:35.775 4088 3038300759320 MainThread DEBUG oslo_concurrency.processutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000000e\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp2v9_hf_4 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:50:35.933 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:50:35.933 4088 3038300761432 MainThread DEBUG nova.compute.manager [req-940d77a4-cc0e-4c5d-bdd5-b00ee4b8ba9c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Received event network-changed-ad57189e-6845-4bd3-a7d1-681004b754a9 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:50:35.933 4088 3038300761432 MainThread DEBUG nova.compute.manager [req-940d77a4-cc0e-4c5d-bdd5-b00ee4b8ba9c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Refreshing instance network info cache due to event network-changed-ad57189e-6845-4bd3-a7d1-681004b754a9. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:50:35.960 4088 3038300758616 GreenThread-13 DEBUG nova.network.neutron [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Successfully updated port: 51e81291-5d40-4203-b72f-f016060edd87 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:50:35.990 4088 3038300758616 GreenThread-13 DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Acquired lock "refresh_cache-98da4c02-e4db-4a02-a807-c737f9038672" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:50:35.990 4088 3038300758616 GreenThread-13 DEBUG nova.network.neutron [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:50:36.118 4088 3038300758616 GreenThread-13 DEBUG nova.network.neutron [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:50:36.165 4088 3038300759320 MainThread DEBUG oslo_concurrency.processutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000000e\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp2v9_hf_4" returned: 0 in 0.390s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:50:36.242 4088 3038300761256 MainThread DEBUG nova.compute.manager [req-2ca6a469-994f-4f76-900c-21e653a873a3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Received event network-changed-51e81291-5d40-4203-b72f-f016060edd87 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:50:36.242 4088 3038300761256 MainThread DEBUG nova.compute.manager [req-2ca6a469-994f-4f76-900c-21e653a873a3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Refreshing instance network info cache due to event network-changed-51e81291-5d40-4203-b72f-f016060edd87. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:50:36.320 4088 3038296677896 GreenThread-12 DEBUG nova.network.neutron [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Updating instance_info_cache with network_info: [{"id": "ad57189e-6845-4bd3-a7d1-681004b754a9", "address": "fa:16:3e:7f:ee:91", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapad57189e-68", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:50:36.350 4088 3038296677896 GreenThread-12 DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Releasing lock "refresh_cache-50586591-86ba-41be-b4e1-5004ea0d76dd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:50:36.350 4088 3038296677896 GreenThread-12 DEBUG nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Instance network_info: |[{"id": "ad57189e-6845-4bd3-a7d1-681004b754a9", "address": "fa:16:3e:7f:ee:91", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapad57189e-68", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:50:36.350 4088 3038300761432 MainThread DEBUG oslo_concurrency.lockutils [req-940d77a4-cc0e-4c5d-bdd5-b00ee4b8ba9c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-50586591-86ba-41be-b4e1-5004ea0d76dd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:50:36.350 4088 3038300761432 MainThread DEBUG nova.network.neutron [req-940d77a4-cc0e-4c5d-bdd5-b00ee4b8ba9c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Refreshing network info cache for port ad57189e-6845-4bd3-a7d1-681004b754a9 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:50:36.350 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Preparing to wait for external event network-vif-plugged-ad57189e-6845-4bd3-a7d1-681004b754a9 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:50:36.350 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:36.350 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:36.350 4088 3038296678072 MainThread DEBUG os_win.utils.compute.vmutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Creating VM instance-00000010 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:50:36.631 4088 3038300759320 MainThread DEBUG nova.virt.hyperv.vmops [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Setting boot order for instance: instance-0000000e: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:50:36.724 4088 3038300758616 GreenThread-13 DEBUG nova.network.neutron [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Updating instance_info_cache with network_info: [{"id": "51e81291-5d40-4203-b72f-f016060edd87", "address": "fa:16:3e:82:36:43", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap51e81291-5d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:50:36.771 4088 3038300758616 GreenThread-13 DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Releasing lock "refresh_cache-98da4c02-e4db-4a02-a807-c737f9038672" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:50:36.771 4088 3038300758616 GreenThread-13 DEBUG nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Instance network_info: |[{"id": "51e81291-5d40-4203-b72f-f016060edd87", "address": "fa:16:3e:82:36:43", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap51e81291-5d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:50:36.771 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Preparing to wait for external event network-vif-plugged-51e81291-5d40-4203-b72f-f016060edd87 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:50:36.771 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "98da4c02-e4db-4a02-a807-c737f9038672-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:36.771 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "98da4c02-e4db-4a02-a807-c737f9038672-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:36.771 4088 3038296678248 MainThread DEBUG os_win.utils.compute.vmutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Creating VM instance-00000011 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:50:36.771 4088 3038300761256 MainThread DEBUG oslo_concurrency.lockutils [req-2ca6a469-994f-4f76-900c-21e653a873a3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-98da4c02-e4db-4a02-a807-c737f9038672" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:50:36.771 4088 3038300761256 MainThread DEBUG nova.network.neutron [req-2ca6a469-994f-4f76-900c-21e653a873a3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Refreshing network info cache for port 51e81291-5d40-4203-b72f-f016060edd87 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:50:36.959 4088 3038300759320 MainThread DEBUG nova.virt.hyperv.vmops [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:50:37.006 4088 3038300761432 MainThread DEBUG nova.network.neutron [req-940d77a4-cc0e-4c5d-bdd5-b00ee4b8ba9c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Updated VIF entry in instance network info cache for port ad57189e-6845-4bd3-a7d1-681004b754a9. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:50:37.006 4088 3038300761432 MainThread DEBUG nova.network.neutron [req-940d77a4-cc0e-4c5d-bdd5-b00ee4b8ba9c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Updating instance_info_cache with network_info: [{"id": "ad57189e-6845-4bd3-a7d1-681004b754a9", "address": "fa:16:3e:7f:ee:91", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapad57189e-68", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:50:37.006 4088 3038300759320 MainThread DEBUG os_win.utils.jobutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Waiting for WMI job: {'InstanceID': 'A5CFC98C-2BF5-4EF7-97E2-BC306BCD0ADD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=22821), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:50:37.037 4088 3038300761432 MainThread DEBUG oslo_concurrency.lockutils [req-940d77a4-cc0e-4c5d-bdd5-b00ee4b8ba9c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-50586591-86ba-41be-b4e1-5004ea0d76dd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:50:37.505 4088 3038300761432 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000000e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:37.505 4088 3038300758616 MainThread DEBUG nova.virt.driver [-] Emitting event Started> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:50:37.505 4088 3038300758616 MainThread INFO nova.compute.manager [-] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] VM Started (Lifecycle Event) 2021-09-10 16:50:37.522 4088 3038300759320 MainThread DEBUG os_win.utils.jobutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] WMI job succeeded: {'InstanceID': 'A5CFC98C-2BF5-4EF7-97E2-BC306BCD0ADD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=425507), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:50:37.522 4088 3038300759320 MainThread DEBUG os_win.utils.compute.vmutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Successfully changed vm state of instance-0000000e to 2 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:50:37.522 4088 3038300759320 MainThread DEBUG nova.virt.hyperv.vmops [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Successfully changed state of VM instance-0000000e to: 2 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:50:37.522 4088 3038300759320 MainThread INFO nova.compute.manager [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Took 12.53 seconds to spawn the instance on the hypervisor. 2021-09-10 16:50:37.522 4088 3038300759320 MainThread DEBUG nova.compute.manager [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:50:37.522 4088 3038300759320 MainThread DEBUG nova.virt.hyperv.vmops [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:50:37.539 4088 3038300758616 MainThread DEBUG nova.compute.manager [req-2a7e29f3-d0fe-4538-84fc-64497a036b3d - - - - -] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:50:37.539 4088 3038300758616 MainThread DEBUG nova.virt.hyperv.vmops [req-2a7e29f3-d0fe-4538-84fc-64497a036b3d - - - - -] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:50:37.630 4088 3038300761432 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000000e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.125s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:37.677 4088 3038300761256 MainThread DEBUG nova.network.neutron [req-2ca6a469-994f-4f76-900c-21e653a873a3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Updated VIF entry in instance network info cache for port 51e81291-5d40-4203-b72f-f016060edd87. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:50:37.677 4088 3038300761256 MainThread DEBUG nova.network.neutron [req-2ca6a469-994f-4f76-900c-21e653a873a3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Updating instance_info_cache with network_info: [{"id": "51e81291-5d40-4203-b72f-f016060edd87", "address": "fa:16:3e:82:36:43", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap51e81291-5d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:50:37.694 4088 3038300758616 MainThread DEBUG nova.compute.manager [req-2a7e29f3-d0fe-4538-84fc-64497a036b3d - - - - -] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:50:37.726 4088 3038300761256 MainThread DEBUG oslo_concurrency.lockutils [req-2ca6a469-994f-4f76-900c-21e653a873a3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-98da4c02-e4db-4a02-a807-c737f9038672" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:50:37.818 4088 3038300759320 MainThread INFO nova.compute.manager [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Took 13.70 seconds to build instance. 2021-09-10 16:50:37.849 4088 3038300759320 MainThread DEBUG oslo_concurrency.lockutils [req-5afa1a50-862a-431a-bdc9-1a3952176e0f fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "17abaf80-43c7-4c09-b4a2-c12636cd0cc3" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.859s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:38.975 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:50:39.101 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:50:42.290 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "17abaf80-43c7-4c09-b4a2-c12636cd0cc3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:42.302 4088 3038300760904 MainThread DEBUG nova.compute.utils [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Using /dev/sd instead of /dev/xvd get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:50:42.318 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "17abaf80-43c7-4c09-b4a2-c12636cd0cc3" released by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 0.032s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:42.349 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:42.398 4088 3038300761784 MainThread DEBUG nova.compute.manager [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:50:42.521 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:42.521 4088 3038300761784 MainThread DEBUG nova.virt.hardware [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:50:42.521 4088 3038300761784 MainThread INFO nova.compute.claims [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Claim successful on node n-h2-808474-1 2021-09-10 16:50:42.585 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "17abaf80-43c7-4c09-b4a2-c12636cd0cc3" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:42.585 4088 3038300760904 MainThread INFO nova.compute.manager [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Attaching volume 4e982f7d-54f9-44a5-9572-7ad727331d99 to /dev/sdb 2021-09-10 16:50:42.865 4088 3038300761784 MainThread DEBUG nova.virt.hyperv.hostops [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:50:42.896 4088 3038300761784 MainThread DEBUG nova.virt.hyperv.hostops [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:50:42.896 4088 3038300760904 MainThread DEBUG os_brick.utils [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:50:42.916 4088 3038300760904 MainThread DEBUG os_brick.utils [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] <== get_connector_properties: return (0ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:50:42.916 4088 3038300760904 MainThread DEBUG nova.virt.block_device [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Updating existing volume attachment record: f3cb7a9b-49be-4e16-8af7-6ddc6b51fc20 _volume_attach c:\openstack\build\nova\nova\virt\block_device.py:556 2021-09-10 16:50:43.302 4088 3038300761784 MainThread DEBUG nova.compute.provider_tree [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:50:43.318 4088 3038300761784 MainThread DEBUG nova.scheduler.client.report [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:50:43.318 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.797s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:43.318 4088 3038300761784 MainThread DEBUG nova.compute.manager [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:50:43.397 4088 3038300761784 MainThread DEBUG nova.compute.utils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:50:43.397 4088 3038338904488 GreenThread-14 DEBUG nova.compute.manager [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:50:43.397 4088 3038338904488 GreenThread-14 DEBUG nova.network.neutron [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:50:43.413 4088 3038300761784 MainThread DEBUG nova.compute.manager [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:50:43.553 4088 3038300761784 MainThread DEBUG nova.compute.manager [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:50:43.553 4088 3038300761784 MainThread INFO nova.virt.hyperv.vmops [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Spawning new instance 2021-09-10 16:50:43.576 4088 3038338904488 GreenThread-14 DEBUG nova.policy [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cfd5525c9e74f68a421f54d1364dd30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28acab1b43b74dc28de8be447d122661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:50:43.576 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "instance-00000013" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:43.576 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "instance-00000013" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:43.576 4088 3038300761784 MainThread DEBUG nova.block_device [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:50:43.576 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:43.576 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:43.599 4088 3038300761784 MainThread DEBUG os_win.utils.pathutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Creating directory: C:\openstack\instances\instance-00000013 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:50:43.599 4088 3038300761784 MainThread DEBUG nova.virt.hyperv.vmops [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000013\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:50:43.981 4088 3038300761784 MainThread DEBUG nova.virt.hyperv.vmops [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Resizing VHD C:\openstack\instances\instance-00000013\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:50:45.161 4088 3038338904488 GreenThread-14 DEBUG nova.network.neutron [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Successfully created port: d98b48f6-4cb1-44c3-9950-b42769c9d93e _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:50:45.464 4088 3038338904840 MainThread DEBUG nova.compute.manager [req-9f1754d9-620e-45ef-8e66-1e80713d9fa7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Received event network-vif-plugged-51e81291-5d40-4203-b72f-f016060edd87 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:50:45.464 4088 3038338904840 MainThread DEBUG oslo_concurrency.lockutils [req-9f1754d9-620e-45ef-8e66-1e80713d9fa7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "98da4c02-e4db-4a02-a807-c737f9038672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:45.464 4088 3038338904840 MainThread DEBUG oslo_concurrency.lockutils [req-9f1754d9-620e-45ef-8e66-1e80713d9fa7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "98da4c02-e4db-4a02-a807-c737f9038672-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:45.464 4088 3038338904840 MainThread DEBUG nova.compute.manager [req-9f1754d9-620e-45ef-8e66-1e80713d9fa7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Processing event network-vif-plugged-51e81291-5d40-4203-b72f-f016060edd87 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:50:45.509 4088 3038296678248 MainThread INFO nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Using config drive for instance 2021-09-10 16:50:45.648 4088 3038296678248 MainThread INFO nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Creating config drive at C:\openstack\instances\instance-00000011\configdrive.iso 2021-09-10 16:50:45.740 4088 3038296678248 MainThread DEBUG oslo_concurrency.processutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000011\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp0oglcr0x execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:50:46.117 4088 3038296678248 MainThread DEBUG oslo_concurrency.processutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000011\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp0oglcr0x" returned: 0 in 0.375s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:50:46.337 4088 3038338904488 GreenThread-14 DEBUG nova.network.neutron [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Successfully updated port: d98b48f6-4cb1-44c3-9950-b42769c9d93e _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:50:46.349 4088 3038338904488 GreenThread-14 DEBUG oslo_concurrency.lockutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Acquired lock "refresh_cache-6a33a253-c7b1-44b1-bdc0-eca64733ab55" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:50:46.349 4088 3038338904488 GreenThread-14 DEBUG nova.network.neutron [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:50:46.458 4088 3038338905016 MainThread DEBUG nova.compute.manager [req-1b21e97a-a74a-43b2-8551-2e59eec3cd32 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Received event network-changed-d98b48f6-4cb1-44c3-9950-b42769c9d93e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:50:46.458 4088 3038338905016 MainThread DEBUG nova.compute.manager [req-1b21e97a-a74a-43b2-8551-2e59eec3cd32 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Refreshing instance network info cache due to event network-changed-d98b48f6-4cb1-44c3-9950-b42769c9d93e. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:50:46.475 4088 3038338904488 GreenThread-14 DEBUG nova.network.neutron [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:50:46.676 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Setting boot order for instance: instance-00000011: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:50:46.771 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:50:46.822 4088 3038296678248 MainThread DEBUG os_win.utils.jobutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Waiting for WMI job: {'InstanceID': 'B27A7380-6DCC-4C3E-A9D0-4CD265D16F75', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17834), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:50:47.193 4088 3038338904488 GreenThread-14 DEBUG nova.network.neutron [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Updating instance_info_cache with network_info: [{"id": "d98b48f6-4cb1-44c3-9950-b42769c9d93e", "address": "fa:16:3e:44:cf:f9", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd98b48f6-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:50:47.211 4088 3038338904488 GreenThread-14 DEBUG oslo_concurrency.lockutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Releasing lock "refresh_cache-6a33a253-c7b1-44b1-bdc0-eca64733ab55" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:50:47.240 4088 3038338904488 GreenThread-14 DEBUG nova.compute.manager [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Instance network_info: |[{"id": "d98b48f6-4cb1-44c3-9950-b42769c9d93e", "address": "fa:16:3e:44:cf:f9", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd98b48f6-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:50:47.240 4088 3038338905016 MainThread DEBUG oslo_concurrency.lockutils [req-1b21e97a-a74a-43b2-8551-2e59eec3cd32 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-6a33a253-c7b1-44b1-bdc0-eca64733ab55" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:50:47.240 4088 3038338905016 MainThread DEBUG nova.network.neutron [req-1b21e97a-a74a-43b2-8551-2e59eec3cd32 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Refreshing network info cache for port d98b48f6-4cb1-44c3-9950-b42769c9d93e _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:50:47.245 4088 3038300761784 MainThread DEBUG nova.compute.manager [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Preparing to wait for external event network-vif-plugged-d98b48f6-4cb1-44c3-9950-b42769c9d93e prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:50:47.255 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:47.255 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:47.255 4088 3038300761784 MainThread DEBUG os_win.utils.compute.vmutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Creating VM instance-00000013 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:50:47.255 4088 3038338904488 MainThread DEBUG nova.virt.driver [-] Emitting event Started> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:50:47.255 4088 3038338904488 MainThread INFO nova.compute.manager [-] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] VM Started (Lifecycle Event) 2021-09-10 16:50:47.255 4088 3038338904664 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000011" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:47.302 4088 3038338904488 MainThread DEBUG nova.compute.manager [req-016c8062-1c0e-4c8c-b5ff-a983a8204754 - - - - -] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:50:47.302 4088 3038338904488 MainThread DEBUG nova.virt.hyperv.vmops [req-016c8062-1c0e-4c8c-b5ff-a983a8204754 - - - - -] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:50:47.317 4088 3038338904664 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000011" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.063s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:47.345 4088 3038296678248 MainThread DEBUG os_win.utils.jobutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] WMI job succeeded: {'InstanceID': 'B27A7380-6DCC-4C3E-A9D0-4CD265D16F75', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=430969), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:50:47.345 4088 3038296678248 MainThread DEBUG os_win.utils.compute.vmutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Successfully changed vm state of instance-00000011 to 2 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:50:47.345 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Successfully changed state of VM instance-00000011 to: 2 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:50:47.345 4088 3038296678248 MainThread INFO nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Took 15.69 seconds to spawn the instance on the hypervisor. 2021-09-10 16:50:47.345 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:50:47.345 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:50:47.413 4088 3038338904488 MainThread DEBUG nova.compute.manager [req-016c8062-1c0e-4c8c-b5ff-a983a8204754 - - - - -] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:50:47.459 4088 3038338904488 MainThread INFO nova.compute.manager [req-016c8062-1c0e-4c8c-b5ff-a983a8204754 - - - - -] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:50:47.568 4088 3038338904488 MainThread DEBUG nova.compute.manager [req-6abffe06-eaee-420a-b007-5ff05c15a6ea 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Received event network-vif-plugged-ad57189e-6845-4bd3-a7d1-681004b754a9 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:50:47.568 4088 3038338904488 MainThread DEBUG oslo_concurrency.lockutils [req-6abffe06-eaee-420a-b007-5ff05c15a6ea 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:47.568 4088 3038338904488 MainThread DEBUG oslo_concurrency.lockutils [req-6abffe06-eaee-420a-b007-5ff05c15a6ea 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:47.568 4088 3038338904488 MainThread DEBUG nova.compute.manager [req-6abffe06-eaee-420a-b007-5ff05c15a6ea 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Processing event network-vif-plugged-ad57189e-6845-4bd3-a7d1-681004b754a9 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:50:47.568 4088 3038296678248 MainThread INFO nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Took 17.58 seconds to build instance. 2021-09-10 16:50:47.614 4088 3038296678072 MainThread INFO nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Using config drive for instance 2021-09-10 16:50:47.614 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "98da4c02-e4db-4a02-a807-c737f9038672" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.750s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:47.838 4088 3038296678072 MainThread INFO nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Creating config drive at C:\openstack\instances\instance-00000010\configdrive.iso 2021-09-10 16:50:47.958 4088 3038296678072 MainThread DEBUG oslo_concurrency.processutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000010\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp8jb37kzf execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:50:48.258 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.volumeops [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Attaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-4e982f7d-54f9-44a5-9572-7ad727331d99', 'target_lun': 0, 'volume_id': '4e982f7d-54f9-44a5-9572-7ad727331d99', 'auth_method': 'CHAP', 'auth_username': '64HsfuxbJfZXqwRTayVC', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'reserved', 'instance': '17abaf80-43c7-4c09-b4a2-c12636cd0cc3', 'attached_at': '', 'detached_at': '', 'volume_id': '4e982f7d-54f9-44a5-9572-7ad727331d99', 'serial': '4e982f7d-54f9-44a5-9572-7ad727331d99'} to instance-0000000e _attach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:108 2021-09-10 16:50:48.258 4088 3038300760904 MainThread DEBUG os_brick.initiator.connector [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Factory for iscsi on None factory c:\python37\lib\site-packages\os_brick\initiator\connector.py:282 2021-09-10 16:50:48.258 4088 3038300760904 MainThread INFO os_brick.initiator.windows.iscsi [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] No iSCSI initiator was explicitly requested. The Microsoft iSCSI initiator will choose the initiator when establishing sessions. 2021-09-10 16:50:48.258 4088 3038300760904 MainThread DEBUG os_brick.initiator.windows.iscsi [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-4e982f7d-54f9-44a5-9572-7ad727331d99', 'target_lun': 0, 'volume_id': '4e982f7d-54f9-44a5-9572-7ad727331d99', 'auth_method': 'CHAP', 'auth_username': '64HsfuxbJfZXqwRTayVC', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:50:48.258 4088 3038300760904 MainThread INFO os_brick.initiator.windows.iscsi [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Attempting to establish an iSCSI session to target iqn.2010-10.org.openstack:volume-4e982f7d-54f9-44a5-9572-7ad727331d99 on portal 10.222.0.55:3260 accessing LUN 0 using initiator None. 2021-09-10 16:50:48.258 4088 3038300760904 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Logging in iSCSI target iqn.2010-10.org.openstack:volume-4e982f7d-54f9-44a5-9572-7ad727331d99 login_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:401 2021-09-10 16:50:48.446 4088 3038338905016 MainThread DEBUG nova.network.neutron [req-1b21e97a-a74a-43b2-8551-2e59eec3cd32 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Updated VIF entry in instance network info cache for port d98b48f6-4cb1-44c3-9950-b42769c9d93e. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:50:48.446 4088 3038338905016 MainThread DEBUG nova.network.neutron [req-1b21e97a-a74a-43b2-8551-2e59eec3cd32 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Updating instance_info_cache with network_info: [{"id": "d98b48f6-4cb1-44c3-9950-b42769c9d93e", "address": "fa:16:3e:44:cf:f9", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd98b48f6-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:50:48.475 4088 3038338905016 MainThread DEBUG oslo_concurrency.lockutils [req-1b21e97a-a74a-43b2-8551-2e59eec3cd32 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-6a33a253-c7b1-44b1-bdc0-eca64733ab55" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:50:48.492 4088 3038296678072 MainThread DEBUG oslo_concurrency.processutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000010\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp8jb37kzf" returned: 0 in 0.532s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:50:49.336 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Setting boot order for instance: instance-00000010: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:50:49.509 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:50:49.633 4088 3038296678072 MainThread DEBUG os_win.utils.jobutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Waiting for WMI job: {'InstanceID': 'BAFC7D38-0411-4F90-8649-267E255FCEA8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=23260), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:50:49.823 4088 3038300761784 MainThread DEBUG nova.virt.hyperv.vmops [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:50:50.146 4088 3038296678072 MainThread DEBUG os_win.utils.jobutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] WMI job succeeded: {'InstanceID': 'BAFC7D38-0411-4F90-8649-267E255FCEA8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=516393), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:50:50.146 4088 3038296678072 MainThread DEBUG os_win.utils.compute.vmutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Successfully changed vm state of instance-00000010 to 2 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:50:50.165 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Successfully changed state of VM instance-00000010 to: 2 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:50:50.165 4088 3038296678072 MainThread INFO nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Took 19.33 seconds to spawn the instance on the hypervisor. 2021-09-10 16:50:50.165 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:50:50.165 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:50:50.182 4088 3038296678248 MainThread DEBUG nova.virt.driver [-] Emitting event Started> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:50:50.182 4088 3038296678248 MainThread INFO nova.compute.manager [-] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] VM Started (Lifecycle Event) 2021-09-10 16:50:50.192 4088 3038338904840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000010" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:50.209 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-61e6aebc-7220-4748-952b-3276079d6a7d - - - - -] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:50:50.209 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-61e6aebc-7220-4748-952b-3276079d6a7d - - - - -] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:50:50.272 4088 3038338904840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000010" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.094s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:50.304 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-61e6aebc-7220-4748-952b-3276079d6a7d - - - - -] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:50:50.353 4088 3038296678248 MainThread INFO nova.compute.manager [req-61e6aebc-7220-4748-952b-3276079d6a7d - - - - -] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:50:50.443 4088 3038296678072 MainThread INFO nova.compute.manager [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Took 20.52 seconds to build instance. 2021-09-10 16:50:50.477 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-0ca3acc8-f8b4-45d3-a939-c3a5d08a4eec bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 20.719s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:53.289 4088 3038300760904 MainThread DEBUG os_win.utils.storage.diskutils [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 16:50:53.779 4088 3038300760904 MainThread DEBUG os_win.utils.storage.diskutils [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 16:50:55.240 4088 3038300760904 MainThread DEBUG os_brick.initiator.windows.iscsi [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] <== connect_volume: return (6982ms) {'type': 'block', 'path': '\\\\.\\PhysicalDrive1', 'number': 1, 'scsi_wwn': '360014056D06827A0A37453798A12FB65'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:50:55.396 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:55.414 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:50:55.632 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:55.632 4088 3038296678072 MainThread DEBUG nova.virt.hardware [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:50:55.648 4088 3038296678072 MainThread INFO nova.compute.claims [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Claim successful on node n-h2-808474-1 2021-09-10 16:50:55.896 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.hostops [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:50:55.942 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.hostops [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:50:56.163 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-9a3e5252-3553-4953-9bfc-9866c9d0fa3d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Received event network-vif-plugged-d98b48f6-4cb1-44c3-9950-b42769c9d93e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:50:56.177 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-9a3e5252-3553-4953-9bfc-9866c9d0fa3d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:56.177 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-9a3e5252-3553-4953-9bfc-9866c9d0fa3d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:56.177 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-9a3e5252-3553-4953-9bfc-9866c9d0fa3d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Processing event network-vif-plugged-d98b48f6-4cb1-44c3-9950-b42769c9d93e _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:50:56.240 4088 3038300761784 MainThread INFO nova.virt.hyperv.vmops [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Using config drive for instance 2021-09-10 16:50:56.442 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.livemigrationops [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] check_can_live_migrate_destination called check_can_live_migrate_destination c:\openstack\build\nova\nova\virt\hyperv\livemigrationops.py:132 2021-09-10 16:50:56.442 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.pathutils [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Checking if C:\openstack\instances and \\n-h1-808474-1\C$\openstack\instances point to the same location. check_dirs_shared_storage c:\openstack\build\nova\nova\virt\hyperv\pathutils.py:183 2021-09-10 16:50:56.461 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] destination check data is HyperVLiveMigrateData(is_shared_instance_path=False,is_volume_backed=,migration=,old_vol_attachment_ids=,vifs=,wait_for_vif_plugged=) check_can_live_migrate_destination c:\openstack\build\nova\nova\compute\manager.py:8040 2021-09-10 16:50:56.506 4088 3038300760904 MainThread DEBUG nova.objects.instance [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lazy-loading 'flavor' on Instance uuid 17abaf80-43c7-4c09-b4a2-c12636cd0cc3 obj_load_attr c:\openstack\build\nova\nova\objects\instance.py:1101 2021-09-10 16:50:56.526 4088 3038296678072 MainThread DEBUG nova.compute.provider_tree [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:50:56.553 4088 3038296678072 MainThread DEBUG nova.scheduler.client.report [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:50:56.553 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.922s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:56.676 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-5a00a3d8-6ba2-47ab-bbad-a911fded678b fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "17abaf80-43c7-4c09-b4a2-c12636cd0cc3" released by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 14.094s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:56.755 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.livemigrationops [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] cleanup_live_migration_destination_check called cleanup_live_migration_destination_check c:\openstack\build\nova\nova\virt\hyperv\livemigrationops.py:148 2021-09-10 16:50:56.786 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "d5c286bc-3fa1-47d5-96ca-aab4277f06c9" acquired by "nova.compute.manager.ComputeManager._validate_instance_group_policy.._do_validation" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:56.801 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] No node specified, defaulting to n-h2-808474-1 _get_nodename c:\openstack\build\nova\nova\compute\manager.py:9984 2021-09-10 16:50:56.885 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "d5c286bc-3fa1-47d5-96ca-aab4277f06c9" released by "nova.compute.manager.ComputeManager._validate_instance_group_policy.._do_validation" :: held 0.094s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:56.885 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:50:57.052 4088 3038296678072 MainThread DEBUG nova.compute.utils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:50:57.052 4088 3038296678248 GreenThread-15 DEBUG nova.compute.manager [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:50:57.052 4088 3038296678248 GreenThread-15 DEBUG nova.network.neutron [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:50:57.102 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:50:57.223 4088 3038300761784 MainThread INFO nova.virt.hyperv.vmops [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Creating config drive at C:\openstack\instances\instance-00000013\configdrive.iso 2021-09-10 16:50:57.380 4088 3038300761784 MainThread DEBUG oslo_concurrency.processutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000013\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp032n1c3i execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:50:57.586 4088 3038296678248 GreenThread-15 DEBUG nova.policy [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf4dce0601aa49c0b9ea6c48f2953557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae864ac350142778dcbcb12a8b3800e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:50:57.757 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:50:57.789 4088 3038296678072 MainThread INFO nova.virt.hyperv.vmops [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Spawning new instance 2021-09-10 16:50:57.817 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "instance-00000015" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:57.817 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "instance-00000015" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:57.817 4088 3038296678072 MainThread DEBUG nova.block_device [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:50:57.817 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:57.817 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:57.833 4088 3038296678072 MainThread DEBUG os_win.utils.pathutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Creating directory: C:\openstack\instances\instance-00000015 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:50:57.833 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000015\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:50:57.926 4088 3038300761784 MainThread DEBUG oslo_concurrency.processutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000013\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp032n1c3i" returned: 0 in 0.547s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:50:58.101 4088 3038338904136 MainThread DEBUG nova.compute.manager [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] pre_live_migration data is HyperVLiveMigrateData(is_shared_instance_path=False,is_volume_backed=False,migration=,old_vol_attachment_ids=,vifs=[VIFMigrateData],wait_for_vif_plugged=) pre_live_migration c:\openstack\build\nova\nova\compute\manager.py:8168 2021-09-10 16:50:58.148 4088 3038338904136 MainThread DEBUG oslo_concurrency.lockutils [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Acquired lock "refresh_cache-359fd482-69f5-4194-9466-f46ea31258d3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:50:58.148 4088 3038338904136 MainThread DEBUG nova.network.neutron [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:50:58.286 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Resizing VHD C:\openstack\instances\instance-00000015\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:50:58.645 4088 3038300761784 MainThread DEBUG nova.virt.hyperv.vmops [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Setting boot order for instance: instance-00000013: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:50:58.773 4088 3038300761784 MainThread DEBUG nova.virt.hyperv.vmops [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:50:58.849 4088 3038300761784 MainThread DEBUG os_win.utils.jobutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Waiting for WMI job: {'InstanceID': 'BC86CE42-3F6D-4E4C-8DF9-74C477B2AA8A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=39274), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:50:59.240 4088 3038296678248 GreenThread-15 DEBUG nova.network.neutron [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Successfully created port: 2ef6a3e6-e7a5-4da7-941d-89a1d5c697b7 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:50:59.412 4088 3038300761784 MainThread DEBUG os_win.utils.jobutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] WMI job succeeded: {'InstanceID': 'BC86CE42-3F6D-4E4C-8DF9-74C477B2AA8A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=567933), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:50:59.412 4088 3038300761784 MainThread DEBUG os_win.utils.compute.vmutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Successfully changed vm state of instance-00000013 to 2 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:50:59.412 4088 3038300761784 MainThread DEBUG nova.virt.hyperv.vmops [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Successfully changed state of VM instance-00000013 to: 2 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:50:59.412 4088 3038300761784 MainThread INFO nova.compute.manager [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Took 15.86 seconds to spawn the instance on the hypervisor. 2021-09-10 16:50:59.412 4088 3038300761784 MainThread DEBUG nova.compute.manager [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:50:59.412 4088 3038300761784 MainThread DEBUG nova.virt.hyperv.vmops [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:50:59.504 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000013" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:50:59.504 4088 3038338905016 MainThread DEBUG nova.virt.driver [-] Emitting event Started> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:50:59.504 4088 3038338905016 MainThread INFO nova.compute.manager [-] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] VM Started (Lifecycle Event) 2021-09-10 16:50:59.527 4088 3038338905016 MainThread DEBUG nova.compute.manager [req-df01a4b2-d3a7-4a31-ba70-cbe2cc7fd0f5 - - - - -] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:50:59.527 4088 3038338905016 MainThread DEBUG nova.virt.hyperv.vmops [req-df01a4b2-d3a7-4a31-ba70-cbe2cc7fd0f5 - - - - -] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:50:59.585 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000013" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.078s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:50:59.621 4088 3038338905016 MainThread DEBUG nova.compute.manager [req-df01a4b2-d3a7-4a31-ba70-cbe2cc7fd0f5 - - - - -] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:50:59.678 4088 3038338905016 MainThread INFO nova.compute.manager [req-df01a4b2-d3a7-4a31-ba70-cbe2cc7fd0f5 - - - - -] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:50:59.763 4088 3038300761784 MainThread INFO nova.compute.manager [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Took 17.28 seconds to build instance. 2021-09-10 16:50:59.794 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [req-7108ad70-00fc-4b4e-a37e-4f556fcae7a2 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:00.176 4088 3038338904136 MainThread DEBUG nova.network.neutron [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Updating instance_info_cache with network_info: [{"id": "43904798-2eab-4ec0-9b1b-f79a929eba99", "address": "fa:16:3e:9c:26:60", "network": {"id": "7434a41e-b78f-4cb9-8ffe-b2514d097201", "bridge": null, "label": "tempest-LiveAutoBlockMigrationV225Test-1499875764-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91237ebda1b54d2dbc761e48fdd93516", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap43904798-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:51:00.241 4088 3038338904136 MainThread DEBUG oslo_concurrency.lockutils [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Releasing lock "refresh_cache-359fd482-69f5-4194-9466-f46ea31258d3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:51:00.254 4088 3038338904136 MainThread DEBUG os_brick.utils [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:51:00.254 4088 3038338904136 MainThread DEBUG os_brick.utils [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] <== get_connector_properties: return (0ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:51:00.270 4088 3038338904136 MainThread DEBUG nova.virt.hyperv.livemigrationops [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] pre_live_migration called pre_live_migration c:\openstack\build\nova\nova\virt\hyperv\livemigrationops.py:92 2021-09-10 16:51:00.303 4088 3038338904136 MainThread DEBUG nova.block_device [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:51:00.303 4088 3038338904136 MainThread DEBUG oslo_concurrency.lockutils [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:00.303 4088 3038338904136 MainThread DEBUG oslo_concurrency.lockutils [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:00.303 4088 3038338904136 MainThread DEBUG nova.compute.manager [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] driver pre_live_migration data is HyperVLiveMigrateData(is_shared_instance_path=False,is_volume_backed=False,migration=,old_vol_attachment_ids={},vifs=[VIFMigrateData],wait_for_vif_plugged=) pre_live_migration c:\openstack\build\nova\nova\compute\manager.py:8230 2021-09-10 16:51:00.933 4088 3038300761784 MainThread DEBUG nova.virt.hyperv.livemigrationops [req-361454bc-34db-4d92-afb2-0647bf016643 631464703d054b39ab2dbb2ef12349bf 65f9947f24f541579df4a582376707cc - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] check_can_live_migrate_source called check_can_live_migrate_source c:\openstack\build\nova\nova\virt\hyperv\livemigrationops.py:153 2021-09-10 16:51:00.933 4088 3038300761784 MainThread DEBUG nova.compute.manager [req-361454bc-34db-4d92-afb2-0647bf016643 631464703d054b39ab2dbb2ef12349bf 65f9947f24f541579df4a582376707cc - default default] source check data is HyperVLiveMigrateData(is_shared_instance_path=False,is_volume_backed=False,migration=,old_vol_attachment_ids=,vifs=,wait_for_vif_plugged=) check_can_live_migrate_source c:\openstack\build\nova\nova\compute\manager.py:8151 2021-09-10 16:51:00.933 4088 3038296678248 GreenThread-15 DEBUG nova.network.neutron [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Successfully updated port: 2ef6a3e6-e7a5-4da7-941d-89a1d5c697b7 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:51:00.957 4088 3038296678248 GreenThread-15 DEBUG oslo_concurrency.lockutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Acquired lock "refresh_cache-592bb39a-81cb-43f8-a643-b04092bd9e8a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:51:00.957 4088 3038296678248 GreenThread-15 DEBUG nova.network.neutron [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:51:01.285 4088 3038296678248 GreenThread-15 DEBUG nova.network.neutron [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:51:01.929 4088 3038338904840 MainThread DEBUG oslo_concurrency.lockutils [req-f6d6b71c-fc20-446a-be74-9bc1ffb9ea26 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:01.929 4088 3038338904840 MainThread DEBUG oslo_concurrency.lockutils [req-f6d6b71c-fc20-446a-be74-9bc1ffb9ea26 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:01.929 4088 3038338904840 MainThread DEBUG oslo_concurrency.lockutils [req-f6d6b71c-fc20-446a-be74-9bc1ffb9ea26 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:01.942 4088 3038338904840 MainThread ERROR nova.compute.manager [req-f6d6b71c-fc20-446a-be74-9bc1ffb9ea26 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Setting instance vm_state to ERROR: NameError: name 'instant' is not defined 2021-09-10 16:51:01.942 4088 3038338904840 MainThread TRACE nova.compute.manager [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Traceback (most recent call last): 2021-09-10 16:51:01.942 4088 3038338904840 MainThread TRACE nova.compute.manager [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:51:01.942 4088 3038338904840 MainThread TRACE nova.compute.manager [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] self._delete_instance(context, instance, bdms) 2021-09-10 16:51:01.942 4088 3038338904840 MainThread TRACE nova.compute.manager [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:51:01.942 4088 3038338904840 MainThread TRACE nova.compute.manager [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:51:01.942 4088 3038338904840 MainThread TRACE nova.compute.manager [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] NameError: name 'instant' is not defined 2021-09-10 16:51:01.942 4088 3038338904840 MainThread TRACE nova.compute.manager [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] 2021-09-10 16:51:02.036 4088 3038338904840 MainThread DEBUG oslo_concurrency.lockutils [req-f6d6b71c-fc20-446a-be74-9bc1ffb9ea26 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55" released by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 0.109s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:02.196 4088 3038338904840 MainThread DEBUG oslo_concurrency.lockutils [req-f6d6b71c-fc20-446a-be74-9bc1ffb9ea26 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:02.269 4088 3038338904136 MainThread DEBUG nova.network.neutron [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Port 43904798-2eab-4ec0-9b1b-f79a929eba99 updated with migration profile {'migrating_to': 'n-h2-808474-1'} successfully _setup_migration_port_profile c:\openstack\build\nova\nova\network\neutron.py:343 2021-09-10 16:51:02.269 4088 3038338904136 MainThread DEBUG nova.compute.manager [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] pre_live_migration result data is HyperVLiveMigrateData(is_shared_instance_path=False,is_volume_backed=False,migration=,old_vol_attachment_ids={},vifs=[VIFMigrateData],wait_for_vif_plugged=True) pre_live_migration c:\openstack\build\nova\nova\compute\manager.py:8285 2021-09-10 16:51:02.269 4088 3038338904840 MainThread DEBUG nova.virt.hyperv.hostops [req-f6d6b71c-fc20-446a-be74-9bc1ffb9ea26 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:51:02.301 4088 3038338904840 MainThread DEBUG nova.virt.hyperv.hostops [req-f6d6b71c-fc20-446a-be74-9bc1ffb9ea26 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:51:02.442 4088 3038296678248 GreenThread-15 DEBUG nova.network.neutron [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Updating instance_info_cache with network_info: [{"id": "2ef6a3e6-e7a5-4da7-941d-89a1d5c697b7", "address": "fa:16:3e:eb:d0:49", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2ef6a3e6-e7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:51:02.553 4088 3038296678248 GreenThread-15 DEBUG oslo_concurrency.lockutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Releasing lock "refresh_cache-592bb39a-81cb-43f8-a643-b04092bd9e8a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:51:02.553 4088 3038296678248 GreenThread-15 DEBUG nova.compute.manager [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Instance network_info: |[{"id": "2ef6a3e6-e7a5-4da7-941d-89a1d5c697b7", "address": "fa:16:3e:eb:d0:49", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2ef6a3e6-e7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:51:02.553 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Preparing to wait for external event network-vif-plugged-2ef6a3e6-e7a5-4da7-941d-89a1d5c697b7 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:51:02.569 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:02.569 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:02.569 4088 3038296678072 MainThread DEBUG os_win.utils.compute.vmutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Creating VM instance-00000015 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:51:02.694 4088 3038338904840 MainThread DEBUG nova.compute.provider_tree [req-f6d6b71c-fc20-446a-be74-9bc1ffb9ea26 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:51:02.740 4088 3038338904840 MainThread DEBUG nova.scheduler.client.report [req-f6d6b71c-fc20-446a-be74-9bc1ffb9ea26 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:51:02.740 4088 3038338904840 MainThread DEBUG oslo_concurrency.lockutils [req-f6d6b71c-fc20-446a-be74-9bc1ffb9ea26 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.547s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:02.740 4088 3038338904840 MainThread INFO nova.compute.manager [req-f6d6b71c-fc20-446a-be74-9bc1ffb9ea26 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Successfully reverted task state from deleting on failure for instance. 2021-09-10 16:51:02.756 4088 3038338904840 MainThread ERROR oslo_messaging.rpc.server [req-f6d6b71c-fc20-446a-be74-9bc1ffb9ea26 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Exception during message handling: NameError: name 'instant' is not defined 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server Traceback (most recent call last): 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 72, in wrapped 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server context, exc, binary) 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server return f(self, context, *args, **kw) 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 184, in decorated_function 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server "Error: %s", e, instance=instance) 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 154, in decorated_function 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\utils.py", line 1433, in decorated_function 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 200, in decorated_function 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3106, in terminate_instance 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server do_terminate_instance(instance, bdms) 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_concurrency\lockutils.py", line 360, in inner 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server return f(*args, **kwargs) 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3104, in do_terminate_instance 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server self._set_instance_obj_error_state(instance) 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server self._delete_instance(context, instance, bdms) 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server NameError: name 'instant' is not defined 2021-09-10 16:51:02.756 4088 3038338904840 MainThread TRACE oslo_messaging.rpc.server 2021-09-10 16:51:03.886 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-656e9421-f6aa-4538-8c0f-48732096768a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Received event network-changed-2ef6a3e6-e7a5-4da7-941d-89a1d5c697b7 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:51:03.886 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-656e9421-f6aa-4538-8c0f-48732096768a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Refreshing instance network info cache due to event network-changed-2ef6a3e6-e7a5-4da7-941d-89a1d5c697b7. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:51:03.886 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-656e9421-f6aa-4538-8c0f-48732096768a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-592bb39a-81cb-43f8-a643-b04092bd9e8a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:51:03.886 4088 3038296678248 MainThread DEBUG nova.network.neutron [req-656e9421-f6aa-4538-8c0f-48732096768a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Refreshing network info cache for port 2ef6a3e6-e7a5-4da7-941d-89a1d5c697b7 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:51:05.162 4088 3038296678248 MainThread DEBUG nova.network.neutron [req-656e9421-f6aa-4538-8c0f-48732096768a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Updated VIF entry in instance network info cache for port 2ef6a3e6-e7a5-4da7-941d-89a1d5c697b7. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:51:05.162 4088 3038296678248 MainThread DEBUG nova.network.neutron [req-656e9421-f6aa-4538-8c0f-48732096768a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Updating instance_info_cache with network_info: [{"id": "2ef6a3e6-e7a5-4da7-941d-89a1d5c697b7", "address": "fa:16:3e:eb:d0:49", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2ef6a3e6-e7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:51:05.192 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-656e9421-f6aa-4538-8c0f-48732096768a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-592bb39a-81cb-43f8-a643-b04092bd9e8a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:51:05.256 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:51:07.100 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-83c1c178-75fe-4691-af04-9877c53c662c 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:07.100 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-83c1c178-75fe-4691-af04-9877c53c662c 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:07.100 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-83c1c178-75fe-4691-af04-9877c53c662c 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:07.100 4088 3038300760904 MainThread ERROR nova.compute.manager [req-83c1c178-75fe-4691-af04-9877c53c662c 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Setting instance vm_state to ERROR: NameError: name 'instant' is not defined 2021-09-10 16:51:07.100 4088 3038300760904 MainThread TRACE nova.compute.manager [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Traceback (most recent call last): 2021-09-10 16:51:07.100 4088 3038300760904 MainThread TRACE nova.compute.manager [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:51:07.100 4088 3038300760904 MainThread TRACE nova.compute.manager [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] self._delete_instance(context, instance, bdms) 2021-09-10 16:51:07.100 4088 3038300760904 MainThread TRACE nova.compute.manager [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:51:07.100 4088 3038300760904 MainThread TRACE nova.compute.manager [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:51:07.100 4088 3038300760904 MainThread TRACE nova.compute.manager [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] NameError: name 'instant' is not defined 2021-09-10 16:51:07.100 4088 3038300760904 MainThread TRACE nova.compute.manager [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] 2021-09-10 16:51:07.229 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-83c1c178-75fe-4691-af04-9877c53c662c 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55" released by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 0.125s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:07.475 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-83c1c178-75fe-4691-af04-9877c53c662c 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:07.489 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.hostops [req-83c1c178-75fe-4691-af04-9877c53c662c 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:51:07.526 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.hostops [req-83c1c178-75fe-4691-af04-9877c53c662c 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:51:07.958 4088 3038300760904 MainThread DEBUG nova.compute.provider_tree [req-83c1c178-75fe-4691-af04-9877c53c662c 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:51:07.992 4088 3038300760904 MainThread DEBUG nova.scheduler.client.report [req-83c1c178-75fe-4691-af04-9877c53c662c 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:51:07.992 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-83c1c178-75fe-4691-af04-9877c53c662c 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.516s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:07.992 4088 3038300760904 MainThread INFO nova.compute.manager [req-83c1c178-75fe-4691-af04-9877c53c662c 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Successfully reverted task state from deleting on failure for instance. 2021-09-10 16:51:08.010 4088 3038300760904 MainThread ERROR oslo_messaging.rpc.server [req-83c1c178-75fe-4691-af04-9877c53c662c 7cfd5525c9e74f68a421f54d1364dd30 28acab1b43b74dc28de8be447d122661 - default default] Exception during message handling: NameError: name 'instant' is not defined 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server Traceback (most recent call last): 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 72, in wrapped 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server context, exc, binary) 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server return f(self, context, *args, **kw) 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 184, in decorated_function 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server "Error: %s", e, instance=instance) 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 154, in decorated_function 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\utils.py", line 1433, in decorated_function 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 200, in decorated_function 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3106, in terminate_instance 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server do_terminate_instance(instance, bdms) 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_concurrency\lockutils.py", line 360, in inner 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server return f(*args, **kwargs) 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3104, in do_terminate_instance 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server self._set_instance_obj_error_state(instance) 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server self._delete_instance(context, instance, bdms) 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server NameError: name 'instant' is not defined 2021-09-10 16:51:08.010 4088 3038300760904 MainThread TRACE oslo_messaging.rpc.server 2021-09-10 16:51:11.493 4088 3038300760904 MainThread DEBUG nova.virt.driver [-] Emitting event Started> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:51:11.493 4088 3038300760904 MainThread INFO nova.compute.manager [-] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] VM Started (Lifecycle Event) 2021-09-10 16:51:11.493 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000012" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:11.522 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-86458e69-660d-4b0c-9a83-92da2bbafadb - - - - -] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:51:11.522 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.vmops [req-86458e69-660d-4b0c-9a83-92da2bbafadb - - - - -] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:51:11.573 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000012" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.078s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:11.624 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-86458e69-660d-4b0c-9a83-92da2bbafadb - - - - -] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: migrating, current DB power_state: 1, VM power_state: 1 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:51:11.660 4088 3038300760904 MainThread INFO nova.compute.manager [req-86458e69-660d-4b0c-9a83-92da2bbafadb - - - - -] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] During the sync_power process the instance has moved from host n-h1-808474-1 to host n-h2-808474-1 2021-09-10 16:51:12.505 4088 3038300760904 MainThread INFO nova.compute.manager [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Post operation of migration started 2021-09-10 16:51:12.758 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Acquired lock "refresh_cache-359fd482-69f5-4194-9466-f46ea31258d3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:51:12.758 4088 3038300760904 MainThread DEBUG nova.network.neutron [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:51:13.426 4088 3038300760904 MainThread DEBUG nova.network.neutron [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Updating instance_info_cache with network_info: [{"id": "43904798-2eab-4ec0-9b1b-f79a929eba99", "address": "fa:16:3e:9c:26:60", "network": {"id": "7434a41e-b78f-4cb9-8ffe-b2514d097201", "bridge": null, "label": "tempest-LiveAutoBlockMigrationV225Test-1499875764-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91237ebda1b54d2dbc761e48fdd93516", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap43904798-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:51:13.457 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Releasing lock "refresh_cache-359fd482-69f5-4194-9466-f46ea31258d3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:51:13.496 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.allocate_pci_devices_for_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:13.496 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.allocate_pci_devices_for_instance" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:13.496 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.livemigrationops [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] post_live_migration_at_destination called post_live_migration_at_destination c:\openstack\build\nova\nova\virt\hyperv\livemigrationops.py:124 2021-09-10 16:51:13.496 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:51:13.496 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.vmops [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:51:13.599 4088 3038300760904 MainThread DEBUG nova.objects.instance [req-52694233-7879-466e-bd52-bb83f831564f ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Trying to apply a migration context that does not seem to be set for this instance apply_migration_context c:\openstack\build\nova\nova\objects\instance.py:1031 2021-09-10 16:51:15.332 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-030807f1-b19e-4284-a28a-38c37bbae0d7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Received event network-vif-plugged-43904798-2eab-4ec0-9b1b-f79a929eba99 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:51:15.332 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-030807f1-b19e-4284-a28a-38c37bbae0d7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "359fd482-69f5-4194-9466-f46ea31258d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:15.332 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-030807f1-b19e-4284-a28a-38c37bbae0d7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "359fd482-69f5-4194-9466-f46ea31258d3-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:15.332 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-030807f1-b19e-4284-a28a-38c37bbae0d7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] No waiting events found dispatching network-vif-plugged-43904798-2eab-4ec0-9b1b-f79a929eba99 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 16:51:15.348 4088 3038300760904 MainThread WARNING nova.compute.manager [req-030807f1-b19e-4284-a28a-38c37bbae0d7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Received unexpected event network-vif-plugged-43904798-2eab-4ec0-9b1b-f79a929eba99 for instance with vm_state active and task_state None. 2021-09-10 16:51:17.431 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-dacdbd4d-8cda-4a82-9414-663ac4f85899 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Received event network-vif-plugged-2ef6a3e6-e7a5-4da7-941d-89a1d5c697b7 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:51:17.431 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-dacdbd4d-8cda-4a82-9414-663ac4f85899 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:17.431 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-dacdbd4d-8cda-4a82-9414-663ac4f85899 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:17.431 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-dacdbd4d-8cda-4a82-9414-663ac4f85899 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Processing event network-vif-plugged-2ef6a3e6-e7a5-4da7-941d-89a1d5c697b7 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:51:17.474 4088 3038296678072 MainThread INFO nova.virt.hyperv.vmops [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Using config drive for instance 2021-09-10 16:51:17.708 4088 3038296678072 MainThread INFO nova.virt.hyperv.vmops [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Creating config drive at C:\openstack\instances\instance-00000015\configdrive.iso 2021-09-10 16:51:17.847 4088 3038296678072 MainThread DEBUG oslo_concurrency.processutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000015\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpt7usddaq execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:51:30.786 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:51:30.786 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-4eb088c0-a66c-4b49-a490-c1eb4396899b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Received event network-vif-unplugged-9ce6624e-4307-41bc-9d39-c5c0bd6572b9 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:51:30.786 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-4eb088c0-a66c-4b49-a490-c1eb4396899b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "17abaf80-43c7-4c09-b4a2-c12636cd0cc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:30.802 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-4eb088c0-a66c-4b49-a490-c1eb4396899b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "17abaf80-43c7-4c09-b4a2-c12636cd0cc3-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:30.802 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-4eb088c0-a66c-4b49-a490-c1eb4396899b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] No waiting events found dispatching network-vif-unplugged-9ce6624e-4307-41bc-9d39-c5c0bd6572b9 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 16:51:30.802 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-4eb088c0-a66c-4b49-a490-c1eb4396899b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Received event network-vif-unplugged-9ce6624e-4307-41bc-9d39-c5c0bd6572b9 for instance with task_state migrating. _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10284 2021-09-10 16:51:30.802 4088 3038338905544 MainThread DEBUG nova.compute.manager [req-dd5f88a2-76da-4b67-9d6b-0ae85ae99aef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Received event network-changed-9ce6624e-4307-41bc-9d39-c5c0bd6572b9 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:51:30.802 4088 3038338905544 MainThread DEBUG nova.compute.manager [req-dd5f88a2-76da-4b67-9d6b-0ae85ae99aef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Refreshing instance network info cache due to event network-changed-9ce6624e-4307-41bc-9d39-c5c0bd6572b9. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:51:30.802 4088 3038338905544 MainThread DEBUG oslo_concurrency.lockutils [req-dd5f88a2-76da-4b67-9d6b-0ae85ae99aef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-17abaf80-43c7-4c09-b4a2-c12636cd0cc3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:51:30.802 4088 3038338905544 MainThread DEBUG nova.network.neutron [req-dd5f88a2-76da-4b67-9d6b-0ae85ae99aef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Refreshing network info cache for port 9ce6624e-4307-41bc-9d39-c5c0bd6572b9 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:51:30.802 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:51:30.802 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 16:51:30.802 4088 3038300761784 MainThread INFO nova.compute.manager [-] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Took 28.17 seconds for pre_live_migration on destination host n-h1-808474-1. 2021-09-10 16:51:30.850 4088 3038300761784 MainThread DEBUG nova.compute.manager [-] live_migration data is HyperVLiveMigrateData(is_shared_instance_path=False,is_volume_backed=False,migration=Migration(6caf2594-4ef9-4a93-9694-0c999f81f712),old_vol_attachment_ids={4e982f7d-54f9-44a5-9572-7ad727331d99='f3cb7a9b-49be-4e16-8af7-6ddc6b51fc20'},vifs=[VIFMigrateData],wait_for_vif_plugged=True) _do_live_migration c:\openstack\build\nova\nova\compute\manager.py:8499 2021-09-10 16:51:30.850 4088 3038300761784 MainThread DEBUG nova.virt.hyperv.livemigrationops [-] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] live_migration called live_migration c:\openstack\build\nova\nova\virt\hyperv\livemigrationops.py:52 2021-09-10 16:51:30.850 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000000e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:30.850 4088 3038300761784 MainThread INFO nova.virt.hyperv.serialconsoleops [-] Stopping instance instance-0000000e serial console handler. 2021-09-10 16:51:30.850 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000000e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:30.972 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:51:30.972 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 16:51:31.005 4088 3038296678072 MainThread DEBUG oslo_concurrency.processutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000015\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpt7usddaq" returned: 0 in 13.156s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:51:31.160 4088 3038300761784 MainThread DEBUG os_win.utils.compute.livemigrationutils [-] Getting live migration networks for host: n-h1-808474-1 _get_ip_address_list c:\openstack\build\os-win\os_win\utils\compute\livemigrationutils.py:172 2021-09-10 16:51:31.350 4088 3038300761784 MainThread DEBUG os_win.utils.compute.livemigrationutils [-] Starting live migration for VM: instance-0000000e _live_migrate_vm c:\openstack\build\os-win\os_win\utils\compute\livemigrationutils.py:162 2021-09-10 16:51:31.425 4088 3038300761784 MainThread DEBUG os_win.utils.jobutils [-] Waiting for WMI job: {'InstanceID': 'DCDF29D2-3953-48D2-AE56-F6A09BCB8FEE', 'Description': 'Moving Virtual Machine and Storage', 'ElementName': 'Moving Virtual Machine and Storage', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=25070), 'Cancellable': True, 'JobType': 306, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 1}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:51:31.644 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Setting boot order for instance: instance-00000015: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:51:31.706 4088 3038338905544 MainThread DEBUG nova.network.neutron [req-dd5f88a2-76da-4b67-9d6b-0ae85ae99aef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Updated VIF entry in instance network info cache for port 9ce6624e-4307-41bc-9d39-c5c0bd6572b9. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:51:31.706 4088 3038338905544 MainThread DEBUG nova.network.neutron [req-dd5f88a2-76da-4b67-9d6b-0ae85ae99aef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Updating instance_info_cache with network_info: [{"id": "9ce6624e-4307-41bc-9d39-c5c0bd6572b9", "address": "fa:16:3e:1a:ba:e3", "network": {"id": "03c1eefd-030f-414f-b7f8-81ed611f877f", "bridge": null, "label": "tempest-LiveMigrationTest-812207682-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fa8236f1477243dfafd0682b608fc659", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9ce6624e-43", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {"migrating_to": "n-h1-808474-1"}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:51:31.754 4088 3038338905544 MainThread DEBUG oslo_concurrency.lockutils [req-dd5f88a2-76da-4b67-9d6b-0ae85ae99aef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-17abaf80-43c7-4c09-b4a2-c12636cd0cc3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:51:31.769 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:51:31.800 4088 3038296678072 MainThread DEBUG os_win.utils.jobutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Waiting for WMI job: {'InstanceID': 'ED75884A-9BB6-4107-96DE-495F23F2116A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17039), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:51:32.159 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:32.175 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:51:32.269 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Started> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:51:32.269 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] VM Started (Lifecycle Event) 2021-09-10 16:51:32.269 4088 3038338905544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000015" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:32.285 4088 3038296678072 MainThread DEBUG os_win.utils.jobutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] WMI job succeeded: {'InstanceID': 'ED75884A-9BB6-4107-96DE-495F23F2116A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=448498), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:51:32.285 4088 3038296678072 MainThread DEBUG os_win.utils.compute.vmutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Successfully changed vm state of instance-00000015 to 2 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:51:32.285 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Successfully changed state of VM instance-00000015 to: 2 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:51:32.285 4088 3038296678072 MainThread INFO nova.compute.manager [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Took 34.53 seconds to spawn the instance on the hypervisor. 2021-09-10 16:51:32.285 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:51:32.285 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:51:32.317 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-933bc7bf-4797-425e-9f8a-3ecd679f7891 - - - - -] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:51:32.317 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-933bc7bf-4797-425e-9f8a-3ecd679f7891 - - - - -] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:51:32.332 4088 3038338905544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000015" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.062s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:32.401 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-933bc7bf-4797-425e-9f8a-3ecd679f7891 - - - - -] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:51:32.415 4088 3038300761080 MainThread INFO nova.compute.manager [req-933bc7bf-4797-425e-9f8a-3ecd679f7891 - - - - -] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:51:32.472 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:32.489 4088 3038300760904 MainThread DEBUG nova.virt.hardware [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:51:32.489 4088 3038300760904 MainThread INFO nova.compute.claims [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Claim successful on node n-h2-808474-1 2021-09-10 16:51:32.534 4088 3038296678072 MainThread INFO nova.compute.manager [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Took 36.95 seconds to build instance. 2021-09-10 16:51:32.583 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-42aedf44-51b4-4cd9-9080-084a8d568de0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 37.187s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:32.661 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Updating instance_info_cache with network_info: [{"id": "e94d3f34-4aa5-46a2-9cf3-221c28446067", "address": "fa:16:3e:bd:9b:a0", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape94d3f34-4a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:51:32.693 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:51:32.693 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 16:51:32.693 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:51:32.693 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:51:32.693 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:51:32.722 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:51:32.722 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:51:32.722 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:51:32.722 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 16:51:32.740 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._run_pending_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:51:32.740 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10602 2021-09-10 16:51:32.740 4088 3038300760904 MainThread DEBUG nova.scheduler.client.report [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Refreshing inventories for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:757 2021-09-10 16:51:32.759 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] There are 0 instances to clean _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10611 2021-09-10 16:51:32.759 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_incomplete_migrations run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:51:32.759 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances with incomplete migration _cleanup_incomplete_migrations c:\openstack\build\nova\nova\compute\manager.py:10640 2021-09-10 16:51:32.771 4088 3038300760904 MainThread DEBUG nova.scheduler.client.report [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Updating ProviderTree inventory for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 from _refresh_and_get_inventory using data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} _refresh_and_get_inventory c:\openstack\build\nova\nova\scheduler\client\report.py:723 2021-09-10 16:51:32.771 4088 3038300760904 MainThread DEBUG nova.compute.provider_tree [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Updating inventory in ProviderTree for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 with inventory: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:176 2021-09-10 16:51:32.785 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:51:32.801 4088 3038300760904 MainThread DEBUG nova.scheduler.client.report [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Refreshing aggregate associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, aggregates: None _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:766 2021-09-10 16:51:32.871 4088 3038300760904 MainThread DEBUG nova.scheduler.client.report [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Refreshing trait associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_VHD,COMPUTE_IMAGE_TYPE_VHDX,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:778 2021-09-10 16:51:32.871 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.hostops [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:51:32.897 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.hostops [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:51:33.160 4088 3038300760904 MainThread DEBUG nova.compute.provider_tree [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:51:33.175 4088 3038300760904 MainThread DEBUG nova.scheduler.client.report [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:51:33.175 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.703s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:33.175 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:51:33.269 4088 3038300760904 MainThread DEBUG nova.compute.utils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:51:33.269 4088 3038296678248 GreenThread-16 DEBUG nova.compute.manager [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:51:33.269 4088 3038296678248 GreenThread-16 DEBUG nova.network.neutron [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:51:33.286 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:51:33.479 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:51:33.479 4088 3038296678248 GreenThread-16 DEBUG nova.policy [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6904e86e6ed64f5a8fc459777a1ba26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c929df49a24fb798e1b2d3f7414211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:51:33.479 4088 3038300760904 MainThread INFO nova.virt.hyperv.vmops [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Spawning new instance 2021-09-10 16:51:33.505 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "instance-00000019" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:33.505 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "instance-00000019" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:33.505 4088 3038300760904 MainThread DEBUG nova.block_device [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:51:33.505 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "2e4b52c5-8e7b-45fc-9524-216069b237bb-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:33.632 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:51:33.649 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:33.649 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:33.649 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 16:51:33.649 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:51:33.676 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:51:33.926 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=3184MB free_disk=52GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 16:51:33.943 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:43.418 4088 3038296678248 GreenThread-16 DEBUG nova.network.neutron [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Successfully created port: cffb92ec-4239-478b-a7e3-533da175c554 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:51:43.941 4088 3038296676664 GreenThread-2 INFO nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Updating resource usage from migration 6caf2594-4ef9-4a93-9694-0c999f81f712 2021-09-10 16:51:44.174 4088 3038300761784 MainThread DEBUG os_win.utils.jobutils [-] WMI job succeeded: {'InstanceID': 'DCDF29D2-3953-48D2-AE56-F6A09BCB8FEE', 'Description': 'Moving Virtual Machine and Storage', 'ElementName': 'Moving Virtual Machine and Storage', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(seconds=5, microseconds=936729), 'Cancellable': True, 'JobType': 306, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:51:44.174 4088 3038300761784 MainThread DEBUG nova.virt.hyperv.livemigrationops [-] Calling live migration post_method for instance: instance-0000000e live_migration c:\openstack\build\nova\nova\virt\hyperv\livemigrationops.py:86 2021-09-10 16:51:44.174 4088 3038300761784 MainThread INFO nova.compute.manager [-] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] _post_live_migration() is started.. 2021-09-10 16:51:44.174 4088 3038300761784 MainThread DEBUG os_brick.initiator.connector [-] Factory for iscsi on None factory c:\python37\lib\site-packages\os_brick\initiator\connector.py:282 2021-09-10 16:51:44.174 4088 3038300761784 MainThread INFO os_brick.initiator.windows.iscsi [-] No iSCSI initiator was explicitly requested. The Microsoft iSCSI initiator will choose the initiator when establishing sessions. 2021-09-10 16:51:44.174 4088 3038300761784 MainThread DEBUG os_brick.initiator.windows.iscsi [-] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-4e982f7d-54f9-44a5-9572-7ad727331d99', 'target_lun': 0, 'volume_id': '4e982f7d-54f9-44a5-9572-7ad727331d99', 'auth_method': 'CHAP', 'auth_username': '64HsfuxbJfZXqwRTayVC', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:51:44.174 4088 3038300761784 MainThread DEBUG os_win.utils.storage.diskutils [-] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 16:51:44.378 4088 3038300761784 MainThread DEBUG os_win.utils.storage.diskutils [-] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 16:51:44.425 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:44.425 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:44.425 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:44.425 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:44.425 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:44.425 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:44.425 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:44.425 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:44.425 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:44.425 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:44.425 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:44.425 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:44.425 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Migration 6caf2594-4ef9-4a93-9694-0c999f81f712 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1537 2021-09-10 16:51:44.425 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 16:51:44.425 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 16:51:44.833 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:51:45.380 4088 3038300761784 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [-] Logging out iSCSI target iqn.2010-10.org.openstack:volume-4e982f7d-54f9-44a5-9572-7ad727331d99 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 16:51:49.739 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "2e4b52c5-8e7b-45fc-9524-216069b237bb-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 16.235s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:49.739 4088 3038296678248 GreenThread-16 DEBUG nova.network.neutron [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Successfully updated port: cffb92ec-4239-478b-a7e3-533da175c554 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:51:49.739 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:51:49.761 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-5b42fca8-a843-42d5-8b68-fed3fd99e150 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Received event network-changed-cffb92ec-4239-478b-a7e3-533da175c554 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:51:49.761 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-5b42fca8-a843-42d5-8b68-fed3fd99e150 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Refreshing instance network info cache due to event network-changed-cffb92ec-4239-478b-a7e3-533da175c554. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:51:49.761 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-5b42fca8-a843-42d5-8b68-fed3fd99e150 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-9bb2d354-2d76-40ea-8b9c-b18a21edefbb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:51:49.761 4088 3038300761080 MainThread DEBUG nova.network.neutron [req-5b42fca8-a843-42d5-8b68-fed3fd99e150 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Refreshing network info cache for port cffb92ec-4239-478b-a7e3-533da175c554 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:51:49.784 4088 3038300760904 MainThread DEBUG os_win.utils.pathutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Creating directory: C:\openstack\instances\instance-00000019 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:51:49.784 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.vmops [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Creating differencing VHD. Parent: C:\openstack\instances\_base\2e4b52c5-8e7b-45fc-9524-216069b237bb.vhdx, Target: C:\openstack\instances\instance-00000019\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:51:49.784 4088 3038300761784 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [-] Removing iSCSI target persistent login: iqn.2010-10.org.openstack:volume-4e982f7d-54f9-44a5-9572-7ad727331d99 _remove_target_persistent_logins c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:495 2021-09-10 16:51:49.784 4088 3038300761784 MainThread DEBUG os_brick.initiator.windows.iscsi [-] <== disconnect_volume: return (5609ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:51:49.804 4088 3038300761784 MainThread DEBUG os_win.utils.pathutils [-] Removing directory: C:\openstack\instances\instance-0000000e check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:51:49.804 4088 3038300761784 MainThread DEBUG os_brick.utils [-] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:51:49.804 4088 3038300761784 MainThread DEBUG os_brick.utils [-] <== get_connector_properties: return (0ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:51:49.928 4088 3038300761080 MainThread DEBUG nova.network.neutron [req-5b42fca8-a843-42d5-8b68-fed3fd99e150 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:51:50.107 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:51:50.113 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:51:50.113 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 16:51:50.113 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 16.172s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:50.303 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.vmops [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Resizing VHD C:\openstack\instances\instance-00000019\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:51:50.682 4088 3038300761080 MainThread DEBUG nova.network.neutron [req-5b42fca8-a843-42d5-8b68-fed3fd99e150 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:51:50.701 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-5b42fca8-a843-42d5-8b68-fed3fd99e150 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-9bb2d354-2d76-40ea-8b9c-b18a21edefbb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:51:50.701 4088 3038296678248 GreenThread-16 DEBUG oslo_concurrency.lockutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Acquired lock "refresh_cache-9bb2d354-2d76-40ea-8b9c-b18a21edefbb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:51:50.701 4088 3038296678248 GreenThread-16 DEBUG nova.network.neutron [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:51:50.823 4088 3038296678248 GreenThread-16 DEBUG nova.network.neutron [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:51:51.644 4088 3038296678248 GreenThread-16 DEBUG nova.network.neutron [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Updating instance_info_cache with network_info: [{"id": "cffb92ec-4239-478b-a7e3-533da175c554", "address": "fa:16:3e:61:8a:33", "network": {"id": "6762dff9-0e3f-42c6-a0d6-ae3571e9fc82", "bridge": null, "label": "tempest-AttachSCSIVolumeTestJSON-1567357011-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "10c929df49a24fb798e1b2d3f7414211", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcffb92ec-42", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:51:51.676 4088 3038296678248 GreenThread-16 DEBUG oslo_concurrency.lockutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Releasing lock "refresh_cache-9bb2d354-2d76-40ea-8b9c-b18a21edefbb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:51:51.676 4088 3038296678248 GreenThread-16 DEBUG nova.compute.manager [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Instance network_info: |[{"id": "cffb92ec-4239-478b-a7e3-533da175c554", "address": "fa:16:3e:61:8a:33", "network": {"id": "6762dff9-0e3f-42c6-a0d6-ae3571e9fc82", "bridge": null, "label": "tempest-AttachSCSIVolumeTestJSON-1567357011-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "10c929df49a24fb798e1b2d3f7414211", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcffb92ec-42", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:51:51.676 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Preparing to wait for external event network-vif-plugged-cffb92ec-4239-478b-a7e3-533da175c554 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:51:51.676 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:51.676 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:51.676 4088 3038300760904 MainThread DEBUG os_win.utils.compute.vmutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Creating VM instance-00000019 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:51:51.847 4088 3038300761784 MainThread DEBUG nova.network.neutron [-] Activated binding for port 9ce6624e-4307-41bc-9d39-c5c0bd6572b9 and host n-h1-808474-1 migrate_instance_start c:\openstack\build\nova\nova\network\neutron.py:3012 2021-09-10 16:51:51.847 4088 3038300761784 MainThread DEBUG nova.compute.manager [-] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Calling driver.post_live_migration_at_source with original source VIFs from migrate_data: [{"id": "9ce6624e-4307-41bc-9d39-c5c0bd6572b9", "address": "fa:16:3e:1a:ba:e3", "network": {"id": "03c1eefd-030f-414f-b7f8-81ed611f877f", "bridge": null, "label": "tempest-LiveMigrationTest-812207682-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fa8236f1477243dfafd0682b608fc659", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9ce6624e-43", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] _post_live_migration c:\openstack\build\nova\nova\compute\manager.py:8815 2021-09-10 16:51:51.864 4088 3038300761784 MainThread DEBUG nova.compute.manager [-] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Hypervisor driver does not support post_live_migration_at_source method _post_live_migration c:\openstack\build\nova\nova\compute\manager.py:8819 2021-09-10 16:51:51.864 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.free_pci_device_allocations_for_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:51.864 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.free_pci_device_allocations_for_instance" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:51.864 4088 3038300761784 MainThread DEBUG nova.objects.instance [-] Lazy-loading 'migration_context' on Instance uuid 17abaf80-43c7-4c09-b4a2-c12636cd0cc3 obj_load_attr c:\openstack\build\nova\nova\objects\instance.py:1101 2021-09-10 16:51:51.864 4088 3038300761784 MainThread DEBUG nova.compute.manager [-] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Calling driver.cleanup from _post_live_migration _post_live_migration c:\openstack\build\nova\nova\compute\manager.py:8837 2021-09-10 16:51:53.195 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "17abaf80-43c7-4c09-b4a2-c12636cd0cc3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:53.195 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "17abaf80-43c7-4c09-b4a2-c12636cd0cc3-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:53.223 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:53.223 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:53.223 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 16:51:53.223 4088 3038300761784 MainThread DEBUG nova.virt.hyperv.hostops [-] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:51:53.252 4088 3038300761784 MainThread DEBUG nova.virt.hyperv.hostops [-] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:51:53.518 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=4237MB free_disk=53GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 16:51:53.518 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:53.660 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Migration for instance 17abaf80-43c7-4c09-b4a2-c12636cd0cc3 refers to another host's instance! _pair_instances_to_migrations c:\openstack\build\nova\nova\compute\resource_tracker.py:911 2021-09-10 16:51:53.709 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Skipping migration as instance is neither resizing nor live-migrating. _update_usage_from_migrations c:\openstack\build\nova\nova\compute\resource_tracker.py:1390 2021-09-10 16:51:53.746 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:53.746 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:53.746 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:53.746 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:53.746 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:53.756 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:53.756 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:53.756 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:53.756 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:53.756 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:53.756 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:53.756 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:51:53.756 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Migration 6caf2594-4ef9-4a93-9694-0c999f81f712 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1537 2021-09-10 16:51:53.756 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Total usable vcpus: 6, total allocated vcpus: 12 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 16:51:53.756 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=12800MB phys_disk=79GB used_disk=12GB total_vcpus=6 used_vcpus=12 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 16:51:53.784 4088 3038300761784 MainThread DEBUG nova.virt.hyperv.hostops [-] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:51:53.784 4088 3038300761784 MainThread DEBUG nova.virt.hyperv.hostops [-] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:51:54.112 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.vmops [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:51:54.112 4088 3038300761784 MainThread DEBUG nova.compute.provider_tree [-] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:51:54.143 4088 3038300761784 MainThread DEBUG nova.scheduler.client.report [-] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:51:54.143 4088 3038300761784 MainThread DEBUG nova.compute.resource_tracker [-] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 16:51:54.143 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.625s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:54.160 4088 3038300761784 MainThread INFO nova.compute.manager [-] [instance: 17abaf80-43c7-4c09-b4a2-c12636cd0cc3] Migrating instance to n-h1-808474-1 finished successfully. 2021-09-10 16:51:54.271 4088 3038300761784 MainThread INFO nova.scheduler.client.report [-] Deleted allocation for migration 6caf2594-4ef9-4a93-9694-0c999f81f712 2021-09-10 16:51:58.690 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Lock "9446e666-4364-4dcd-b041-405653a856bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:58.724 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:51:58.815 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:58.815 4088 3038338906072 MainThread DEBUG nova.virt.hardware [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:51:58.815 4088 3038338906072 MainThread INFO nova.compute.claims [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Claim successful on node n-h2-808474-1 2021-09-10 16:51:58.972 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.hostops [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:51:58.988 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.hostops [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:51:59.263 4088 3038338906072 MainThread DEBUG nova.compute.provider_tree [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:51:59.278 4088 3038338906072 MainThread DEBUG nova.scheduler.client.report [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:51:59.278 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:59.278 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:51:59.397 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:51:59.397 4088 3038338905896 GreenThread-17 DEBUG nova.compute.manager [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:51:59.397 4088 3038338905896 GreenThread-17 DEBUG nova.network.neutron [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:51:59.572 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:51:59.597 4088 3038338906072 MainThread INFO nova.virt.hyperv.vmops [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Spawning new instance 2021-09-10 16:51:59.643 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Lock "instance-00000017" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:59.643 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Lock "instance-00000017" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:59.643 4088 3038338906072 MainThread DEBUG nova.block_device [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:51:59.643 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:59.669 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:51:59.676 4088 3038338905896 GreenThread-17 DEBUG nova.policy [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68a189ea096f4b08ae59e252907de4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be36af928b5149e58720b1f68dda425d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:51:59.676 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "59feb82d-9fd9-4170-aa08-742104f9e642" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:59.707 4088 3038338906072 MainThread DEBUG os_win.utils.pathutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Creating directory: C:\openstack\instances\instance-00000017 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:51:59.707 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000017\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:51:59.722 4088 3038338907480 MainThread DEBUG nova.compute.manager [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:51:59.846 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:51:59.846 4088 3038338907480 MainThread DEBUG nova.virt.hardware [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:51:59.846 4088 3038338907480 MainThread INFO nova.compute.claims [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Claim successful on node n-h2-808474-1 2021-09-10 16:51:59.972 4088 3038338907480 MainThread DEBUG nova.virt.hyperv.hostops [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:51:59.988 4088 3038338907480 MainThread DEBUG nova.virt.hyperv.hostops [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:52:00.112 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Resizing VHD C:\openstack\instances\instance-00000017\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:52:00.337 4088 3038338907480 MainThread DEBUG nova.compute.provider_tree [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:52:00.337 4088 3038338905896 GreenThread-17 DEBUG nova.network.neutron [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Successfully created port: f581c585-39ab-4120-a040-5d92bb401a6c _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:52:00.351 4088 3038338907480 MainThread DEBUG nova.scheduler.client.report [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:52:00.351 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:00.351 4088 3038338907480 MainThread DEBUG nova.compute.manager [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:52:00.471 4088 3038338907480 MainThread DEBUG nova.compute.manager [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:52:00.471 4088 3038338907304 GreenThread-18 DEBUG nova.compute.manager [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:52:00.471 4088 3038338907304 GreenThread-18 DEBUG nova.network.neutron [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:52:00.752 4088 3038338907304 GreenThread-18 DEBUG nova.policy [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'beffe9ba8529426fbb27e549254bd679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91237ebda1b54d2dbc761e48fdd93516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:52:00.752 4088 3038338907480 MainThread DEBUG nova.compute.manager [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:52:00.771 4088 3038338907480 MainThread INFO nova.virt.hyperv.vmops [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Spawning new instance 2021-09-10 16:52:00.784 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-00000016" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:00.784 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-00000016" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:00.784 4088 3038338907480 MainThread DEBUG nova.block_device [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:52:00.784 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:00.784 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:00.800 4088 3038338907480 MainThread DEBUG os_win.utils.pathutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Creating directory: C:\openstack\instances\instance-00000016 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:52:00.800 4088 3038338907480 MainThread DEBUG nova.virt.hyperv.vmops [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000016\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:52:01.206 4088 3038338907480 MainThread DEBUG nova.virt.hyperv.vmops [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Resizing VHD C:\openstack\instances\instance-00000016\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:52:01.283 4088 3038338905896 GreenThread-17 DEBUG nova.network.neutron [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Successfully updated port: f581c585-39ab-4120-a040-5d92bb401a6c _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:52:01.305 4088 3038338905896 GreenThread-17 DEBUG oslo_concurrency.lockutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Acquired lock "refresh_cache-9446e666-4364-4dcd-b041-405653a856bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:52:01.320 4088 3038338905896 GreenThread-17 DEBUG nova.network.neutron [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:52:01.748 4088 3038338905896 GreenThread-17 DEBUG nova.network.neutron [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:52:01.786 4088 3038338907832 MainThread DEBUG nova.compute.manager [req-960fef6c-cf3d-4019-8b4d-a40edd5434b3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Received event network-vif-plugged-cffb92ec-4239-478b-a7e3-533da175c554 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:52:01.786 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-960fef6c-cf3d-4019-8b4d-a40edd5434b3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:01.786 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-960fef6c-cf3d-4019-8b4d-a40edd5434b3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:01.786 4088 3038338907832 MainThread DEBUG nova.compute.manager [req-960fef6c-cf3d-4019-8b4d-a40edd5434b3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Processing event network-vif-plugged-cffb92ec-4239-478b-a7e3-533da175c554 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:52:01.847 4088 3038300760904 MainThread INFO nova.virt.hyperv.vmops [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Using config drive for instance 2021-09-10 16:52:01.911 4088 3038340411464 MainThread DEBUG nova.compute.manager [req-4759774b-f08e-42e8-8d12-9c1081b2d65b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Received event network-changed-f581c585-39ab-4120-a040-5d92bb401a6c external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:52:01.911 4088 3038340411464 MainThread DEBUG nova.compute.manager [req-4759774b-f08e-42e8-8d12-9c1081b2d65b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Refreshing instance network info cache due to event network-changed-f581c585-39ab-4120-a040-5d92bb401a6c. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:52:01.987 4088 3038338907304 GreenThread-18 DEBUG nova.network.neutron [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Successfully created port: 8dec7dd4-3185-447e-8abe-ceb3bada20bd _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:52:02.159 4088 3038300760904 MainThread INFO nova.virt.hyperv.vmops [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Creating config drive at C:\openstack\instances\instance-00000019\configdrive.iso 2021-09-10 16:52:02.264 4088 3038300760904 MainThread DEBUG oslo_concurrency.processutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000019\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpsddju0vc execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:52:02.642 4088 3038300760904 MainThread DEBUG oslo_concurrency.processutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000019\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpsddju0vc" returned: 0 in 0.375s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:52:02.867 4088 3038338905896 GreenThread-17 DEBUG nova.network.neutron [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Updating instance_info_cache with network_info: [{"id": "f581c585-39ab-4120-a040-5d92bb401a6c", "address": "fa:16:3e:da:9a:80", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf581c585-39", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:52:02.895 4088 3038338905896 GreenThread-17 DEBUG oslo_concurrency.lockutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Releasing lock "refresh_cache-9446e666-4364-4dcd-b041-405653a856bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:52:02.895 4088 3038338905896 GreenThread-17 DEBUG nova.compute.manager [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Instance network_info: |[{"id": "f581c585-39ab-4120-a040-5d92bb401a6c", "address": "fa:16:3e:da:9a:80", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf581c585-39", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:52:02.895 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Preparing to wait for external event network-vif-plugged-f581c585-39ab-4120-a040-5d92bb401a6c prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:52:02.895 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Lock "9446e666-4364-4dcd-b041-405653a856bd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:02.895 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Lock "9446e666-4364-4dcd-b041-405653a856bd-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:02.895 4088 3038338906072 MainThread DEBUG os_win.utils.compute.vmutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Creating VM instance-00000017 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:52:02.895 4088 3038340411464 MainThread DEBUG oslo_concurrency.lockutils [req-4759774b-f08e-42e8-8d12-9c1081b2d65b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-9446e666-4364-4dcd-b041-405653a856bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:52:02.895 4088 3038340411464 MainThread DEBUG nova.network.neutron [req-4759774b-f08e-42e8-8d12-9c1081b2d65b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Refreshing network info cache for port f581c585-39ab-4120-a040-5d92bb401a6c _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:52:03.068 4088 3038338907304 GreenThread-18 DEBUG nova.network.neutron [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Successfully updated port: 8dec7dd4-3185-447e-8abe-ceb3bada20bd _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:52:03.099 4088 3038338907304 GreenThread-18 DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Acquired lock "refresh_cache-59feb82d-9fd9-4170-aa08-742104f9e642" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:52:03.099 4088 3038338907304 GreenThread-18 DEBUG nova.network.neutron [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:52:03.221 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.vmops [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Setting boot order for instance: instance-00000019: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:52:03.244 4088 3038340411816 MainThread DEBUG nova.compute.manager [req-e57ea87f-b8dd-4b73-b8a4-79ab49ce1139 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Received event network-changed-8dec7dd4-3185-447e-8abe-ceb3bada20bd external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:52:03.244 4088 3038340411816 MainThread DEBUG nova.compute.manager [req-e57ea87f-b8dd-4b73-b8a4-79ab49ce1139 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Refreshing instance network info cache due to event network-changed-8dec7dd4-3185-447e-8abe-ceb3bada20bd. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:52:03.254 4088 3038338907304 GreenThread-18 DEBUG nova.network.neutron [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:52:03.580 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.vmops [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:52:03.612 4088 3038300760904 MainThread DEBUG os_win.utils.jobutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Waiting for WMI job: {'InstanceID': 'CA7A372D-BA1B-4357-A8D3-3F572BEDDA8D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=23558), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:03.754 4088 3038338907304 GreenThread-18 DEBUG nova.network.neutron [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Updating instance_info_cache with network_info: [{"id": "8dec7dd4-3185-447e-8abe-ceb3bada20bd", "address": "fa:16:3e:eb:ff:af", "network": {"id": "7434a41e-b78f-4cb9-8ffe-b2514d097201", "bridge": null, "label": "tempest-LiveAutoBlockMigrationV225Test-1499875764-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91237ebda1b54d2dbc761e48fdd93516", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8dec7dd4-31", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:52:03.805 4088 3038338907304 GreenThread-18 DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Releasing lock "refresh_cache-59feb82d-9fd9-4170-aa08-742104f9e642" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:52:03.805 4088 3038338907304 GreenThread-18 DEBUG nova.compute.manager [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Instance network_info: |[{"id": "8dec7dd4-3185-447e-8abe-ceb3bada20bd", "address": "fa:16:3e:eb:ff:af", "network": {"id": "7434a41e-b78f-4cb9-8ffe-b2514d097201", "bridge": null, "label": "tempest-LiveAutoBlockMigrationV225Test-1499875764-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91237ebda1b54d2dbc761e48fdd93516", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8dec7dd4-31", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:52:03.805 4088 3038338907480 MainThread DEBUG nova.compute.manager [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Preparing to wait for external event network-vif-plugged-8dec7dd4-3185-447e-8abe-ceb3bada20bd prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:52:03.805 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "59feb82d-9fd9-4170-aa08-742104f9e642-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:03.805 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "59feb82d-9fd9-4170-aa08-742104f9e642-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:03.805 4088 3038338907480 MainThread DEBUG os_win.utils.compute.vmutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Creating VM instance-00000016 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:52:03.805 4088 3038340411816 MainThread DEBUG oslo_concurrency.lockutils [req-e57ea87f-b8dd-4b73-b8a4-79ab49ce1139 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-59feb82d-9fd9-4170-aa08-742104f9e642" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:52:03.805 4088 3038340411816 MainThread DEBUG nova.network.neutron [req-e57ea87f-b8dd-4b73-b8a4-79ab49ce1139 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Refreshing network info cache for port 8dec7dd4-3185-447e-8abe-ceb3bada20bd _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:52:03.908 4088 3038340411464 MainThread DEBUG nova.network.neutron [req-4759774b-f08e-42e8-8d12-9c1081b2d65b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Updated VIF entry in instance network info cache for port f581c585-39ab-4120-a040-5d92bb401a6c. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:52:03.908 4088 3038340411464 MainThread DEBUG nova.network.neutron [req-4759774b-f08e-42e8-8d12-9c1081b2d65b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Updating instance_info_cache with network_info: [{"id": "f581c585-39ab-4120-a040-5d92bb401a6c", "address": "fa:16:3e:da:9a:80", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf581c585-39", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:52:03.924 4088 3038340411464 MainThread DEBUG oslo_concurrency.lockutils [req-4759774b-f08e-42e8-8d12-9c1081b2d65b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-9446e666-4364-4dcd-b041-405653a856bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:52:04.020 4088 3038300760904 MainThread DEBUG os_win.utils.jobutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] WMI job succeeded: {'InstanceID': 'CA7A372D-BA1B-4357-A8D3-3F572BEDDA8D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=402595), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:52:04.020 4088 3038300760904 MainThread DEBUG os_win.utils.compute.vmutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Successfully changed vm state of instance-00000019 to 2 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:52:04.020 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.vmops [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Successfully changed state of VM instance-00000019 to: 2 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:52:04.020 4088 3038300760904 MainThread INFO nova.compute.manager [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Took 30.55 seconds to spawn the instance on the hypervisor. 2021-09-10 16:52:04.020 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:52:04.020 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.vmops [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:52:04.314 4088 3038338907656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000019" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:04.314 4088 3038338907832 MainThread DEBUG nova.virt.driver [-] Emitting event Started> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:52:04.314 4088 3038338907832 MainThread INFO nova.compute.manager [-] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] VM Started (Lifecycle Event) 2021-09-10 16:52:04.348 4088 3038338907832 MainThread DEBUG nova.compute.manager [req-f608a990-db62-49a7-b726-559c6b4d2e18 - - - - -] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:52:04.348 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.vmops [req-f608a990-db62-49a7-b726-559c6b4d2e18 - - - - -] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:52:04.494 4088 3038338907656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000019" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.172s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:04.519 4088 3038300760904 MainThread INFO nova.compute.manager [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Took 32.27 seconds to build instance. 2021-09-10 16:52:04.543 4088 3038338907832 MainThread DEBUG nova.compute.manager [req-f608a990-db62-49a7-b726-559c6b4d2e18 - - - - -] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:52:04.549 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-fa89bed5-50c8-4c6e-8055-8e7fa0a94eb2 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 32.391s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:05.417 4088 3038340411816 MainThread DEBUG nova.network.neutron [req-e57ea87f-b8dd-4b73-b8a4-79ab49ce1139 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Updated VIF entry in instance network info cache for port 8dec7dd4-3185-447e-8abe-ceb3bada20bd. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:52:05.417 4088 3038340411816 MainThread DEBUG nova.network.neutron [req-e57ea87f-b8dd-4b73-b8a4-79ab49ce1139 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Updating instance_info_cache with network_info: [{"id": "8dec7dd4-3185-447e-8abe-ceb3bada20bd", "address": "fa:16:3e:eb:ff:af", "network": {"id": "7434a41e-b78f-4cb9-8ffe-b2514d097201", "bridge": null, "label": "tempest-LiveAutoBlockMigrationV225Test-1499875764-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91237ebda1b54d2dbc761e48fdd93516", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8dec7dd4-31", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:52:05.442 4088 3038340411816 MainThread DEBUG oslo_concurrency.lockutils [req-e57ea87f-b8dd-4b73-b8a4-79ab49ce1139 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-59feb82d-9fd9-4170-aa08-742104f9e642" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:52:06.159 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:52:06.636 4088 3038338907480 MainThread DEBUG nova.virt.hyperv.vmops [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:52:08.290 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-f34511cf-e072-4a4b-b865-b08ceafb9d27 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:08.300 4088 3038300760904 MainThread DEBUG nova.compute.utils [req-f34511cf-e072-4a4b-b865-b08ceafb9d27 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:52:08.346 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-f34511cf-e072-4a4b-b865-b08ceafb9d27 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" released by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 0.063s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:08.676 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-f34511cf-e072-4a4b-b865-b08ceafb9d27 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:08.676 4088 3038300760904 MainThread INFO nova.compute.manager [req-f34511cf-e072-4a4b-b865-b08ceafb9d27 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Attaching volume 3b096fcb-4b67-4a67-a7db-59896737c770 to /dev/sdb 2021-09-10 16:52:08.711 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Lock "f3ef8889-0aba-4544-aa33-a09b43d286aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:08.736 4088 3038340489816 MainThread DEBUG nova.compute.manager [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:52:08.787 4088 3038300760904 MainThread DEBUG os_brick.utils [req-f34511cf-e072-4a4b-b865-b08ceafb9d27 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:52:08.787 4088 3038300760904 MainThread DEBUG os_brick.utils [req-f34511cf-e072-4a4b-b865-b08ceafb9d27 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] <== get_connector_properties: return (0ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:52:08.787 4088 3038300760904 MainThread DEBUG nova.virt.block_device [req-f34511cf-e072-4a4b-b865-b08ceafb9d27 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Updating existing volume attachment record: d596ae82-f601-4ca3-8057-1e266fbc0924 _volume_attach c:\openstack\build\nova\nova\virt\block_device.py:556 2021-09-10 16:52:08.848 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:08.870 4088 3038340489816 MainThread DEBUG nova.virt.hardware [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:52:08.870 4088 3038340489816 MainThread INFO nova.compute.claims [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Claim successful on node n-h2-808474-1 2021-09-10 16:52:09.036 4088 3038340489816 MainThread DEBUG nova.virt.hyperv.hostops [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:52:09.067 4088 3038340489816 MainThread DEBUG nova.virt.hyperv.hostops [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:52:09.346 4088 3038340489816 MainThread DEBUG nova.compute.provider_tree [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:52:09.367 4088 3038340489816 MainThread DEBUG nova.scheduler.client.report [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:52:09.367 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:09.367 4088 3038340489816 MainThread DEBUG nova.compute.manager [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:52:09.504 4088 3038340489816 MainThread DEBUG nova.compute.manager [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:52:09.518 4088 3038340489640 GreenThread-19 DEBUG nova.compute.manager [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:52:09.518 4088 3038340489640 GreenThread-19 DEBUG nova.network.neutron [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:52:09.692 4088 3038340489640 GreenThread-19 DEBUG nova.policy [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66161d18b31e45309aee94f739bc6a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145f8177efc74f5e9be31c5f74e69d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:52:09.773 4088 3038340489816 MainThread DEBUG nova.compute.manager [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:52:09.795 4088 3038340489816 MainThread INFO nova.virt.hyperv.vmops [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Spawning new instance 2021-09-10 16:52:09.800 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Lock "instance-0000001b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:09.800 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Lock "instance-0000001b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:09.800 4088 3038340489816 MainThread DEBUG nova.block_device [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] block_device_list ['sdb'] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:52:09.800 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:09.814 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:09.832 4088 3038340489816 MainThread DEBUG os_win.utils.pathutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Creating directory: C:\openstack\instances\instance-0000001b check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:52:09.832 4088 3038340489816 MainThread DEBUG nova.virt.hyperv.vmops [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000001b\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:52:10.299 4088 3038340489816 MainThread DEBUG nova.virt.hyperv.vmops [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Resizing VHD C:\openstack\instances\instance-0000001b\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:52:11.269 4088 3038340489640 GreenThread-19 DEBUG nova.network.neutron [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Successfully created port: 47561034-0e3c-44d6-ba9c-6d7a2155a81c _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:52:13.551 4088 3038340490168 MainThread DEBUG nova.compute.manager [req-f1e2a7ea-354c-4bfe-91ed-6949b6ba8350 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Received event network-vif-plugged-f581c585-39ab-4120-a040-5d92bb401a6c external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:52:13.551 4088 3038340490168 MainThread DEBUG oslo_concurrency.lockutils [req-f1e2a7ea-354c-4bfe-91ed-6949b6ba8350 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9446e666-4364-4dcd-b041-405653a856bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:13.551 4088 3038340490168 MainThread DEBUG oslo_concurrency.lockutils [req-f1e2a7ea-354c-4bfe-91ed-6949b6ba8350 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9446e666-4364-4dcd-b041-405653a856bd-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:13.551 4088 3038340490168 MainThread DEBUG nova.compute.manager [req-f1e2a7ea-354c-4bfe-91ed-6949b6ba8350 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Processing event network-vif-plugged-f581c585-39ab-4120-a040-5d92bb401a6c _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:52:13.596 4088 3038338906072 MainThread INFO nova.virt.hyperv.vmops [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Using config drive for instance 2021-09-10 16:52:13.736 4088 3038340489640 GreenThread-19 DEBUG nova.network.neutron [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Successfully updated port: 47561034-0e3c-44d6-ba9c-6d7a2155a81c _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:52:13.768 4088 3038338906072 MainThread INFO nova.virt.hyperv.vmops [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Creating config drive at C:\openstack\instances\instance-00000017\configdrive.iso 2021-09-10 16:52:13.861 4088 3038338906072 MainThread DEBUG oslo_concurrency.processutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000017\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp0bpbihvp execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:52:14.018 4088 3038340489640 GreenThread-19 DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Acquired lock "refresh_cache-f3ef8889-0aba-4544-aa33-a09b43d286aa" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:52:14.018 4088 3038340489640 GreenThread-19 DEBUG nova.network.neutron [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:52:14.129 4088 3038340489640 GreenThread-19 DEBUG nova.network.neutron [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:52:14.238 4088 3038338906072 MainThread DEBUG oslo_concurrency.processutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000017\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp0bpbihvp" returned: 0 in 0.375s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:52:14.682 4088 3038340490344 MainThread DEBUG nova.compute.manager [req-d91e8c1d-bd7f-4ea6-b12a-bb7378ad7ad2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Received event network-changed-47561034-0e3c-44d6-ba9c-6d7a2155a81c external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:52:14.682 4088 3038340490344 MainThread DEBUG nova.compute.manager [req-d91e8c1d-bd7f-4ea6-b12a-bb7378ad7ad2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Refreshing instance network info cache due to event network-changed-47561034-0e3c-44d6-ba9c-6d7a2155a81c. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:52:14.835 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Setting boot order for instance: instance-00000017: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:52:14.940 4088 3038340489640 GreenThread-19 DEBUG nova.network.neutron [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Updating instance_info_cache with network_info: [{"id": "47561034-0e3c-44d6-ba9c-6d7a2155a81c", "address": "fa:16:3e:b5:23:95", "network": {"id": "7269c681-e442-4edc-a7f7-eb367d70620b", "bridge": null, "label": "tempest-ServersWithSpecificFlavorTestJSON-568615719-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "145f8177efc74f5e9be31c5f74e69d0a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap47561034-0e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:52:14.958 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:52:14.975 4088 3038340489640 GreenThread-19 DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Releasing lock "refresh_cache-f3ef8889-0aba-4544-aa33-a09b43d286aa" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:52:14.975 4088 3038340489640 GreenThread-19 DEBUG nova.compute.manager [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Instance network_info: |[{"id": "47561034-0e3c-44d6-ba9c-6d7a2155a81c", "address": "fa:16:3e:b5:23:95", "network": {"id": "7269c681-e442-4edc-a7f7-eb367d70620b", "bridge": null, "label": "tempest-ServersWithSpecificFlavorTestJSON-568615719-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "145f8177efc74f5e9be31c5f74e69d0a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap47561034-0e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:52:14.975 4088 3038340490344 MainThread DEBUG oslo_concurrency.lockutils [req-d91e8c1d-bd7f-4ea6-b12a-bb7378ad7ad2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-f3ef8889-0aba-4544-aa33-a09b43d286aa" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:52:14.975 4088 3038340490344 MainThread DEBUG nova.network.neutron [req-d91e8c1d-bd7f-4ea6-b12a-bb7378ad7ad2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Refreshing network info cache for port 47561034-0e3c-44d6-ba9c-6d7a2155a81c _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:52:14.975 4088 3038340489816 MainThread DEBUG nova.compute.manager [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Preparing to wait for external event network-vif-plugged-47561034-0e3c-44d6-ba9c-6d7a2155a81c prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:52:14.987 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Lock "f3ef8889-0aba-4544-aa33-a09b43d286aa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:14.987 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Lock "f3ef8889-0aba-4544-aa33-a09b43d286aa-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:14.987 4088 3038340489816 MainThread DEBUG os_win.utils.compute.vmutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Creating VM instance-0000001b create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:52:15.021 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Waiting for WMI job: {'InstanceID': '434B08B1-CB53-4355-AAC9-BE8A3432AEC8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=28467), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:15.175 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.volumeops [req-f34511cf-e072-4a4b-b865-b08ceafb9d27 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Attaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-3b096fcb-4b67-4a67-a7db-59896737c770', 'target_lun': 0, 'volume_id': '3b096fcb-4b67-4a67-a7db-59896737c770', 'auth_method': 'CHAP', 'auth_username': 'omhn338SPsSrkxXCGtch', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'reserved', 'instance': '9bb2d354-2d76-40ea-8b9c-b18a21edefbb', 'attached_at': '', 'detached_at': '', 'volume_id': '3b096fcb-4b67-4a67-a7db-59896737c770', 'serial': '3b096fcb-4b67-4a67-a7db-59896737c770'} to instance-00000019 _attach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:108 2021-09-10 16:52:15.189 4088 3038300760904 MainThread DEBUG os_brick.initiator.windows.iscsi [req-f34511cf-e072-4a4b-b865-b08ceafb9d27 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-3b096fcb-4b67-4a67-a7db-59896737c770', 'target_lun': 0, 'volume_id': '3b096fcb-4b67-4a67-a7db-59896737c770', 'auth_method': 'CHAP', 'auth_username': 'omhn338SPsSrkxXCGtch', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:52:15.189 4088 3038300760904 MainThread INFO os_brick.initiator.windows.iscsi [req-f34511cf-e072-4a4b-b865-b08ceafb9d27 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Attempting to establish an iSCSI session to target iqn.2010-10.org.openstack:volume-3b096fcb-4b67-4a67-a7db-59896737c770 on portal 10.222.0.55:3260 accessing LUN 0 using initiator None. 2021-09-10 16:52:15.205 4088 3038300760904 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-f34511cf-e072-4a4b-b865-b08ceafb9d27 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Logging in iSCSI target iqn.2010-10.org.openstack:volume-3b096fcb-4b67-4a67-a7db-59896737c770 login_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:401 2021-09-10 16:52:15.503 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] WMI job succeeded: {'InstanceID': '434B08B1-CB53-4355-AAC9-BE8A3432AEC8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=445033), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:52:15.503 4088 3038338906072 MainThread DEBUG os_win.utils.compute.vmutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Successfully changed vm state of instance-00000017 to 2 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:52:15.503 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Successfully changed state of VM instance-00000017 to: 2 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:52:15.503 4088 3038338906072 MainThread INFO nova.compute.manager [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Took 15.92 seconds to spawn the instance on the hypervisor. 2021-09-10 16:52:15.503 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:52:15.503 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:52:15.644 4088 3038340489640 MainThread DEBUG nova.virt.driver [-] Emitting event Started> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:52:15.644 4088 3038340489640 MainThread INFO nova.compute.manager [-] [instance: 9446e666-4364-4dcd-b041-405653a856bd] VM Started (Lifecycle Event) 2021-09-10 16:52:15.644 4088 3038340490872 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000017" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:15.677 4088 3038340489640 MainThread DEBUG nova.compute.manager [req-29be697c-0232-408e-8fae-c5f79659af14 - - - - -] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:52:15.689 4088 3038340489640 MainThread DEBUG nova.virt.hyperv.vmops [req-29be697c-0232-408e-8fae-c5f79659af14 - - - - -] [instance: 9446e666-4364-4dcd-b041-405653a856bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:52:15.689 4088 3038340490168 MainThread DEBUG nova.compute.manager [req-9038e309-4794-436a-b73a-bed8e8d51cf7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Received event network-vif-plugged-8dec7dd4-3185-447e-8abe-ceb3bada20bd external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:52:15.689 4088 3038340490168 MainThread DEBUG oslo_concurrency.lockutils [req-9038e309-4794-436a-b73a-bed8e8d51cf7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "59feb82d-9fd9-4170-aa08-742104f9e642-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:15.689 4088 3038340490168 MainThread DEBUG oslo_concurrency.lockutils [req-9038e309-4794-436a-b73a-bed8e8d51cf7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "59feb82d-9fd9-4170-aa08-742104f9e642-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:15.689 4088 3038340490168 MainThread DEBUG nova.compute.manager [req-9038e309-4794-436a-b73a-bed8e8d51cf7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Processing event network-vif-plugged-8dec7dd4-3185-447e-8abe-ceb3bada20bd _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:52:15.709 4088 3038340490872 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000017" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.062s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:15.738 4088 3038338907480 MainThread INFO nova.virt.hyperv.vmops [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Using config drive for instance 2021-09-10 16:52:15.773 4088 3038340489640 MainThread DEBUG nova.compute.manager [req-29be697c-0232-408e-8fae-c5f79659af14 - - - - -] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:52:15.872 4088 3038340489640 MainThread INFO nova.compute.manager [req-29be697c-0232-408e-8fae-c5f79659af14 - - - - -] [instance: 9446e666-4364-4dcd-b041-405653a856bd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:52:15.900 4088 3038338906072 MainThread INFO nova.compute.manager [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Took 17.11 seconds to build instance. 2021-09-10 16:52:15.939 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-6382f5fd-88e0-488a-a292-4e3a2359ec0f 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Lock "9446e666-4364-4dcd-b041-405653a856bd" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.250s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:16.080 4088 3038340490344 MainThread DEBUG nova.network.neutron [req-d91e8c1d-bd7f-4ea6-b12a-bb7378ad7ad2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Updated VIF entry in instance network info cache for port 47561034-0e3c-44d6-ba9c-6d7a2155a81c. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:52:16.080 4088 3038340490344 MainThread DEBUG nova.network.neutron [req-d91e8c1d-bd7f-4ea6-b12a-bb7378ad7ad2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Updating instance_info_cache with network_info: [{"id": "47561034-0e3c-44d6-ba9c-6d7a2155a81c", "address": "fa:16:3e:b5:23:95", "network": {"id": "7269c681-e442-4edc-a7f7-eb367d70620b", "bridge": null, "label": "tempest-ServersWithSpecificFlavorTestJSON-568615719-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "145f8177efc74f5e9be31c5f74e69d0a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap47561034-0e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:52:16.103 4088 3038340490344 MainThread DEBUG oslo_concurrency.lockutils [req-d91e8c1d-bd7f-4ea6-b12a-bb7378ad7ad2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-f3ef8889-0aba-4544-aa33-a09b43d286aa" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:52:16.267 4088 3038338907480 MainThread INFO nova.virt.hyperv.vmops [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Creating config drive at C:\openstack\instances\instance-00000016\configdrive.iso 2021-09-10 16:52:16.402 4088 3038338907480 MainThread DEBUG oslo_concurrency.processutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000016\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpwspnb0ro execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:52:16.832 4088 3038338907480 MainThread DEBUG oslo_concurrency.processutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000016\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpwspnb0ro" returned: 0 in 0.422s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:52:17.067 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:52:17.067 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:52:17.270 4088 3038338906072 MainThread INFO nova.compute.manager [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] instance snapshotting 2021-09-10 16:52:17.270 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.snapshotops [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Creating snapshot for instance instance-00000017 snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:50 2021-09-10 16:52:17.378 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Waiting for WMI job: {'InstanceID': '30AF1B04-3D77-470B-9184-CA6A74B039B0', 'Description': 'Creating Virtual Machine Checkpoint', 'ElementName': 'Creating Checkpoint', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=23277), 'Cancellable': True, 'JobType': 70, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:17.721 4088 3038338907480 MainThread DEBUG nova.virt.hyperv.vmops [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Setting boot order for instance: instance-00000016: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:52:17.879 4088 3038338907480 MainThread DEBUG nova.virt.hyperv.vmops [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:52:17.971 4088 3038338907480 MainThread DEBUG os_win.utils.jobutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': 'E0C5CF10-919B-4227-AEEF-C7AE260181F1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20771), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:18.954 4088 3038340489816 MainThread DEBUG nova.virt.hyperv.vmops [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:52:19.892 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] WMI job succeeded: {'InstanceID': '30AF1B04-3D77-470B-9184-CA6A74B039B0', 'Description': 'Creating Virtual Machine Checkpoint', 'ElementName': 'Creating Checkpoint', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(seconds=2, microseconds=536165), 'Cancellable': True, 'JobType': 70, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:52:20.097 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.snapshotops [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Getting info for VHD C:\openstack\instances\instance-00000017\root.vhdx snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:59 2021-09-10 16:52:20.130 4088 3038338906072 MainThread DEBUG os_win.utils.pathutils [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Creating directory: C:\openstack\instances\export\instance-00000017 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:52:20.130 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.snapshotops [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Copying VHD C:\openstack\instances\instance-00000017\root.vhdx to C:\openstack\instances\export\instance-00000017\root.vhdx snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:69 2021-09-10 16:52:20.173 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.snapshotops [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Copying base disk C:\openstack\instances\instance-00000017\root.vhdx to C:\openstack\instances\export\instance-00000017\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:81 2021-09-10 16:52:20.251 4088 3038300760904 MainThread DEBUG os_win.utils.storage.diskutils [req-f34511cf-e072-4a4b-b865-b08ceafb9d27 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 16:52:20.362 4088 3038300760904 MainThread DEBUG os_win.utils.storage.diskutils [req-f34511cf-e072-4a4b-b865-b08ceafb9d27 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 16:52:20.454 4088 3038300760904 MainThread DEBUG os_brick.initiator.windows.iscsi [req-f34511cf-e072-4a4b-b865-b08ceafb9d27 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] <== connect_volume: return (5265ms) {'type': 'block', 'path': '\\\\.\\PhysicalDrive1', 'number': 1, 'scsi_wwn': '36001405923C898C887B40FEAB195791E'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:52:21.397 4088 3038300760904 MainThread DEBUG nova.objects.instance [req-f34511cf-e072-4a4b-b865-b08ceafb9d27 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lazy-loading 'flavor' on Instance uuid 9bb2d354-2d76-40ea-8b9c-b18a21edefbb obj_load_attr c:\openstack\build\nova\nova\objects\instance.py:1101 2021-09-10 16:52:21.446 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-f34511cf-e072-4a4b-b865-b08ceafb9d27 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" released by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 12.766s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:22.955 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-c1cbd330-3a12-4fe8-a72f-1b7f3a1435cc 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:22.986 4088 3038300760904 MainThread INFO nova.compute.manager [req-c1cbd330-3a12-4fe8-a72f-1b7f3a1435cc 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Detaching volume 3b096fcb-4b67-4a67-a7db-59896737c770 2021-09-10 16:52:23.082 4088 3038300760904 MainThread INFO nova.virt.block_device [req-c1cbd330-3a12-4fe8-a72f-1b7f3a1435cc 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Attempting to driver detach volume 3b096fcb-4b67-4a67-a7db-59896737c770 from mountpoint /dev/sdb 2021-09-10 16:52:23.110 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.volumeops [req-c1cbd330-3a12-4fe8-a72f-1b7f3a1435cc 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Detaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-3b096fcb-4b67-4a67-a7db-59896737c770', 'target_lun': 0, 'volume_id': '3b096fcb-4b67-4a67-a7db-59896737c770', 'auth_method': 'CHAP', 'auth_username': 'omhn338SPsSrkxXCGtch', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'reserved', 'instance': '9bb2d354-2d76-40ea-8b9c-b18a21edefbb', 'attached_at': '', 'detached_at': '', 'volume_id': '3b096fcb-4b67-4a67-a7db-59896737c770', 'serial': '3b096fcb-4b67-4a67-a7db-59896737c770'} from instance-00000019 detach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:128 2021-09-10 16:52:23.110 4088 3038300760904 MainThread DEBUG os_brick.initiator.windows.iscsi [req-c1cbd330-3a12-4fe8-a72f-1b7f3a1435cc 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] ==> get_volume_paths: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-3b096fcb-4b67-4a67-a7db-59896737c770', 'target_lun': 0, 'volume_id': '3b096fcb-4b67-4a67-a7db-59896737c770', 'auth_method': 'CHAP', 'auth_username': 'omhn338SPsSrkxXCGtch', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:52:23.130 4088 3038300760904 MainThread DEBUG os_brick.initiator.windows.iscsi [req-c1cbd330-3a12-4fe8-a72f-1b7f3a1435cc 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] <== get_volume_paths: return (20ms) ['\\\\.\\PhysicalDrive1'] trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:52:23.207 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.volumeops [req-c1cbd330-3a12-4fe8-a72f-1b7f3a1435cc 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Detaching disk \\N-H2-808474-1\root\virtualization\v2:Msvm_DiskDrive.CreationClassName="Msvm_DiskDrive",DeviceID="Microsoft:353B3BE8-310C-4cf4-839E-4E1B14616136\\1",SystemCreationClassName="Msvm_ComputerSystem",SystemName="N-H2-808474-1" from instance: instance-00000019 detach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:292 2021-09-10 16:52:23.579 4088 3038300760904 MainThread DEBUG os_brick.initiator.windows.iscsi [req-c1cbd330-3a12-4fe8-a72f-1b7f3a1435cc 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-3b096fcb-4b67-4a67-a7db-59896737c770', 'target_lun': 0, 'volume_id': '3b096fcb-4b67-4a67-a7db-59896737c770', 'auth_method': 'CHAP', 'auth_username': 'omhn338SPsSrkxXCGtch', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:52:23.579 4088 3038300760904 MainThread DEBUG os_win.utils.storage.diskutils [req-c1cbd330-3a12-4fe8-a72f-1b7f3a1435cc 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 16:52:23.722 4088 3038300760904 MainThread DEBUG os_win.utils.storage.diskutils [req-c1cbd330-3a12-4fe8-a72f-1b7f3a1435cc 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 16:52:23.722 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.snapshotops [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Reconnecting copied base VHD C:\openstack\instances\export\instance-00000017\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx and diff VHD C:\openstack\instances\export\instance-00000017\root.vhdx snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:89 2021-09-10 16:52:23.739 4088 3038300760904 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-c1cbd330-3a12-4fe8-a72f-1b7f3a1435cc 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-3b096fcb-4b67-4a67-a7db-59896737c770 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 16:52:23.806 4088 3038300760904 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-c1cbd330-3a12-4fe8-a72f-1b7f3a1435cc 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Removing iSCSI target persistent login: iqn.2010-10.org.openstack:volume-3b096fcb-4b67-4a67-a7db-59896737c770 _remove_target_persistent_logins c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:495 2021-09-10 16:52:23.806 4088 3038300760904 MainThread DEBUG os_brick.initiator.windows.iscsi [req-c1cbd330-3a12-4fe8-a72f-1b7f3a1435cc 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] <== disconnect_volume: return (226ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:52:25.525 4088 3038340490520 MainThread DEBUG nova.compute.manager [req-b14aa78d-aa9c-461b-9080-9095edad4c84 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Received event network-vif-plugged-f581c585-39ab-4120-a040-5d92bb401a6c external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:52:25.525 4088 3038340490520 MainThread DEBUG oslo_concurrency.lockutils [req-b14aa78d-aa9c-461b-9080-9095edad4c84 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9446e666-4364-4dcd-b041-405653a856bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:25.525 4088 3038340490520 MainThread DEBUG oslo_concurrency.lockutils [req-b14aa78d-aa9c-461b-9080-9095edad4c84 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9446e666-4364-4dcd-b041-405653a856bd-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:25.525 4088 3038340490520 MainThread DEBUG nova.compute.manager [req-b14aa78d-aa9c-461b-9080-9095edad4c84 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] No waiting events found dispatching network-vif-plugged-f581c585-39ab-4120-a040-5d92bb401a6c pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 16:52:25.525 4088 3038340490520 MainThread WARNING nova.compute.manager [req-b14aa78d-aa9c-461b-9080-9095edad4c84 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Received unexpected event network-vif-plugged-f581c585-39ab-4120-a040-5d92bb401a6c for instance with vm_state active and task_state image_pending_upload. 2021-09-10 16:52:26.174 4088 3038296623592 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:52:26.174 4088 3038296623592 MainThread INFO nova.compute.manager [-] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] VM Stopped (Lifecycle Event) 2021-09-10 16:52:26.174 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000016" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:26.174 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000016" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:26.220 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-815132e1-a81f-4fb5-924f-333536c30742 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:52:26.220 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-815132e1-a81f-4fb5-924f-333536c30742 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:52:26.220 4088 3038338907480 MainThread ERROR os_win.utils.jobutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000016\' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)instance-00000016E32CC1D4-F7F5-4886-B9A1-B546D46005E812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)instance-00000016E32CC1D4-F7F5-4886-B9A1-B546D46005E810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000016\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)instance-00000016E32CC1D4-F7F5-4886-B9A1-B546D46005E8%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E0C5CF10-919B-4227-AEEF-C7AE260181F1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=140184), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 52, 17), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 52, 18), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000016' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)\n\nNot enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)\n\n'instance-00000016' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)", 'ErrorSummaryDescription': "'instance-00000016' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000016.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:52:26.220 4088 3038338907480 MainThread DEBUG os_win._utils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000016' failed to start. Not enough memory in the system to start the virtual machine instance-00000016. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000016' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Not enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) 'instance-00000016' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 8.340853929519653 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:52:26.286 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-815132e1-a81f-4fb5-924f-333536c30742 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:52:26.286 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.snapshotops [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Merging diff disk C:\openstack\instances\export\instance-00000017\root.vhdx into its parent. snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:94 2021-09-10 16:52:26.299 4088 3038296623592 MainThread INFO nova.compute.manager [req-815132e1-a81f-4fb5-924f-333536c30742 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:52:27.158 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.snapshotops [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Updating Glance image cdc65379-758e-4e49-a2fc-5e526876e1a0 with content from merged disk C:\openstack\instances\export\instance-00000017\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:100 2021-09-10 16:52:27.251 4088 3038338907480 MainThread DEBUG os_win.utils.jobutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': '61AFEE75-6B9F-4845-8A77-49DADAB131A9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18808), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:27.492 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000016" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:27.492 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000016" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:27.492 4088 3038300758968 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:52:27.492 4088 3038300758968 MainThread INFO nova.compute.manager [-] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] VM Stopped (Lifecycle Event) 2021-09-10 16:52:27.533 4088 3038300758968 MainThread DEBUG nova.compute.manager [req-62993be2-a273-438b-a648-5e0f29c57bf6 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:52:27.533 4088 3038300758968 MainThread DEBUG nova.virt.hyperv.vmops [req-62993be2-a273-438b-a648-5e0f29c57bf6 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:52:27.548 4088 3038338907480 MainThread ERROR os_win.utils.jobutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000016\' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)instance-00000016E32CC1D4-F7F5-4886-B9A1-B546D46005E812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)instance-00000016E32CC1D4-F7F5-4886-B9A1-B546D46005E810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000016\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)instance-00000016E32CC1D4-F7F5-4886-B9A1-B546D46005E8%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '61AFEE75-6B9F-4845-8A77-49DADAB131A9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=142038), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 52, 27), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 52, 27), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000016' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)\n\nNot enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)\n\n'instance-00000016' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)", 'ErrorSummaryDescription': "'instance-00000016' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000016.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:52:27.548 4088 3038338907480 MainThread DEBUG os_win._utils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000016' failed to start. Not enough memory in the system to start the virtual machine instance-00000016. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000016' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Not enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) 'instance-00000016' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 9.668415546417236 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:52:27.579 4088 3038300758968 MainThread DEBUG nova.compute.manager [req-62993be2-a273-438b-a648-5e0f29c57bf6 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:52:27.626 4088 3038300758968 MainThread INFO nova.compute.manager [req-62993be2-a273-438b-a648-5e0f29c57bf6 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:52:28.598 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-f2596176-c293-42e8-b1b9-e6253931087f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Received event network-vif-plugged-47561034-0e3c-44d6-ba9c-6d7a2155a81c external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:52:28.598 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-f2596176-c293-42e8-b1b9-e6253931087f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "f3ef8889-0aba-4544-aa33-a09b43d286aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:28.598 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-f2596176-c293-42e8-b1b9-e6253931087f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "f3ef8889-0aba-4544-aa33-a09b43d286aa-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:28.598 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-f2596176-c293-42e8-b1b9-e6253931087f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Processing event network-vif-plugged-47561034-0e3c-44d6-ba9c-6d7a2155a81c _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:52:28.613 4088 3038338907480 MainThread DEBUG os_win.utils.jobutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': '22635B35-8E34-4B30-9ACE-087A80560B5C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16691), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:28.642 4088 3038340489816 MainThread INFO nova.virt.hyperv.vmops [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Using config drive for instance 2021-09-10 16:52:28.769 4088 3038338907480 MainThread ERROR os_win.utils.jobutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000016\' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)instance-00000016E32CC1D4-F7F5-4886-B9A1-B546D46005E812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)instance-00000016E32CC1D4-F7F5-4886-B9A1-B546D46005E810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000016\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)instance-00000016E32CC1D4-F7F5-4886-B9A1-B546D46005E8%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '22635B35-8E34-4B30-9ACE-087A80560B5C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=131249), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 52, 28), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 52, 28), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000016' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)\n\nNot enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)\n\n'instance-00000016' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)", 'ErrorSummaryDescription': "'instance-00000016' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000016.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:52:28.769 4088 3038338907480 MainThread DEBUG os_win._utils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000016' failed to start. Not enough memory in the system to start the virtual machine instance-00000016. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000016' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Not enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) 'instance-00000016' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 10.889365434646606 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:52:28.801 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000016" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:28.801 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000016" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:28.801 4088 3038300758968 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:52:28.801 4088 3038300758968 MainThread INFO nova.compute.manager [-] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] VM Stopped (Lifecycle Event) 2021-09-10 16:52:28.846 4088 3038300758968 MainThread DEBUG nova.compute.manager [req-903f4219-b97f-4a9d-afce-d99e9c444393 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:52:28.846 4088 3038300758968 MainThread DEBUG nova.virt.hyperv.vmops [req-903f4219-b97f-4a9d-afce-d99e9c444393 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:52:28.908 4088 3038300758968 MainThread DEBUG nova.compute.manager [req-903f4219-b97f-4a9d-afce-d99e9c444393 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:52:28.969 4088 3038300758968 MainThread INFO nova.compute.manager [req-903f4219-b97f-4a9d-afce-d99e9c444393 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:52:29.032 4088 3038340489816 MainThread INFO nova.virt.hyperv.vmops [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Creating config drive at C:\openstack\instances\instance-0000001b\configdrive.iso 2021-09-10 16:52:29.190 4088 3038340489816 MainThread DEBUG oslo_concurrency.processutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000001b\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpd5_xgm6n execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:52:29.579 4088 3038340489816 MainThread DEBUG oslo_concurrency.processutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000001b\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpd5_xgm6n" returned: 0 in 0.390s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:52:29.659 4088 3038300760904 MainThread DEBUG nova.objects.instance [req-c1cbd330-3a12-4fe8-a72f-1b7f3a1435cc 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lazy-loading 'flavor' on Instance uuid 9bb2d354-2d76-40ea-8b9c-b18a21edefbb obj_load_attr c:\openstack\build\nova\nova\objects\instance.py:1101 2021-09-10 16:52:29.719 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [req-c1cbd330-3a12-4fe8-a72f-1b7f3a1435cc 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" released by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 6.766s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:29.803 4088 3038338907480 MainThread DEBUG os_win.utils.jobutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': '5327F36B-A780-4719-AAFC-56C3560A2DFE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19631), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:29.819 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "079b5c5d-fe33-48d2-ba84-de08229901eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:29.854 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:52:29.987 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:29.987 4088 3038338907304 MainThread DEBUG nova.virt.hardware [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:52:29.987 4088 3038338907304 MainThread INFO nova.compute.claims [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Claim successful on node n-h2-808474-1 2021-09-10 16:52:30.003 4088 3038338907480 MainThread ERROR os_win.utils.jobutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000016\' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)instance-00000016E32CC1D4-F7F5-4886-B9A1-B546D46005E812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)instance-00000016E32CC1D4-F7F5-4886-B9A1-B546D46005E810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000016\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)instance-00000016E32CC1D4-F7F5-4886-B9A1-B546D46005E8%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5327F36B-A780-4719-AAFC-56C3560A2DFE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=155405), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 52, 29), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 52, 29), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000016' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)\n\nNot enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)\n\n'instance-00000016' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)", 'ErrorSummaryDescription': "'instance-00000016' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000016.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:52:30.003 4088 3038338907480 MainThread DEBUG os_win._utils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000016' failed to start. Not enough memory in the system to start the virtual machine instance-00000016. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000016' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Not enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) 'instance-00000016' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 12.123678922653198 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:52:30.115 4088 3038338905192 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:52:30.115 4088 3038338905192 MainThread INFO nova.compute.manager [-] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] VM Stopped (Lifecycle Event) 2021-09-10 16:52:30.115 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000016" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:30.115 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000016" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:30.173 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-bc031986-629f-465a-9067-e32ede7d10b3 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:52:30.173 4088 3038338905192 MainThread DEBUG nova.virt.hyperv.vmops [req-bc031986-629f-465a-9067-e32ede7d10b3 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:52:30.222 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.hostops [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:52:30.222 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-bc031986-629f-465a-9067-e32ede7d10b3 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:52:30.251 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.hostops [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:52:30.283 4088 3038338905192 MainThread INFO nova.compute.manager [req-bc031986-629f-465a-9067-e32ede7d10b3 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:52:30.361 4088 3038340489816 MainThread DEBUG nova.virt.hyperv.vmops [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Setting boot order for instance: instance-0000001b: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:52:30.485 4088 3038340489816 MainThread DEBUG nova.virt.hyperv.vmops [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:52:30.532 4088 3038340489816 MainThread DEBUG os_win.utils.jobutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Waiting for WMI job: {'InstanceID': '1AC57619-AF10-4F15-920B-40C9CB8307DF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19929), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:30.628 4088 3038338907304 MainThread DEBUG nova.compute.provider_tree [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:52:30.642 4088 3038338907304 MainThread DEBUG nova.scheduler.client.report [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:52:30.642 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.656s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:30.660 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:52:30.723 4088 3038340489816 MainThread ERROR os_win.utils.jobutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001b\' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)instance-0000001b5D471948-6250-46CE-B17C-8D21AFF1607012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)instance-0000001b5D471948-6250-46CE-B17C-8D21AFF1607010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)instance-0000001b5D471948-6250-46CE-B17C-8D21AFF16070%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1AC57619-AF10-4F15-920B-40C9CB8307DF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=147204), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 52, 30), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 52, 30), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001b' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)\n\nNot enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)\n\n'instance-0000001b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)", 'ErrorSummaryDescription': "'instance-0000001b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:52:30.723 4088 3038340489816 MainThread DEBUG os_win._utils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001b' failed to start. Not enough memory in the system to start the virtual machine instance-0000001b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001b' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Not enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) 'instance-0000001b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.2199084758758545 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:52:30.800 4088 3038338905016 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:52:30.800 4088 3038338905016 MainThread INFO nova.compute.manager [-] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] VM Stopped (Lifecycle Event) 2021-09-10 16:52:30.800 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:30.800 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:30.813 4088 3038338907304 MainThread DEBUG nova.compute.utils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:52:30.813 4088 3038338905192 GreenThread-20 DEBUG nova.compute.manager [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:52:30.813 4088 3038338905192 GreenThread-20 DEBUG nova.network.neutron [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:52:30.830 4088 3038338905016 MainThread DEBUG nova.compute.manager [req-2c061c5a-032d-452b-84c3-3ce8e628d9b4 - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:52:30.830 4088 3038338905016 MainThread DEBUG nova.virt.hyperv.vmops [req-2c061c5a-032d-452b-84c3-3ce8e628d9b4 - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:52:30.861 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:52:30.894 4088 3038338905016 MainThread DEBUG nova.compute.manager [req-2c061c5a-032d-452b-84c3-3ce8e628d9b4 - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:52:30.943 4088 3038338905016 MainThread INFO nova.compute.manager [req-2c061c5a-032d-452b-84c3-3ce8e628d9b4 - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:52:30.987 4088 3038338907304 MainThread INFO nova.virt.block_device [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Booting with volume a0ac4351-dd95-40e6-bcc7-f7e316d40088 at /dev/sda 2021-09-10 16:52:31.048 4088 3038338907480 MainThread DEBUG os_win.utils.jobutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': '789C2715-3750-41F1-8876-CB30E2244FDC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=22683), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:31.112 4088 3038338905192 GreenThread-20 DEBUG nova.policy [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fac7f2174628404cb8576928225b4394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8236f1477243dfafd0682b608fc659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:52:31.112 4088 3038338907304 MainThread DEBUG os_brick.utils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:52:31.133 4088 3038338907304 MainThread DEBUG os_brick.utils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] <== get_connector_properties: return (0ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:52:31.133 4088 3038338907304 MainThread DEBUG nova.virt.block_device [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Updating existing volume attachment record: e0de3746-2f0e-4bb1-b7b1-5f96c5fd97f9 _volume_attach c:\openstack\build\nova\nova\virt\block_device.py:556 2021-09-10 16:52:31.220 4088 3038338907480 MainThread ERROR os_win.utils.jobutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000016\' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)instance-00000016E32CC1D4-F7F5-4886-B9A1-B546D46005E812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)instance-00000016E32CC1D4-F7F5-4886-B9A1-B546D46005E810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000016\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)instance-00000016E32CC1D4-F7F5-4886-B9A1-B546D46005E8%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '789C2715-3750-41F1-8876-CB30E2244FDC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=129633), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 52, 31), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 52, 31), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000016' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)\n\nNot enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)\n\n'instance-00000016' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)", 'ErrorSummaryDescription': "'instance-00000016' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000016.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:52:31.220 4088 3038338907480 MainThread DEBUG os_win._utils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000016' failed to start. Not enough memory in the system to start the virtual machine instance-00000016. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000016' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Not enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) 'instance-00000016' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 13.340961933135986 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:52:31.294 4088 3038300758968 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000016" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:31.294 4088 3038300758968 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000016" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:31.294 4088 3038300758440 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:52:31.294 4088 3038300758440 MainThread INFO nova.compute.manager [-] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] VM Stopped (Lifecycle Event) 2021-09-10 16:52:31.315 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-524359c6-dc66-4571-a4c0-29fda037317d - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:52:31.315 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.vmops [req-524359c6-dc66-4571-a4c0-29fda037317d - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:52:31.380 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-524359c6-dc66-4571-a4c0-29fda037317d - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:52:31.407 4088 3038300758440 MainThread INFO nova.compute.manager [req-524359c6-dc66-4571-a4c0-29fda037317d - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:52:31.751 4088 3038340489816 MainThread DEBUG os_win.utils.jobutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Waiting for WMI job: {'InstanceID': 'FB976C14-D20E-4BA5-A980-B1B3B90655FB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19963), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:31.993 4088 3038300758440 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:52:31.993 4088 3038300758440 MainThread INFO nova.compute.manager [-] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] VM Stopped (Lifecycle Event) 2021-09-10 16:52:32.003 4088 3038300758968 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:32.003 4088 3038300758968 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:32.016 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-224aac46-4180-4735-882f-320b88f9ad84 - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:52:32.016 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.vmops [req-224aac46-4180-4735-882f-320b88f9ad84 - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:52:32.053 4088 3038340489816 MainThread ERROR os_win.utils.jobutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001b\' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)instance-0000001b5D471948-6250-46CE-B17C-8D21AFF1607012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)instance-0000001b5D471948-6250-46CE-B17C-8D21AFF1607010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)instance-0000001b5D471948-6250-46CE-B17C-8D21AFF16070%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'FB976C14-D20E-4BA5-A980-B1B3B90655FB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=150522), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 52, 31), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 52, 31), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001b' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)\n\nNot enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)\n\n'instance-0000001b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)", 'ErrorSummaryDescription': "'instance-0000001b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:52:32.053 4088 3038340489816 MainThread DEBUG os_win._utils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001b' failed to start. Not enough memory in the system to start the virtual machine instance-0000001b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001b' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Not enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) 'instance-0000001b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.55033540725708 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:52:32.095 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-224aac46-4180-4735-882f-320b88f9ad84 - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:52:32.130 4088 3038300758440 MainThread INFO nova.compute.manager [req-224aac46-4180-4735-882f-320b88f9ad84 - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:52:32.251 4088 3038338907480 MainThread DEBUG os_win.utils.jobutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': 'F912A129-9659-444D-A0F3-CA1EAC52697B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17866), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:32.486 4088 3038300758440 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:52:32.486 4088 3038300758440 MainThread INFO nova.compute.manager [-] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] VM Stopped (Lifecycle Event) 2021-09-10 16:52:32.486 4088 3038300758968 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000016" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:32.486 4088 3038300758968 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000016" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:32.532 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-0ffc36b5-ad9d-403e-982f-62a666a5cab9 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:52:32.532 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.vmops [req-0ffc36b5-ad9d-403e-982f-62a666a5cab9 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:52:32.532 4088 3038338907480 MainThread ERROR os_win.utils.jobutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000016\' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)instance-00000016E32CC1D4-F7F5-4886-B9A1-B546D46005E812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)instance-00000016E32CC1D4-F7F5-4886-B9A1-B546D46005E810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000016\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)instance-00000016E32CC1D4-F7F5-4886-B9A1-B546D46005E8%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'F912A129-9659-444D-A0F3-CA1EAC52697B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=147804), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 52, 32), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 52, 32), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000016' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)\n\nNot enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)\n\n'instance-00000016' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8)", 'ErrorSummaryDescription': "'instance-00000016' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000016.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:52:32.532 4088 3038338907480 MainThread ERROR nova.virt.hyperv.vmops [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Failed to change vm state of instance-00000016 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000016' failed to start. 2021-09-10 16:52:32.532 4088 3038338907480 MainThread INFO nova.virt.hyperv.vmops [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Got request to destroy instance 2021-09-10 16:52:32.581 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-0ffc36b5-ad9d-403e-982f-62a666a5cab9 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:52:32.616 4088 3038300758440 MainThread INFO nova.compute.manager [req-0ffc36b5-ad9d-403e-982f-62a666a5cab9 - - - - -] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:52:32.723 4088 3038338905192 GreenThread-20 DEBUG nova.network.neutron [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Successfully created port: 2443269b-3d7a-4f11-ac3e-3380fd9883a4 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:52:32.862 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-5b0803e6-d199-4e6a-98f6-f07246284432 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:32.862 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-5b0803e6-d199-4e6a-98f6-f07246284432 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:32.862 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-5b0803e6-d199-4e6a-98f6-f07246284432 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:32.862 4088 3038300758440 MainThread ERROR nova.compute.manager [req-5b0803e6-d199-4e6a-98f6-f07246284432 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Setting instance vm_state to ERROR: NameError: name 'instant' is not defined 2021-09-10 16:52:32.862 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Traceback (most recent call last): 2021-09-10 16:52:32.862 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:52:32.862 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] self._delete_instance(context, instance, bdms) 2021-09-10 16:52:32.862 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:52:32.862 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:52:32.862 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] NameError: name 'instant' is not defined 2021-09-10 16:52:32.862 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] 2021-09-10 16:52:32.943 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-5b0803e6-d199-4e6a-98f6-f07246284432 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" released by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 0.078s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:33.094 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-5b0803e6-d199-4e6a-98f6-f07246284432 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:33.094 4088 3038340489816 MainThread DEBUG os_win.utils.jobutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Waiting for WMI job: {'InstanceID': '583D38ED-44AB-4888-A862-A2B5CCC67470', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20719), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:33.129 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.hostops [req-5b0803e6-d199-4e6a-98f6-f07246284432 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:52:33.158 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.hostops [req-5b0803e6-d199-4e6a-98f6-f07246284432 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:52:33.251 4088 3038340489816 MainThread ERROR os_win.utils.jobutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001b\' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)instance-0000001b5D471948-6250-46CE-B17C-8D21AFF1607012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)instance-0000001b5D471948-6250-46CE-B17C-8D21AFF1607010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)instance-0000001b5D471948-6250-46CE-B17C-8D21AFF16070%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '583D38ED-44AB-4888-A862-A2B5CCC67470', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=139978), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 52, 33), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 52, 33), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001b' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)\n\nNot enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)\n\n'instance-0000001b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)", 'ErrorSummaryDescription': "'instance-0000001b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:52:33.251 4088 3038340489816 MainThread DEBUG os_win._utils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001b' failed to start. Not enough memory in the system to start the virtual machine instance-0000001b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001b' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Not enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) 'instance-0000001b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.7480247020721436 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:52:33.330 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:33.330 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:33.330 4088 3038300758968 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:52:33.330 4088 3038300758968 MainThread INFO nova.compute.manager [-] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] VM Stopped (Lifecycle Event) 2021-09-10 16:52:33.361 4088 3038300758968 MainThread DEBUG nova.compute.manager [req-e40da630-427f-4453-b2c9-6dfa957dec18 - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:52:33.361 4088 3038300758968 MainThread DEBUG nova.virt.hyperv.vmops [req-e40da630-427f-4453-b2c9-6dfa957dec18 - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:52:33.438 4088 3038300758968 MainThread DEBUG nova.compute.manager [req-e40da630-427f-4453-b2c9-6dfa957dec18 - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:52:33.504 4088 3038300758968 MainThread INFO nova.compute.manager [req-e40da630-427f-4453-b2c9-6dfa957dec18 - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:52:33.534 4088 3038300758440 MainThread DEBUG nova.compute.provider_tree [req-5b0803e6-d199-4e6a-98f6-f07246284432 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:52:33.534 4088 3038300758440 MainThread DEBUG nova.scheduler.client.report [req-5b0803e6-d199-4e6a-98f6-f07246284432 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:52:33.534 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-5b0803e6-d199-4e6a-98f6-f07246284432 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:33.534 4088 3038300758440 MainThread INFO nova.compute.manager [req-5b0803e6-d199-4e6a-98f6-f07246284432 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Successfully reverted task state from deleting on failure for instance. 2021-09-10 16:52:33.563 4088 3038300758440 MainThread ERROR oslo_messaging.rpc.server [req-5b0803e6-d199-4e6a-98f6-f07246284432 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Exception during message handling: NameError: name 'instant' is not defined 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server Traceback (most recent call last): 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 72, in wrapped 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server context, exc, binary) 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server return f(self, context, *args, **kw) 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 184, in decorated_function 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server "Error: %s", e, instance=instance) 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 154, in decorated_function 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\utils.py", line 1433, in decorated_function 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 200, in decorated_function 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3106, in terminate_instance 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server do_terminate_instance(instance, bdms) 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_concurrency\lockutils.py", line 360, in inner 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server return f(*args, **kwargs) 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3104, in do_terminate_instance 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server self._set_instance_obj_error_state(instance) 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server self._delete_instance(context, instance, bdms) 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server NameError: name 'instant' is not defined 2021-09-10 16:52:33.563 4088 3038300758440 MainThread TRACE oslo_messaging.rpc.server 2021-09-10 16:52:34.300 4088 3038340489816 MainThread DEBUG os_win.utils.jobutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Waiting for WMI job: {'InstanceID': '6486F68C-2B8D-4B7B-B6C3-5A031528327C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=27851), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:34.548 4088 3038338905192 GreenThread-20 DEBUG nova.network.neutron [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Successfully updated port: 2443269b-3d7a-4f11-ac3e-3380fd9883a4 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:52:34.572 4088 3038340489816 MainThread ERROR os_win.utils.jobutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001b\' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)instance-0000001b5D471948-6250-46CE-B17C-8D21AFF1607012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)instance-0000001b5D471948-6250-46CE-B17C-8D21AFF1607010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)instance-0000001b5D471948-6250-46CE-B17C-8D21AFF16070%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6486F68C-2B8D-4B7B-B6C3-5A031528327C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=170457), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 52, 34), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 52, 34), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001b' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)\n\nNot enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)\n\n'instance-0000001b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)", 'ErrorSummaryDescription': "'instance-0000001b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:52:34.581 4088 3038340489816 MainThread DEBUG os_win._utils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001b' failed to start. Not enough memory in the system to start the virtual machine instance-0000001b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001b' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Not enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) 'instance-0000001b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 4.078230142593384 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:52:34.581 4088 3038338905192 GreenThread-20 DEBUG oslo_concurrency.lockutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Acquired lock "refresh_cache-079b5c5d-fe33-48d2-ba84-de08229901eb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:52:34.581 4088 3038338905192 GreenThread-20 DEBUG nova.network.neutron [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:52:34.629 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:52:34.629 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] VM Stopped (Lifecycle Event) 2021-09-10 16:52:34.629 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:34.641 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:34.658 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-962d238c-ffd0-4a11-9798-e1197de5e30b - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:52:34.658 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-962d238c-ffd0-4a11-9798-e1197de5e30b - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:52:34.725 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-962d238c-ffd0-4a11-9798-e1197de5e30b - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:52:34.767 4088 3038300761080 MainThread INFO nova.compute.manager [req-962d238c-ffd0-4a11-9798-e1197de5e30b - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:52:34.823 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:52:34.823 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:52:34.823 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 16:52:34.970 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-66c5445c-c347-4833-8af8-58ba8ff6d95e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:52:34.970 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 16:52:35.001 4088 3038338905192 GreenThread-20 DEBUG nova.network.neutron [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:52:35.235 4088 3038338907480 MainThread DEBUG nova.virt.hyperv.vmops [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:52:35.235 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-00000016" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:35.235 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-00000016" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:35.251 4088 3038338907480 MainThread DEBUG os_win.utils.compute.vmutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Successfully changed vm state of instance-00000016 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:52:35.251 4088 3038338907480 MainThread DEBUG nova.virt.hyperv.vmops [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Successfully changed state of VM instance-00000016 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:52:35.331 4088 3038338907480 MainThread DEBUG os_win.utils.jobutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': '3EB292FB-CBBD-4B3F-BF99-BD4BCE2FF399', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=34625), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:35.595 4088 3038338907480 MainThread DEBUG os_win.utils.jobutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job succeeded: {'InstanceID': '3EB292FB-CBBD-4B3F-BF99-BD4BCE2FF399', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=185839), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:52:35.595 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-00000016" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:35.611 4088 3038338907480 MainThread DEBUG os_win.utils.pathutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Removing directory: C:\openstack\instances\instance-00000016 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:52:35.611 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-00000016" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:35.611 4088 3038338907480 MainThread ERROR nova.compute.manager [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000016' failed to start. Not enough memory in the system to start the virtual machine instance-00000016. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000016' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Not enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) 'instance-00000016' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Error code: 32778. 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Traceback (most recent call last): 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] return function(*args, **kwargs) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] admin_password, network_info, block_device_info) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] return function(self, *args, **kwds) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self.force_reraise() 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] raise self.value 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] should_plug_vifs=False) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 'req_state': req_state}) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self.force_reraise() 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] raise self.value 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] time.sleep(sleep_time) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self.force_reraise() 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] raise self.value 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] return f(*args, **kwargs) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] return self._wait_for_job(job_path) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] error_desc=err_desc) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000016' failed to start. 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Not enough memory in the system to start the virtual machine instance-00000016. 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000016' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Not enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 'instance-00000016' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Error code: 32778. 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] During handling of the above exception, another exception occurred: 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Traceback (most recent call last): 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] yield resources 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] accel_info=accel_info) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] return function(*args, **kwargs) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] admin_password, network_info, block_device_info) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] return function(self, *args, **kwds) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self.force_reraise() 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] raise self.value 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] should_plug_vifs=False) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 'req_state': req_state}) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self.force_reraise() 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] raise self.value 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] time.sleep(sleep_time) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self.force_reraise() 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] raise self.value 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] return f(*args, **kwargs) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] return self._wait_for_job(job_path) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] error_desc=err_desc) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000016' failed to start. 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Not enough memory in the system to start the virtual machine instance-00000016. 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000016' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Not enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 'instance-00000016' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Error code: 32778. 2021-09-10 16:52:35.611 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:35.611 4088 3038338907480 MainThread INFO nova.compute.manager [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Terminating instance 2021-09-10 16:52:35.628 4088 3038338907480 MainThread DEBUG nova.compute.manager [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:52:35.628 4088 3038338907480 MainThread INFO nova.virt.hyperv.vmops [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Got request to destroy instance 2021-09-10 16:52:35.664 4088 3038340489816 MainThread DEBUG os_win.utils.jobutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Waiting for WMI job: {'InstanceID': 'BE2C068E-C91E-4313-B692-4847E619C590', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=54148), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:35.664 4088 3038338907480 MainThread DEBUG nova.virt.hyperv.vmops [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:52:35.664 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-00000016" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:35.664 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-00000016" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:35.664 4088 3038338907480 MainThread INFO nova.compute.manager [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 16:52:35.664 4088 3038338907480 MainThread DEBUG nova.compute.claims [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:52:35.664 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:35.847 4088 3038340489816 MainThread ERROR os_win.utils.jobutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001b\' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)instance-0000001b5D471948-6250-46CE-B17C-8D21AFF1607012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)instance-0000001b5D471948-6250-46CE-B17C-8D21AFF1607010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)instance-0000001b5D471948-6250-46CE-B17C-8D21AFF16070%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BE2C068E-C91E-4313-B692-4847E619C590', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=171354), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 52, 35), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 52, 35), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001b' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)\n\nNot enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)\n\n'instance-0000001b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)", 'ErrorSummaryDescription': "'instance-0000001b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:52:35.847 4088 3038340489816 MainThread DEBUG os_win._utils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001b' failed to start. Not enough memory in the system to start the virtual machine instance-0000001b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001b' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Not enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) 'instance-0000001b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.34459114074707 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:52:35.882 4088 3038338907480 MainThread DEBUG nova.virt.hyperv.hostops [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:52:35.915 4088 3038338907480 MainThread DEBUG nova.virt.hyperv.hostops [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:52:35.940 4088 3038340490344 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:35.940 4088 3038340490344 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:35.940 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:52:35.940 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] VM Stopped (Lifecycle Event) 2021-09-10 16:52:35.986 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-b8769653-d424-4a35-bbde-83b7b3e31e3b - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:52:35.986 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-b8769653-d424-4a35-bbde-83b7b3e31e3b - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:52:35.986 4088 3038338905192 GreenThread-20 DEBUG nova.network.neutron [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Updating instance_info_cache with network_info: [{"id": "2443269b-3d7a-4f11-ac3e-3380fd9883a4", "address": "fa:16:3e:6e:8a:6f", "network": {"id": "03c1eefd-030f-414f-b7f8-81ed611f877f", "bridge": null, "label": "tempest-LiveMigrationTest-812207682-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fa8236f1477243dfafd0682b608fc659", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2443269b-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:52:36.022 4088 3038338905192 GreenThread-20 DEBUG oslo_concurrency.lockutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Releasing lock "refresh_cache-079b5c5d-fe33-48d2-ba84-de08229901eb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:52:36.022 4088 3038338905192 GreenThread-20 DEBUG nova.compute.manager [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Instance network_info: |[{"id": "2443269b-3d7a-4f11-ac3e-3380fd9883a4", "address": "fa:16:3e:6e:8a:6f", "network": {"id": "03c1eefd-030f-414f-b7f8-81ed611f877f", "bridge": null, "label": "tempest-LiveMigrationTest-812207682-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fa8236f1477243dfafd0682b608fc659", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2443269b-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:52:36.064 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-b8769653-d424-4a35-bbde-83b7b3e31e3b - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:52:36.079 4088 3038300761080 MainThread INFO nova.compute.manager [req-b8769653-d424-4a35-bbde-83b7b3e31e3b - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:52:36.301 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Updating instance_info_cache with network_info: [{"id": "fecb5a04-48f6-4c8b-bb0f-748b812daefa", "address": "fa:16:3e:2d:da:04", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfecb5a04-48", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:52:36.301 4088 3038338907480 MainThread DEBUG nova.compute.provider_tree [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:52:36.328 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-66c5445c-c347-4833-8af8-58ba8ff6d95e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:52:36.328 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 16:52:36.328 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:52:36.328 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:52:36.328 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:52:36.328 4088 3038338907480 MainThread DEBUG nova.scheduler.client.report [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:52:36.328 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.672s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:36.328 4088 3038338907480 MainThread ERROR nova.compute.manager [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000016' failed to start. Not enough memory in the system to start the virtual machine instance-00000016. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000016' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Not enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) 'instance-00000016' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Error code: 32778. 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Traceback (most recent call last): 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] return function(*args, **kwargs) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] admin_password, network_info, block_device_info) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] return function(self, *args, **kwds) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self.force_reraise() 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] raise self.value 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] should_plug_vifs=False) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 'req_state': req_state}) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self.force_reraise() 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] raise self.value 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] time.sleep(sleep_time) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self.force_reraise() 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] raise self.value 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] return f(*args, **kwargs) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] return self._wait_for_job(job_path) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] error_desc=err_desc) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000016' failed to start. 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Not enough memory in the system to start the virtual machine instance-00000016. 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000016' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Not enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 'instance-00000016' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Error code: 32778. 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] During handling of the above exception, another exception occurred: 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Traceback (most recent call last): 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] accel_info=accel_info) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] return function(*args, **kwargs) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] admin_password, network_info, block_device_info) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] return function(self, *args, **kwds) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self.force_reraise() 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] raise self.value 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] should_plug_vifs=False) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 'req_state': req_state}) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self.force_reraise() 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] raise self.value 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] time.sleep(sleep_time) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self.force_reraise() 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] raise self.value 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] return f(*args, **kwargs) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] return self._wait_for_job(job_path) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] error_desc=err_desc) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000016' failed to start. 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Not enough memory in the system to start the virtual machine instance-00000016. 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000016' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Not enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 'instance-00000016' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Error code: 32778. 2021-09-10 16:52:36.328 4088 3038338907480 MainThread TRACE nova.compute.manager [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] 2021-09-10 16:52:36.348 4088 3038338907480 MainThread DEBUG nova.compute.utils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] WMI job failed with status 10. Error summary description: 'instance-00000016' failed to start. Not enough memory in the system to start the virtual machine instance-00000016. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:52:36.348 4088 3038338907480 MainThread DEBUG nova.compute.manager [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Build of instance 59feb82d-9fd9-4170-aa08-742104f9e642 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000016' failed to start. Not enough memory in the system to start the virtual machine instance-00000016. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000016' failed to start. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Not enough memory in the system to start the virtual machine instance-00000016 with ram size 1024 megabytes. (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) 'instance-00000016' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E32CC1D4-F7F5-4886-B9A1-B546D46005E8) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:52:36.348 4088 3038338907480 MainThread DEBUG nova.compute.manager [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:52:36.348 4088 3038338907480 MainThread DEBUG nova.compute.manager [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:52:36.348 4088 3038338907480 MainThread DEBUG nova.compute.manager [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:52:36.360 4088 3038338907480 MainThread DEBUG nova.network.neutron [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:52:36.360 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:52:36.393 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:52:36.393 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:52:36.407 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 16:52:36.407 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:52:36.493 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:36.493 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:36.493 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 16:52:36.493 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:52:36.503 4088 3038338906424 MainThread DEBUG nova.compute.manager [req-009e993f-760e-4d62-b650-8875514eb7aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Received event network-changed-2443269b-3d7a-4f11-ac3e-3380fd9883a4 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:52:36.503 4088 3038338906424 MainThread DEBUG nova.compute.manager [req-009e993f-760e-4d62-b650-8875514eb7aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Refreshing instance network info cache due to event network-changed-2443269b-3d7a-4f11-ac3e-3380fd9883a4. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:52:36.503 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-009e993f-760e-4d62-b650-8875514eb7aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-079b5c5d-fe33-48d2-ba84-de08229901eb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:52:36.503 4088 3038338906424 MainThread DEBUG nova.network.neutron [req-009e993f-760e-4d62-b650-8875514eb7aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Refreshing network info cache for port 2443269b-3d7a-4f11-ac3e-3380fd9883a4 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:52:36.534 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:52:36.865 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2134MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 16:52:36.865 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:36.898 4088 3038340489816 MainThread DEBUG os_win.utils.jobutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Waiting for WMI job: {'InstanceID': '5E50D5FA-7092-4466-BF72-051122233D06', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18329), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:37.064 4088 3038340489816 MainThread ERROR os_win.utils.jobutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001b\' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)instance-0000001b5D471948-6250-46CE-B17C-8D21AFF1607012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)instance-0000001b5D471948-6250-46CE-B17C-8D21AFF1607010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)instance-0000001b5D471948-6250-46CE-B17C-8D21AFF16070%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5E50D5FA-7092-4466-BF72-051122233D06', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=137045), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 52, 36), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 52, 37), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001b' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)\n\nNot enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)\n\n'instance-0000001b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070)", 'ErrorSummaryDescription': "'instance-0000001b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:52:37.064 4088 3038340489816 MainThread ERROR nova.virt.hyperv.vmops [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Failed to change vm state of instance-0000001b to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000001b' failed to start. 2021-09-10 16:52:37.064 4088 3038340489816 MainThread INFO nova.virt.hyperv.vmops [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Got request to destroy instance 2021-09-10 16:52:37.100 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:37.100 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:37.111 4088 3038338906952 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:52:37.111 4088 3038338906952 MainThread INFO nova.compute.manager [-] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] VM Stopped (Lifecycle Event) 2021-09-10 16:52:37.172 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-87782e14-c194-4d9b-bc3d-b180df0da4fe - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:52:37.172 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.vmops [req-87782e14-c194-4d9b-bc3d-b180df0da4fe - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:52:37.220 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-87782e14-c194-4d9b-bc3d-b180df0da4fe - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:52:37.253 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:52:37.253 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance f3ef8889-0aba-4544-aa33-a09b43d286aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 2, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:52:37.253 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:52:37.267 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:52:37.267 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:52:37.267 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:52:37.267 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:52:37.267 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:52:37.267 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:52:37.267 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:52:37.267 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:52:37.267 4088 3038338906952 MainThread INFO nova.compute.manager [req-87782e14-c194-4d9b-bc3d-b180df0da4fe - - - - -] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:52:37.313 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 59feb82d-9fd9-4170-aa08-742104f9e642 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1591 2021-09-10 16:52:37.313 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:52:37.313 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:52:37.313 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:52:37.313 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 079b5c5d-fe33-48d2-ba84-de08229901eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:52:37.313 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 15 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 16:52:37.313 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=15872MB phys_disk=79GB used_disk=15GB total_vcpus=6 used_vcpus=15 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 16:52:37.362 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:52:37.402 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:52:37.596 4088 3038338907480 MainThread DEBUG nova.network.neutron [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:52:37.631 4088 3038338907480 MainThread INFO nova.compute.manager [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 59feb82d-9fd9-4170-aa08-742104f9e642] Took 1.26 seconds to deallocate network for instance. 2021-09-10 16:52:37.752 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:52:37.788 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:52:37.788 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 16:52:37.788 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.921s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:37.798 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:52:37.862 4088 3038338907480 MainThread INFO nova.scheduler.client.report [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Deleted allocations for instance 59feb82d-9fd9-4170-aa08-742104f9e642 2021-09-10 16:52:37.914 4088 3038338906424 MainThread DEBUG nova.network.neutron [req-009e993f-760e-4d62-b650-8875514eb7aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Updated VIF entry in instance network info cache for port 2443269b-3d7a-4f11-ac3e-3380fd9883a4. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:52:37.914 4088 3038338906424 MainThread DEBUG nova.network.neutron [req-009e993f-760e-4d62-b650-8875514eb7aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Updating instance_info_cache with network_info: [{"id": "2443269b-3d7a-4f11-ac3e-3380fd9883a4", "address": "fa:16:3e:6e:8a:6f", "network": {"id": "03c1eefd-030f-414f-b7f8-81ed611f877f", "bridge": null, "label": "tempest-LiveMigrationTest-812207682-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fa8236f1477243dfafd0682b608fc659", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2443269b-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:52:37.940 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-e4083828-d740-4043-bff5-e307aa22db1a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "59feb82d-9fd9-4170-aa08-742104f9e642" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 38.266s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:38.016 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-009e993f-760e-4d62-b650-8875514eb7aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-079b5c5d-fe33-48d2-ba84-de08229901eb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:52:38.329 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:52:38.349 4088 3038338907304 MainThread INFO nova.virt.hyperv.vmops [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Spawning new instance 2021-09-10 16:52:38.375 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "instance-0000001d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:38.375 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "instance-0000001d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:38.375 4088 3038338907304 MainThread DEBUG nova.block_device [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] block_device_list ['sda'] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:52:38.375 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Preparing to wait for external event network-vif-plugged-2443269b-3d7a-4f11-ac3e-3380fd9883a4 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:52:38.375 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "079b5c5d-fe33-48d2-ba84-de08229901eb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:38.375 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "079b5c5d-fe33-48d2-ba84-de08229901eb-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:38.375 4088 3038338907304 MainThread DEBUG os_win.utils.compute.vmutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Creating VM instance-0000001d create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:52:39.613 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:52:39.956 4088 3038340489816 MainThread DEBUG nova.virt.hyperv.vmops [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:52:39.956 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Lock "instance-0000001b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:39.956 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Lock "instance-0000001b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:39.986 4088 3038340489816 MainThread DEBUG os_win.utils.compute.vmutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Successfully changed vm state of instance-0000001b to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:52:39.986 4088 3038340489816 MainThread DEBUG nova.virt.hyperv.vmops [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Successfully changed state of VM instance-0000001b to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:52:40.070 4088 3038340489816 MainThread DEBUG os_win.utils.jobutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Waiting for WMI job: {'InstanceID': 'DF102E8B-A48F-460B-83DB-100B92C00B0E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=25273), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:40.270 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.volumeops [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Attaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-a0ac4351-dd95-40e6-bcc7-f7e316d40088', 'target_lun': 0, 'volume_id': 'a0ac4351-dd95-40e6-bcc7-f7e316d40088', 'auth_method': 'CHAP', 'auth_username': 'WUVTEq8Na5sjUfeUS977', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'reserved', 'instance': '079b5c5d-fe33-48d2-ba84-de08229901eb', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0ac4351-dd95-40e6-bcc7-f7e316d40088', 'serial': 'a0ac4351-dd95-40e6-bcc7-f7e316d40088'} to instance-0000001d _attach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:108 2021-09-10 16:52:40.270 4088 3038338907304 MainThread DEBUG os_brick.initiator.connector [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Factory for iscsi on None factory c:\python37\lib\site-packages\os_brick\initiator\connector.py:282 2021-09-10 16:52:40.270 4088 3038338907304 MainThread INFO os_brick.initiator.windows.iscsi [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] No iSCSI initiator was explicitly requested. The Microsoft iSCSI initiator will choose the initiator when establishing sessions. 2021-09-10 16:52:40.270 4088 3038338907304 MainThread DEBUG os_brick.initiator.windows.iscsi [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-a0ac4351-dd95-40e6-bcc7-f7e316d40088', 'target_lun': 0, 'volume_id': 'a0ac4351-dd95-40e6-bcc7-f7e316d40088', 'auth_method': 'CHAP', 'auth_username': 'WUVTEq8Na5sjUfeUS977', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:52:40.270 4088 3038338907304 MainThread INFO os_brick.initiator.windows.iscsi [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Attempting to establish an iSCSI session to target iqn.2010-10.org.openstack:volume-a0ac4351-dd95-40e6-bcc7-f7e316d40088 on portal 10.222.0.55:3260 accessing LUN 0 using initiator None. 2021-09-10 16:52:40.285 4088 3038338907304 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Logging in iSCSI target iqn.2010-10.org.openstack:volume-a0ac4351-dd95-40e6-bcc7-f7e316d40088 login_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:401 2021-09-10 16:52:40.329 4088 3038340489816 MainThread DEBUG os_win.utils.jobutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] WMI job succeeded: {'InstanceID': 'DF102E8B-A48F-460B-83DB-100B92C00B0E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=208158), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:52:40.329 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Lock "instance-0000001b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:40.329 4088 3038340489816 MainThread DEBUG os_win.utils.pathutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Removing directory: C:\openstack\instances\instance-0000001b check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:52:40.329 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Lock "instance-0000001b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:40.329 4088 3038340489816 MainThread ERROR nova.compute.manager [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000001b' failed to start. Not enough memory in the system to start the virtual machine instance-0000001b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001b' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Not enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) 'instance-0000001b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Error code: 32778. 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Traceback (most recent call last): 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] return function(*args, **kwargs) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] admin_password, network_info, block_device_info) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] return function(self, *args, **kwds) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self.force_reraise() 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] raise self.value 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] should_plug_vifs=False) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 'req_state': req_state}) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self.force_reraise() 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] raise self.value 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] time.sleep(sleep_time) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self.force_reraise() 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] raise self.value 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] return f(*args, **kwargs) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] return self._wait_for_job(job_path) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] error_desc=err_desc) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000001b' failed to start. 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Not enough memory in the system to start the virtual machine instance-0000001b. 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001b' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Not enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 'instance-0000001b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Error code: 32778. 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] During handling of the above exception, another exception occurred: 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Traceback (most recent call last): 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] yield resources 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] accel_info=accel_info) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] return function(*args, **kwargs) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] admin_password, network_info, block_device_info) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] return function(self, *args, **kwds) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self.force_reraise() 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] raise self.value 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] should_plug_vifs=False) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 'req_state': req_state}) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self.force_reraise() 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] raise self.value 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] time.sleep(sleep_time) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self.force_reraise() 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] raise self.value 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] return f(*args, **kwargs) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] return self._wait_for_job(job_path) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] error_desc=err_desc) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000001b' failed to start. 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Not enough memory in the system to start the virtual machine instance-0000001b. 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001b' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Not enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 'instance-0000001b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Error code: 32778. 2021-09-10 16:52:40.329 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.329 4088 3038340489816 MainThread INFO nova.compute.manager [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Terminating instance 2021-09-10 16:52:40.329 4088 3038340489816 MainThread DEBUG nova.compute.manager [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:52:40.329 4088 3038340489816 MainThread INFO nova.virt.hyperv.vmops [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Got request to destroy instance 2021-09-10 16:52:40.361 4088 3038340489816 MainThread DEBUG nova.virt.hyperv.vmops [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:52:40.361 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Lock "instance-0000001b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:40.361 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Lock "instance-0000001b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:40.361 4088 3038340489816 MainThread INFO nova.compute.manager [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 16:52:40.361 4088 3038340489816 MainThread DEBUG nova.compute.claims [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:52:40.361 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:40.516 4088 3038340489816 MainThread DEBUG nova.virt.hyperv.hostops [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:52:40.532 4088 3038340489816 MainThread DEBUG nova.virt.hyperv.hostops [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:52:40.814 4088 3038340489816 MainThread DEBUG nova.compute.provider_tree [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:52:40.832 4088 3038340489816 MainThread DEBUG nova.scheduler.client.report [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:52:40.832 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.468s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:40.832 4088 3038340489816 MainThread ERROR nova.compute.manager [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000001b' failed to start. Not enough memory in the system to start the virtual machine instance-0000001b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001b' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Not enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) 'instance-0000001b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Error code: 32778. 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Traceback (most recent call last): 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] return function(*args, **kwargs) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] admin_password, network_info, block_device_info) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] return function(self, *args, **kwds) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self.force_reraise() 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] raise self.value 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] should_plug_vifs=False) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 'req_state': req_state}) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self.force_reraise() 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] raise self.value 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] time.sleep(sleep_time) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self.force_reraise() 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] raise self.value 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] return f(*args, **kwargs) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] return self._wait_for_job(job_path) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] error_desc=err_desc) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000001b' failed to start. 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Not enough memory in the system to start the virtual machine instance-0000001b. 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001b' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Not enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 'instance-0000001b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Error code: 32778. 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] During handling of the above exception, another exception occurred: 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Traceback (most recent call last): 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] accel_info=accel_info) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] return function(*args, **kwargs) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] admin_password, network_info, block_device_info) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] return function(self, *args, **kwds) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self.force_reraise() 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] raise self.value 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] should_plug_vifs=False) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 'req_state': req_state}) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self.force_reraise() 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] raise self.value 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] time.sleep(sleep_time) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self.force_reraise() 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] raise self.value 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] return f(*args, **kwargs) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] return self._wait_for_job(job_path) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] error_desc=err_desc) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000001b' failed to start. 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Not enough memory in the system to start the virtual machine instance-0000001b. 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001b' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Not enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 'instance-0000001b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Error code: 32778. 2021-09-10 16:52:40.832 4088 3038340489816 MainThread TRACE nova.compute.manager [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] 2021-09-10 16:52:40.844 4088 3038340489816 MainThread DEBUG nova.compute.utils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] WMI job failed with status 10. Error summary description: 'instance-0000001b' failed to start. Not enough memory in the system to start the virtual machine instance-0000001b. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:52:40.844 4088 3038340489816 MainThread DEBUG nova.compute.manager [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Build of instance f3ef8889-0aba-4544-aa33-a09b43d286aa was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000001b' failed to start. Not enough memory in the system to start the virtual machine instance-0000001b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001b' failed to start. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Not enough memory in the system to start the virtual machine instance-0000001b with ram size 1024 megabytes. (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) 'instance-0000001b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D471948-6250-46CE-B17C-8D21AFF16070) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:52:40.844 4088 3038340489816 MainThread DEBUG nova.compute.manager [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:52:40.844 4088 3038340489816 MainThread DEBUG nova.compute.manager [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:52:40.844 4088 3038340489816 MainThread DEBUG nova.compute.manager [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:52:40.844 4088 3038340489816 MainThread DEBUG nova.network.neutron [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:52:41.425 4088 3038340489816 MainThread DEBUG nova.network.neutron [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:52:41.459 4088 3038340489816 MainThread INFO nova.compute.manager [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] [instance: f3ef8889-0aba-4544-aa33-a09b43d286aa] Took 0.61 seconds to deallocate network for instance. 2021-09-10 16:52:41.676 4088 3038340489816 MainThread INFO nova.scheduler.client.report [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Deleted allocations for instance f3ef8889-0aba-4544-aa33-a09b43d286aa 2021-09-10 16:52:41.720 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-4242a0d8-ac56-43ee-97e5-64be11182803 66161d18b31e45309aee94f739bc6a3f 145f8177efc74f5e9be31c5f74e69d0a - default default] Lock "f3ef8889-0aba-4544-aa33-a09b43d286aa" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 33.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:44.048 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.snapshotops [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Snapshot image cdc65379-758e-4e49-a2fc-5e526876e1a0 updated for VM instance-00000017 snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:107 2021-09-10 16:52:44.048 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.snapshotops [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Removing snapshot cdc65379-758e-4e49-a2fc-5e526876e1a0 snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:110 2021-09-10 16:52:44.110 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Waiting for WMI job: {'InstanceID': '3FCDF3C1-2E27-45F7-A930-70640D8BF93D', 'Description': 'Deleting Checkpoint', 'ElementName': 'Deleting Checkpoint', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17893), 'Cancellable': False, 'JobType': 72, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:44.626 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] WMI job succeeded: {'InstanceID': '3FCDF3C1-2E27-45F7-A930-70640D8BF93D', 'Description': 'Deleting Checkpoint', 'ElementName': 'Deleting Checkpoint', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=511616), 'Cancellable': False, 'JobType': 72, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:52:44.626 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.snapshotops [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Removing directory: C:\openstack\instances\export\instance-00000017 snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:116 2021-09-10 16:52:44.752 4088 3038338906072 MainThread INFO nova.compute.manager [req-89289c84-a04e-48a1-8c66-5b290db65f25 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Took 27.48 seconds to snapshot the instance on the hypervisor. 2021-09-10 16:52:45.110 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "1f7074b3-ef6e-40e5-9ea0-31847563fef0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:45.132 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:52:45.266 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:45.266 4088 3038338906072 MainThread DEBUG nova.virt.hardware [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:52:45.266 4088 3038338906072 MainThread INFO nova.compute.claims [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Claim successful on node n-h2-808474-1 2021-09-10 16:52:45.313 4088 3038338907304 MainThread DEBUG os_win.utils.storage.diskutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 16:52:45.454 4088 3038338907304 MainThread DEBUG os_win.utils.storage.diskutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 16:52:45.454 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.hostops [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:52:45.487 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.hostops [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:52:45.550 4088 3038338907304 MainThread DEBUG os_brick.initiator.windows.iscsi [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] <== connect_volume: return (5279ms) {'type': 'block', 'path': '\\\\.\\PhysicalDrive1', 'number': 1, 'scsi_wwn': '360014053047808A0D0D43168D6E4B43B'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:52:45.814 4088 3038338906072 MainThread DEBUG nova.compute.provider_tree [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:52:45.844 4088 3038338906072 MainThread DEBUG nova.scheduler.client.report [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:52:45.844 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:45.844 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:52:45.938 4088 3038338906072 MainThread DEBUG nova.compute.utils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:52:45.938 4088 3038296623592 GreenThread-21 DEBUG nova.compute.manager [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:52:45.938 4088 3038296623592 GreenThread-21 DEBUG nova.network.neutron [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:52:45.973 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:52:46.144 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:52:46.144 4088 3038338906072 MainThread INFO nova.virt.hyperv.vmops [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Spawning new instance 2021-09-10 16:52:46.226 4088 3038296623592 GreenThread-21 DEBUG nova.policy [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf4dce0601aa49c0b9ea6c48f2953557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae864ac350142778dcbcb12a8b3800e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:52:46.360 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "instance-0000001e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:46.377 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "instance-0000001e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:46.377 4088 3038338906072 MainThread DEBUG nova.block_device [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:52:46.377 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:46.393 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:46.422 4088 3038338906072 MainThread DEBUG os_win.utils.pathutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Creating directory: C:\openstack\instances\instance-0000001e check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:52:46.422 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000001e\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:52:46.613 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:52:46.937 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "9107836a-481d-4cb5-9c7d-6432f4cd5309" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:46.969 4088 3038338907832 MainThread DEBUG nova.compute.manager [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:52:47.050 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Resizing VHD C:\openstack\instances\instance-0000001e\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:52:47.101 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:47.101 4088 3038338907832 MainThread DEBUG nova.virt.hardware [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:52:47.101 4088 3038338907832 MainThread INFO nova.compute.claims [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Claim successful on node n-h2-808474-1 2021-09-10 16:52:47.454 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.hostops [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:52:47.485 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.hostops [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:52:47.625 4088 3038296623592 GreenThread-21 DEBUG nova.network.neutron [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Successfully created port: ce9385c0-fdc8-463a-b1f4-2d897eea7193 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:52:47.814 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-cb8c4a99-adea-4c15-8959-ed648e3c34b2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Received event network-vif-unplugged-f581c585-39ab-4120-a040-5d92bb401a6c external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:52:47.814 4088 3038338907656 MainThread DEBUG oslo_concurrency.lockutils [req-cb8c4a99-adea-4c15-8959-ed648e3c34b2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9446e666-4364-4dcd-b041-405653a856bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:47.814 4088 3038338907656 MainThread DEBUG oslo_concurrency.lockutils [req-cb8c4a99-adea-4c15-8959-ed648e3c34b2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9446e666-4364-4dcd-b041-405653a856bd-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:47.814 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-cb8c4a99-adea-4c15-8959-ed648e3c34b2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] No waiting events found dispatching network-vif-unplugged-f581c585-39ab-4120-a040-5d92bb401a6c pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 16:52:47.814 4088 3038338907656 MainThread WARNING nova.compute.manager [req-cb8c4a99-adea-4c15-8959-ed648e3c34b2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Received unexpected event network-vif-unplugged-f581c585-39ab-4120-a040-5d92bb401a6c for instance with vm_state active and task_state None. 2021-09-10 16:52:47.911 4088 3038338907832 MainThread DEBUG nova.compute.provider_tree [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:52:47.938 4088 3038338907832 MainThread DEBUG nova.scheduler.client.report [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:52:47.938 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.844s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:47.938 4088 3038338907832 MainThread DEBUG nova.compute.manager [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:52:48.052 4088 3038338907832 MainThread DEBUG nova.compute.utils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:52:48.052 4088 3038338907656 GreenThread-22 DEBUG nova.compute.manager [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:52:48.074 4088 3038338907656 GreenThread-22 DEBUG nova.network.neutron [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:52:48.110 4088 3038338907832 MainThread DEBUG nova.compute.manager [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:52:48.298 4088 3038338907656 GreenThread-22 DEBUG nova.policy [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'beffe9ba8529426fbb27e549254bd679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91237ebda1b54d2dbc761e48fdd93516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:52:48.391 4088 3038338907832 MainThread DEBUG nova.compute.manager [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:52:48.406 4088 3038338907832 MainThread INFO nova.virt.hyperv.vmops [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Spawning new instance 2021-09-10 16:52:48.406 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-0000001f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:48.406 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-0000001f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:48.406 4088 3038338907832 MainThread DEBUG nova.block_device [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:52:48.432 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.032s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:48.432 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:48.443 4088 3038338907832 MainThread DEBUG os_win.utils.pathutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Creating directory: C:\openstack\instances\instance-0000001f check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:52:48.443 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.vmops [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000001f\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:52:48.518 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-7386d5b8-b516-4c40-b458-e1fac184196e 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:48.518 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-7386d5b8-b516-4c40-b458-e1fac184196e 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:48.518 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-7386d5b8-b516-4c40-b458-e1fac184196e 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:48.518 4088 3038338908008 MainThread ERROR nova.compute.manager [req-7386d5b8-b516-4c40-b458-e1fac184196e 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Setting instance vm_state to ERROR: NameError: name 'instant' is not defined 2021-09-10 16:52:48.518 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Traceback (most recent call last): 2021-09-10 16:52:48.518 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:52:48.518 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] self._delete_instance(context, instance, bdms) 2021-09-10 16:52:48.518 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:52:48.518 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:52:48.518 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] NameError: name 'instant' is not defined 2021-09-10 16:52:48.518 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] 2021-09-10 16:52:48.625 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-7386d5b8-b516-4c40-b458-e1fac184196e 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" released by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 0.109s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:48.829 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-7386d5b8-b516-4c40-b458-e1fac184196e 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:48.829 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.hostops [req-7386d5b8-b516-4c40-b458-e1fac184196e 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:52:48.860 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.hostops [req-7386d5b8-b516-4c40-b458-e1fac184196e 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:52:48.942 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.vmops [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Resizing VHD C:\openstack\instances\instance-0000001f\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:52:49.266 4088 3038296623592 GreenThread-21 DEBUG nova.network.neutron [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Successfully updated port: ce9385c0-fdc8-463a-b1f4-2d897eea7193 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:52:49.282 4088 3038296623592 GreenThread-21 DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Acquired lock "refresh_cache-1f7074b3-ef6e-40e5-9ea0-31847563fef0" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:52:49.282 4088 3038296623592 GreenThread-21 DEBUG nova.network.neutron [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:52:49.329 4088 3038338908008 MainThread DEBUG nova.compute.provider_tree [req-7386d5b8-b516-4c40-b458-e1fac184196e 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:52:49.344 4088 3038338908008 MainThread DEBUG nova.scheduler.client.report [req-7386d5b8-b516-4c40-b458-e1fac184196e 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:52:49.344 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-7386d5b8-b516-4c40-b458-e1fac184196e 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.516s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:49.344 4088 3038338908008 MainThread INFO nova.compute.manager [req-7386d5b8-b516-4c40-b458-e1fac184196e 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Successfully reverted task state from deleting on failure for instance. 2021-09-10 16:52:49.344 4088 3038338908008 MainThread ERROR oslo_messaging.rpc.server [req-7386d5b8-b516-4c40-b458-e1fac184196e 6904e86e6ed64f5a8fc459777a1ba26e 10c929df49a24fb798e1b2d3f7414211 - default default] Exception during message handling: NameError: name 'instant' is not defined 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server Traceback (most recent call last): 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 72, in wrapped 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server context, exc, binary) 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server return f(self, context, *args, **kw) 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 184, in decorated_function 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server "Error: %s", e, instance=instance) 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 154, in decorated_function 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\utils.py", line 1433, in decorated_function 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 200, in decorated_function 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3106, in terminate_instance 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server do_terminate_instance(instance, bdms) 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_concurrency\lockutils.py", line 360, in inner 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server return f(*args, **kwargs) 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3104, in do_terminate_instance 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self._set_instance_obj_error_state(instance) 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self._delete_instance(context, instance, bdms) 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server NameError: name 'instant' is not defined 2021-09-10 16:52:49.344 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server 2021-09-10 16:52:49.500 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-42c30b30-dd90-42e2-aabd-92877c5ab945 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Received event network-changed-ce9385c0-fdc8-463a-b1f4-2d897eea7193 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:52:49.515 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-42c30b30-dd90-42e2-aabd-92877c5ab945 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Refreshing instance network info cache due to event network-changed-ce9385c0-fdc8-463a-b1f4-2d897eea7193. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:52:49.597 4088 3038338907656 GreenThread-22 DEBUG nova.network.neutron [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Successfully created port: 4976e995-8bf8-4ddb-833a-7cc8f525682f _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:52:49.705 4088 3038296623592 GreenThread-21 DEBUG nova.network.neutron [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:52:50.955 4088 3038296623592 GreenThread-21 DEBUG nova.network.neutron [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Updating instance_info_cache with network_info: [{"id": "ce9385c0-fdc8-463a-b1f4-2d897eea7193", "address": "fa:16:3e:62:07:9c", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapce9385c0-fd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:52:50.985 4088 3038296623592 GreenThread-21 DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Releasing lock "refresh_cache-1f7074b3-ef6e-40e5-9ea0-31847563fef0" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:52:50.985 4088 3038296623592 GreenThread-21 DEBUG nova.compute.manager [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Instance network_info: |[{"id": "ce9385c0-fdc8-463a-b1f4-2d897eea7193", "address": "fa:16:3e:62:07:9c", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapce9385c0-fd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:52:50.985 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Preparing to wait for external event network-vif-plugged-ce9385c0-fdc8-463a-b1f4-2d897eea7193 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:52:51.004 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "1f7074b3-ef6e-40e5-9ea0-31847563fef0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:51.004 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "1f7074b3-ef6e-40e5-9ea0-31847563fef0-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:51.004 4088 3038338906072 MainThread DEBUG os_win.utils.compute.vmutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Creating VM instance-0000001e create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:52:51.004 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-42c30b30-dd90-42e2-aabd-92877c5ab945 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-1f7074b3-ef6e-40e5-9ea0-31847563fef0" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:52:51.004 4088 3038338908008 MainThread DEBUG nova.network.neutron [req-42c30b30-dd90-42e2-aabd-92877c5ab945 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Refreshing network info cache for port ce9385c0-fdc8-463a-b1f4-2d897eea7193 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:52:51.797 4088 3038338907656 GreenThread-22 DEBUG nova.network.neutron [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Successfully updated port: 4976e995-8bf8-4ddb-833a-7cc8f525682f _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:52:51.828 4088 3038338907656 GreenThread-22 DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Acquired lock "refresh_cache-9107836a-481d-4cb5-9c7d-6432f4cd5309" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:52:51.828 4088 3038338907656 GreenThread-22 DEBUG nova.network.neutron [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:52:52.068 4088 3038338907656 GreenThread-22 DEBUG nova.network.neutron [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:52:52.312 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-857803ec-ca3c-4710-8486-077cbdd48844 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Received event network-changed-4976e995-8bf8-4ddb-833a-7cc8f525682f external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:52:52.312 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-857803ec-ca3c-4710-8486-077cbdd48844 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Refreshing instance network info cache due to event network-changed-4976e995-8bf8-4ddb-833a-7cc8f525682f. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:52:52.424 4088 3038338908008 MainThread DEBUG nova.network.neutron [req-42c30b30-dd90-42e2-aabd-92877c5ab945 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Updated VIF entry in instance network info cache for port ce9385c0-fdc8-463a-b1f4-2d897eea7193. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:52:52.424 4088 3038338908008 MainThread DEBUG nova.network.neutron [req-42c30b30-dd90-42e2-aabd-92877c5ab945 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Updating instance_info_cache with network_info: [{"id": "ce9385c0-fdc8-463a-b1f4-2d897eea7193", "address": "fa:16:3e:62:07:9c", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapce9385c0-fd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:52:52.470 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-42c30b30-dd90-42e2-aabd-92877c5ab945 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-1f7074b3-ef6e-40e5-9ea0-31847563fef0" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:52:53.486 4088 3038338907656 GreenThread-22 DEBUG nova.network.neutron [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Updating instance_info_cache with network_info: [{"id": "4976e995-8bf8-4ddb-833a-7cc8f525682f", "address": "fa:16:3e:60:12:74", "network": {"id": "7434a41e-b78f-4cb9-8ffe-b2514d097201", "bridge": null, "label": "tempest-LiveAutoBlockMigrationV225Test-1499875764-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91237ebda1b54d2dbc761e48fdd93516", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4976e995-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:52:53.518 4088 3038338907656 GreenThread-22 DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Releasing lock "refresh_cache-9107836a-481d-4cb5-9c7d-6432f4cd5309" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:52:53.518 4088 3038338907656 GreenThread-22 DEBUG nova.compute.manager [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Instance network_info: |[{"id": "4976e995-8bf8-4ddb-833a-7cc8f525682f", "address": "fa:16:3e:60:12:74", "network": {"id": "7434a41e-b78f-4cb9-8ffe-b2514d097201", "bridge": null, "label": "tempest-LiveAutoBlockMigrationV225Test-1499875764-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91237ebda1b54d2dbc761e48fdd93516", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4976e995-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:52:53.518 4088 3038338907832 MainThread DEBUG nova.compute.manager [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Preparing to wait for external event network-vif-plugged-4976e995-8bf8-4ddb-833a-7cc8f525682f prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:52:53.518 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "9107836a-481d-4cb5-9c7d-6432f4cd5309-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:53.518 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "9107836a-481d-4cb5-9c7d-6432f4cd5309-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:53.518 4088 3038338907832 MainThread DEBUG os_win.utils.compute.vmutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Creating VM instance-0000001f create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:52:53.518 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-857803ec-ca3c-4710-8486-077cbdd48844 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-9107836a-481d-4cb5-9c7d-6432f4cd5309" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:52:53.518 4088 3038338905192 MainThread DEBUG nova.network.neutron [req-857803ec-ca3c-4710-8486-077cbdd48844 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Refreshing network info cache for port 4976e995-8bf8-4ddb-833a-7cc8f525682f _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:52:53.899 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:52:54.394 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Lock "f3fbc33e-18d4-47bf-b643-94d2edfcae5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:54.435 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:52:54.656 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:54.656 4088 3038338906952 MainThread DEBUG nova.virt.hardware [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:52:54.656 4088 3038338906952 MainThread INFO nova.compute.claims [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Claim successful on node n-h2-808474-1 2021-09-10 16:52:54.784 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-66ad22f8-70a4-45ac-9597-5ee6f86ea507 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Received event network-vif-plugged-2443269b-3d7a-4f11-ac3e-3380fd9883a4 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:52:54.784 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-66ad22f8-70a4-45ac-9597-5ee6f86ea507 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "079b5c5d-fe33-48d2-ba84-de08229901eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:54.784 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-66ad22f8-70a4-45ac-9597-5ee6f86ea507 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "079b5c5d-fe33-48d2-ba84-de08229901eb-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:54.797 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-66ad22f8-70a4-45ac-9597-5ee6f86ea507 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Processing event network-vif-plugged-2443269b-3d7a-4f11-ac3e-3380fd9883a4 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:52:54.829 4088 3038338907304 MainThread INFO nova.virt.hyperv.vmops [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Using config drive for instance 2021-09-10 16:52:54.909 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.hostops [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:52:54.941 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.hostops [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:52:55.298 4088 3038338907304 MainThread INFO nova.virt.hyperv.vmops [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Creating config drive at C:\openstack\instances\instance-0000001d\configdrive.iso 2021-09-10 16:52:55.422 4088 3038338907304 MainThread DEBUG oslo_concurrency.processutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000001d\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp61zn44a0 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:52:55.640 4088 3038338906952 MainThread DEBUG nova.compute.provider_tree [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:52:55.640 4088 3038338905192 MainThread DEBUG nova.network.neutron [req-857803ec-ca3c-4710-8486-077cbdd48844 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Updated VIF entry in instance network info cache for port 4976e995-8bf8-4ddb-833a-7cc8f525682f. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:52:55.640 4088 3038338905192 MainThread DEBUG nova.network.neutron [req-857803ec-ca3c-4710-8486-077cbdd48844 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Updating instance_info_cache with network_info: [{"id": "4976e995-8bf8-4ddb-833a-7cc8f525682f", "address": "fa:16:3e:60:12:74", "network": {"id": "7434a41e-b78f-4cb9-8ffe-b2514d097201", "bridge": null, "label": "tempest-LiveAutoBlockMigrationV225Test-1499875764-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91237ebda1b54d2dbc761e48fdd93516", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4976e995-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:52:55.640 4088 3038338906952 MainThread DEBUG nova.scheduler.client.report [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:52:55.640 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.985s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:55.640 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:52:55.672 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-857803ec-ca3c-4710-8486-077cbdd48844 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-9107836a-481d-4cb5-9c7d-6432f4cd5309" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:52:55.844 4088 3038338906952 MainThread DEBUG nova.compute.utils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:52:55.861 4088 3038296623592 GreenThread-23 DEBUG nova.compute.manager [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:52:55.861 4088 3038296623592 GreenThread-23 DEBUG nova.network.neutron [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:52:55.895 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:52:55.923 4088 3038338907304 MainThread DEBUG oslo_concurrency.processutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000001d\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp61zn44a0" returned: 0 in 0.500s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:52:56.062 4088 3038338906952 MainThread INFO nova.virt.block_device [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Booting with volume f5252e88-87bd-471e-b572-a8d70f3c3790 at /dev/sda 2021-09-10 16:52:56.241 4088 3038338906952 MainThread DEBUG os_brick.utils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:52:56.266 4088 3038296623592 GreenThread-23 DEBUG nova.policy [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4826ecf435ad43b6984adee7a94b6ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7199a32f43ef47a1940566d570e22783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:52:56.266 4088 3038338906952 MainThread DEBUG os_brick.utils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] <== get_connector_properties: return (5ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:52:56.266 4088 3038338906952 MainThread DEBUG nova.virt.block_device [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Updating existing volume attachment record: 1db2c6f7-9432-4540-b559-d08cf8fd8f9c _volume_attach c:\openstack\build\nova\nova\virt\block_device.py:556 2021-09-10 16:52:56.865 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Setting boot order for instance: instance-0000001d: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:52:56.984 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.vmops [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:52:57.097 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:52:57.158 4088 3038338907304 MainThread DEBUG os_win.utils.jobutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Waiting for WMI job: {'InstanceID': '61B3A4B5-D264-410A-BE7B-421441B914EE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=29218), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:57.459 4088 3038338907304 MainThread ERROR os_win.utils.jobutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001d\' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)instance-0000001d56652803-50AE-40D0-B280-C15B77ACA21012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)instance-0000001d56652803-50AE-40D0-B280-C15B77ACA21010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)instance-0000001d56652803-50AE-40D0-B280-C15B77ACA210%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '61B3A4B5-D264-410A-BE7B-421441B914EE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=200286), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 52, 57), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 52, 57), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001d' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)\n\nNot enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)\n\n'instance-0000001d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)", 'ErrorSummaryDescription': "'instance-0000001d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:52:57.480 4088 3038338907304 MainThread DEBUG os_win._utils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001d' failed to start. Not enough memory in the system to start the virtual machine instance-0000001d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001d' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Not enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) 'instance-0000001d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.38233351707458496 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:52:58.536 4088 3038338907304 MainThread DEBUG os_win.utils.jobutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Waiting for WMI job: {'InstanceID': 'FDFBDDFD-5EE8-45DC-9054-2C68FC63BBEE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=26923), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:52:58.782 4088 3038296623592 GreenThread-23 DEBUG nova.network.neutron [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Successfully created port: 2e1238b5-599f-4296-ab7a-cd575fc958c1 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:52:58.812 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:52:58.812 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:52:58.812 4088 3038338907656 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:52:58.812 4088 3038338907656 MainThread INFO nova.compute.manager [-] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] VM Stopped (Lifecycle Event) 2021-09-10 16:52:58.831 4088 3038338907304 MainThread ERROR os_win.utils.jobutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001d\' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)instance-0000001d56652803-50AE-40D0-B280-C15B77ACA21012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)instance-0000001d56652803-50AE-40D0-B280-C15B77ACA21010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)instance-0000001d56652803-50AE-40D0-B280-C15B77ACA210%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'FDFBDDFD-5EE8-45DC-9054-2C68FC63BBEE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=152236), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 52, 58), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 52, 58), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001d' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)\n\nNot enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)\n\n'instance-0000001d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)", 'ErrorSummaryDescription': "'instance-0000001d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:52:58.831 4088 3038338907304 MainThread DEBUG os_win._utils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001d' failed to start. Not enough memory in the system to start the virtual machine instance-0000001d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001d' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Not enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) 'instance-0000001d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.7340056896209717 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:52:58.896 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-bacc69cc-a96c-406d-985a-4d6e09713d2a - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:52:58.896 4088 3038338907656 MainThread DEBUG nova.virt.hyperv.vmops [req-bacc69cc-a96c-406d-985a-4d6e09713d2a - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:52:59.035 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-bacc69cc-a96c-406d-985a-4d6e09713d2a - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:52:59.083 4088 3038338907656 MainThread INFO nova.compute.manager [req-bacc69cc-a96c-406d-985a-4d6e09713d2a - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:52:59.955 4088 3038338907304 MainThread DEBUG os_win.utils.jobutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Waiting for WMI job: {'InstanceID': 'E203FD61-1C05-4EF7-A1BC-B209C57DE6FD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=23679), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:00.203 4088 3038338907656 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:00.203 4088 3038338907656 MainThread INFO nova.compute.manager [-] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] VM Stopped (Lifecycle Event) 2021-09-10 16:53:00.203 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:00.219 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:00.235 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-814aaa6f-8484-457e-98dd-cd81d5e98e83 - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:00.235 4088 3038338907656 MainThread DEBUG nova.virt.hyperv.vmops [req-814aaa6f-8484-457e-98dd-cd81d5e98e83 - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:00.250 4088 3038338907304 MainThread ERROR os_win.utils.jobutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001d\' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)instance-0000001d56652803-50AE-40D0-B280-C15B77ACA21012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)instance-0000001d56652803-50AE-40D0-B280-C15B77ACA21010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)instance-0000001d56652803-50AE-40D0-B280-C15B77ACA210%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E203FD61-1C05-4EF7-A1BC-B209C57DE6FD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=160836), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 52, 59), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001d' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)\n\nNot enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)\n\n'instance-0000001d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)", 'ErrorSummaryDescription': "'instance-0000001d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:00.270 4088 3038338907304 MainThread DEBUG os_win._utils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001d' failed to start. Not enough memory in the system to start the virtual machine instance-0000001d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001d' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Not enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) 'instance-0000001d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 3.172985553741455 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:00.302 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-814aaa6f-8484-457e-98dd-cd81d5e98e83 - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:00.331 4088 3038338907656 MainThread INFO nova.compute.manager [req-814aaa6f-8484-457e-98dd-cd81d5e98e83 - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:00.399 4088 3038296623592 GreenThread-23 DEBUG nova.network.neutron [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Successfully updated port: 2e1238b5-599f-4296-ab7a-cd575fc958c1 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:53:00.436 4088 3038296623592 GreenThread-23 DEBUG oslo_concurrency.lockutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Acquired lock "refresh_cache-f3fbc33e-18d4-47bf-b643-94d2edfcae5f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:53:00.436 4088 3038296623592 GreenThread-23 DEBUG nova.network.neutron [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:53:00.689 4088 3038340489288 MainThread DEBUG nova.compute.manager [req-ccdac543-3253-455e-802c-66b8fec5a893 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Received event network-changed-2e1238b5-599f-4296-ab7a-cd575fc958c1 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:53:00.689 4088 3038340489288 MainThread DEBUG nova.compute.manager [req-ccdac543-3253-455e-802c-66b8fec5a893 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Refreshing instance network info cache due to event network-changed-2e1238b5-599f-4296-ab7a-cd575fc958c1. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:53:00.891 4088 3038296623592 GreenThread-23 DEBUG nova.network.neutron [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:53:01.315 4088 3038338907304 MainThread DEBUG os_win.utils.jobutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Waiting for WMI job: {'InstanceID': '642813DB-DD73-49AF-9BF9-4D285E42473A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=23017), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:01.487 4088 3038338907304 MainThread ERROR os_win.utils.jobutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001d\' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)instance-0000001d56652803-50AE-40D0-B280-C15B77ACA21012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)instance-0000001d56652803-50AE-40D0-B280-C15B77ACA21010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)instance-0000001d56652803-50AE-40D0-B280-C15B77ACA210%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '642813DB-DD73-49AF-9BF9-4D285E42473A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=138195), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 1), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 1), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001d' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)\n\nNot enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)\n\n'instance-0000001d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)", 'ErrorSummaryDescription': "'instance-0000001d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:01.487 4088 3038338907304 MainThread DEBUG os_win._utils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001d' failed to start. Not enough memory in the system to start the virtual machine instance-0000001d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001d' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Not enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) 'instance-0000001d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 4.389755725860596 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:01.533 4088 3038338907656 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:01.533 4088 3038338907656 MainThread INFO nova.compute.manager [-] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] VM Stopped (Lifecycle Event) 2021-09-10 16:53:01.533 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:01.533 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:01.555 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-4703aeab-240a-4e67-8d8e-a379e29e82a1 - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:01.555 4088 3038338907656 MainThread DEBUG nova.virt.hyperv.vmops [req-4703aeab-240a-4e67-8d8e-a379e29e82a1 - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:01.627 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-4703aeab-240a-4e67-8d8e-a379e29e82a1 - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:01.655 4088 3038338907656 MainThread INFO nova.compute.manager [req-4703aeab-240a-4e67-8d8e-a379e29e82a1 - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:02.032 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-d8dd5b3c-3bee-4275-8d66-113f162c1b50 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Received event network-vif-plugged-ce9385c0-fdc8-463a-b1f4-2d897eea7193 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:53:02.032 4088 3038338907656 MainThread DEBUG oslo_concurrency.lockutils [req-d8dd5b3c-3bee-4275-8d66-113f162c1b50 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "1f7074b3-ef6e-40e5-9ea0-31847563fef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:02.032 4088 3038338907656 MainThread DEBUG oslo_concurrency.lockutils [req-d8dd5b3c-3bee-4275-8d66-113f162c1b50 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "1f7074b3-ef6e-40e5-9ea0-31847563fef0-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:02.047 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-d8dd5b3c-3bee-4275-8d66-113f162c1b50 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Processing event network-vif-plugged-ce9385c0-fdc8-463a-b1f4-2d897eea7193 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:53:02.081 4088 3038338906072 MainThread INFO nova.virt.hyperv.vmops [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Using config drive for instance 2021-09-10 16:53:02.392 4088 3038338906072 MainThread INFO nova.virt.hyperv.vmops [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Creating config drive at C:\openstack\instances\instance-0000001e\configdrive.iso 2021-09-10 16:53:02.533 4088 3038338906072 MainThread DEBUG oslo_concurrency.processutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000001e\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpettkjy4n execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:53:02.704 4088 3038296623592 GreenThread-23 DEBUG nova.network.neutron [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Updating instance_info_cache with network_info: [{"id": "2e1238b5-599f-4296-ab7a-cd575fc958c1", "address": "fa:16:3e:c3:a2:02", "network": {"id": "1e7a7677-ebf7-4159-b113-9f9b3431daf6", "bridge": null, "label": "tempest-ServersTestBootFromVolume-771384563-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7199a32f43ef47a1940566d570e22783", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2e1238b5-59", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:53:02.736 4088 3038296623592 GreenThread-23 DEBUG oslo_concurrency.lockutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Releasing lock "refresh_cache-f3fbc33e-18d4-47bf-b643-94d2edfcae5f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:53:02.736 4088 3038296623592 GreenThread-23 DEBUG nova.compute.manager [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Instance network_info: |[{"id": "2e1238b5-599f-4296-ab7a-cd575fc958c1", "address": "fa:16:3e:c3:a2:02", "network": {"id": "1e7a7677-ebf7-4159-b113-9f9b3431daf6", "bridge": null, "label": "tempest-ServersTestBootFromVolume-771384563-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7199a32f43ef47a1940566d570e22783", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2e1238b5-59", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:53:02.736 4088 3038340489288 MainThread DEBUG oslo_concurrency.lockutils [req-ccdac543-3253-455e-802c-66b8fec5a893 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-f3fbc33e-18d4-47bf-b643-94d2edfcae5f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:53:02.736 4088 3038340489288 MainThread DEBUG nova.network.neutron [req-ccdac543-3253-455e-802c-66b8fec5a893 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Refreshing network info cache for port 2e1238b5-599f-4296-ab7a-cd575fc958c1 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:53:02.781 4088 3038338907304 MainThread DEBUG os_win.utils.jobutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Waiting for WMI job: {'InstanceID': '3AB7968D-FEBA-444E-A658-9253CDA9ED04', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=46535), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:02.984 4088 3038338906072 MainThread DEBUG oslo_concurrency.processutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000001e\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpettkjy4n" returned: 0 in 0.454s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:53:03.081 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:03.081 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:03.081 4088 3038338907656 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:03.081 4088 3038338907656 MainThread INFO nova.compute.manager [-] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] VM Stopped (Lifecycle Event) 2021-09-10 16:53:03.109 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-5ccab1df-06a9-42ee-b597-92c9eb5515d8 - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:03.109 4088 3038338907656 MainThread DEBUG nova.virt.hyperv.vmops [req-5ccab1df-06a9-42ee-b597-92c9eb5515d8 - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:03.128 4088 3038338907304 MainThread ERROR os_win.utils.jobutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001d\' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)instance-0000001d56652803-50AE-40D0-B280-C15B77ACA21012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)instance-0000001d56652803-50AE-40D0-B280-C15B77ACA21010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)instance-0000001d56652803-50AE-40D0-B280-C15B77ACA210%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3AB7968D-FEBA-444E-A658-9253CDA9ED04', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=172820), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 2), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 2), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001d' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)\n\nNot enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)\n\n'instance-0000001d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)", 'ErrorSummaryDescription': "'instance-0000001d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:03.128 4088 3038338907304 MainThread DEBUG os_win._utils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001d' failed to start. Not enough memory in the system to start the virtual machine instance-0000001d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001d' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Not enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) 'instance-0000001d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 6.0310258865356445 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:03.172 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-5ccab1df-06a9-42ee-b597-92c9eb5515d8 - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:03.219 4088 3038338907656 MainThread INFO nova.compute.manager [req-5ccab1df-06a9-42ee-b597-92c9eb5515d8 - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:03.845 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Setting boot order for instance: instance-0000001e: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:53:04.001 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:53:04.095 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Waiting for WMI job: {'InstanceID': '7C2150E6-32B8-4560-8D2A-64E113E630B6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=69517), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:04.171 4088 3038338907304 MainThread DEBUG os_win.utils.jobutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Waiting for WMI job: {'InstanceID': 'C2ACC64D-837D-46D5-B599-0B444C641889', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=24226), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:04.219 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:53:04.249 4088 3038338906952 MainThread INFO nova.virt.hyperv.vmops [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Spawning new instance 2021-09-10 16:53:04.265 4088 3038338906072 MainThread ERROR os_win.utils.jobutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001e\' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)instance-0000001e97132A99-9834-41E0-9EB8-C5E70B7E1E5012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)instance-0000001e97132A99-9834-41E0-9EB8-C5E70B7E1E5010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)instance-0000001e97132A99-9834-41E0-9EB8-C5E70B7E1E50%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7C2150E6-32B8-4560-8D2A-64E113E630B6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=168865), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 4), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001e' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)\n\nNot enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)\n\n'instance-0000001e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)", 'ErrorSummaryDescription': "'instance-0000001e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:04.265 4088 3038338906072 MainThread DEBUG os_win._utils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001e' failed to start. Not enough memory in the system to start the virtual machine instance-0000001e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001e' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Not enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) 'instance-0000001e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.26424670219421387 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:04.335 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Lock "instance-00000020" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:04.335 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Lock "instance-00000020" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:04.335 4088 3038338906952 MainThread DEBUG nova.block_device [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] block_device_list ['sda'] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:53:04.335 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Preparing to wait for external event network-vif-plugged-2e1238b5-599f-4296-ab7a-cd575fc958c1 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:53:04.335 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Lock "f3fbc33e-18d4-47bf-b643-94d2edfcae5f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:04.346 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Lock "f3fbc33e-18d4-47bf-b643-94d2edfcae5f-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:04.346 4088 3038338906952 MainThread DEBUG os_win.utils.compute.vmutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Creating VM instance-00000020 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:53:04.392 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-1cd8ca47-e2a0-4013-9aba-001313340e19 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Received event network-vif-plugged-4976e995-8bf8-4ddb-833a-7cc8f525682f external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:53:04.392 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-1cd8ca47-e2a0-4013-9aba-001313340e19 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9107836a-481d-4cb5-9c7d-6432f4cd5309-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:04.392 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-1cd8ca47-e2a0-4013-9aba-001313340e19 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9107836a-481d-4cb5-9c7d-6432f4cd5309-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:04.392 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-1cd8ca47-e2a0-4013-9aba-001313340e19 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Processing event network-vif-plugged-4976e995-8bf8-4ddb-833a-7cc8f525682f _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:53:04.407 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:04.407 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:04.423 4088 3038296623592 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:04.423 4088 3038296623592 MainThread INFO nova.compute.manager [-] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] VM Stopped (Lifecycle Event) 2021-09-10 16:53:04.437 4088 3038338907832 MainThread INFO nova.virt.hyperv.vmops [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Using config drive for instance 2021-09-10 16:53:04.437 4088 3038338905192 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:04.437 4088 3038338905192 MainThread INFO nova.compute.manager [-] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] VM Stopped (Lifecycle Event) 2021-09-10 16:53:04.456 4088 3038338904840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:04.456 4088 3038338904840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:04.469 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-28eae291-a90d-461e-ac5a-278a89d13f84 - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:04.469 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-28eae291-a90d-461e-ac5a-278a89d13f84 - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:04.469 4088 3038338907304 MainThread ERROR os_win.utils.jobutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001d\' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)instance-0000001d56652803-50AE-40D0-B280-C15B77ACA21012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)instance-0000001d56652803-50AE-40D0-B280-C15B77ACA21010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)instance-0000001d56652803-50AE-40D0-B280-C15B77ACA210%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C2ACC64D-837D-46D5-B599-0B444C641889', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=189173), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 4), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001d' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)\n\nNot enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)\n\n'instance-0000001d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210)", 'ErrorSummaryDescription': "'instance-0000001d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:04.469 4088 3038338907304 MainThread ERROR nova.virt.hyperv.vmops [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Failed to change vm state of instance-0000001d to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000001d' failed to start. 2021-09-10 16:53:04.484 4088 3038338907304 MainThread INFO nova.virt.hyperv.vmops [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Got request to destroy instance 2021-09-10 16:53:04.500 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-5f376a5f-06c5-4bc7-b182-362f590904db - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:04.500 4088 3038338905192 MainThread DEBUG nova.virt.hyperv.vmops [req-5f376a5f-06c5-4bc7-b182-362f590904db - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:04.535 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-28eae291-a90d-461e-ac5a-278a89d13f84 - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:04.549 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-5f376a5f-06c5-4bc7-b182-362f590904db - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:04.573 4088 3038296623592 MainThread INFO nova.compute.manager [req-28eae291-a90d-461e-ac5a-278a89d13f84 - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:04.584 4088 3038338905192 MainThread INFO nova.compute.manager [req-5f376a5f-06c5-4bc7-b182-362f590904db - - - - -] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:04.858 4088 3038338907832 MainThread INFO nova.virt.hyperv.vmops [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Creating config drive at C:\openstack\instances\instance-0000001f\configdrive.iso 2021-09-10 16:53:04.987 4088 3038338907832 MainThread DEBUG oslo_concurrency.processutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000001f\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpv0inyofs execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:53:05.345 4088 3038340489288 MainThread DEBUG nova.network.neutron [req-ccdac543-3253-455e-802c-66b8fec5a893 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Updated VIF entry in instance network info cache for port 2e1238b5-599f-4296-ab7a-cd575fc958c1. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:53:05.345 4088 3038340489288 MainThread DEBUG nova.network.neutron [req-ccdac543-3253-455e-802c-66b8fec5a893 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Updating instance_info_cache with network_info: [{"id": "2e1238b5-599f-4296-ab7a-cd575fc958c1", "address": "fa:16:3e:c3:a2:02", "network": {"id": "1e7a7677-ebf7-4159-b113-9f9b3431daf6", "bridge": null, "label": "tempest-ServersTestBootFromVolume-771384563-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7199a32f43ef47a1940566d570e22783", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2e1238b5-59", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:53:05.359 4088 3038338907832 MainThread DEBUG oslo_concurrency.processutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000001f\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpv0inyofs" returned: 0 in 0.375s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:53:05.390 4088 3038340489288 MainThread DEBUG oslo_concurrency.lockutils [req-ccdac543-3253-455e-802c-66b8fec5a893 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-f3fbc33e-18d4-47bf-b643-94d2edfcae5f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:53:05.422 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Waiting for WMI job: {'InstanceID': 'EA134BC3-2A82-4656-929F-7200718F97DA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21268), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:05.692 4088 3038338906072 MainThread ERROR os_win.utils.jobutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001e\' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)instance-0000001e97132A99-9834-41E0-9EB8-C5E70B7E1E5012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)instance-0000001e97132A99-9834-41E0-9EB8-C5E70B7E1E5010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)instance-0000001e97132A99-9834-41E0-9EB8-C5E70B7E1E50%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'EA134BC3-2A82-4656-929F-7200718F97DA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=149262), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 5), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 5), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001e' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)\n\nNot enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)\n\n'instance-0000001e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)", 'ErrorSummaryDescription': "'instance-0000001e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:05.708 4088 3038338906072 MainThread DEBUG os_win._utils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001e' failed to start. Not enough memory in the system to start the virtual machine instance-0000001e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001e' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Not enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) 'instance-0000001e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.7073841094970703 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:05.738 4088 3038296623592 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:05.738 4088 3038296623592 MainThread INFO nova.compute.manager [-] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] VM Stopped (Lifecycle Event) 2021-09-10 16:53:05.738 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:05.738 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:05.749 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-132875e3-88d7-4742-aaff-d23c8e484e48 - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:05.749 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-132875e3-88d7-4742-aaff-d23c8e484e48 - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:05.834 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-132875e3-88d7-4742-aaff-d23c8e484e48 - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:05.861 4088 3038296623592 MainThread INFO nova.compute.manager [req-132875e3-88d7-4742-aaff-d23c8e484e48 - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:06.173 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.vmops [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Setting boot order for instance: instance-0000001f: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:53:06.253 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.volumeops [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Attaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-f5252e88-87bd-471e-b572-a8d70f3c3790', 'target_lun': 0, 'volume_id': 'f5252e88-87bd-471e-b572-a8d70f3c3790', 'auth_method': 'CHAP', 'auth_username': 'nVSjUhEE86QfhZaDKiyx', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'reserved', 'instance': 'f3fbc33e-18d4-47bf-b643-94d2edfcae5f', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5252e88-87bd-471e-b572-a8d70f3c3790', 'serial': 'f5252e88-87bd-471e-b572-a8d70f3c3790'} to instance-00000020 _attach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:108 2021-09-10 16:53:06.271 4088 3038338906952 MainThread DEBUG os_brick.initiator.windows.iscsi [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-f5252e88-87bd-471e-b572-a8d70f3c3790', 'target_lun': 0, 'volume_id': 'f5252e88-87bd-471e-b572-a8d70f3c3790', 'auth_method': 'CHAP', 'auth_username': 'nVSjUhEE86QfhZaDKiyx', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:53:06.271 4088 3038338906952 MainThread INFO os_brick.initiator.windows.iscsi [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Attempting to establish an iSCSI session to target iqn.2010-10.org.openstack:volume-f5252e88-87bd-471e-b572-a8d70f3c3790 on portal 10.222.0.55:3260 accessing LUN 0 using initiator None. 2021-09-10 16:53:06.271 4088 3038338906952 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Logging in iSCSI target iqn.2010-10.org.openstack:volume-f5252e88-87bd-471e-b572-a8d70f3c3790 login_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:401 2021-09-10 16:53:06.374 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.vmops [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:53:06.418 4088 3038338907832 MainThread DEBUG os_win.utils.jobutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': '7FCDB71B-E07E-4B2E-A6FF-847C4D39661B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19361), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:06.577 4088 3038338907832 MainThread ERROR os_win.utils.jobutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001f\' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)instance-0000001fB6A8BEA2-C47D-4D3A-8DEC-7BF441547F7112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)instance-0000001fB6A8BEA2-C47D-4D3A-8DEC-7BF441547F7110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)instance-0000001fB6A8BEA2-C47D-4D3A-8DEC-7BF441547F71%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7FCDB71B-E07E-4B2E-A6FF-847C4D39661B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=141150), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 6), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 6), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001f' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)\n\nNot enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)\n\n'instance-0000001f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)", 'ErrorSummaryDescription': "'instance-0000001f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:06.577 4088 3038338907832 MainThread DEBUG os_win._utils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001f' failed to start. Not enough memory in the system to start the virtual machine instance-0000001f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001f' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Not enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) 'instance-0000001f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.2029874324798584 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:06.642 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:06.642 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:06.642 4088 3038296623592 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:06.642 4088 3038296623592 MainThread INFO nova.compute.manager [-] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] VM Stopped (Lifecycle Event) 2021-09-10 16:53:06.655 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-ffbe67d4-5261-4cc6-be40-bbf1a601586d - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:06.655 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-ffbe67d4-5261-4cc6-be40-bbf1a601586d - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:06.722 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-ffbe67d4-5261-4cc6-be40-bbf1a601586d - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:06.751 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Waiting for WMI job: {'InstanceID': '51E08A56-A3C9-4693-B1BF-772F8CD7AF5D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21006), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:06.765 4088 3038296623592 MainThread INFO nova.compute.manager [req-ffbe67d4-5261-4cc6-be40-bbf1a601586d - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:06.911 4088 3038338906072 MainThread ERROR os_win.utils.jobutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001e\' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)instance-0000001e97132A99-9834-41E0-9EB8-C5E70B7E1E5012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)instance-0000001e97132A99-9834-41E0-9EB8-C5E70B7E1E5010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)instance-0000001e97132A99-9834-41E0-9EB8-C5E70B7E1E50%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '51E08A56-A3C9-4693-B1BF-772F8CD7AF5D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=141533), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 6), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 6), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001e' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)\n\nNot enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)\n\n'instance-0000001e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)", 'ErrorSummaryDescription': "'instance-0000001e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:06.911 4088 3038338906072 MainThread DEBUG os_win._utils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001e' failed to start. Not enough memory in the system to start the virtual machine instance-0000001e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001e' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Not enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) 'instance-0000001e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.9105875492095947 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:06.972 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:06.972 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:06.972 4088 3038296623592 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:06.972 4088 3038296623592 MainThread INFO nova.compute.manager [-] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] VM Stopped (Lifecycle Event) 2021-09-10 16:53:06.984 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-5d244a28-5ee7-4b54-a3cd-b8d7a2b4a43b - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:06.984 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-5d244a28-5ee7-4b54-a3cd-b8d7a2b4a43b - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:07.055 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-5d244a28-5ee7-4b54-a3cd-b8d7a2b4a43b - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:07.093 4088 3038296623592 MainThread INFO nova.compute.manager [req-5d244a28-5ee7-4b54-a3cd-b8d7a2b4a43b - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:07.110 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:53:07.110 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "instance-0000001d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:07.110 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "instance-0000001d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:07.140 4088 3038338907304 MainThread DEBUG os_win.utils.compute.vmutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Successfully changed vm state of instance-0000001d to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:53:07.140 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Successfully changed state of VM instance-0000001d to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:53:07.204 4088 3038338907304 MainThread DEBUG os_win.utils.jobutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Waiting for WMI job: {'InstanceID': 'B8180BA1-46D7-41BA-9626-EE41F762228F', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21241), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:07.443 4088 3038338907304 MainThread DEBUG os_win.utils.jobutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] WMI job succeeded: {'InstanceID': 'B8180BA1-46D7-41BA-9626-EE41F762228F', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=150842), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:53:07.443 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "instance-0000001d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:07.443 4088 3038338907304 MainThread DEBUG os_win.utils.pathutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Removing directory: C:\openstack\instances\instance-0000001d check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:53:07.468 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "instance-0000001d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:07.468 4088 3038338907304 MainThread ERROR nova.compute.manager [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000001d' failed to start. Not enough memory in the system to start the virtual machine instance-0000001d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001d' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Not enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) 'instance-0000001d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Error code: 32778. 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Traceback (most recent call last): 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] return function(*args, **kwargs) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] admin_password, network_info, block_device_info) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] return function(self, *args, **kwds) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self.force_reraise() 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] raise self.value 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] should_plug_vifs=False) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 'req_state': req_state}) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self.force_reraise() 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] raise self.value 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] time.sleep(sleep_time) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self.force_reraise() 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] raise self.value 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] return f(*args, **kwargs) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] return self._wait_for_job(job_path) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] error_desc=err_desc) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000001d' failed to start. 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Not enough memory in the system to start the virtual machine instance-0000001d. 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001d' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Not enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 'instance-0000001d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Error code: 32778. 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] During handling of the above exception, another exception occurred: 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Traceback (most recent call last): 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] yield resources 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] accel_info=accel_info) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] return function(*args, **kwargs) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] admin_password, network_info, block_device_info) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] return function(self, *args, **kwds) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self.force_reraise() 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] raise self.value 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] should_plug_vifs=False) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 'req_state': req_state}) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self.force_reraise() 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] raise self.value 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] time.sleep(sleep_time) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self.force_reraise() 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] raise self.value 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] return f(*args, **kwargs) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] return self._wait_for_job(job_path) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] error_desc=err_desc) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000001d' failed to start. 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Not enough memory in the system to start the virtual machine instance-0000001d. 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001d' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Not enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 'instance-0000001d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Error code: 32778. 2021-09-10 16:53:07.468 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:07.472 4088 3038338907304 MainThread INFO nova.compute.manager [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Terminating instance 2021-09-10 16:53:07.472 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:53:07.472 4088 3038338907304 MainThread INFO nova.virt.hyperv.vmops [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Got request to destroy instance 2021-09-10 16:53:07.484 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:53:07.501 4088 3038338907304 MainThread DEBUG os_brick.initiator.windows.iscsi [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-a0ac4351-dd95-40e6-bcc7-f7e316d40088', 'target_lun': 0, 'volume_id': 'a0ac4351-dd95-40e6-bcc7-f7e316d40088', 'auth_method': 'CHAP', 'auth_username': 'WUVTEq8Na5sjUfeUS977', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:53:07.501 4088 3038338907304 MainThread DEBUG os_win.utils.storage.diskutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 16:53:07.633 4088 3038338907832 MainThread DEBUG os_win.utils.jobutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': '89D4AF6E-415C-4991-B92A-B5D07EFBE588', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=30071), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:07.647 4088 3038338907304 MainThread DEBUG os_win.utils.storage.diskutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 16:53:07.663 4088 3038338907304 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-a0ac4351-dd95-40e6-bcc7-f7e316d40088 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 16:53:07.718 4088 3038338907304 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Removing iSCSI target persistent login: iqn.2010-10.org.openstack:volume-a0ac4351-dd95-40e6-bcc7-f7e316d40088 _remove_target_persistent_logins c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:495 2021-09-10 16:53:07.718 4088 3038338907304 MainThread DEBUG os_brick.initiator.windows.iscsi [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] <== disconnect_volume: return (217ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:53:07.718 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "instance-0000001d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:07.736 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "instance-0000001d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:07.736 4088 3038338907304 MainThread INFO nova.compute.manager [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Took 0.27 seconds to destroy the instance on the hypervisor. 2021-09-10 16:53:07.798 4088 3038338907832 MainThread ERROR os_win.utils.jobutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001f\' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)instance-0000001fB6A8BEA2-C47D-4D3A-8DEC-7BF441547F7112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)instance-0000001fB6A8BEA2-C47D-4D3A-8DEC-7BF441547F7110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)instance-0000001fB6A8BEA2-C47D-4D3A-8DEC-7BF441547F71%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '89D4AF6E-415C-4991-B92A-B5D07EFBE588', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=140773), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 7), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001f' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)\n\nNot enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)\n\n'instance-0000001f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)", 'ErrorSummaryDescription': "'instance-0000001f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:07.798 4088 3038338907832 MainThread DEBUG os_win._utils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001f' failed to start. Not enough memory in the system to start the virtual machine instance-0000001f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001f' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Not enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) 'instance-0000001f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4238784313201904 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:07.841 4088 3038338908008 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:07.841 4088 3038338908008 MainThread INFO nova.compute.manager [-] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] VM Stopped (Lifecycle Event) 2021-09-10 16:53:07.846 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:07.846 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:07.877 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-69e6ed5c-2d0c-424b-880c-c81db38f93e9 - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:07.877 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-69e6ed5c-2d0c-424b-880c-c81db38f93e9 - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:07.937 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-69e6ed5c-2d0c-424b-880c-c81db38f93e9 - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:07.954 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Waiting for WMI job: {'InstanceID': '3636AA1D-5700-4450-AE1A-B5638D46DA74', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=27146), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:07.984 4088 3038338908008 MainThread INFO nova.compute.manager [req-69e6ed5c-2d0c-424b-880c-c81db38f93e9 - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:08.108 4088 3038338906072 MainThread ERROR os_win.utils.jobutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001e\' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)instance-0000001e97132A99-9834-41E0-9EB8-C5E70B7E1E5012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)instance-0000001e97132A99-9834-41E0-9EB8-C5E70B7E1E5010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)instance-0000001e97132A99-9834-41E0-9EB8-C5E70B7E1E50%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3636AA1D-5700-4450-AE1A-B5638D46DA74', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=140995), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 8), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001e' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)\n\nNot enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)\n\n'instance-0000001e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)", 'ErrorSummaryDescription': "'instance-0000001e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:08.108 4088 3038338906072 MainThread DEBUG os_win._utils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001e' failed to start. Not enough memory in the system to start the virtual machine instance-0000001e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001e' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Not enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) 'instance-0000001e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 4.107806205749512 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:08.171 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:08.171 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:08.171 4088 3038338908008 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:08.171 4088 3038338908008 MainThread INFO nova.compute.manager [-] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] VM Stopped (Lifecycle Event) 2021-09-10 16:53:08.218 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-0c3a2654-2ab7-4fe9-91ca-d0fdb342bb90 - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:08.218 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-0c3a2654-2ab7-4fe9-91ca-d0fdb342bb90 - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:08.297 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-0c3a2654-2ab7-4fe9-91ca-d0fdb342bb90 - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:08.345 4088 3038338908008 MainThread INFO nova.compute.manager [req-0c3a2654-2ab7-4fe9-91ca-d0fdb342bb90 - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:08.783 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "ecbb6387-a846-41fc-9117-6880e641e5bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:08.798 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:53:08.848 4088 3038338907832 MainThread DEBUG os_win.utils.jobutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': '0DCA6C8F-6046-4AB7-A35B-B51FCD82615D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16691), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:08.972 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:08.972 4088 3038338905192 MainThread DEBUG nova.virt.hardware [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:53:08.972 4088 3038338905192 MainThread INFO nova.compute.claims [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Claim successful on node n-h2-808474-1 2021-09-10 16:53:09.015 4088 3038338907832 MainThread ERROR os_win.utils.jobutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001f\' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)instance-0000001fB6A8BEA2-C47D-4D3A-8DEC-7BF441547F7112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)instance-0000001fB6A8BEA2-C47D-4D3A-8DEC-7BF441547F7110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)instance-0000001fB6A8BEA2-C47D-4D3A-8DEC-7BF441547F71%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0DCA6C8F-6046-4AB7-A35B-B51FCD82615D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=132889), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 8), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 8), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001f' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)\n\nNot enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)\n\n'instance-0000001f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)", 'ErrorSummaryDescription': "'instance-0000001f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:09.015 4088 3038338907832 MainThread DEBUG os_win._utils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001f' failed to start. Not enough memory in the system to start the virtual machine instance-0000001f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001f' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Not enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) 'instance-0000001f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.6406893730163574 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:09.097 4088 3038338908008 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:09.097 4088 3038338908008 MainThread INFO nova.compute.manager [-] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] VM Stopped (Lifecycle Event) 2021-09-10 16:53:09.097 4088 3038338904840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:09.097 4088 3038338904840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:09.111 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-2f5a4441-1db4-41c2-bcda-c2a2ab370eb1 - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:09.111 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-2f5a4441-1db4-41c2-bcda-c2a2ab370eb1 - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:09.162 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Waiting for WMI job: {'InstanceID': 'ABA87313-F63D-4766-A1D9-3A5FD9350A64', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21616), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:09.173 4088 3038338905192 MainThread DEBUG nova.virt.hyperv.hostops [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:53:09.188 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-2f5a4441-1db4-41c2-bcda-c2a2ab370eb1 - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:09.204 4088 3038338905192 MainThread DEBUG nova.virt.hyperv.hostops [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:53:09.241 4088 3038338908008 MainThread INFO nova.compute.manager [req-2f5a4441-1db4-41c2-bcda-c2a2ab370eb1 - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:09.327 4088 3038338906072 MainThread ERROR os_win.utils.jobutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001e\' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)instance-0000001e97132A99-9834-41E0-9EB8-C5E70B7E1E5012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)instance-0000001e97132A99-9834-41E0-9EB8-C5E70B7E1E5010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)instance-0000001e97132A99-9834-41E0-9EB8-C5E70B7E1E50%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'ABA87313-F63D-4766-A1D9-3A5FD9350A64', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=153305), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 9), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 9), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001e' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)\n\nNot enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)\n\n'instance-0000001e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)", 'ErrorSummaryDescription': "'instance-0000001e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:09.327 4088 3038338906072 MainThread DEBUG os_win._utils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001e' failed to start. Not enough memory in the system to start the virtual machine instance-0000001e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001e' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Not enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) 'instance-0000001e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.326378583908081 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:09.439 4088 3038338908008 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:09.439 4088 3038338908008 MainThread INFO nova.compute.manager [-] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] VM Stopped (Lifecycle Event) 2021-09-10 16:53:09.439 4088 3038338904840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:09.454 4088 3038338904840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:09.469 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-536b847a-8bb9-4b7c-b399-d49cd3f2679c - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:09.469 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-536b847a-8bb9-4b7c-b399-d49cd3f2679c - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:09.469 4088 3038338905192 MainThread DEBUG nova.compute.provider_tree [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:53:09.486 4088 3038338905192 MainThread DEBUG nova.scheduler.client.report [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:53:09.486 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:09.486 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:53:09.538 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-536b847a-8bb9-4b7c-b399-d49cd3f2679c - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:09.566 4088 3038338908008 MainThread INFO nova.compute.manager [req-536b847a-8bb9-4b7c-b399-d49cd3f2679c - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:09.687 4088 3038338905192 MainThread DEBUG nova.compute.utils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:53:09.705 4088 3038338908008 GreenThread-24 DEBUG nova.compute.manager [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:53:09.705 4088 3038338908008 GreenThread-24 DEBUG nova.network.neutron [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:53:09.734 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:53:10.014 4088 3038338908008 GreenThread-24 DEBUG nova.policy [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd33d11497a91483d93fe0ed8f5c26603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc5deaa89294889821f303976e2d776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:53:10.046 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:53:10.046 4088 3038338905192 MainThread INFO nova.virt.hyperv.vmops [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Spawning new instance 2021-09-10 16:53:10.061 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000021" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:10.061 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000021" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:10.061 4088 3038338905192 MainThread DEBUG nova.block_device [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:53:10.061 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:10.079 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:10.079 4088 3038338907832 MainThread DEBUG os_win.utils.jobutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': '53E0A0A9-AEA9-41EB-B5C6-B12E217FFE17', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18487), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:10.095 4088 3038338905192 MainThread DEBUG os_win.utils.pathutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Creating directory: C:\openstack\instances\instance-00000021 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:53:10.095 4088 3038338905192 MainThread DEBUG nova.virt.hyperv.vmops [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000021\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:53:10.234 4088 3038338907832 MainThread ERROR os_win.utils.jobutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001f\' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)instance-0000001fB6A8BEA2-C47D-4D3A-8DEC-7BF441547F7112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)instance-0000001fB6A8BEA2-C47D-4D3A-8DEC-7BF441547F7110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)instance-0000001fB6A8BEA2-C47D-4D3A-8DEC-7BF441547F71%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '53E0A0A9-AEA9-41EB-B5C6-B12E217FFE17', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=129885), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 10), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 10), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001f' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)\n\nNot enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)\n\n'instance-0000001f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)", 'ErrorSummaryDescription': "'instance-0000001f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:10.234 4088 3038338907832 MainThread DEBUG os_win._utils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001f' failed to start. Not enough memory in the system to start the virtual machine instance-0000001f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001f' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Not enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) 'instance-0000001f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.859492540359497 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:10.312 4088 3038338907656 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:10.312 4088 3038338907656 MainThread INFO nova.compute.manager [-] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] VM Stopped (Lifecycle Event) 2021-09-10 16:53:10.312 4088 3038340489288 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:10.312 4088 3038340489288 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:10.359 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-aed863ef-3b9d-4a92-bc09-4d2bc2cac4f4 - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:10.359 4088 3038338907656 MainThread DEBUG nova.virt.hyperv.vmops [req-aed863ef-3b9d-4a92-bc09-4d2bc2cac4f4 - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:10.359 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Waiting for WMI job: {'InstanceID': 'B49FC1B5-D99C-4A3B-ADA4-63DF7AB0F482', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17501), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:10.419 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-aed863ef-3b9d-4a92-bc09-4d2bc2cac4f4 - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:10.436 4088 3038338907656 MainThread INFO nova.compute.manager [req-aed863ef-3b9d-4a92-bc09-4d2bc2cac4f4 - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:10.533 4088 3038338906072 MainThread ERROR os_win.utils.jobutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001e\' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)instance-0000001e97132A99-9834-41E0-9EB8-C5E70B7E1E5012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)instance-0000001e97132A99-9834-41E0-9EB8-C5E70B7E1E5010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)instance-0000001e97132A99-9834-41E0-9EB8-C5E70B7E1E50%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B49FC1B5-D99C-4A3B-ADA4-63DF7AB0F482', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=139242), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 10), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 10), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001e' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)\n\nNot enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)\n\n'instance-0000001e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50)", 'ErrorSummaryDescription': "'instance-0000001e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:10.533 4088 3038338906072 MainThread ERROR nova.virt.hyperv.vmops [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Failed to change vm state of instance-0000001e to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000001e' failed to start. 2021-09-10 16:53:10.533 4088 3038338906072 MainThread INFO nova.virt.hyperv.vmops [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Got request to destroy instance 2021-09-10 16:53:10.593 4088 3038338905192 MainThread DEBUG nova.virt.hyperv.vmops [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Resizing VHD C:\openstack\instances\instance-00000021\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:53:10.609 4088 3038338907656 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:10.609 4088 3038338907656 MainThread INFO nova.compute.manager [-] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] VM Stopped (Lifecycle Event) 2021-09-10 16:53:10.609 4088 3038340489288 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:10.609 4088 3038340489288 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:10.633 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-2931f81f-399c-4d90-8ef3-179b7c601b64 - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:10.633 4088 3038338907656 MainThread DEBUG nova.virt.hyperv.vmops [req-2931f81f-399c-4d90-8ef3-179b7c601b64 - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:10.687 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-2931f81f-399c-4d90-8ef3-179b7c601b64 - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:10.727 4088 3038338907656 MainThread INFO nova.compute.manager [req-2931f81f-399c-4d90-8ef3-179b7c601b64 - - - - -] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:11.265 4088 3038338907832 MainThread DEBUG os_win.utils.jobutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': '8F004D90-3435-4FDA-BF30-D7303855D923', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20725), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:11.305 4088 3038338906952 MainThread DEBUG os_win.utils.storage.diskutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 16:53:11.421 4088 3038338906952 MainThread DEBUG os_win.utils.storage.diskutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 16:53:11.441 4088 3038338907832 MainThread ERROR os_win.utils.jobutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001f\' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)instance-0000001fB6A8BEA2-C47D-4D3A-8DEC-7BF441547F7112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)instance-0000001fB6A8BEA2-C47D-4D3A-8DEC-7BF441547F7110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)instance-0000001fB6A8BEA2-C47D-4D3A-8DEC-7BF441547F71%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '8F004D90-3435-4FDA-BF30-D7303855D923', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=148878), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 11), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 11), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001f' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)\n\nNot enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)\n\n'instance-0000001f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)", 'ErrorSummaryDescription': "'instance-0000001f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:11.441 4088 3038338907832 MainThread DEBUG os_win._utils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000001f' failed to start. Not enough memory in the system to start the virtual machine instance-0000001f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001f' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Not enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) 'instance-0000001f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.066834926605225 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:11.464 4088 3038338906952 MainThread DEBUG os_brick.initiator.windows.iscsi [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] <== connect_volume: return (5192ms) {'type': 'block', 'path': '\\\\.\\PhysicalDrive2', 'number': 2, 'scsi_wwn': '36001405D12D71EBB52347858C49FCCC8'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:53:11.517 4088 3038338908008 GreenThread-24 DEBUG nova.network.neutron [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Successfully created port: f358fb5c-ad42-4d9f-a2b8-3d307d1bdd39 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:53:11.535 4088 3038338907656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:11.535 4088 3038338907656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000001f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:11.535 4088 3038338904840 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:11.535 4088 3038338904840 MainThread INFO nova.compute.manager [-] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] VM Stopped (Lifecycle Event) 2021-09-10 16:53:11.579 4088 3038338904840 MainThread DEBUG nova.compute.manager [req-fc3aa8ca-73bf-433c-ac8b-431084bad97f - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:11.579 4088 3038338904840 MainThread DEBUG nova.virt.hyperv.vmops [req-fc3aa8ca-73bf-433c-ac8b-431084bad97f - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:11.641 4088 3038338904840 MainThread DEBUG nova.compute.manager [req-fc3aa8ca-73bf-433c-ac8b-431084bad97f - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:11.693 4088 3038338904840 MainThread INFO nova.compute.manager [req-fc3aa8ca-73bf-433c-ac8b-431084bad97f - - - - -] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:12.406 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.vmops [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:53:12.486 4088 3038338907832 MainThread DEBUG os_win.utils.jobutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': 'AEBC0503-AF09-42E0-8FFA-BBFB9159C7E8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19365), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:12.643 4088 3038338907832 MainThread ERROR os_win.utils.jobutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000001f\' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)instance-0000001fB6A8BEA2-C47D-4D3A-8DEC-7BF441547F7112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)instance-0000001fB6A8BEA2-C47D-4D3A-8DEC-7BF441547F7110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000001f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)instance-0000001fB6A8BEA2-C47D-4D3A-8DEC-7BF441547F71%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'AEBC0503-AF09-42E0-8FFA-BBFB9159C7E8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=134438), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 12), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 12), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000001f' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)\n\nNot enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)\n\n'instance-0000001f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71)", 'ErrorSummaryDescription': "'instance-0000001f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000001f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:12.656 4088 3038338907832 MainThread ERROR nova.virt.hyperv.vmops [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Failed to change vm state of instance-0000001f to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000001f' failed to start. 2021-09-10 16:53:12.656 4088 3038338907832 MainThread INFO nova.virt.hyperv.vmops [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Got request to destroy instance 2021-09-10 16:53:12.955 4088 3038338908008 GreenThread-24 DEBUG nova.network.neutron [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Successfully updated port: f358fb5c-ad42-4d9f-a2b8-3d307d1bdd39 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:53:12.970 4088 3038338908008 GreenThread-24 DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Acquired lock "refresh_cache-ecbb6387-a846-41fc-9117-6880e641e5bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:53:12.993 4088 3038338908008 GreenThread-24 DEBUG nova.network.neutron [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:53:13.077 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:53:13.077 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "instance-0000001e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:13.077 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "instance-0000001e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:13.097 4088 3038338908008 GreenThread-24 DEBUG nova.network.neutron [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:53:13.110 4088 3038338906072 MainThread DEBUG os_win.utils.compute.vmutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Successfully changed vm state of instance-0000001e to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:53:13.110 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Successfully changed state of VM instance-0000001e to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:53:13.173 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Waiting for WMI job: {'InstanceID': 'C70BB38F-B867-46F2-AC5B-F3D3B68D0BAC', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18425), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:13.297 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] WMI job succeeded: {'InstanceID': 'C70BB38F-B867-46F2-AC5B-F3D3B68D0BAC', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=145802), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:53:13.297 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "instance-0000001e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:13.312 4088 3038338906072 MainThread DEBUG os_win.utils.pathutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Removing directory: C:\openstack\instances\instance-0000001e check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:53:13.312 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "instance-0000001e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:13.312 4088 3038338906072 MainThread ERROR nova.compute.manager [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000001e' failed to start. Not enough memory in the system to start the virtual machine instance-0000001e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001e' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Not enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) 'instance-0000001e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Error code: 32778. 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Traceback (most recent call last): 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] return function(*args, **kwargs) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] admin_password, network_info, block_device_info) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] return function(self, *args, **kwds) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self.force_reraise() 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] raise self.value 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] should_plug_vifs=False) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 'req_state': req_state}) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self.force_reraise() 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] raise self.value 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] time.sleep(sleep_time) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self.force_reraise() 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] raise self.value 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] return f(*args, **kwargs) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] return self._wait_for_job(job_path) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] error_desc=err_desc) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000001e' failed to start. 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Not enough memory in the system to start the virtual machine instance-0000001e. 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001e' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Not enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 'instance-0000001e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Error code: 32778. 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] During handling of the above exception, another exception occurred: 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Traceback (most recent call last): 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] yield resources 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] accel_info=accel_info) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] return function(*args, **kwargs) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] admin_password, network_info, block_device_info) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] return function(self, *args, **kwds) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self.force_reraise() 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] raise self.value 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] should_plug_vifs=False) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 'req_state': req_state}) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self.force_reraise() 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] raise self.value 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] time.sleep(sleep_time) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self.force_reraise() 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] raise self.value 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] return f(*args, **kwargs) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] return self._wait_for_job(job_path) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] error_desc=err_desc) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000001e' failed to start. 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Not enough memory in the system to start the virtual machine instance-0000001e. 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001e' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Not enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 'instance-0000001e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Error code: 32778. 2021-09-10 16:53:13.312 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.312 4088 3038338906072 MainThread INFO nova.compute.manager [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Terminating instance 2021-09-10 16:53:13.312 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:53:13.312 4088 3038338906072 MainThread INFO nova.virt.hyperv.vmops [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Got request to destroy instance 2021-09-10 16:53:13.343 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:53:13.343 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "instance-0000001e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:13.343 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "instance-0000001e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:13.343 4088 3038338906072 MainThread INFO nova.compute.manager [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 16:53:13.343 4088 3038338906072 MainThread DEBUG nova.compute.claims [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:53:13.343 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:13.533 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.hostops [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:53:13.546 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-46cfbd2c-e797-4625-bed4-c67926db5c65 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Received event network-vif-unplugged-2443269b-3d7a-4f11-ac3e-3380fd9883a4 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:53:13.546 4088 3038338907656 MainThread DEBUG oslo_concurrency.lockutils [req-46cfbd2c-e797-4625-bed4-c67926db5c65 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "079b5c5d-fe33-48d2-ba84-de08229901eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:13.546 4088 3038338907656 MainThread DEBUG oslo_concurrency.lockutils [req-46cfbd2c-e797-4625-bed4-c67926db5c65 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "079b5c5d-fe33-48d2-ba84-de08229901eb-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:13.546 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-46cfbd2c-e797-4625-bed4-c67926db5c65 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] No waiting events found dispatching network-vif-unplugged-2443269b-3d7a-4f11-ac3e-3380fd9883a4 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 16:53:13.546 4088 3038338907656 MainThread WARNING nova.compute.manager [req-46cfbd2c-e797-4625-bed4-c67926db5c65 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Received unexpected event network-vif-unplugged-2443269b-3d7a-4f11-ac3e-3380fd9883a4 for instance with vm_state building and task_state spawning. 2021-09-10 16:53:13.546 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.hostops [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:53:13.845 4088 3038338906072 MainThread DEBUG nova.compute.provider_tree [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:53:13.877 4088 3038338906072 MainThread DEBUG nova.scheduler.client.report [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:53:13.877 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.531s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:13.877 4088 3038338906072 MainThread ERROR nova.compute.manager [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000001e' failed to start. Not enough memory in the system to start the virtual machine instance-0000001e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001e' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Not enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) 'instance-0000001e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Error code: 32778. 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Traceback (most recent call last): 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] return function(*args, **kwargs) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] admin_password, network_info, block_device_info) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] return function(self, *args, **kwds) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self.force_reraise() 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] raise self.value 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] should_plug_vifs=False) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 'req_state': req_state}) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self.force_reraise() 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] raise self.value 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] time.sleep(sleep_time) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self.force_reraise() 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] raise self.value 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] return f(*args, **kwargs) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] return self._wait_for_job(job_path) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] error_desc=err_desc) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000001e' failed to start. 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Not enough memory in the system to start the virtual machine instance-0000001e. 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001e' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Not enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 'instance-0000001e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Error code: 32778. 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] During handling of the above exception, another exception occurred: 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Traceback (most recent call last): 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] accel_info=accel_info) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] return function(*args, **kwargs) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] admin_password, network_info, block_device_info) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] return function(self, *args, **kwds) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self.force_reraise() 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] raise self.value 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] should_plug_vifs=False) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 'req_state': req_state}) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self.force_reraise() 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] raise self.value 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] time.sleep(sleep_time) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self.force_reraise() 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] raise self.value 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] return f(*args, **kwargs) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] return self._wait_for_job(job_path) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] error_desc=err_desc) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000001e' failed to start. 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Not enough memory in the system to start the virtual machine instance-0000001e. 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001e' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Not enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 'instance-0000001e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Error code: 32778. 2021-09-10 16:53:13.877 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] 2021-09-10 16:53:13.890 4088 3038338906072 MainThread DEBUG nova.compute.utils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] WMI job failed with status 10. Error summary description: 'instance-0000001e' failed to start. Not enough memory in the system to start the virtual machine instance-0000001e. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:53:13.890 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Build of instance 1f7074b3-ef6e-40e5-9ea0-31847563fef0 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000001e' failed to start. Not enough memory in the system to start the virtual machine instance-0000001e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001e' failed to start. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Not enough memory in the system to start the virtual machine instance-0000001e with ram size 1024 megabytes. (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) 'instance-0000001e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 97132A99-9834-41E0-9EB8-C5E70B7E1E50) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:53:13.890 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:53:13.890 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:53:13.890 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:53:13.890 4088 3038338906072 MainThread DEBUG nova.network.neutron [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:53:13.905 4088 3038338908008 GreenThread-24 DEBUG nova.network.neutron [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Updating instance_info_cache with network_info: [{"id": "f358fb5c-ad42-4d9f-a2b8-3d307d1bdd39", "address": "fa:16:3e:98:0b:07", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf358fb5c-ad", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:53:13.952 4088 3038338908008 GreenThread-24 DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Releasing lock "refresh_cache-ecbb6387-a846-41fc-9117-6880e641e5bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:53:13.967 4088 3038338908008 GreenThread-24 DEBUG nova.compute.manager [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Instance network_info: |[{"id": "f358fb5c-ad42-4d9f-a2b8-3d307d1bdd39", "address": "fa:16:3e:98:0b:07", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf358fb5c-ad", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:53:13.967 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Preparing to wait for external event network-vif-plugged-f358fb5c-ad42-4d9f-a2b8-3d307d1bdd39 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:53:13.967 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "ecbb6387-a846-41fc-9117-6880e641e5bd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:13.967 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "ecbb6387-a846-41fc-9117-6880e641e5bd-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:13.967 4088 3038338905192 MainThread DEBUG os_win.utils.compute.vmutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Creating VM instance-00000021 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:53:14.030 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-200cc3c7-e428-4934-8862-eb8084fe11e7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Received event network-changed-f358fb5c-ad42-4d9f-a2b8-3d307d1bdd39 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:53:14.030 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-200cc3c7-e428-4934-8862-eb8084fe11e7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Refreshing instance network info cache due to event network-changed-f358fb5c-ad42-4d9f-a2b8-3d307d1bdd39. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:53:14.030 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-200cc3c7-e428-4934-8862-eb8084fe11e7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-ecbb6387-a846-41fc-9117-6880e641e5bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:53:14.030 4088 3038338908008 MainThread DEBUG nova.network.neutron [req-200cc3c7-e428-4934-8862-eb8084fe11e7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Refreshing network info cache for port f358fb5c-ad42-4d9f-a2b8-3d307d1bdd39 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:53:15.143 4088 3038338907304 MainThread INFO nova.compute.manager [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Took 7.41 seconds to detach 1 volumes for instance. 2021-09-10 16:53:15.143 4088 3038338907304 MainThread DEBUG nova.compute.claims [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:53:15.143 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:15.298 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.vmops [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:53:15.298 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-0000001f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:15.298 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-0000001f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:15.343 4088 3038338907832 MainThread DEBUG os_win.utils.compute.vmutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Successfully changed vm state of instance-0000001f to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:53:15.343 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.vmops [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Successfully changed state of VM instance-0000001f to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:53:15.377 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.hostops [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:53:15.395 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.hostops [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:53:15.453 4088 3038338907832 MainThread DEBUG os_win.utils.jobutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': 'F0FF3D1C-7686-47F7-8F81-6822479C4903', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20907), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:15.675 4088 3038338907304 MainThread DEBUG nova.compute.provider_tree [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:53:15.687 4088 3038338907832 MainThread DEBUG os_win.utils.jobutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job succeeded: {'InstanceID': 'F0FF3D1C-7686-47F7-8F81-6822479C4903', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=190181), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:53:15.704 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-0000001f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:15.704 4088 3038338907832 MainThread DEBUG os_win.utils.pathutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Removing directory: C:\openstack\instances\instance-0000001f check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:53:15.704 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-0000001f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:15.704 4088 3038338907832 MainThread ERROR nova.compute.manager [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000001f' failed to start. Not enough memory in the system to start the virtual machine instance-0000001f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001f' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Not enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) 'instance-0000001f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Error code: 32778. 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Traceback (most recent call last): 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] return function(*args, **kwargs) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] admin_password, network_info, block_device_info) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] return function(self, *args, **kwds) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self.force_reraise() 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] raise self.value 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] should_plug_vifs=False) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 'req_state': req_state}) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self.force_reraise() 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] raise self.value 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] time.sleep(sleep_time) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self.force_reraise() 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] raise self.value 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] return f(*args, **kwargs) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] return self._wait_for_job(job_path) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] error_desc=err_desc) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000001f' failed to start. 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Not enough memory in the system to start the virtual machine instance-0000001f. 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001f' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Not enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 'instance-0000001f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Error code: 32778. 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] During handling of the above exception, another exception occurred: 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Traceback (most recent call last): 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] yield resources 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] accel_info=accel_info) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] return function(*args, **kwargs) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] admin_password, network_info, block_device_info) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] return function(self, *args, **kwds) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self.force_reraise() 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] raise self.value 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] should_plug_vifs=False) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 'req_state': req_state}) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self.force_reraise() 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] raise self.value 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] time.sleep(sleep_time) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self.force_reraise() 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] raise self.value 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] return f(*args, **kwargs) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] return self._wait_for_job(job_path) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] error_desc=err_desc) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000001f' failed to start. 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Not enough memory in the system to start the virtual machine instance-0000001f. 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001f' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Not enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 'instance-0000001f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Error code: 32778. 2021-09-10 16:53:15.704 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:15.704 4088 3038338907832 MainThread INFO nova.compute.manager [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Terminating instance 2021-09-10 16:53:15.704 4088 3038338907832 MainThread DEBUG nova.compute.manager [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:53:15.721 4088 3038338907832 MainThread INFO nova.virt.hyperv.vmops [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Got request to destroy instance 2021-09-10 16:53:15.721 4088 3038338907304 MainThread DEBUG nova.scheduler.client.report [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:53:15.721 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.578s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:15.721 4088 3038338907304 MainThread ERROR nova.compute.manager [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000001d' failed to start. Not enough memory in the system to start the virtual machine instance-0000001d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001d' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Not enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) 'instance-0000001d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Error code: 32778. 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Traceback (most recent call last): 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] return function(*args, **kwargs) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] admin_password, network_info, block_device_info) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] return function(self, *args, **kwds) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self.force_reraise() 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] raise self.value 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] should_plug_vifs=False) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 'req_state': req_state}) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self.force_reraise() 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] raise self.value 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] time.sleep(sleep_time) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self.force_reraise() 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] raise self.value 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] return f(*args, **kwargs) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] return self._wait_for_job(job_path) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] error_desc=err_desc) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000001d' failed to start. 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Not enough memory in the system to start the virtual machine instance-0000001d. 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001d' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Not enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 'instance-0000001d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Error code: 32778. 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] During handling of the above exception, another exception occurred: 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Traceback (most recent call last): 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] accel_info=accel_info) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] return function(*args, **kwargs) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] admin_password, network_info, block_device_info) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] return function(self, *args, **kwds) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self.force_reraise() 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] raise self.value 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] should_plug_vifs=False) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 'req_state': req_state}) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self.force_reraise() 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] raise self.value 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] time.sleep(sleep_time) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self.force_reraise() 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] raise self.value 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] return f(*args, **kwargs) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] return self._wait_for_job(job_path) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] error_desc=err_desc) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000001d' failed to start. 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Not enough memory in the system to start the virtual machine instance-0000001d. 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001d' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Not enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 'instance-0000001d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Error code: 32778. 2021-09-10 16:53:15.721 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] 2021-09-10 16:53:15.736 4088 3038338907304 MainThread DEBUG nova.compute.utils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] WMI job failed with status 10. Error summary description: 'instance-0000001d' failed to start. Not enough memory in the system to start the virtual machine instance-0000001d. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:53:15.736 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Build of instance 079b5c5d-fe33-48d2-ba84-de08229901eb was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000001d' failed to start. Not enough memory in the system to start the virtual machine instance-0000001d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001d' failed to start. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Not enough memory in the system to start the virtual machine instance-0000001d with ram size 1024 megabytes. (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) 'instance-0000001d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 56652803-50AE-40D0-B280-C15B77ACA210) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:53:15.736 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:53:15.736 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:53:15.736 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:53:15.736 4088 3038338907304 MainThread DEBUG nova.network.neutron [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:53:15.813 4088 3038338908008 MainThread DEBUG nova.network.neutron [req-200cc3c7-e428-4934-8862-eb8084fe11e7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Updated VIF entry in instance network info cache for port f358fb5c-ad42-4d9f-a2b8-3d307d1bdd39. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:53:15.827 4088 3038338908008 MainThread DEBUG nova.network.neutron [req-200cc3c7-e428-4934-8862-eb8084fe11e7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Updating instance_info_cache with network_info: [{"id": "f358fb5c-ad42-4d9f-a2b8-3d307d1bdd39", "address": "fa:16:3e:98:0b:07", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf358fb5c-ad", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:53:15.859 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-200cc3c7-e428-4934-8862-eb8084fe11e7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-ecbb6387-a846-41fc-9117-6880e641e5bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:53:15.859 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.vmops [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:53:15.859 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-0000001f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:15.859 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-0000001f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:15.859 4088 3038338907832 MainThread INFO nova.compute.manager [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Took 0.14 seconds to destroy the instance on the hypervisor. 2021-09-10 16:53:15.859 4088 3038338907832 MainThread DEBUG nova.compute.claims [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:53:15.859 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:16.140 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.hostops [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:53:16.155 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.hostops [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:53:16.204 4088 3038338906072 MainThread DEBUG nova.network.neutron [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:53:16.235 4088 3038338906072 MainThread INFO nova.compute.manager [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 1f7074b3-ef6e-40e5-9ea0-31847563fef0] Took 2.34 seconds to deallocate network for instance. 2021-09-10 16:53:16.502 4088 3038338906072 MainThread INFO nova.scheduler.client.report [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Deleted allocations for instance 1f7074b3-ef6e-40e5-9ea0-31847563fef0 2021-09-10 16:53:16.530 4088 3038338907832 MainThread DEBUG nova.compute.provider_tree [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:53:16.546 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-12eebf70-df25-40c0-a7ea-9ce2cf8e1630 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "1f7074b3-ef6e-40e5-9ea0-31847563fef0" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 31.437s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:16.585 4088 3038338907832 MainThread DEBUG nova.scheduler.client.report [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:53:16.585 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.718s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:16.585 4088 3038338907832 MainThread ERROR nova.compute.manager [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000001f' failed to start. Not enough memory in the system to start the virtual machine instance-0000001f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001f' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Not enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) 'instance-0000001f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Error code: 32778. 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Traceback (most recent call last): 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] return function(*args, **kwargs) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] admin_password, network_info, block_device_info) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] return function(self, *args, **kwds) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self.force_reraise() 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] raise self.value 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] should_plug_vifs=False) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 'req_state': req_state}) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self.force_reraise() 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] raise self.value 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] time.sleep(sleep_time) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self.force_reraise() 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] raise self.value 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] return f(*args, **kwargs) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] return self._wait_for_job(job_path) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] error_desc=err_desc) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000001f' failed to start. 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Not enough memory in the system to start the virtual machine instance-0000001f. 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001f' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Not enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 'instance-0000001f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Error code: 32778. 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] During handling of the above exception, another exception occurred: 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Traceback (most recent call last): 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] accel_info=accel_info) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] return function(*args, **kwargs) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] admin_password, network_info, block_device_info) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] return function(self, *args, **kwds) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self.force_reraise() 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] raise self.value 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] should_plug_vifs=False) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 'req_state': req_state}) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self.force_reraise() 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] raise self.value 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] time.sleep(sleep_time) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self.force_reraise() 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] raise self.value 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] return f(*args, **kwargs) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] return self._wait_for_job(job_path) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] error_desc=err_desc) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000001f' failed to start. 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Not enough memory in the system to start the virtual machine instance-0000001f. 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001f' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Not enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 'instance-0000001f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Error code: 32778. 2021-09-10 16:53:16.585 4088 3038338907832 MainThread TRACE nova.compute.manager [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] 2021-09-10 16:53:16.601 4088 3038338907832 MainThread DEBUG nova.compute.utils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] WMI job failed with status 10. Error summary description: 'instance-0000001f' failed to start. Not enough memory in the system to start the virtual machine instance-0000001f. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:53:16.601 4088 3038338907832 MainThread DEBUG nova.compute.manager [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Build of instance 9107836a-481d-4cb5-9c7d-6432f4cd5309 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000001f' failed to start. Not enough memory in the system to start the virtual machine instance-0000001f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000001f' failed to start. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Not enough memory in the system to start the virtual machine instance-0000001f with ram size 1024 megabytes. (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) 'instance-0000001f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B6A8BEA2-C47D-4D3A-8DEC-7BF441547F71) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:53:16.601 4088 3038338907832 MainThread DEBUG nova.compute.manager [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:53:16.601 4088 3038338907832 MainThread DEBUG nova.compute.manager [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:53:16.601 4088 3038338907832 MainThread DEBUG nova.compute.manager [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:53:16.611 4088 3038338907832 MainThread DEBUG nova.network.neutron [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:53:16.858 4088 3038338905192 MainThread DEBUG nova.virt.hyperv.vmops [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:53:16.896 4088 3038338907304 MainThread DEBUG nova.network.neutron [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:53:16.922 4088 3038338907304 MainThread INFO nova.compute.manager [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] [instance: 079b5c5d-fe33-48d2-ba84-de08229901eb] Took 1.19 seconds to deallocate network for instance. 2021-09-10 16:53:17.143 4088 3038338907304 MainThread INFO nova.scheduler.client.report [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Deleted allocations for instance 079b5c5d-fe33-48d2-ba84-de08229901eb 2021-09-10 16:53:17.189 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-694051d5-68cf-4fa0-9b51-cd9e0a53c0a7 fac7f2174628404cb8576928225b4394 fa8236f1477243dfafd0682b608fc659 - default default] Lock "079b5c5d-fe33-48d2-ba84-de08229901eb" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 47.375s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:18.269 4088 3038338907832 MainThread DEBUG nova.network.neutron [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:53:18.297 4088 3038338907832 MainThread INFO nova.compute.manager [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Took 1.69 seconds to deallocate network for instance. 2021-09-10 16:53:18.484 4088 3038338907832 MainThread INFO nova.scheduler.client.report [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Deleted allocations for instance 9107836a-481d-4cb5-9c7d-6432f4cd5309 2021-09-10 16:53:18.530 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-db57e51c-ac83-40a9-bbcb-3db0152ae027 beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "9107836a-481d-4cb5-9c7d-6432f4cd5309" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 31.593s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:21.203 4088 3038338907832 MainThread DEBUG nova.compute.manager [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:21.203 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.vmops [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:21.409 4088 3038338907832 MainThread INFO nova.compute.manager [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] instance snapshotting 2021-09-10 16:53:21.409 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.snapshotops [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Creating snapshot for instance instance-00000017 snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:50 2021-09-10 16:53:21.499 4088 3038338907832 MainThread DEBUG os_win.utils.jobutils [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Waiting for WMI job: {'InstanceID': 'AC89B1E4-C4AD-44D3-A338-45787E081314', 'Description': 'Creating Virtual Machine Checkpoint', 'ElementName': 'Creating Checkpoint', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19327), 'Cancellable': True, 'JobType': 70, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:21.907 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-dfda81f6-27d2-46d9-995c-5024323befc2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Received event network-vif-plugged-2e1238b5-599f-4296-ab7a-cd575fc958c1 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:53:21.907 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-dfda81f6-27d2-46d9-995c-5024323befc2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "f3fbc33e-18d4-47bf-b643-94d2edfcae5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:21.907 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-dfda81f6-27d2-46d9-995c-5024323befc2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "f3fbc33e-18d4-47bf-b643-94d2edfcae5f-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:21.907 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-dfda81f6-27d2-46d9-995c-5024323befc2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Processing event network-vif-plugged-2e1238b5-599f-4296-ab7a-cd575fc958c1 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:53:21.953 4088 3038338906952 MainThread INFO nova.virt.hyperv.vmops [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Using config drive for instance 2021-09-10 16:53:22.332 4088 3038338906952 MainThread INFO nova.virt.hyperv.vmops [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Creating config drive at C:\openstack\instances\instance-00000020\configdrive.iso 2021-09-10 16:53:22.503 4088 3038338906952 MainThread DEBUG oslo_concurrency.processutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000020\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp9j6_g255 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:53:22.897 4088 3038338906952 MainThread DEBUG oslo_concurrency.processutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000020\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp9j6_g255" returned: 0 in 0.391s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:53:23.674 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.vmops [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Setting boot order for instance: instance-00000020: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:53:23.718 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-5763026e-2aa6-4d8b-818e-ecd5edf8181d bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:23.718 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-5763026e-2aa6-4d8b-818e-ecd5edf8181d bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:23.718 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-5763026e-2aa6-4d8b-818e-ecd5edf8181d bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:23.718 4088 3038338908008 MainThread ERROR nova.compute.manager [req-5763026e-2aa6-4d8b-818e-ecd5edf8181d bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Setting instance vm_state to ERROR: NameError: name 'instant' is not defined 2021-09-10 16:53:23.718 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Traceback (most recent call last): 2021-09-10 16:53:23.718 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:53:23.718 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] self._delete_instance(context, instance, bdms) 2021-09-10 16:53:23.718 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:53:23.718 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:53:23.718 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] NameError: name 'instant' is not defined 2021-09-10 16:53:23.718 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] 2021-09-10 16:53:23.780 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-5763026e-2aa6-4d8b-818e-ecd5edf8181d bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a" released by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 0.062s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:23.862 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.vmops [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:53:23.878 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-5763026e-2aa6-4d8b-818e-ecd5edf8181d bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:23.906 4088 3038338906952 MainThread DEBUG os_win.utils.jobutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Waiting for WMI job: {'InstanceID': 'C6E9D735-51B3-429C-975D-724528AB4269', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=27924), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:23.923 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.hostops [req-5763026e-2aa6-4d8b-818e-ecd5edf8181d bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:53:23.942 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.hostops [req-5763026e-2aa6-4d8b-818e-ecd5edf8181d bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:53:24.068 4088 3038338906952 MainThread ERROR os_win.utils.jobutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000020\' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)instance-000000201653F5DC-31AC-4D02-8B07-FF32DE1D023812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)instance-000000201653F5DC-31AC-4D02-8B07-FF32DE1D023810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000020\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)instance-000000201653F5DC-31AC-4D02-8B07-FF32DE1D0238%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C6E9D735-51B3-429C-975D-724528AB4269', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=142486), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 23), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 24), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000020' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)\n\nNot enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)\n\n'instance-00000020' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)", 'ErrorSummaryDescription': "'instance-00000020' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000020.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:24.068 4088 3038338906952 MainThread DEBUG os_win._utils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000020' failed to start. Not enough memory in the system to start the virtual machine instance-00000020. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000020' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Not enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) 'instance-00000020' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.20592403411865234 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:24.187 4088 3038340492632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000020" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:24.202 4088 3038340492632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000020" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:24.202 4088 3038338907304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:24.202 4088 3038338907304 MainThread INFO nova.compute.manager [-] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] VM Stopped (Lifecycle Event) 2021-09-10 16:53:24.218 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-7c16e7d9-3b9b-4a5f-85e7-e84fd446c15a - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:24.218 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-7c16e7d9-3b9b-4a5f-85e7-e84fd446c15a - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:24.240 4088 3038338908008 MainThread DEBUG nova.compute.provider_tree [req-5763026e-2aa6-4d8b-818e-ecd5edf8181d bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:53:24.267 4088 3038338908008 MainThread DEBUG nova.scheduler.client.report [req-5763026e-2aa6-4d8b-818e-ecd5edf8181d bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:53:24.267 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-5763026e-2aa6-4d8b-818e-ecd5edf8181d bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:24.267 4088 3038338908008 MainThread INFO nova.compute.manager [req-5763026e-2aa6-4d8b-818e-ecd5edf8181d bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Successfully reverted task state from deleting on failure for instance. 2021-09-10 16:53:24.267 4088 3038338908008 MainThread ERROR oslo_messaging.rpc.server [req-5763026e-2aa6-4d8b-818e-ecd5edf8181d bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Exception during message handling: NameError: name 'instant' is not defined 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server Traceback (most recent call last): 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 72, in wrapped 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server context, exc, binary) 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server return f(self, context, *args, **kw) 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 184, in decorated_function 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server "Error: %s", e, instance=instance) 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 154, in decorated_function 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\utils.py", line 1433, in decorated_function 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 200, in decorated_function 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3106, in terminate_instance 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server do_terminate_instance(instance, bdms) 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_concurrency\lockutils.py", line 360, in inner 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server return f(*args, **kwargs) 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3104, in do_terminate_instance 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self._set_instance_obj_error_state(instance) 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self._delete_instance(context, instance, bdms) 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server NameError: name 'instant' is not defined 2021-09-10 16:53:24.267 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server 2021-09-10 16:53:24.311 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-7c16e7d9-3b9b-4a5f-85e7-e84fd446c15a - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:24.328 4088 3038338907304 MainThread INFO nova.compute.manager [req-7c16e7d9-3b9b-4a5f-85e7-e84fd446c15a - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:24.436 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-98e8dbe1-1263-4a73-918d-3150bd727179 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Received event network-vif-plugged-f358fb5c-ad42-4d9f-a2b8-3d307d1bdd39 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:53:24.436 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-98e8dbe1-1263-4a73-918d-3150bd727179 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "ecbb6387-a846-41fc-9117-6880e641e5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:24.436 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-98e8dbe1-1263-4a73-918d-3150bd727179 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "ecbb6387-a846-41fc-9117-6880e641e5bd-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:24.436 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-98e8dbe1-1263-4a73-918d-3150bd727179 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Processing event network-vif-plugged-f358fb5c-ad42-4d9f-a2b8-3d307d1bdd39 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:53:24.468 4088 3038338905192 MainThread INFO nova.virt.hyperv.vmops [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Using config drive for instance 2021-09-10 16:53:24.985 4088 3038338905192 MainThread INFO nova.virt.hyperv.vmops [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Creating config drive at C:\openstack\instances\instance-00000021\configdrive.iso 2021-09-10 16:53:25.092 4088 3038338905192 MainThread DEBUG oslo_concurrency.processutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000021\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp6jvxn3q0 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:53:25.422 4088 3038338906952 MainThread DEBUG os_win.utils.jobutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Waiting for WMI job: {'InstanceID': 'C5314A3A-BB91-4A0F-94F1-9C3EBA85B0A8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18619), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:25.504 4088 3038338905192 MainThread DEBUG oslo_concurrency.processutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000021\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp6jvxn3q0" returned: 0 in 0.406s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:53:25.592 4088 3038338906952 MainThread ERROR os_win.utils.jobutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000020\' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)instance-000000201653F5DC-31AC-4D02-8B07-FF32DE1D023812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)instance-000000201653F5DC-31AC-4D02-8B07-FF32DE1D023810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000020\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)instance-000000201653F5DC-31AC-4D02-8B07-FF32DE1D0238%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C5314A3A-BB91-4A0F-94F1-9C3EBA85B0A8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=127755), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 25), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 25), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000020' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)\n\nNot enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)\n\n'instance-00000020' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)", 'ErrorSummaryDescription': "'instance-00000020' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000020.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:25.592 4088 3038338906952 MainThread DEBUG os_win._utils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000020' failed to start. Not enough memory in the system to start the virtual machine instance-00000020. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000020' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Not enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) 'instance-00000020' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.7296123504638672 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:25.640 4088 3038338908008 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:25.640 4088 3038338908008 MainThread INFO nova.compute.manager [-] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] VM Stopped (Lifecycle Event) 2021-09-10 16:53:25.640 4088 3038340492632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000020" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:25.640 4088 3038340492632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000020" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:25.659 4088 3038338907832 MainThread DEBUG os_win.utils.jobutils [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] WMI job succeeded: {'InstanceID': 'AC89B1E4-C4AD-44D3-A338-45787E081314', 'Description': 'Creating Virtual Machine Checkpoint', 'ElementName': 'Creating Checkpoint', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(seconds=4, microseconds=39981), 'Cancellable': True, 'JobType': 70, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:53:25.659 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-42cdcaa2-ccc1-4588-ae56-e97709e4f930 - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:25.659 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-42cdcaa2-ccc1-4588-ae56-e97709e4f930 - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:25.734 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-42cdcaa2-ccc1-4588-ae56-e97709e4f930 - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:25.765 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.snapshotops [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Getting info for VHD C:\openstack\instances\instance-00000017\root.vhdx snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:59 2021-09-10 16:53:25.765 4088 3038338908008 MainThread INFO nova.compute.manager [req-42cdcaa2-ccc1-4588-ae56-e97709e4f930 - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:25.795 4088 3038338907832 MainThread DEBUG os_win.utils.pathutils [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Creating directory: C:\openstack\instances\export\instance-00000017 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:53:25.795 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.snapshotops [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Copying VHD C:\openstack\instances\instance-00000017\root.vhdx to C:\openstack\instances\export\instance-00000017\root.vhdx snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:69 2021-09-10 16:53:26.031 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.snapshotops [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Copying base disk C:\openstack\instances\instance-00000017\root.vhdx to C:\openstack\instances\export\instance-00000017\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:81 2021-09-10 16:53:26.234 4088 3038338905192 MainThread DEBUG nova.virt.hyperv.vmops [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Setting boot order for instance: instance-00000021: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:53:26.374 4088 3038338905192 MainThread DEBUG nova.virt.hyperv.vmops [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:53:26.420 4088 3038338905192 MainThread DEBUG os_win.utils.jobutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': '1AAD1BFB-23C0-450F-85EC-6E2422829333', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20362), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:26.671 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000021" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:26.671 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000021" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:26.671 4088 3038338908008 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:26.671 4088 3038338908008 MainThread INFO nova.compute.manager [-] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] VM Stopped (Lifecycle Event) 2021-09-10 16:53:26.692 4088 3038338905192 MainThread ERROR os_win.utils.jobutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000021\' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)instance-000000210868F3D8-8C54-4B09-8977-A0DFE5345F0512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)instance-000000210868F3D8-8C54-4B09-8977-A0DFE5345F0510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000021\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)instance-000000210868F3D8-8C54-4B09-8977-A0DFE5345F05%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1AAD1BFB-23C0-450F-85EC-6E2422829333', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=150804), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 26), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 26), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000021' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)\n\nNot enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)\n\n'instance-00000021' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)", 'ErrorSummaryDescription': "'instance-00000021' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000021.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:26.692 4088 3038338905192 MainThread DEBUG os_win._utils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000021' failed to start. Not enough memory in the system to start the virtual machine instance-00000021. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000021' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Not enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) 'instance-00000021' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.31797027587890625 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:26.692 4088 3038338906952 MainThread DEBUG os_win.utils.jobutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Waiting for WMI job: {'InstanceID': '9EC0EE8B-E88B-4957-92E3-6EF1D366240A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=31895), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:26.703 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-1aa9644d-b58b-435d-98ad-50d4ed9d525f - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:26.703 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-1aa9644d-b58b-435d-98ad-50d4ed9d525f - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:26.764 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-1aa9644d-b58b-435d-98ad-50d4ed9d525f - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:26.796 4088 3038338908008 MainThread INFO nova.compute.manager [req-1aa9644d-b58b-435d-98ad-50d4ed9d525f - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:26.858 4088 3038338906952 MainThread ERROR os_win.utils.jobutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000020\' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)instance-000000201653F5DC-31AC-4D02-8B07-FF32DE1D023812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)instance-000000201653F5DC-31AC-4D02-8B07-FF32DE1D023810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000020\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)instance-000000201653F5DC-31AC-4D02-8B07-FF32DE1D0238%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9EC0EE8B-E88B-4957-92E3-6EF1D366240A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=128078), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 26), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 26), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000020' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)\n\nNot enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)\n\n'instance-00000020' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)", 'ErrorSummaryDescription': "'instance-00000020' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000020.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:26.858 4088 3038338906952 MainThread DEBUG os_win._utils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000020' failed to start. Not enough memory in the system to start the virtual machine instance-00000020. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000020' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Not enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) 'instance-00000020' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.9959139823913574 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:26.893 4088 3038338908008 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:26.893 4088 3038338908008 MainThread INFO nova.compute.manager [-] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] VM Stopped (Lifecycle Event) 2021-09-10 16:53:26.908 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000020" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:26.908 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000020" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:26.948 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-6c524355-dd72-461c-bd1e-854b566d8df4 - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:26.954 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-6c524355-dd72-461c-bd1e-854b566d8df4 - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:26.968 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-8742dabf-79b8-4e40-ad85-5c1aa714b5ae bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:26.968 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-8742dabf-79b8-4e40-ad85-5c1aa714b5ae bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:26.968 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-8742dabf-79b8-4e40-ad85-5c1aa714b5ae bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:26.968 4088 3038338907304 MainThread ERROR nova.compute.manager [req-8742dabf-79b8-4e40-ad85-5c1aa714b5ae bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Setting instance vm_state to ERROR: NameError: name 'instant' is not defined 2021-09-10 16:53:26.968 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Traceback (most recent call last): 2021-09-10 16:53:26.968 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:53:26.968 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] self._delete_instance(context, instance, bdms) 2021-09-10 16:53:26.968 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:53:26.968 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:53:26.968 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] NameError: name 'instant' is not defined 2021-09-10 16:53:26.968 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] 2021-09-10 16:53:27.015 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-6c524355-dd72-461c-bd1e-854b566d8df4 - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:27.030 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-8742dabf-79b8-4e40-ad85-5c1aa714b5ae bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd" released by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 0.062s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:27.045 4088 3038338908008 MainThread INFO nova.compute.manager [req-6c524355-dd72-461c-bd1e-854b566d8df4 - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:27.094 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-f4164458-2c58-4edd-a5a4-f25972db7bf0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "98da4c02-e4db-4a02-a807-c737f9038672" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:27.094 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-f4164458-2c58-4edd-a5a4-f25972db7bf0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "98da4c02-e4db-4a02-a807-c737f9038672-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:27.094 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-f4164458-2c58-4edd-a5a4-f25972db7bf0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "98da4c02-e4db-4a02-a807-c737f9038672-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:27.094 4088 3038338908008 MainThread ERROR nova.compute.manager [req-f4164458-2c58-4edd-a5a4-f25972db7bf0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Setting instance vm_state to ERROR: NameError: name 'instant' is not defined 2021-09-10 16:53:27.094 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Traceback (most recent call last): 2021-09-10 16:53:27.094 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 98da4c02-e4db-4a02-a807-c737f9038672] File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:53:27.094 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 98da4c02-e4db-4a02-a807-c737f9038672] self._delete_instance(context, instance, bdms) 2021-09-10 16:53:27.094 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 98da4c02-e4db-4a02-a807-c737f9038672] File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:53:27.094 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 98da4c02-e4db-4a02-a807-c737f9038672] self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:53:27.094 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 98da4c02-e4db-4a02-a807-c737f9038672] NameError: name 'instant' is not defined 2021-09-10 16:53:27.094 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 98da4c02-e4db-4a02-a807-c737f9038672] 2021-09-10 16:53:27.172 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-8742dabf-79b8-4e40-ad85-5c1aa714b5ae bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:27.190 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-f4164458-2c58-4edd-a5a4-f25972db7bf0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "98da4c02-e4db-4a02-a807-c737f9038672" released by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 0.094s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:27.220 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.hostops [req-8742dabf-79b8-4e40-ad85-5c1aa714b5ae bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:53:27.235 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.hostops [req-8742dabf-79b8-4e40-ad85-5c1aa714b5ae bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:53:27.516 4088 3038338907304 MainThread DEBUG nova.compute.provider_tree [req-8742dabf-79b8-4e40-ad85-5c1aa714b5ae bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:53:27.531 4088 3038338907304 MainThread DEBUG nova.scheduler.client.report [req-8742dabf-79b8-4e40-ad85-5c1aa714b5ae bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:53:27.531 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-8742dabf-79b8-4e40-ad85-5c1aa714b5ae bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:27.531 4088 3038338907304 MainThread INFO nova.compute.manager [req-8742dabf-79b8-4e40-ad85-5c1aa714b5ae bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Successfully reverted task state from deleting on failure for instance. 2021-09-10 16:53:27.531 4088 3038338907304 MainThread ERROR oslo_messaging.rpc.server [req-8742dabf-79b8-4e40-ad85-5c1aa714b5ae bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Exception during message handling: NameError: name 'instant' is not defined 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server Traceback (most recent call last): 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 72, in wrapped 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server context, exc, binary) 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server return f(self, context, *args, **kw) 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 184, in decorated_function 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server "Error: %s", e, instance=instance) 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 154, in decorated_function 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\utils.py", line 1433, in decorated_function 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 200, in decorated_function 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3106, in terminate_instance 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server do_terminate_instance(instance, bdms) 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_concurrency\lockutils.py", line 360, in inner 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server return f(*args, **kwargs) 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3104, in do_terminate_instance 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self._set_instance_obj_error_state(instance) 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self._delete_instance(context, instance, bdms) 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server NameError: name 'instant' is not defined 2021-09-10 16:53:27.531 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server 2021-09-10 16:53:27.549 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-f4164458-2c58-4edd-a5a4-f25972db7bf0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.234s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:27.578 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.hostops [req-f4164458-2c58-4edd-a5a4-f25972db7bf0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:53:27.610 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.hostops [req-f4164458-2c58-4edd-a5a4-f25972db7bf0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:53:27.748 4088 3038338905192 MainThread DEBUG os_win.utils.jobutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': '34619062-2FD9-442A-956C-DEF2865AC410', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=42648), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:27.921 4088 3038338906952 MainThread DEBUG os_win.utils.jobutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Waiting for WMI job: {'InstanceID': '3FEB4414-E608-44A7-BB22-69C832324B06', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=28807), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:27.968 4088 3038338905192 MainThread ERROR os_win.utils.jobutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000021\' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)instance-000000210868F3D8-8C54-4B09-8977-A0DFE5345F0512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)instance-000000210868F3D8-8C54-4B09-8977-A0DFE5345F0510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000021\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)instance-000000210868F3D8-8C54-4B09-8977-A0DFE5345F05%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '34619062-2FD9-442A-956C-DEF2865AC410', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=164947), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 27), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 27), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000021' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)\n\nNot enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)\n\n'instance-00000021' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)", 'ErrorSummaryDescription': "'instance-00000021' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000021.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:27.968 4088 3038338905192 MainThread DEBUG os_win._utils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000021' failed to start. Not enough memory in the system to start the virtual machine instance-00000021. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000021' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Not enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) 'instance-00000021' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.5940544605255127 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:27.986 4088 3038338908008 MainThread DEBUG nova.compute.provider_tree [req-f4164458-2c58-4edd-a5a4-f25972db7bf0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:53:28.000 4088 3038338908008 MainThread DEBUG nova.scheduler.client.report [req-f4164458-2c58-4edd-a5a4-f25972db7bf0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:53:28.000 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-f4164458-2c58-4edd-a5a4-f25972db7bf0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:28.000 4088 3038338908008 MainThread INFO nova.compute.manager [req-f4164458-2c58-4edd-a5a4-f25972db7bf0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Successfully reverted task state from deleting on failure for instance. 2021-09-10 16:53:28.015 4088 3038338908008 MainThread ERROR oslo_messaging.rpc.server [req-f4164458-2c58-4edd-a5a4-f25972db7bf0 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Exception during message handling: NameError: name 'instant' is not defined 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server Traceback (most recent call last): 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 72, in wrapped 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server context, exc, binary) 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server return f(self, context, *args, **kw) 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 184, in decorated_function 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server "Error: %s", e, instance=instance) 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 154, in decorated_function 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\utils.py", line 1433, in decorated_function 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 200, in decorated_function 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3106, in terminate_instance 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server do_terminate_instance(instance, bdms) 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_concurrency\lockutils.py", line 360, in inner 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server return f(*args, **kwargs) 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3104, in do_terminate_instance 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self._set_instance_obj_error_state(instance) 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self._delete_instance(context, instance, bdms) 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server NameError: name 'instant' is not defined 2021-09-10 16:53:28.015 4088 3038338908008 MainThread TRACE oslo_messaging.rpc.server 2021-09-10 16:53:28.015 4088 3038338908008 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:28.015 4088 3038338908008 MainThread INFO nova.compute.manager [-] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] VM Stopped (Lifecycle Event) 2021-09-10 16:53:28.015 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000021" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:28.034 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000021" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:28.053 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-60349d6a-b997-4dc8-a613-b77db405386b - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:28.053 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-60349d6a-b997-4dc8-a613-b77db405386b - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:28.124 4088 3038338906952 MainThread ERROR os_win.utils.jobutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000020\' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)instance-000000201653F5DC-31AC-4D02-8B07-FF32DE1D023812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)instance-000000201653F5DC-31AC-4D02-8B07-FF32DE1D023810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000020\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)instance-000000201653F5DC-31AC-4D02-8B07-FF32DE1D0238%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3FEB4414-E608-44A7-BB22-69C832324B06', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=146326), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 27), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 28), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000020' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)\n\nNot enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)\n\n'instance-00000020' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)", 'ErrorSummaryDescription': "'instance-00000020' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000020.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:28.124 4088 3038338906952 MainThread DEBUG os_win._utils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000020' failed to start. Not enough memory in the system to start the virtual machine instance-00000020. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000020' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Not enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) 'instance-00000020' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 4.261963367462158 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:28.218 4088 3038338907304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:28.218 4088 3038338907304 MainThread INFO nova.compute.manager [-] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] VM Stopped (Lifecycle Event) 2021-09-10 16:53:28.218 4088 3038340492632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000020" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:28.218 4088 3038340492632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000020" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:28.233 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-96317105-ae7f-42d2-9e7c-79683b3e2e22 - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:28.233 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-96317105-ae7f-42d2-9e7c-79683b3e2e22 - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:28.249 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-60349d6a-b997-4dc8-a613-b77db405386b - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:28.272 4088 3038338908008 MainThread INFO nova.compute.manager [req-60349d6a-b997-4dc8-a613-b77db405386b - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:28.300 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-96317105-ae7f-42d2-9e7c-79683b3e2e22 - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:28.328 4088 3038338907304 MainThread INFO nova.compute.manager [req-96317105-ae7f-42d2-9e7c-79683b3e2e22 - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:29.021 4088 3038338905192 MainThread DEBUG os_win.utils.jobutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': '479FC80E-9DDC-40C6-A1FA-D7F6618BE01C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=29529), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:29.021 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.snapshotops [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Reconnecting copied base VHD C:\openstack\instances\export\instance-00000017\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx and diff VHD C:\openstack\instances\export\instance-00000017\root.vhdx snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:89 2021-09-10 16:53:29.174 4088 3038338906952 MainThread DEBUG os_win.utils.jobutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Waiting for WMI job: {'InstanceID': '584FB1FD-A959-49FA-9B23-8BEA66A6CE30', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20726), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:29.264 4088 3038338905192 MainThread ERROR os_win.utils.jobutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000021\' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)instance-000000210868F3D8-8C54-4B09-8977-A0DFE5345F0512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)instance-000000210868F3D8-8C54-4B09-8977-A0DFE5345F0510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000021\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)instance-000000210868F3D8-8C54-4B09-8977-A0DFE5345F05%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '479FC80E-9DDC-40C6-A1FA-D7F6618BE01C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=151904), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 28), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 29), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000021' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)\n\nNot enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)\n\n'instance-00000021' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)", 'ErrorSummaryDescription': "'instance-00000021' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000021.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:29.264 4088 3038338905192 MainThread DEBUG os_win._utils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000021' failed to start. Not enough memory in the system to start the virtual machine instance-00000021. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000021' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Not enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) 'instance-00000021' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.889941930770874 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:29.328 4088 3038338906952 MainThread ERROR os_win.utils.jobutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000020\' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)instance-000000201653F5DC-31AC-4D02-8B07-FF32DE1D023812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)instance-000000201653F5DC-31AC-4D02-8B07-FF32DE1D023810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000020\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)instance-000000201653F5DC-31AC-4D02-8B07-FF32DE1D0238%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '584FB1FD-A959-49FA-9B23-8BEA66A6CE30', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=137973), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 29), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 29), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000020' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)\n\nNot enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)\n\n'instance-00000020' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)", 'ErrorSummaryDescription': "'instance-00000020' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000020.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:29.328 4088 3038338906952 MainThread DEBUG os_win._utils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000020' failed to start. Not enough memory in the system to start the virtual machine instance-00000020. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000020' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Not enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) 'instance-00000020' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.465539216995239 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:29.519 4088 3038338907304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:29.563 4088 3038338907304 MainThread INFO nova.compute.manager [-] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] VM Stopped (Lifecycle Event) 2021-09-10 16:53:29.563 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000021" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:29.563 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000021" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:29.577 4088 3038338908008 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:29.577 4088 3038338908008 MainThread INFO nova.compute.manager [-] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] VM Stopped (Lifecycle Event) 2021-09-10 16:53:29.577 4088 3038340492632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000020" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:29.577 4088 3038340492632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000020" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:29.594 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-33c2fd5d-7a59-47ab-b984-a1076b1b7bca - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:29.594 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-33c2fd5d-7a59-47ab-b984-a1076b1b7bca - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:29.608 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-a62b4357-581b-49f6-a2f8-d0f734a0da84 - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:29.608 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-a62b4357-581b-49f6-a2f8-d0f734a0da84 - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:29.658 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-a62b4357-581b-49f6-a2f8-d0f734a0da84 - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:29.658 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-33c2fd5d-7a59-47ab-b984-a1076b1b7bca - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:29.673 4088 3038338908008 MainThread INFO nova.compute.manager [req-a62b4357-581b-49f6-a2f8-d0f734a0da84 - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:29.673 4088 3038338907304 MainThread INFO nova.compute.manager [req-33c2fd5d-7a59-47ab-b984-a1076b1b7bca - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:30.317 4088 3038338905192 MainThread DEBUG os_win.utils.jobutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': 'A1D633DC-D2A3-4516-91CD-5808BA49A556', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20061), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:30.389 4088 3038338906952 MainThread DEBUG os_win.utils.jobutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Waiting for WMI job: {'InstanceID': '511C873D-62B9-49D9-8A0A-6624683717E3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=22908), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:30.420 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-cf787ec5-e1f7-4302-b44b-08df3c6796a2 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:30.420 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-cf787ec5-e1f7-4302-b44b-08df3c6796a2 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:30.420 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-cf787ec5-e1f7-4302-b44b-08df3c6796a2 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:30.420 4088 3038338907304 MainThread ERROR nova.compute.manager [req-cf787ec5-e1f7-4302-b44b-08df3c6796a2 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Setting instance vm_state to ERROR: NameError: name 'instant' is not defined 2021-09-10 16:53:30.420 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Traceback (most recent call last): 2021-09-10 16:53:30.420 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:53:30.420 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] self._delete_instance(context, instance, bdms) 2021-09-10 16:53:30.420 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:53:30.420 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:53:30.420 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] NameError: name 'instant' is not defined 2021-09-10 16:53:30.420 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] 2021-09-10 16:53:30.514 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-cf787ec5-e1f7-4302-b44b-08df3c6796a2 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029" released by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 0.094s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:30.610 4088 3038338905192 MainThread ERROR os_win.utils.jobutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000021\' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)instance-000000210868F3D8-8C54-4B09-8977-A0DFE5345F0512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)instance-000000210868F3D8-8C54-4B09-8977-A0DFE5345F0510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000021\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)instance-000000210868F3D8-8C54-4B09-8977-A0DFE5345F05%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A1D633DC-D2A3-4516-91CD-5808BA49A556', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=146581), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 30), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 30), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000021' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)\n\nNot enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)\n\n'instance-00000021' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)", 'ErrorSummaryDescription': "'instance-00000021' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000021.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:30.610 4088 3038338905192 MainThread DEBUG os_win._utils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000021' failed to start. Not enough memory in the system to start the virtual machine instance-00000021. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000021' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Not enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) 'instance-00000021' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 4.236237049102783 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:30.624 4088 3038338908008 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:30.624 4088 3038338908008 MainThread INFO nova.compute.manager [-] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] VM Stopped (Lifecycle Event) 2021-09-10 16:53:30.624 4088 3038340492632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000021" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:30.624 4088 3038340492632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000021" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:30.639 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-ea37e05f-c9e9-4789-9e80-cd39bbafbf27 - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:30.639 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-ea37e05f-c9e9-4789-9e80-cd39bbafbf27 - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:30.655 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-cf787ec5-e1f7-4302-b44b-08df3c6796a2 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:30.671 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.hostops [req-cf787ec5-e1f7-4302-b44b-08df3c6796a2 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:53:30.671 4088 3038338906952 MainThread ERROR os_win.utils.jobutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000020\' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)instance-000000201653F5DC-31AC-4D02-8B07-FF32DE1D023812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)instance-000000201653F5DC-31AC-4D02-8B07-FF32DE1D023810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000020\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)instance-000000201653F5DC-31AC-4D02-8B07-FF32DE1D0238%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '511C873D-62B9-49D9-8A0A-6624683717E3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=224742), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 30), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 30), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000020' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)\n\nNot enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)\n\n'instance-00000020' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238)", 'ErrorSummaryDescription': "'instance-00000020' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000020.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:30.671 4088 3038338906952 MainThread ERROR nova.virt.hyperv.vmops [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Failed to change vm state of instance-00000020 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000020' failed to start. 2021-09-10 16:53:30.671 4088 3038338906952 MainThread INFO nova.virt.hyperv.vmops [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Got request to destroy instance 2021-09-10 16:53:30.702 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.hostops [req-cf787ec5-e1f7-4302-b44b-08df3c6796a2 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:53:30.781 4088 3038340492808 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000020" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:30.781 4088 3038340492808 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000020" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:30.781 4088 3038340492632 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:30.781 4088 3038340492632 MainThread INFO nova.compute.manager [-] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] VM Stopped (Lifecycle Event) 2021-09-10 16:53:30.814 4088 3038340492632 MainThread DEBUG nova.compute.manager [req-8dcf66bd-5d05-419f-9c8d-635870c100ba - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:30.814 4088 3038340492632 MainThread DEBUG nova.virt.hyperv.vmops [req-8dcf66bd-5d05-419f-9c8d-635870c100ba - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:30.814 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-ea37e05f-c9e9-4789-9e80-cd39bbafbf27 - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:30.834 4088 3038338908008 MainThread INFO nova.compute.manager [req-ea37e05f-c9e9-4789-9e80-cd39bbafbf27 - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:30.913 4088 3038340492632 MainThread DEBUG nova.compute.manager [req-8dcf66bd-5d05-419f-9c8d-635870c100ba - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:30.937 4088 3038340492632 MainThread INFO nova.compute.manager [req-8dcf66bd-5d05-419f-9c8d-635870c100ba - - - - -] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:31.092 4088 3038338907304 MainThread DEBUG nova.compute.provider_tree [req-cf787ec5-e1f7-4302-b44b-08df3c6796a2 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:53:31.124 4088 3038338907304 MainThread DEBUG nova.scheduler.client.report [req-cf787ec5-e1f7-4302-b44b-08df3c6796a2 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:53:31.124 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-cf787ec5-e1f7-4302-b44b-08df3c6796a2 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:31.124 4088 3038338907304 MainThread INFO nova.compute.manager [req-cf787ec5-e1f7-4302-b44b-08df3c6796a2 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Successfully reverted task state from deleting on failure for instance. 2021-09-10 16:53:31.124 4088 3038338907304 MainThread ERROR oslo_messaging.rpc.server [req-cf787ec5-e1f7-4302-b44b-08df3c6796a2 bf4dce0601aa49c0b9ea6c48f2953557 3ae864ac350142778dcbcb12a8b3800e - default default] Exception during message handling: NameError: name 'instant' is not defined 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server Traceback (most recent call last): 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 72, in wrapped 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server context, exc, binary) 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server return f(self, context, *args, **kw) 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 184, in decorated_function 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server "Error: %s", e, instance=instance) 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 154, in decorated_function 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\utils.py", line 1433, in decorated_function 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 200, in decorated_function 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3106, in terminate_instance 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server do_terminate_instance(instance, bdms) 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_concurrency\lockutils.py", line 360, in inner 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server return f(*args, **kwargs) 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3104, in do_terminate_instance 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self._set_instance_obj_error_state(instance) 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self._delete_instance(context, instance, bdms) 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server NameError: name 'instant' is not defined 2021-09-10 16:53:31.124 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server 2021-09-10 16:53:31.218 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.snapshotops [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Merging diff disk C:\openstack\instances\export\instance-00000017\root.vhdx into its parent. snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:94 2021-09-10 16:53:31.561 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:53:31.561 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:53:31.640 4088 3038338905192 MainThread DEBUG os_win.utils.jobutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': 'BB952508-37CE-43D5-9A55-F62292198216', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17778), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:31.801 4088 3038338905192 MainThread ERROR os_win.utils.jobutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000021\' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)instance-000000210868F3D8-8C54-4B09-8977-A0DFE5345F0512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)instance-000000210868F3D8-8C54-4B09-8977-A0DFE5345F0510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000021\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)instance-000000210868F3D8-8C54-4B09-8977-A0DFE5345F05%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BB952508-37CE-43D5-9A55-F62292198216', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=124315), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 31), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 31), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000021' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)\n\nNot enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)\n\n'instance-00000021' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)", 'ErrorSummaryDescription': "'instance-00000021' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000021.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:31.801 4088 3038338905192 MainThread DEBUG os_win._utils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000021' failed to start. Not enough memory in the system to start the virtual machine instance-00000021. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000021' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Not enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) 'instance-00000021' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.426735162734985 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:53:31.876 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000021" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:31.876 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000021" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:31.876 4088 3038338907304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:31.876 4088 3038338907304 MainThread INFO nova.compute.manager [-] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] VM Stopped (Lifecycle Event) 2021-09-10 16:53:31.916 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-c8916fe3-032c-4640-8b41-d1c159ee1cc5 - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:31.916 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-c8916fe3-032c-4640-8b41-d1c159ee1cc5 - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:31.953 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-c8916fe3-032c-4640-8b41-d1c159ee1cc5 - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:32.001 4088 3038338907304 MainThread INFO nova.compute.manager [req-c8916fe3-032c-4640-8b41-d1c159ee1cc5 - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:32.070 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-15f7439a-604e-4a2d-a86a-b0fe75083e59 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Received event network-vif-plugged-f581c585-39ab-4120-a040-5d92bb401a6c external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:53:32.070 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-15f7439a-604e-4a2d-a86a-b0fe75083e59 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9446e666-4364-4dcd-b041-405653a856bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:32.070 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-15f7439a-604e-4a2d-a86a-b0fe75083e59 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9446e666-4364-4dcd-b041-405653a856bd-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:32.070 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-15f7439a-604e-4a2d-a86a-b0fe75083e59 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] No waiting events found dispatching network-vif-plugged-f581c585-39ab-4120-a040-5d92bb401a6c pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 16:53:32.070 4088 3038338907304 MainThread WARNING nova.compute.manager [req-15f7439a-604e-4a2d-a86a-b0fe75083e59 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Received unexpected event network-vif-plugged-f581c585-39ab-4120-a040-5d92bb401a6c for instance with vm_state active and task_state image_pending_upload. 2021-09-10 16:53:32.205 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.snapshotops [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Updating Glance image b5a5c200-6595-4ce3-8ee2-fdac3bb3c8a7 with content from merged disk C:\openstack\instances\export\instance-00000017\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:100 2021-09-10 16:53:32.560 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:53:32.560 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 16:53:32.889 4088 3038338905192 MainThread DEBUG os_win.utils.jobutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': '731A6014-C6A9-4951-9C43-A22F92360777', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=25073), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:33.046 4088 3038338905192 MainThread ERROR os_win.utils.jobutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000021\' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)instance-000000210868F3D8-8C54-4B09-8977-A0DFE5345F0512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)instance-000000210868F3D8-8C54-4B09-8977-A0DFE5345F0510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000021\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)instance-000000210868F3D8-8C54-4B09-8977-A0DFE5345F05%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '731A6014-C6A9-4951-9C43-A22F92360777', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=131975), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 53, 32), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 53, 32), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000021' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)\n\nNot enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)\n\n'instance-00000021' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05)", 'ErrorSummaryDescription': "'instance-00000021' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000021.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:53:33.046 4088 3038338905192 MainThread ERROR nova.virt.hyperv.vmops [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Failed to change vm state of instance-00000021 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000021' failed to start. 2021-09-10 16:53:33.046 4088 3038338905192 MainThread INFO nova.virt.hyperv.vmops [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Got request to destroy instance 2021-09-10 16:53:33.093 4088 3038340492808 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:53:33.093 4088 3038340492808 MainThread INFO nova.compute.manager [-] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] VM Stopped (Lifecycle Event) 2021-09-10 16:53:33.093 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000021" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:33.093 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000021" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:33.126 4088 3038340492808 MainThread DEBUG nova.compute.manager [req-d014b430-d0fe-490f-83ee-76ebd6f327eb - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:53:33.126 4088 3038340492808 MainThread DEBUG nova.virt.hyperv.vmops [req-d014b430-d0fe-490f-83ee-76ebd6f327eb - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:53:33.190 4088 3038340492808 MainThread DEBUG nova.compute.manager [req-d014b430-d0fe-490f-83ee-76ebd6f327eb - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:53:33.236 4088 3038340492808 MainThread INFO nova.compute.manager [req-d014b430-d0fe-490f-83ee-76ebd6f327eb - - - - -] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:53:33.413 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.vmops [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:53:33.413 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Lock "instance-00000020" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:33.413 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Lock "instance-00000020" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:33.436 4088 3038338906952 MainThread DEBUG os_win.utils.compute.vmutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Successfully changed vm state of instance-00000020 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:53:33.436 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.vmops [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Successfully changed state of VM instance-00000020 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:53:33.483 4088 3038338906952 MainThread DEBUG os_win.utils.jobutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Waiting for WMI job: {'InstanceID': '227137C9-0B39-41F5-9202-16B0863598EC', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16665), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:33.563 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:53:33.563 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:53:33.844 4088 3038338906952 MainThread DEBUG os_win.utils.jobutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] WMI job succeeded: {'InstanceID': '227137C9-0B39-41F5-9202-16B0863598EC', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=308091), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:53:33.863 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Lock "instance-00000020" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:33.863 4088 3038338906952 MainThread DEBUG os_win.utils.pathutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Removing directory: C:\openstack\instances\instance-00000020 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:53:33.863 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Lock "instance-00000020" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:33.863 4088 3038338906952 MainThread ERROR nova.compute.manager [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000020' failed to start. Not enough memory in the system to start the virtual machine instance-00000020. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000020' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Not enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) 'instance-00000020' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Error code: 32778. 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Traceback (most recent call last): 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] return function(*args, **kwargs) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] admin_password, network_info, block_device_info) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] return function(self, *args, **kwds) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self.force_reraise() 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] raise self.value 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] should_plug_vifs=False) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 'req_state': req_state}) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self.force_reraise() 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] raise self.value 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] time.sleep(sleep_time) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self.force_reraise() 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] raise self.value 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] return f(*args, **kwargs) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] return self._wait_for_job(job_path) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] error_desc=err_desc) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000020' failed to start. 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Not enough memory in the system to start the virtual machine instance-00000020. 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000020' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Not enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 'instance-00000020' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Error code: 32778. 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] During handling of the above exception, another exception occurred: 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Traceback (most recent call last): 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] yield resources 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] accel_info=accel_info) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] return function(*args, **kwargs) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] admin_password, network_info, block_device_info) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] return function(self, *args, **kwds) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self.force_reraise() 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] raise self.value 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] should_plug_vifs=False) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 'req_state': req_state}) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self.force_reraise() 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] raise self.value 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] time.sleep(sleep_time) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self.force_reraise() 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] raise self.value 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] return f(*args, **kwargs) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] return self._wait_for_job(job_path) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] error_desc=err_desc) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000020' failed to start. 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Not enough memory in the system to start the virtual machine instance-00000020. 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000020' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Not enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 'instance-00000020' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Error code: 32778. 2021-09-10 16:53:33.863 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:33.863 4088 3038338906952 MainThread INFO nova.compute.manager [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Terminating instance 2021-09-10 16:53:33.863 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:53:33.875 4088 3038338906952 MainThread INFO nova.virt.hyperv.vmops [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Got request to destroy instance 2021-09-10 16:53:33.889 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.vmops [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:53:33.889 4088 3038338906952 MainThread DEBUG os_brick.initiator.windows.iscsi [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-f5252e88-87bd-471e-b572-a8d70f3c3790', 'target_lun': 0, 'volume_id': 'f5252e88-87bd-471e-b572-a8d70f3c3790', 'auth_method': 'CHAP', 'auth_username': 'nVSjUhEE86QfhZaDKiyx', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:53:33.889 4088 3038338906952 MainThread DEBUG os_win.utils.storage.diskutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 16:53:34.014 4088 3038338906952 MainThread DEBUG os_win.utils.storage.diskutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 16:53:34.034 4088 3038338906952 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-f5252e88-87bd-471e-b572-a8d70f3c3790 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 16:53:34.087 4088 3038338906952 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Removing iSCSI target persistent login: iqn.2010-10.org.openstack:volume-f5252e88-87bd-471e-b572-a8d70f3c3790 _remove_target_persistent_logins c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:495 2021-09-10 16:53:34.093 4088 3038338906952 MainThread DEBUG os_brick.initiator.windows.iscsi [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] <== disconnect_volume: return (204ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:53:34.093 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Lock "instance-00000020" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:34.093 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Lock "instance-00000020" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:34.093 4088 3038338906952 MainThread INFO nova.compute.manager [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Took 0.22 seconds to destroy the instance on the hypervisor. 2021-09-10 16:53:34.561 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:53:34.561 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 16:53:35.406 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:53:35.406 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 16:53:35.423 4088 3038338905192 MainThread DEBUG nova.virt.hyperv.vmops [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:53:35.423 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000021" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:35.423 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000021" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:35.452 4088 3038338905192 MainThread DEBUG os_win.utils.compute.vmutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Successfully changed vm state of instance-00000021 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:53:35.452 4088 3038338905192 MainThread DEBUG nova.virt.hyperv.vmops [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Successfully changed state of VM instance-00000021 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:53:35.514 4088 3038338905192 MainThread DEBUG os_win.utils.jobutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': 'D74837DE-3827-4E86-8044-A5F16DB54C27', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18037), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:35.766 4088 3038338905192 MainThread DEBUG os_win.utils.jobutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job succeeded: {'InstanceID': 'D74837DE-3827-4E86-8044-A5F16DB54C27', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=167513), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:53:35.766 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000021" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:35.766 4088 3038338905192 MainThread DEBUG os_win.utils.pathutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Removing directory: C:\openstack\instances\instance-00000021 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:53:35.766 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000021" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:35.766 4088 3038338905192 MainThread ERROR nova.compute.manager [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000021' failed to start. Not enough memory in the system to start the virtual machine instance-00000021. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000021' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Not enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) 'instance-00000021' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Error code: 32778. 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Traceback (most recent call last): 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] return function(*args, **kwargs) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] admin_password, network_info, block_device_info) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] return function(self, *args, **kwds) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self.force_reraise() 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] raise self.value 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] should_plug_vifs=False) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 'req_state': req_state}) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self.force_reraise() 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] raise self.value 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] time.sleep(sleep_time) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self.force_reraise() 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] raise self.value 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] return f(*args, **kwargs) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] return self._wait_for_job(job_path) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] error_desc=err_desc) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000021' failed to start. 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Not enough memory in the system to start the virtual machine instance-00000021. 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000021' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Not enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 'instance-00000021' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Error code: 32778. 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] During handling of the above exception, another exception occurred: 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Traceback (most recent call last): 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] yield resources 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] accel_info=accel_info) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] return function(*args, **kwargs) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] admin_password, network_info, block_device_info) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] return function(self, *args, **kwds) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self.force_reraise() 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] raise self.value 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] should_plug_vifs=False) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 'req_state': req_state}) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self.force_reraise() 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] raise self.value 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] time.sleep(sleep_time) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self.force_reraise() 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] raise self.value 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] return f(*args, **kwargs) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] return self._wait_for_job(job_path) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] error_desc=err_desc) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000021' failed to start. 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Not enough memory in the system to start the virtual machine instance-00000021. 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000021' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Not enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 'instance-00000021' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Error code: 32778. 2021-09-10 16:53:35.766 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:35.766 4088 3038338905192 MainThread INFO nova.compute.manager [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Terminating instance 2021-09-10 16:53:35.766 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:53:35.766 4088 3038338905192 MainThread INFO nova.virt.hyperv.vmops [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Got request to destroy instance 2021-09-10 16:53:35.799 4088 3038338905192 MainThread DEBUG nova.virt.hyperv.vmops [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:53:35.799 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000021" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:35.799 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000021" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:35.799 4088 3038338905192 MainThread INFO nova.compute.manager [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 16:53:35.799 4088 3038338905192 MainThread DEBUG nova.compute.claims [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:53:35.799 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:36.016 4088 3038338905192 MainThread DEBUG nova.virt.hyperv.hostops [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:53:36.047 4088 3038338905192 MainThread DEBUG nova.virt.hyperv.hostops [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:53:36.296 4088 3038338905192 MainThread DEBUG nova.compute.provider_tree [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:53:36.327 4088 3038338905192 MainThread DEBUG nova.scheduler.client.report [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:53:36.327 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.531s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:36.327 4088 3038338905192 MainThread ERROR nova.compute.manager [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000021' failed to start. Not enough memory in the system to start the virtual machine instance-00000021. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000021' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Not enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) 'instance-00000021' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Error code: 32778. 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Traceback (most recent call last): 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] return function(*args, **kwargs) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] admin_password, network_info, block_device_info) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] return function(self, *args, **kwds) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self.force_reraise() 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] raise self.value 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] should_plug_vifs=False) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 'req_state': req_state}) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self.force_reraise() 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] raise self.value 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] time.sleep(sleep_time) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self.force_reraise() 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] raise self.value 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] return f(*args, **kwargs) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] return self._wait_for_job(job_path) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] error_desc=err_desc) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000021' failed to start. 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Not enough memory in the system to start the virtual machine instance-00000021. 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000021' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Not enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 'instance-00000021' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Error code: 32778. 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] During handling of the above exception, another exception occurred: 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Traceback (most recent call last): 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] accel_info=accel_info) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] return function(*args, **kwargs) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] admin_password, network_info, block_device_info) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] return function(self, *args, **kwds) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self.force_reraise() 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] raise self.value 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] should_plug_vifs=False) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 'req_state': req_state}) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self.force_reraise() 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] raise self.value 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] time.sleep(sleep_time) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self.force_reraise() 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] raise self.value 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] return f(*args, **kwargs) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] return self._wait_for_job(job_path) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] error_desc=err_desc) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000021' failed to start. 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Not enough memory in the system to start the virtual machine instance-00000021. 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000021' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Not enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 'instance-00000021' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Error code: 32778. 2021-09-10 16:53:36.327 4088 3038338905192 MainThread TRACE nova.compute.manager [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] 2021-09-10 16:53:36.327 4088 3038338905192 MainThread DEBUG nova.compute.utils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] WMI job failed with status 10. Error summary description: 'instance-00000021' failed to start. Not enough memory in the system to start the virtual machine instance-00000021. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:53:36.327 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Build of instance ecbb6387-a846-41fc-9117-6880e641e5bd was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000021' failed to start. Not enough memory in the system to start the virtual machine instance-00000021. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000021' failed to start. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Not enough memory in the system to start the virtual machine instance-00000021 with ram size 1024 megabytes. (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) 'instance-00000021' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0868F3D8-8C54-4B09-8977-A0DFE5345F05) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:53:36.327 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:53:36.327 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:53:36.327 4088 3038338905192 MainThread DEBUG nova.compute.manager [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:53:36.327 4088 3038338905192 MainThread DEBUG nova.network.neutron [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:53:37.045 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Updating instance_info_cache with network_info: [{"id": "83b451dc-a198-4ccd-9f65-c8fe6343aea3", "address": "fa:16:3e:44:7f:92", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap83b451dc-a1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:53:37.080 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:53:37.080 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 16:53:37.080 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:53:37.080 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:53:37.080 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:53:37.124 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:37.124 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:37.124 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 16:53:37.124 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:53:37.139 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:53:37.394 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=1578MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 16:53:37.394 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:37.739 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:53:37.739 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:53:37.739 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:53:37.748 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:53:37.748 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:53:37.748 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:53:37.748 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:53:37.748 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:53:37.748 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance f3fbc33e-18d4-47bf-b643-94d2edfcae5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:53:37.748 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:53:37.748 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:53:37.748 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:53:37.748 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:53:37.748 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:53:37.780 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ecbb6387-a846-41fc-9117-6880e641e5bd has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1591 2021-09-10 16:53:37.780 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 16:53:37.780 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 16:53:37.810 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:53:37.835 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:53:37.938 4088 3038340492632 MainThread DEBUG nova.compute.manager [req-aa5163bd-3f69-4f20-8d90-6c4802f10532 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Received event network-vif-unplugged-2e1238b5-599f-4296-ab7a-cd575fc958c1 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:53:37.938 4088 3038340492632 MainThread DEBUG oslo_concurrency.lockutils [req-aa5163bd-3f69-4f20-8d90-6c4802f10532 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "f3fbc33e-18d4-47bf-b643-94d2edfcae5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:37.938 4088 3038340492632 MainThread DEBUG oslo_concurrency.lockutils [req-aa5163bd-3f69-4f20-8d90-6c4802f10532 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "f3fbc33e-18d4-47bf-b643-94d2edfcae5f-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:37.938 4088 3038340492632 MainThread DEBUG nova.compute.manager [req-aa5163bd-3f69-4f20-8d90-6c4802f10532 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] No waiting events found dispatching network-vif-unplugged-2e1238b5-599f-4296-ab7a-cd575fc958c1 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 16:53:37.938 4088 3038340492632 MainThread WARNING nova.compute.manager [req-aa5163bd-3f69-4f20-8d90-6c4802f10532 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Received unexpected event network-vif-unplugged-2e1238b5-599f-4296-ab7a-cd575fc958c1 for instance with vm_state building and task_state spawning. 2021-09-10 16:53:38.078 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:53:38.093 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:53:38.093 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 16:53:38.093 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.703s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:38.364 4088 3038338905192 MainThread DEBUG nova.network.neutron [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:53:38.404 4088 3038338905192 MainThread INFO nova.compute.manager [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: ecbb6387-a846-41fc-9117-6880e641e5bd] Took 2.08 seconds to deallocate network for instance. 2021-09-10 16:53:38.796 4088 3038338905192 MainThread INFO nova.scheduler.client.report [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Deleted allocations for instance ecbb6387-a846-41fc-9117-6880e641e5bd 2021-09-10 16:53:38.843 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [req-cf04c780-a4c1-49ad-8018-7fe6422c33e6 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "ecbb6387-a846-41fc-9117-6880e641e5bd" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 30.063s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:41.690 4088 3038338906952 MainThread INFO nova.compute.manager [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Took 7.59 seconds to detach 1 volumes for instance. 2021-09-10 16:53:41.690 4088 3038338906952 MainThread DEBUG nova.compute.claims [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:53:41.690 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:53:41.927 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.hostops [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:53:41.938 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.hostops [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:53:42.190 4088 3038338906952 MainThread DEBUG nova.compute.provider_tree [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:53:42.218 4088 3038338906952 MainThread DEBUG nova.scheduler.client.report [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:53:42.218 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.531s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:42.218 4088 3038338906952 MainThread ERROR nova.compute.manager [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000020' failed to start. Not enough memory in the system to start the virtual machine instance-00000020. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000020' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Not enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) 'instance-00000020' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Error code: 32778. 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Traceback (most recent call last): 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] return function(*args, **kwargs) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] admin_password, network_info, block_device_info) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] return function(self, *args, **kwds) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self.force_reraise() 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] raise self.value 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] should_plug_vifs=False) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 'req_state': req_state}) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self.force_reraise() 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] raise self.value 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] time.sleep(sleep_time) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self.force_reraise() 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] raise self.value 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] return f(*args, **kwargs) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] return self._wait_for_job(job_path) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] error_desc=err_desc) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000020' failed to start. 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Not enough memory in the system to start the virtual machine instance-00000020. 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000020' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Not enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 'instance-00000020' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Error code: 32778. 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] During handling of the above exception, another exception occurred: 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Traceback (most recent call last): 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] accel_info=accel_info) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] return function(*args, **kwargs) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] admin_password, network_info, block_device_info) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] return function(self, *args, **kwds) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self.force_reraise() 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] raise self.value 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] should_plug_vifs=False) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 'req_state': req_state}) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self.force_reraise() 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] raise self.value 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] time.sleep(sleep_time) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self.force_reraise() 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] raise self.value 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] return f(*args, **kwargs) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] return self._wait_for_job(job_path) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] error_desc=err_desc) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000020' failed to start. 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Not enough memory in the system to start the virtual machine instance-00000020. 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000020' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Not enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 'instance-00000020' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Error code: 32778. 2021-09-10 16:53:42.218 4088 3038338906952 MainThread TRACE nova.compute.manager [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] 2021-09-10 16:53:42.218 4088 3038338906952 MainThread DEBUG nova.compute.utils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] WMI job failed with status 10. Error summary description: 'instance-00000020' failed to start. Not enough memory in the system to start the virtual machine instance-00000020. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:53:42.218 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Build of instance f3fbc33e-18d4-47bf-b643-94d2edfcae5f was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000020' failed to start. Not enough memory in the system to start the virtual machine instance-00000020. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000020' failed to start. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Not enough memory in the system to start the virtual machine instance-00000020 with ram size 1024 megabytes. (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) 'instance-00000020' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1653F5DC-31AC-4D02-8B07-FF32DE1D0238) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:53:42.218 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:53:42.234 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:53:42.234 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:53:42.234 4088 3038338906952 MainThread DEBUG nova.network.neutron [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:53:44.014 4088 3038338906952 MainThread DEBUG nova.network.neutron [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:53:44.048 4088 3038338906952 MainThread INFO nova.compute.manager [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] [instance: f3fbc33e-18d4-47bf-b643-94d2edfcae5f] Took 1.81 seconds to deallocate network for instance. 2021-09-10 16:53:44.482 4088 3038338906952 MainThread INFO nova.scheduler.client.report [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Deleted allocations for instance f3fbc33e-18d4-47bf-b643-94d2edfcae5f 2021-09-10 16:53:44.549 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-7e06ecf1-e4b6-4913-b62a-aef6ef7ada8b 4826ecf435ad43b6984adee7a94b6ebc 7199a32f43ef47a1940566d570e22783 - default default] Lock "f3fbc33e-18d4-47bf-b643-94d2edfcae5f" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 50.156s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:53:57.066 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.livemigrationops [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] check_can_live_migrate_destination called check_can_live_migrate_destination c:\openstack\build\nova\nova\virt\hyperv\livemigrationops.py:132 2021-09-10 16:53:57.066 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.pathutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Checking if C:\openstack\instances and \\n-h1-808474-1\C$\openstack\instances point to the same location. check_dirs_shared_storage c:\openstack\build\nova\nova\virt\hyperv\pathutils.py:183 2021-09-10 16:53:57.077 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] destination check data is HyperVLiveMigrateData(is_shared_instance_path=False,is_volume_backed=,migration=,old_vol_attachment_ids=,vifs=,wait_for_vif_plugged=) check_can_live_migrate_destination c:\openstack\build\nova\nova\compute\manager.py:8040 2021-09-10 16:53:57.466 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.livemigrationops [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] cleanup_live_migration_destination_check called cleanup_live_migration_destination_check c:\openstack\build\nova\nova\virt\hyperv\livemigrationops.py:148 2021-09-10 16:53:58.156 4088 3038340793800 MainThread DEBUG nova.compute.manager [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] pre_live_migration data is HyperVLiveMigrateData(is_shared_instance_path=False,is_volume_backed=False,migration=,old_vol_attachment_ids=,vifs=[VIFMigrateData],wait_for_vif_plugged=) pre_live_migration c:\openstack\build\nova\nova\compute\manager.py:8168 2021-09-10 16:53:58.202 4088 3038340793800 MainThread DEBUG oslo_concurrency.lockutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Acquired lock "refresh_cache-9107836a-481d-4cb5-9c7d-6432f4cd5309" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:53:58.202 4088 3038340793800 MainThread DEBUG nova.network.neutron [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:53:58.515 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.snapshotops [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Snapshot image b5a5c200-6595-4ce3-8ee2-fdac3bb3c8a7 updated for VM instance-00000017 snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:107 2021-09-10 16:53:58.515 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.snapshotops [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Removing snapshot b5a5c200-6595-4ce3-8ee2-fdac3bb3c8a7 snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:110 2021-09-10 16:53:58.591 4088 3038338907832 MainThread DEBUG os_win.utils.jobutils [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Waiting for WMI job: {'InstanceID': '83C7C43D-D31B-4615-96AF-F194E999EB97', 'Description': 'Deleting Checkpoint', 'ElementName': 'Deleting Checkpoint', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21056), 'Cancellable': False, 'JobType': 72, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:53:58.872 4088 3038340793800 MainThread DEBUG nova.network.neutron [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Updating instance_info_cache with network_info: [{"id": "5beac292-790e-4830-8f59-e411516f08cc", "address": "fa:16:3e:ea:47:a7", "network": {"id": "7434a41e-b78f-4cb9-8ffe-b2514d097201", "bridge": null, "label": "tempest-LiveAutoBlockMigrationV225Test-1499875764-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91237ebda1b54d2dbc761e48fdd93516", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap5beac292-79", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:53:58.905 4088 3038340793800 MainThread DEBUG oslo_concurrency.lockutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Releasing lock "refresh_cache-9107836a-481d-4cb5-9c7d-6432f4cd5309" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:53:58.905 4088 3038340793800 MainThread DEBUG os_brick.utils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:53:58.905 4088 3038340793800 MainThread DEBUG os_brick.utils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] <== get_connector_properties: return (0ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:53:59.075 4088 3038338907832 MainThread DEBUG os_win.utils.jobutils [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] WMI job succeeded: {'InstanceID': '83C7C43D-D31B-4615-96AF-F194E999EB97', 'Description': 'Deleting Checkpoint', 'ElementName': 'Deleting Checkpoint', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=407798), 'Cancellable': False, 'JobType': 72, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:53:59.075 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.snapshotops [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Removing directory: C:\openstack\instances\export\instance-00000017 snapshot c:\openstack\build\nova\nova\virt\hyperv\snapshotops.py:116 2021-09-10 16:53:59.169 4088 3038338907832 MainThread INFO nova.compute.manager [req-7734073c-518a-4ec6-ad6a-875fe6542a85 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Took 37.77 seconds to snapshot the instance on the hypervisor. 2021-09-10 16:54:04.451 4088 3038340793800 MainThread DEBUG nova.virt.hyperv.livemigrationops [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] pre_live_migration called pre_live_migration c:\openstack\build\nova\nova\virt\hyperv\livemigrationops.py:92 2021-09-10 16:54:04.483 4088 3038340793800 MainThread DEBUG nova.block_device [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] block_device_list ['sdb'] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:54:04.483 4088 3038340793800 MainThread DEBUG oslo_concurrency.lockutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:04.483 4088 3038340793800 MainThread DEBUG oslo_concurrency.lockutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:04.502 4088 3038340793800 MainThread DEBUG os_brick.initiator.windows.iscsi [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-6fe38b5b-f580-4b49-8822-02f1519e6936', 'target_lun': 0, 'volume_id': '6fe38b5b-f580-4b49-8822-02f1519e6936', 'auth_method': 'CHAP', 'auth_username': 'cLGGMECT57NdrLs34ud4', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:54:04.502 4088 3038340793800 MainThread INFO os_brick.initiator.windows.iscsi [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Attempting to establish an iSCSI session to target iqn.2010-10.org.openstack:volume-6fe38b5b-f580-4b49-8822-02f1519e6936 on portal 10.222.0.55:3260 accessing LUN 0 using initiator None. 2021-09-10 16:54:04.502 4088 3038340793800 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Logging in iSCSI target iqn.2010-10.org.openstack:volume-6fe38b5b-f580-4b49-8822-02f1519e6936 login_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:401 2021-09-10 16:54:04.891 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-ca533613-ee51-4e10-9bde-18e2b8aa3230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Received event network-vif-unplugged-f581c585-39ab-4120-a040-5d92bb401a6c external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:54:04.891 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-ca533613-ee51-4e10-9bde-18e2b8aa3230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9446e666-4364-4dcd-b041-405653a856bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:04.891 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-ca533613-ee51-4e10-9bde-18e2b8aa3230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9446e666-4364-4dcd-b041-405653a856bd-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:04.891 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-ca533613-ee51-4e10-9bde-18e2b8aa3230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] No waiting events found dispatching network-vif-unplugged-f581c585-39ab-4120-a040-5d92bb401a6c pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 16:54:04.891 4088 3038338907304 MainThread WARNING nova.compute.manager [req-ca533613-ee51-4e10-9bde-18e2b8aa3230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Received unexpected event network-vif-unplugged-f581c585-39ab-4120-a040-5d92bb401a6c for instance with vm_state active and task_state None. 2021-09-10 16:54:08.872 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-35458d93-60c0-45b1-a702-112051ff5762 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Lock "9446e666-4364-4dcd-b041-405653a856bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:08.872 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-35458d93-60c0-45b1-a702-112051ff5762 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Lock "9446e666-4364-4dcd-b041-405653a856bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:08.872 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-35458d93-60c0-45b1-a702-112051ff5762 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Lock "9446e666-4364-4dcd-b041-405653a856bd-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:08.872 4088 3038338907304 MainThread ERROR nova.compute.manager [req-35458d93-60c0-45b1-a702-112051ff5762 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Setting instance vm_state to ERROR: NameError: name 'instant' is not defined 2021-09-10 16:54:08.872 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 9446e666-4364-4dcd-b041-405653a856bd] Traceback (most recent call last): 2021-09-10 16:54:08.872 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 9446e666-4364-4dcd-b041-405653a856bd] File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:54:08.872 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 9446e666-4364-4dcd-b041-405653a856bd] self._delete_instance(context, instance, bdms) 2021-09-10 16:54:08.872 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 9446e666-4364-4dcd-b041-405653a856bd] File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:54:08.872 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 9446e666-4364-4dcd-b041-405653a856bd] self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:54:08.872 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 9446e666-4364-4dcd-b041-405653a856bd] NameError: name 'instant' is not defined 2021-09-10 16:54:08.872 4088 3038338907304 MainThread TRACE nova.compute.manager [instance: 9446e666-4364-4dcd-b041-405653a856bd] 2021-09-10 16:54:08.930 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-35458d93-60c0-45b1-a702-112051ff5762 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Lock "9446e666-4364-4dcd-b041-405653a856bd" released by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 0.063s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:09.029 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-35458d93-60c0-45b1-a702-112051ff5762 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:09.060 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.hostops [req-35458d93-60c0-45b1-a702-112051ff5762 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:54:09.078 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.hostops [req-35458d93-60c0-45b1-a702-112051ff5762 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:54:09.326 4088 3038338907304 MainThread DEBUG nova.compute.provider_tree [req-35458d93-60c0-45b1-a702-112051ff5762 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:54:09.356 4088 3038338907304 MainThread DEBUG nova.scheduler.client.report [req-35458d93-60c0-45b1-a702-112051ff5762 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:54:09.356 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-35458d93-60c0-45b1-a702-112051ff5762 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:09.356 4088 3038338907304 MainThread INFO nova.compute.manager [req-35458d93-60c0-45b1-a702-112051ff5762 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Successfully reverted task state from deleting on failure for instance. 2021-09-10 16:54:09.356 4088 3038338907304 MainThread ERROR oslo_messaging.rpc.server [req-35458d93-60c0-45b1-a702-112051ff5762 68a189ea096f4b08ae59e252907de4ff be36af928b5149e58720b1f68dda425d - default default] Exception during message handling: NameError: name 'instant' is not defined 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server Traceback (most recent call last): 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 72, in wrapped 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server context, exc, binary) 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server return f(self, context, *args, **kw) 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 184, in decorated_function 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server "Error: %s", e, instance=instance) 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 154, in decorated_function 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\utils.py", line 1433, in decorated_function 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 200, in decorated_function 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3106, in terminate_instance 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server do_terminate_instance(instance, bdms) 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_concurrency\lockutils.py", line 360, in inner 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server return f(*args, **kwargs) 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3104, in do_terminate_instance 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self._set_instance_obj_error_state(instance) 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self._delete_instance(context, instance, bdms) 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server NameError: name 'instant' is not defined 2021-09-10 16:54:09.356 4088 3038338907304 MainThread TRACE oslo_messaging.rpc.server 2021-09-10 16:54:09.528 4088 3038340793800 MainThread DEBUG os_win.utils.storage.diskutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 16:54:09.655 4088 3038340793800 MainThread DEBUG os_win.utils.storage.diskutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 16:54:09.724 4088 3038340793800 MainThread DEBUG os_brick.initiator.windows.iscsi [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] <== connect_volume: return (5221ms) {'type': 'block', 'path': '\\\\.\\PhysicalDrive1', 'number': 1, 'scsi_wwn': '3600140539E1019FB39C4B4D82780189D'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:54:09.724 4088 3038340793800 MainThread DEBUG os_brick.initiator.windows.iscsi [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] ==> get_volume_paths: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-6fe38b5b-f580-4b49-8822-02f1519e6936', 'target_lun': 0, 'volume_id': '6fe38b5b-f580-4b49-8822-02f1519e6936', 'auth_method': 'CHAP', 'auth_username': 'cLGGMECT57NdrLs34ud4', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:54:09.748 4088 3038340793800 MainThread DEBUG os_brick.initiator.windows.iscsi [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] <== get_volume_paths: return (23ms) ['\\\\.\\PhysicalDrive1'] trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:54:09.895 4088 3038340793800 MainThread DEBUG os_win.utils.compute.livemigrationutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Getting live migration networks for host: n-h2-808474-1 _get_ip_address_list c:\openstack\build\os-win\os_win\utils\compute\livemigrationutils.py:172 2021-09-10 16:54:10.187 4088 3038340793800 MainThread DEBUG os_win.utils.compute.livemigrationutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Creating planned VM for VM: instance-0000001f _create_planned_vm c:\openstack\build\os-win\os_win\utils\compute\livemigrationutils.py:87 2021-09-10 16:54:10.372 4088 3038340793800 MainThread DEBUG os_win.utils.jobutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Waiting for WMI job: {'InstanceID': 'ED60B0F2-E0D2-4AEE-A688-B8D9ACC6FA93', 'Description': 'Creating Remote Virtual Machine', 'ElementName': 'Creating Remote Virtual Machine', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=73465), 'Cancellable': True, 'JobType': 300, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 3}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:11.123 4088 3038340793800 MainThread DEBUG os_win.utils.jobutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] WMI job succeeded: {'InstanceID': 'ED60B0F2-E0D2-4AEE-A688-B8D9ACC6FA93', 'Description': 'Creating Remote Virtual Machine', 'ElementName': 'Creating Remote Virtual Machine', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=804249), 'Cancellable': True, 'JobType': 300, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:54:11.310 4088 3038340793800 MainThread DEBUG os_win.utils.compute.livemigrationutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Replacing host resource \\N-H2-808474-1\root\virtualization\v2:Msvm_DiskDrive.CreationClassName="Msvm_DiskDrive",DeviceID="Microsoft:353B3BE8-310C-4cf4-839E-4E1B14616136\\1",SystemCreationClassName="Msvm_ComputerSystem",SystemName="N-H2-808474-1" with \\N-H2-808474-1\root\virtualization\v2:Msvm_DiskDrive.CreationClassName="Msvm_DiskDrive",DeviceID="Microsoft:353B3BE8-310C-4cf4-839E-4E1B14616136\\1",SystemCreationClassName="Msvm_ComputerSystem",SystemName="N-H2-808474-1" on planned VM instance-0000001f _update_planned_vm_disk_resources c:\openstack\build\os-win\os_win\utils\compute\livemigrationutils.py:128 2021-09-10 16:54:11.310 4088 3038340793800 MainThread DEBUG os_win.utils.compute.livemigrationutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Updating remote planned VM disk paths for VM: instance-0000001f _update_planned_vm_disk_resources c:\openstack\build\os-win\os_win\utils\compute\livemigrationutils.py:133 2021-09-10 16:54:11.360 4088 3038340793800 MainThread DEBUG nova.compute.manager [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] driver pre_live_migration data is HyperVLiveMigrateData(is_shared_instance_path=False,is_volume_backed=False,migration=,old_vol_attachment_ids={6fe38b5b-f580-4b49-8822-02f1519e6936='db68e464-635a-43fc-81e3-e6681a734234'},vifs=[VIFMigrateData],wait_for_vif_plugged=) pre_live_migration c:\openstack\build\nova\nova\compute\manager.py:8230 2021-09-10 16:54:12.357 4088 3038340793800 MainThread DEBUG nova.network.neutron [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Port 5beac292-790e-4830-8f59-e411516f08cc updated with migration profile {'migrating_to': 'n-h2-808474-1'} successfully _setup_migration_port_profile c:\openstack\build\nova\nova\network\neutron.py:343 2021-09-10 16:54:12.499 4088 3038340793800 MainThread DEBUG nova.compute.manager [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] pre_live_migration result data is HyperVLiveMigrateData(is_shared_instance_path=False,is_volume_backed=False,migration=,old_vol_attachment_ids={6fe38b5b-f580-4b49-8822-02f1519e6936='db68e464-635a-43fc-81e3-e6681a734234'},vifs=[VIFMigrateData],wait_for_vif_plugged=True) pre_live_migration c:\openstack\build\nova\nova\compute\manager.py:8285 2021-09-10 16:54:13.925 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Lock "f0b03925-8953-422e-83b5-82f2f00745af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:13.954 4088 3038340794856 MainThread DEBUG nova.compute.manager [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:54:14.061 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:14.061 4088 3038340794856 MainThread DEBUG nova.virt.hardware [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:54:14.061 4088 3038340794856 MainThread INFO nova.compute.claims [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Claim successful on node n-h2-808474-1 2021-09-10 16:54:14.201 4088 3038340794856 MainThread DEBUG nova.virt.hyperv.hostops [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:54:14.219 4088 3038340794856 MainThread DEBUG nova.virt.hyperv.hostops [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:54:14.466 4088 3038340794856 MainThread DEBUG nova.compute.provider_tree [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:54:14.485 4088 3038340794856 MainThread DEBUG nova.scheduler.client.report [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:54:14.485 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:14.485 4088 3038340794856 MainThread DEBUG nova.compute.manager [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:54:14.545 4088 3038340794856 MainThread DEBUG nova.compute.manager [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:54:14.565 4088 3038338907304 GreenThread-25 DEBUG nova.compute.manager [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:54:14.575 4088 3038338907304 GreenThread-25 DEBUG nova.network.neutron [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:54:14.735 4088 3038338907304 GreenThread-25 DEBUG nova.policy [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92577cd3faa34912ba4767d0c2bde084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662be160c9d04068bc4711ac9c9433d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:54:14.754 4088 3038340794856 MainThread DEBUG nova.compute.manager [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:54:14.763 4088 3038340794856 MainThread INFO nova.virt.hyperv.vmops [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Spawning new instance 2021-09-10 16:54:14.763 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Lock "instance-00000022" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:14.763 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Lock "instance-00000022" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:14.763 4088 3038340794856 MainThread DEBUG nova.block_device [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:54:14.763 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:14.763 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:14.810 4088 3038340794856 MainThread DEBUG os_win.utils.pathutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Creating directory: C:\openstack\instances\instance-00000022 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:54:14.810 4088 3038340794856 MainThread DEBUG nova.virt.hyperv.vmops [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000022\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:54:15.254 4088 3038340794856 MainThread DEBUG nova.virt.hyperv.vmops [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Resizing VHD C:\openstack\instances\instance-00000022\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:54:15.280 4088 3038340794680 MainThread DEBUG nova.compute.manager [req-9098b029-d07f-4d59-8357-33cdc6339651 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Received event network-vif-deleted-73746707-7c0f-494e-b5b2-c9c883f64863 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:54:15.689 4088 3038338907304 GreenThread-25 DEBUG nova.network.neutron [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Successfully created port: 65439f9c-9600-4df4-aab7-57611332c64b _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:54:17.000 4088 3038338907304 GreenThread-25 DEBUG nova.network.neutron [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Successfully updated port: 65439f9c-9600-4df4-aab7-57611332c64b _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:54:17.030 4088 3038338907304 GreenThread-25 DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Acquired lock "refresh_cache-f0b03925-8953-422e-83b5-82f2f00745af" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:54:17.030 4088 3038338907304 GreenThread-25 DEBUG nova.network.neutron [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:54:17.153 4088 3038338907304 GreenThread-25 DEBUG nova.network.neutron [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:54:17.668 4088 3038338907304 GreenThread-25 DEBUG nova.network.neutron [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Updating instance_info_cache with network_info: [{"id": "65439f9c-9600-4df4-aab7-57611332c64b", "address": "fa:16:3e:b8:ca:21", "network": {"id": "04d8859a-8629-42fd-bdbd-a131a503ae71", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-344376700-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "662be160c9d04068bc4711ac9c9433d7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap65439f9c-96", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:54:17.715 4088 3038338907304 GreenThread-25 DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Releasing lock "refresh_cache-f0b03925-8953-422e-83b5-82f2f00745af" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:54:17.715 4088 3038338907304 GreenThread-25 DEBUG nova.compute.manager [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Instance network_info: |[{"id": "65439f9c-9600-4df4-aab7-57611332c64b", "address": "fa:16:3e:b8:ca:21", "network": {"id": "04d8859a-8629-42fd-bdbd-a131a503ae71", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-344376700-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "662be160c9d04068bc4711ac9c9433d7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap65439f9c-96", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:54:17.715 4088 3038340794856 MainThread DEBUG nova.compute.manager [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Preparing to wait for external event network-vif-plugged-65439f9c-9600-4df4-aab7-57611332c64b prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:54:17.715 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Lock "f0b03925-8953-422e-83b5-82f2f00745af-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:17.715 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Lock "f0b03925-8953-422e-83b5-82f2f00745af-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:17.715 4088 3038340794856 MainThread DEBUG os_win.utils.compute.vmutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Creating VM instance-00000022 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:54:17.872 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-53451c40-a9ac-491f-9cc4-9d4b3124d2b3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Received event network-changed-65439f9c-9600-4df4-aab7-57611332c64b external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:54:17.872 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-53451c40-a9ac-491f-9cc4-9d4b3124d2b3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Refreshing instance network info cache due to event network-changed-65439f9c-9600-4df4-aab7-57611332c64b. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:54:17.872 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-53451c40-a9ac-491f-9cc4-9d4b3124d2b3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-f0b03925-8953-422e-83b5-82f2f00745af" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:54:17.872 4088 3038338907304 MainThread DEBUG nova.network.neutron [req-53451c40-a9ac-491f-9cc4-9d4b3124d2b3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Refreshing network info cache for port 65439f9c-9600-4df4-aab7-57611332c64b _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:54:18.591 4088 3038338907304 MainThread DEBUG nova.network.neutron [req-53451c40-a9ac-491f-9cc4-9d4b3124d2b3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Updated VIF entry in instance network info cache for port 65439f9c-9600-4df4-aab7-57611332c64b. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:54:18.591 4088 3038338907304 MainThread DEBUG nova.network.neutron [req-53451c40-a9ac-491f-9cc4-9d4b3124d2b3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Updating instance_info_cache with network_info: [{"id": "65439f9c-9600-4df4-aab7-57611332c64b", "address": "fa:16:3e:b8:ca:21", "network": {"id": "04d8859a-8629-42fd-bdbd-a131a503ae71", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-344376700-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "662be160c9d04068bc4711ac9c9433d7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap65439f9c-96", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:54:18.606 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-53451c40-a9ac-491f-9cc4-9d4b3124d2b3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-f0b03925-8953-422e-83b5-82f2f00745af" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:54:18.840 4088 3038338907304 MainThread INFO nova.virt.block_device [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Attempting to driver detach volume 6fe38b5b-f580-4b49-8822-02f1519e6936 from mountpoint /dev/sdb 2021-09-10 16:54:18.873 4088 3038338907304 MainThread WARNING nova.virt.block_device [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Detaching volume from unknown instance 2021-09-10 16:54:18.873 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.volumeops [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Detaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-6fe38b5b-f580-4b49-8822-02f1519e6936', 'target_lun': 0, 'volume_id': '6fe38b5b-f580-4b49-8822-02f1519e6936', 'auth_method': 'CHAP', 'auth_username': 'cLGGMECT57NdrLs34ud4', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'attaching', 'instance': '9107836a-481d-4cb5-9c7d-6432f4cd5309', 'attached_at': '2021-09-10T16:54:04.000000', 'detached_at': '', 'volume_id': '6fe38b5b-f580-4b49-8822-02f1519e6936', 'serial': '6fe38b5b-f580-4b49-8822-02f1519e6936'} from instance-0000001f detach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:128 2021-09-10 16:54:18.892 4088 3038338907304 MainThread WARNING nova.virt.hyperv.volumeops [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Instance instance-0000001f is a Planned VM, cannot detach volumes from it. 2021-09-10 16:54:18.892 4088 3038338907304 MainThread DEBUG os_brick.initiator.windows.iscsi [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-6fe38b5b-f580-4b49-8822-02f1519e6936', 'target_lun': 0, 'volume_id': '6fe38b5b-f580-4b49-8822-02f1519e6936', 'auth_method': 'CHAP', 'auth_username': 'cLGGMECT57NdrLs34ud4', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:54:18.892 4088 3038338907304 MainThread DEBUG os_win.utils.storage.diskutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 16:54:18.989 4088 3038338907304 MainThread DEBUG os_win.utils.storage.diskutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 16:54:19.005 4088 3038338907304 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-6fe38b5b-f580-4b49-8822-02f1519e6936 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 16:54:19.075 4088 3038338907304 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Removing iSCSI target persistent login: iqn.2010-10.org.openstack:volume-6fe38b5b-f580-4b49-8822-02f1519e6936 _remove_target_persistent_logins c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:495 2021-09-10 16:54:19.075 4088 3038338907304 MainThread DEBUG os_brick.initiator.windows.iscsi [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] <== disconnect_volume: return (182ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:54:19.904 4088 3038340794856 MainThread DEBUG nova.virt.hyperv.vmops [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:54:21.517 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Acquired lock "refresh_cache-9107836a-481d-4cb5-9c7d-6432f4cd5309" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:54:21.517 4088 3038338907832 MainThread DEBUG nova.network.neutron [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:54:23.298 4088 3038338907832 MainThread DEBUG nova.network.neutron [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Updating instance_info_cache with network_info: [{"id": "5beac292-790e-4830-8f59-e411516f08cc", "address": "fa:16:3e:ea:47:a7", "network": {"id": "7434a41e-b78f-4cb9-8ffe-b2514d097201", "bridge": null, "label": "tempest-LiveAutoBlockMigrationV225Test-1499875764-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91237ebda1b54d2dbc761e48fdd93516", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap5beac292-79", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {"migrating_to": "n-h2-808474-1"}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:54:23.328 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Releasing lock "refresh_cache-9107836a-481d-4cb5-9c7d-6432f4cd5309" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:54:23.496 4088 3038338907832 MainThread DEBUG nova.network.neutron [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Removing port 5beac292-790e-4830-8f59-e411516f08cc migration profile _clear_migration_port_profile c:\openstack\build\nova\nova\network\neutron.py:316 2021-09-10 16:54:25.961 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.free_pci_device_claims_for_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:25.961 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.free_pci_device_claims_for_instance" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:25.961 4088 3038338907832 MainThread INFO nova.virt.hyperv.vmops [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] [instance: 9107836a-481d-4cb5-9c7d-6432f4cd5309] Got request to destroy instance 2021-09-10 16:54:25.998 4088 3038338907832 MainThread DEBUG os_win.utils.compute.migrationutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Destroying existing planned VM: instance-0000001f _destroy_planned_vm c:\openstack\build\os-win\os_win\utils\compute\migrationutils.py:92 2021-09-10 16:54:26.062 4088 3038338907832 MainThread DEBUG os_win.utils.jobutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Waiting for WMI job: {'InstanceID': '93CB927D-58AB-411D-99A6-56C1B1DEFA83', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20523), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:26.325 4088 3038338907832 MainThread DEBUG os_win.utils.jobutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] WMI job succeeded: {'InstanceID': '93CB927D-58AB-411D-99A6-56C1B1DEFA83', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=151081), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:54:26.325 4088 3038338907832 MainThread DEBUG os_brick.initiator.windows.iscsi [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-6fe38b5b-f580-4b49-8822-02f1519e6936', 'target_lun': 0, 'volume_id': '6fe38b5b-f580-4b49-8822-02f1519e6936', 'auth_method': 'CHAP', 'auth_username': 'cLGGMECT57NdrLs34ud4', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:54:26.325 4088 3038338907832 MainThread DEBUG os_win.utils.storage.diskutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 16:54:26.423 4088 3038338907832 MainThread DEBUG os_win.utils.storage.diskutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 16:54:26.423 4088 3038338907832 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-6fe38b5b-f580-4b49-8822-02f1519e6936 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 16:54:26.423 4088 3038338907832 MainThread DEBUG os_brick.initiator.windows.iscsi [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] <== disconnect_volume: return (97ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:54:26.423 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Lock "instance-0000001f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:26.423 4088 3038338907832 MainThread DEBUG os_win.utils.pathutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Removing directory: C:\openstack\instances\instance-0000001f check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:54:26.439 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [req-3c50aed4-453b-49ff-aed0-9ddeb0e8f00a ca2efda67fb64954b0bfece0cc597f88 398a3c674d0e41c1a7e4459b18602bb9 - default default] Lock "instance-0000001f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:27.423 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "c466fddc-e13c-4586-a808-4e92dcac06cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:27.442 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:54:27.674 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:27.685 4088 3038340796088 MainThread DEBUG nova.virt.hardware [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:54:27.685 4088 3038340796088 MainThread INFO nova.compute.claims [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Claim successful on node n-h2-808474-1 2021-09-10 16:54:27.922 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.hostops [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:54:27.957 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.hostops [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:54:28.185 4088 3038340796088 MainThread DEBUG nova.compute.provider_tree [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:54:28.200 4088 3038340796088 MainThread DEBUG nova.scheduler.client.report [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:54:28.215 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:28.215 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:54:28.369 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:54:28.372 4088 3038338907304 GreenThread-26 DEBUG nova.compute.manager [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:54:28.372 4088 3038338907304 GreenThread-26 DEBUG nova.network.neutron [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:54:28.482 4088 3038340795912 MainThread DEBUG nova.compute.manager [req-c2fc44a6-8d34-4436-adf7-2e648f83672d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Received event network-vif-deleted-12e6f6e2-aa56-4d3c-95f8-c5e715703f47 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:54:28.550 4088 3038340795912 MainThread DEBUG nova.compute.manager [req-9c3d4af9-afca-4640-b99c-ce3ede43259f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Received event network-vif-plugged-65439f9c-9600-4df4-aab7-57611332c64b external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:54:28.550 4088 3038340795912 MainThread DEBUG oslo_concurrency.lockutils [req-9c3d4af9-afca-4640-b99c-ce3ede43259f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "f0b03925-8953-422e-83b5-82f2f00745af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:28.550 4088 3038340795912 MainThread DEBUG oslo_concurrency.lockutils [req-9c3d4af9-afca-4640-b99c-ce3ede43259f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "f0b03925-8953-422e-83b5-82f2f00745af-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:28.550 4088 3038340795912 MainThread DEBUG nova.compute.manager [req-9c3d4af9-afca-4640-b99c-ce3ede43259f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Processing event network-vif-plugged-65439f9c-9600-4df4-aab7-57611332c64b _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:54:28.653 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:54:28.670 4088 3038340796088 MainThread INFO nova.virt.hyperv.vmops [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Spawning new instance 2021-09-10 16:54:28.670 4088 3038340794856 MainThread INFO nova.virt.hyperv.vmops [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Using config drive for instance 2021-09-10 16:54:28.670 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "instance-00000023" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:28.670 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "instance-00000023" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:28.683 4088 3038340796088 MainThread DEBUG nova.block_device [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:54:28.683 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:28.683 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:28.702 4088 3038340796088 MainThread DEBUG os_win.utils.pathutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Creating directory: C:\openstack\instances\instance-00000023 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:54:28.702 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000023\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:54:29.090 4088 3038340794856 MainThread INFO nova.virt.hyperv.vmops [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Creating config drive at C:\openstack\instances\instance-00000022\configdrive.iso 2021-09-10 16:54:29.202 4088 3038340794856 MainThread DEBUG oslo_concurrency.processutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000022\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpnvje65cv execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:54:33.184 4088 3038338907304 GreenThread-26 DEBUG nova.policy [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14929f631b514b1ba7de48ea6f7875b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12d8e551e4d4d599a26e3249f7560f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:54:33.206 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Resizing VHD C:\openstack\instances\instance-00000023\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:54:33.328 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "6f3c13e4-15bf-4dd6-ad7e-7870384f5220" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:33.380 4088 3038340794856 MainThread DEBUG oslo_concurrency.processutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000022\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpnvje65cv" returned: 0 in 4.172s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:54:33.404 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:54:33.565 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:33.565 4088 3038340847048 MainThread DEBUG nova.virt.hardware [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:54:33.565 4088 3038340847048 MainThread INFO nova.compute.claims [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Claim successful on node n-h2-808474-1 2021-09-10 16:54:33.594 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:54:33.594 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:54:33.594 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:54:33.594 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 16:54:33.762 4088 3038340847048 MainThread DEBUG nova.virt.hyperv.hostops [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:54:33.786 4088 3038340847048 MainThread DEBUG nova.virt.hyperv.hostops [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:54:33.982 4088 3038340794856 MainThread DEBUG nova.virt.hyperv.vmops [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Setting boot order for instance: instance-00000022: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:54:34.045 4088 3038340847048 MainThread DEBUG nova.compute.provider_tree [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:54:34.045 4088 3038340847048 MainThread DEBUG nova.scheduler.client.report [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:54:34.045 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:34.064 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:54:34.141 4088 3038340794856 MainThread DEBUG nova.virt.hyperv.vmops [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:54:34.186 4088 3038340794856 MainThread DEBUG os_win.utils.jobutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Waiting for WMI job: {'InstanceID': 'FFA9BC8D-A6D7-49C8-BC08-4C712F7843EF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17533), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:34.202 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:54:34.221 4088 3038340795912 GreenThread-27 DEBUG nova.compute.manager [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:54:34.221 4088 3038340795912 GreenThread-27 DEBUG nova.network.neutron [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:54:34.329 4088 3038340794856 MainThread ERROR os_win.utils.jobutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000022\' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)instance-00000022EBE05142-2225-4E0B-93B0-346AE805654B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)instance-00000022EBE05142-2225-4E0B-93B0-346AE805654B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000022\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)instance-00000022EBE05142-2225-4E0B-93B0-346AE805654B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'FFA9BC8D-A6D7-49C8-BC08-4C712F7843EF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117378), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 54, 34), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 54, 34), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000022' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)\n\nNot enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)\n\n'instance-00000022' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)", 'ErrorSummaryDescription': "'instance-00000022' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000022.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:54:34.329 4088 3038340794856 MainThread DEBUG os_win._utils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000022' failed to start. Not enough memory in the system to start the virtual machine instance-00000022. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000022' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Not enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) 'instance-00000022' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.16609978675842285 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:54:34.377 4088 3038340845640 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:54:34.377 4088 3038340845640 MainThread INFO nova.compute.manager [-] [instance: f0b03925-8953-422e-83b5-82f2f00745af] VM Stopped (Lifecycle Event) 2021-09-10 16:54:34.377 4088 3038340846872 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000022" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:34.377 4088 3038340846872 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000022" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:34.425 4088 3038340845640 MainThread DEBUG nova.compute.manager [req-3107b1b7-711c-4907-aa70-368d03edf719 - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:54:34.425 4088 3038340845640 MainThread DEBUG nova.virt.hyperv.vmops [req-3107b1b7-711c-4907-aa70-368d03edf719 - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:54:34.425 4088 3038338907304 GreenThread-26 DEBUG nova.network.neutron [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Successfully created port: ac4e1fac-eb99-4ce7-95bb-a6ec7e0e2d96 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:54:34.485 4088 3038340845640 MainThread DEBUG nova.compute.manager [req-3107b1b7-711c-4907-aa70-368d03edf719 - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:54:34.514 4088 3038340845640 MainThread INFO nova.compute.manager [req-3107b1b7-711c-4907-aa70-368d03edf719 - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:54:34.564 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:54:34.564 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 16:54:34.646 4088 3038340795912 GreenThread-27 DEBUG nova.policy [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd33d11497a91483d93fe0ed8f5c26603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc5deaa89294889821f303976e2d776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:54:34.699 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:54:34.699 4088 3038340847048 MainThread INFO nova.virt.hyperv.vmops [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Spawning new instance 2021-09-10 16:54:34.722 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000024" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:34.722 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000024" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:34.722 4088 3038340847048 MainThread DEBUG nova.block_device [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:54:34.722 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:34.722 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:34.733 4088 3038340847048 MainThread DEBUG os_win.utils.pathutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Creating directory: C:\openstack\instances\instance-00000024 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:54:34.733 4088 3038340847048 MainThread DEBUG nova.virt.hyperv.vmops [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000024\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:54:34.972 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-9db39d70-5120-4de4-bb87-480a6efb8a3a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:54:34.972 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 16:54:35.105 4088 3038340847048 MainThread DEBUG nova.virt.hyperv.vmops [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Resizing VHD C:\openstack\instances\instance-00000024\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:54:35.388 4088 3038340794856 MainThread DEBUG os_win.utils.jobutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Waiting for WMI job: {'InstanceID': 'BC6F1139-03F8-4D9D-98F9-1E23C22B1BB1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17339), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:35.550 4088 3038340794856 MainThread ERROR os_win.utils.jobutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000022\' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)instance-00000022EBE05142-2225-4E0B-93B0-346AE805654B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)instance-00000022EBE05142-2225-4E0B-93B0-346AE805654B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000022\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)instance-00000022EBE05142-2225-4E0B-93B0-346AE805654B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BC6F1139-03F8-4D9D-98F9-1E23C22B1BB1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=124604), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 54, 35), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 54, 35), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000022' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)\n\nNot enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)\n\n'instance-00000022' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)", 'ErrorSummaryDescription': "'instance-00000022' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000022.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:54:35.550 4088 3038340794856 MainThread DEBUG os_win._utils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000022' failed to start. Not enough memory in the system to start the virtual machine instance-00000022. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000022' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Not enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) 'instance-00000022' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.386549949645996 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:54:35.611 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000022" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:35.611 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000022" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:35.611 4088 3038340846872 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:54:35.611 4088 3038340846872 MainThread INFO nova.compute.manager [-] [instance: f0b03925-8953-422e-83b5-82f2f00745af] VM Stopped (Lifecycle Event) 2021-09-10 16:54:35.637 4088 3038340846872 MainThread DEBUG nova.compute.manager [req-41e880c8-d6d2-42ff-b95e-763c1eb11013 - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:54:35.637 4088 3038340846872 MainThread DEBUG nova.virt.hyperv.vmops [req-41e880c8-d6d2-42ff-b95e-763c1eb11013 - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:54:35.699 4088 3038340846872 MainThread DEBUG nova.compute.manager [req-41e880c8-d6d2-42ff-b95e-763c1eb11013 - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:54:35.720 4088 3038340846872 MainThread INFO nova.compute.manager [req-41e880c8-d6d2-42ff-b95e-763c1eb11013 - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:54:36.468 4088 3038340846872 MainThread DEBUG nova.compute.manager [req-b6bdda05-961e-4235-916b-e71413f8e6ad 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Received event network-vif-deleted-e0a6eaf9-527b-44d8-8e4e-5beaa55bf373 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:54:36.559 4088 3038340794856 MainThread DEBUG os_win.utils.jobutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Waiting for WMI job: {'InstanceID': 'ADAFBB9C-A30B-41DC-9686-DD5D6A145027', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19200), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:36.732 4088 3038340794856 MainThread ERROR os_win.utils.jobutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000022\' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)instance-00000022EBE05142-2225-4E0B-93B0-346AE805654B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)instance-00000022EBE05142-2225-4E0B-93B0-346AE805654B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000022\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)instance-00000022EBE05142-2225-4E0B-93B0-346AE805654B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'ADAFBB9C-A30B-41DC-9686-DD5D6A145027', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=126671), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 54, 36), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 54, 36), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000022' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)\n\nNot enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)\n\n'instance-00000022' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)", 'ErrorSummaryDescription': "'instance-00000022' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000022.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:54:36.732 4088 3038340794856 MainThread DEBUG os_win._utils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000022' failed to start. Not enough memory in the system to start the virtual machine instance-00000022. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000022' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Not enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) 'instance-00000022' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.569108247756958 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:54:36.777 4088 3038340846872 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:54:36.777 4088 3038340846872 MainThread INFO nova.compute.manager [-] [instance: f0b03925-8953-422e-83b5-82f2f00745af] VM Stopped (Lifecycle Event) 2021-09-10 16:54:36.777 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000022" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:36.777 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000022" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:36.817 4088 3038340846872 MainThread DEBUG nova.compute.manager [req-9172ec47-519a-477e-9c1f-a54a419f1165 - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:54:36.817 4088 3038340846872 MainThread DEBUG nova.virt.hyperv.vmops [req-9172ec47-519a-477e-9c1f-a54a419f1165 - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:54:36.876 4088 3038340846872 MainThread DEBUG nova.compute.manager [req-9172ec47-519a-477e-9c1f-a54a419f1165 - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:54:36.888 4088 3038340846872 MainThread INFO nova.compute.manager [req-9172ec47-519a-477e-9c1f-a54a419f1165 - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:54:37.668 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Updating instance_info_cache with network_info: [{"id": "66953b8a-00d2-4045-8dae-abe4c015822d", "address": "fa:16:3e:7a:90:37", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap66953b8a-00", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:54:37.699 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-9db39d70-5120-4de4-bb87-480a6efb8a3a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:54:37.699 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 16:54:37.699 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:54:37.699 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:54:37.714 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:54:37.714 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:54:37.768 4088 3038340794856 MainThread DEBUG os_win.utils.jobutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Waiting for WMI job: {'InstanceID': 'CEABA5D2-8928-4637-846F-0599AB5D580D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17706), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:37.842 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:54:37.920 4088 3038340795912 GreenThread-27 DEBUG nova.network.neutron [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Successfully created port: d5286e5e-28fa-4987-849a-ba6527ce0a5c _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:54:37.933 4088 3038340794856 MainThread ERROR os_win.utils.jobutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000022\' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)instance-00000022EBE05142-2225-4E0B-93B0-346AE805654B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)instance-00000022EBE05142-2225-4E0B-93B0-346AE805654B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000022\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)instance-00000022EBE05142-2225-4E0B-93B0-346AE805654B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'CEABA5D2-8928-4637-846F-0599AB5D580D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=123073), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 54, 37), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 54, 37), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000022' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)\n\nNot enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)\n\n'instance-00000022' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)", 'ErrorSummaryDescription': "'instance-00000022' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000022.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:54:37.933 4088 3038340794856 MainThread DEBUG os_win._utils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000022' failed to start. Not enough memory in the system to start the virtual machine instance-00000022. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000022' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Not enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) 'instance-00000022' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.770214796066284 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:54:37.933 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:54:37.972 4088 3038340847224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:54:37.972 4088 3038340847224 MainThread INFO nova.compute.manager [-] [instance: f0b03925-8953-422e-83b5-82f2f00745af] VM Stopped (Lifecycle Event) 2021-09-10 16:54:37.972 4088 3038340845640 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000022" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:37.972 4088 3038340845640 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000022" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:37.992 4088 3038340847224 MainThread DEBUG nova.compute.manager [req-1f1d3b06-543a-4abb-a2fd-98b04f481f2d - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:54:38.004 4088 3038340847224 MainThread DEBUG nova.virt.hyperv.vmops [req-1f1d3b06-543a-4abb-a2fd-98b04f481f2d - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:54:38.044 4088 3038340847224 MainThread DEBUG nova.compute.manager [req-1f1d3b06-543a-4abb-a2fd-98b04f481f2d - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:54:38.089 4088 3038340847224 MainThread INFO nova.compute.manager [req-1f1d3b06-543a-4abb-a2fd-98b04f481f2d - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:54:38.621 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:54:38.639 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:38.639 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:38.639 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 16:54:38.639 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:54:38.655 4088 3038338907304 GreenThread-26 DEBUG nova.network.neutron [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Successfully updated port: ac4e1fac-eb99-4ce7-95bb-a6ec7e0e2d96 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:54:38.655 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:54:38.671 4088 3038338907304 GreenThread-26 DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Acquired lock "refresh_cache-c466fddc-e13c-4586-a808-4e92dcac06cc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:54:38.671 4088 3038338907304 GreenThread-26 DEBUG nova.network.neutron [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:54:38.923 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2153MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 16:54:38.923 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:38.953 4088 3038338907304 GreenThread-26 DEBUG nova.network.neutron [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:54:38.953 4088 3038340794856 MainThread DEBUG os_win.utils.jobutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Waiting for WMI job: {'InstanceID': 'B4679444-EB2E-47D6-B325-A3580D46B2A3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16549), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:39.121 4088 3038340794856 MainThread ERROR os_win.utils.jobutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000022\' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)instance-00000022EBE05142-2225-4E0B-93B0-346AE805654B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)instance-00000022EBE05142-2225-4E0B-93B0-346AE805654B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000022\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)instance-00000022EBE05142-2225-4E0B-93B0-346AE805654B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B4679444-EB2E-47D6-B325-A3580D46B2A3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117013), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 54, 38), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 54, 39), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000022' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)\n\nNot enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)\n\n'instance-00000022' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)", 'ErrorSummaryDescription': "'instance-00000022' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000022.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:54:39.121 4088 3038340794856 MainThread DEBUG os_win._utils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000022' failed to start. Not enough memory in the system to start the virtual machine instance-00000022. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000022' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Not enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) 'instance-00000022' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.958314895629883 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:54:39.194 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000022" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:39.194 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000022" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:39.194 4088 3038340846872 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:54:39.194 4088 3038340846872 MainThread INFO nova.compute.manager [-] [instance: f0b03925-8953-422e-83b5-82f2f00745af] VM Stopped (Lifecycle Event) 2021-09-10 16:54:39.215 4088 3038340846872 MainThread DEBUG nova.compute.manager [req-38c6f988-a09a-470d-b21b-285e3be37cbf - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:54:39.215 4088 3038340846872 MainThread DEBUG nova.virt.hyperv.vmops [req-38c6f988-a09a-470d-b21b-285e3be37cbf - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:54:39.232 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:54:39.232 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:54:39.232 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:54:39.232 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:54:39.232 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:54:39.232 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:54:39.232 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:54:39.232 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:54:39.232 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance f0b03925-8953-422e-83b5-82f2f00745af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:54:39.232 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:54:39.232 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:54:39.232 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:54:39.232 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:54:39.232 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:54:39.232 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6f3c13e4-15bf-4dd6-ad7e-7870384f5220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:54:39.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance c466fddc-e13c-4586-a808-4e92dcac06cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:54:39.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 16 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 16:54:39.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=16896MB phys_disk=79GB used_disk=16GB total_vcpus=6 used_vcpus=16 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 16:54:39.265 4088 3038340846872 MainThread DEBUG nova.compute.manager [req-38c6f988-a09a-470d-b21b-285e3be37cbf - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:54:39.293 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:54:39.317 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:54:39.317 4088 3038340846872 MainThread INFO nova.compute.manager [req-38c6f988-a09a-470d-b21b-285e3be37cbf - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:54:39.529 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:54:39.554 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:54:39.554 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 16:54:39.554 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.641s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:39.921 4088 3038340846872 MainThread DEBUG nova.compute.manager [req-e459a4b3-5702-4f0d-96ef-3d4f01d2ee65 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Received event network-changed-ac4e1fac-eb99-4ce7-95bb-a6ec7e0e2d96 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:54:39.921 4088 3038340846872 MainThread DEBUG nova.compute.manager [req-e459a4b3-5702-4f0d-96ef-3d4f01d2ee65 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Refreshing instance network info cache due to event network-changed-ac4e1fac-eb99-4ce7-95bb-a6ec7e0e2d96. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:54:40.072 4088 3038338907304 GreenThread-26 DEBUG nova.network.neutron [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Updating instance_info_cache with network_info: [{"id": "ac4e1fac-eb99-4ce7-95bb-a6ec7e0e2d96", "address": "fa:16:3e:86:40:73", "network": {"id": "2b8d2ab0-2056-4c92-9f13-38b73897c01b", "bridge": null, "label": "tempest-SecurityGroupsTestJSON-625655316-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f12d8e551e4d4d599a26e3249f7560f1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapac4e1fac-eb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:54:40.094 4088 3038338907304 GreenThread-26 DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Releasing lock "refresh_cache-c466fddc-e13c-4586-a808-4e92dcac06cc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:54:40.094 4088 3038338907304 GreenThread-26 DEBUG nova.compute.manager [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Instance network_info: |[{"id": "ac4e1fac-eb99-4ce7-95bb-a6ec7e0e2d96", "address": "fa:16:3e:86:40:73", "network": {"id": "2b8d2ab0-2056-4c92-9f13-38b73897c01b", "bridge": null, "label": "tempest-SecurityGroupsTestJSON-625655316-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f12d8e551e4d4d599a26e3249f7560f1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapac4e1fac-eb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:54:40.094 4088 3038340846872 MainThread DEBUG oslo_concurrency.lockutils [req-e459a4b3-5702-4f0d-96ef-3d4f01d2ee65 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-c466fddc-e13c-4586-a808-4e92dcac06cc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:54:40.094 4088 3038340846872 MainThread DEBUG nova.network.neutron [req-e459a4b3-5702-4f0d-96ef-3d4f01d2ee65 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Refreshing network info cache for port ac4e1fac-eb99-4ce7-95bb-a6ec7e0e2d96 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:54:40.094 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Preparing to wait for external event network-vif-plugged-ac4e1fac-eb99-4ce7-95bb-a6ec7e0e2d96 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:54:40.094 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "c466fddc-e13c-4586-a808-4e92dcac06cc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:40.094 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "c466fddc-e13c-4586-a808-4e92dcac06cc-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:40.094 4088 3038340796088 MainThread DEBUG os_win.utils.compute.vmutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Creating VM instance-00000023 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:54:40.153 4088 3038340794856 MainThread DEBUG os_win.utils.jobutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Waiting for WMI job: {'InstanceID': '48B341C3-EE41-4567-8251-B47F8724B7B4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17759), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:40.294 4088 3038340794856 MainThread ERROR os_win.utils.jobutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000022\' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)instance-00000022EBE05142-2225-4E0B-93B0-346AE805654B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)instance-00000022EBE05142-2225-4E0B-93B0-346AE805654B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000022\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)instance-00000022EBE05142-2225-4E0B-93B0-346AE805654B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '48B341C3-EE41-4567-8251-B47F8724B7B4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118478), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 54, 40), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 54, 40), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000022' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)\n\nNot enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)\n\n'instance-00000022' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B)", 'ErrorSummaryDescription': "'instance-00000022' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000022.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:54:40.294 4088 3038340794856 MainThread ERROR nova.virt.hyperv.vmops [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Failed to change vm state of instance-00000022 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000022' failed to start. 2021-09-10 16:54:40.324 4088 3038340794856 MainThread INFO nova.virt.hyperv.vmops [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Got request to destroy instance 2021-09-10 16:54:40.423 4088 3038340795912 GreenThread-27 DEBUG nova.network.neutron [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Successfully updated port: d5286e5e-28fa-4987-849a-ba6527ce0a5c _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:54:40.437 4088 3038340795912 GreenThread-27 DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Acquired lock "refresh_cache-6f3c13e4-15bf-4dd6-ad7e-7870384f5220" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:54:40.452 4088 3038340795912 GreenThread-27 DEBUG nova.network.neutron [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:54:40.571 4088 3038340847400 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:54:40.571 4088 3038340847400 MainThread INFO nova.compute.manager [-] [instance: f0b03925-8953-422e-83b5-82f2f00745af] VM Stopped (Lifecycle Event) 2021-09-10 16:54:40.578 4088 3038340847576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000022" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:40.578 4088 3038340847576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000022" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:40.590 4088 3038340847400 MainThread DEBUG nova.compute.manager [req-6cda1d40-b4c5-463c-9e10-aecd45a70364 - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:54:40.590 4088 3038340847400 MainThread DEBUG nova.virt.hyperv.vmops [req-6cda1d40-b4c5-463c-9e10-aecd45a70364 - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:54:40.658 4088 3038340847400 MainThread DEBUG nova.compute.manager [req-6cda1d40-b4c5-463c-9e10-aecd45a70364 - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:54:40.699 4088 3038340847400 MainThread INFO nova.compute.manager [req-6cda1d40-b4c5-463c-9e10-aecd45a70364 - - - - -] [instance: f0b03925-8953-422e-83b5-82f2f00745af] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:54:40.749 4088 3038340795912 GreenThread-27 DEBUG nova.network.neutron [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:54:40.997 4088 3038340846872 MainThread DEBUG nova.network.neutron [req-e459a4b3-5702-4f0d-96ef-3d4f01d2ee65 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Updated VIF entry in instance network info cache for port ac4e1fac-eb99-4ce7-95bb-a6ec7e0e2d96. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:54:40.997 4088 3038340846872 MainThread DEBUG nova.network.neutron [req-e459a4b3-5702-4f0d-96ef-3d4f01d2ee65 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Updating instance_info_cache with network_info: [{"id": "ac4e1fac-eb99-4ce7-95bb-a6ec7e0e2d96", "address": "fa:16:3e:86:40:73", "network": {"id": "2b8d2ab0-2056-4c92-9f13-38b73897c01b", "bridge": null, "label": "tempest-SecurityGroupsTestJSON-625655316-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f12d8e551e4d4d599a26e3249f7560f1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapac4e1fac-eb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:54:41.036 4088 3038340846872 MainThread DEBUG oslo_concurrency.lockutils [req-e459a4b3-5702-4f0d-96ef-3d4f01d2ee65 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-c466fddc-e13c-4586-a808-4e92dcac06cc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:54:41.214 4088 3038340796264 MainThread DEBUG nova.compute.manager [req-8eec5598-4228-43c2-b033-fdf5d846e13e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Received event network-changed-d5286e5e-28fa-4987-849a-ba6527ce0a5c external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:54:41.214 4088 3038340796264 MainThread DEBUG nova.compute.manager [req-8eec5598-4228-43c2-b033-fdf5d846e13e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Refreshing instance network info cache due to event network-changed-d5286e5e-28fa-4987-849a-ba6527ce0a5c. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:54:42.191 4088 3038340795912 GreenThread-27 DEBUG nova.network.neutron [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Updating instance_info_cache with network_info: [{"id": "d5286e5e-28fa-4987-849a-ba6527ce0a5c", "address": "fa:16:3e:80:33:cc", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd5286e5e-28", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:54:42.215 4088 3038340795912 GreenThread-27 DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Releasing lock "refresh_cache-6f3c13e4-15bf-4dd6-ad7e-7870384f5220" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:54:42.215 4088 3038340795912 GreenThread-27 DEBUG nova.compute.manager [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Instance network_info: |[{"id": "d5286e5e-28fa-4987-849a-ba6527ce0a5c", "address": "fa:16:3e:80:33:cc", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd5286e5e-28", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:54:42.234 4088 3038340796264 MainThread DEBUG oslo_concurrency.lockutils [req-8eec5598-4228-43c2-b033-fdf5d846e13e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-6f3c13e4-15bf-4dd6-ad7e-7870384f5220" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:54:42.234 4088 3038340796264 MainThread DEBUG nova.network.neutron [req-8eec5598-4228-43c2-b033-fdf5d846e13e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Refreshing network info cache for port d5286e5e-28fa-4987-849a-ba6527ce0a5c _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:54:42.234 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Preparing to wait for external event network-vif-plugged-d5286e5e-28fa-4987-849a-ba6527ce0a5c prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:54:42.234 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "6f3c13e4-15bf-4dd6-ad7e-7870384f5220-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:42.234 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "6f3c13e4-15bf-4dd6-ad7e-7870384f5220-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:42.234 4088 3038340847048 MainThread DEBUG os_win.utils.compute.vmutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Creating VM instance-00000024 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:54:42.420 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:54:42.816 4088 3038340794856 MainThread DEBUG nova.virt.hyperv.vmops [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:54:42.830 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Lock "instance-00000022" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:42.830 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Lock "instance-00000022" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:42.889 4088 3038340794856 MainThread DEBUG os_win.utils.compute.vmutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Successfully changed vm state of instance-00000022 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:54:42.889 4088 3038340794856 MainThread DEBUG nova.virt.hyperv.vmops [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Successfully changed state of VM instance-00000022 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:54:43.058 4088 3038340794856 MainThread DEBUG os_win.utils.jobutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Waiting for WMI job: {'InstanceID': '7EFFE8B3-2FF2-4C5F-BDDD-A0E9BF2EE5AE', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19058), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:43.187 4088 3038340794856 MainThread DEBUG os_win.utils.jobutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] WMI job succeeded: {'InstanceID': '7EFFE8B3-2FF2-4C5F-BDDD-A0E9BF2EE5AE', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=138726), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:54:43.187 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Lock "instance-00000022" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:43.187 4088 3038340794856 MainThread DEBUG os_win.utils.pathutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Removing directory: C:\openstack\instances\instance-00000022 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:54:43.187 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Lock "instance-00000022" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:43.187 4088 3038340794856 MainThread ERROR nova.compute.manager [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000022' failed to start. Not enough memory in the system to start the virtual machine instance-00000022. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000022' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Not enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) 'instance-00000022' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Error code: 32778. 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] Traceback (most recent call last): 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] return function(*args, **kwargs) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] admin_password, network_info, block_device_info) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] return function(self, *args, **kwds) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self.force_reraise() 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] raise self.value 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] should_plug_vifs=False) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 'req_state': req_state}) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self.force_reraise() 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] raise self.value 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] time.sleep(sleep_time) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self.force_reraise() 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] raise self.value 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] return f(*args, **kwargs) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] return self._wait_for_job(job_path) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] error_desc=err_desc) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000022' failed to start. 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] Not enough memory in the system to start the virtual machine instance-00000022. 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000022' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] Not enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 'instance-00000022' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Error code: 32778. 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] During handling of the above exception, another exception occurred: 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] Traceback (most recent call last): 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] yield resources 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] accel_info=accel_info) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] return function(*args, **kwargs) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] admin_password, network_info, block_device_info) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] return function(self, *args, **kwds) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self.force_reraise() 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] raise self.value 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] should_plug_vifs=False) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 'req_state': req_state}) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self.force_reraise() 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] raise self.value 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] time.sleep(sleep_time) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self.force_reraise() 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] raise self.value 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] return f(*args, **kwargs) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] return self._wait_for_job(job_path) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] error_desc=err_desc) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000022' failed to start. 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] Not enough memory in the system to start the virtual machine instance-00000022. 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000022' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] Not enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 'instance-00000022' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Error code: 32778. 2021-09-10 16:54:43.187 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.202 4088 3038340794856 MainThread INFO nova.compute.manager [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Terminating instance 2021-09-10 16:54:43.202 4088 3038340794856 MainThread DEBUG nova.compute.manager [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:54:43.202 4088 3038340794856 MainThread INFO nova.virt.hyperv.vmops [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Got request to destroy instance 2021-09-10 16:54:43.230 4088 3038340794856 MainThread DEBUG nova.virt.hyperv.vmops [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:54:43.230 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Lock "instance-00000022" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:43.230 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Lock "instance-00000022" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:43.230 4088 3038340794856 MainThread INFO nova.compute.manager [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 16:54:43.230 4088 3038340794856 MainThread DEBUG nova.compute.claims [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:54:43.230 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:43.311 4088 3038340794856 MainThread DEBUG nova.virt.hyperv.hostops [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:54:43.356 4088 3038340794856 MainThread DEBUG nova.virt.hyperv.hostops [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:54:43.792 4088 3038340794856 MainThread DEBUG nova.compute.provider_tree [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:54:43.810 4088 3038340794856 MainThread DEBUG nova.scheduler.client.report [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:54:43.810 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.578s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:43.810 4088 3038340794856 MainThread ERROR nova.compute.manager [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000022' failed to start. Not enough memory in the system to start the virtual machine instance-00000022. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000022' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Not enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) 'instance-00000022' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Error code: 32778. 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] Traceback (most recent call last): 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] return function(*args, **kwargs) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] admin_password, network_info, block_device_info) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] return function(self, *args, **kwds) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self.force_reraise() 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] raise self.value 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] should_plug_vifs=False) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 'req_state': req_state}) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self.force_reraise() 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] raise self.value 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] time.sleep(sleep_time) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self.force_reraise() 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] raise self.value 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] return f(*args, **kwargs) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] return self._wait_for_job(job_path) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] error_desc=err_desc) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000022' failed to start. 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] Not enough memory in the system to start the virtual machine instance-00000022. 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000022' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] Not enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 'instance-00000022' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Error code: 32778. 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] During handling of the above exception, another exception occurred: 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] Traceback (most recent call last): 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] accel_info=accel_info) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] return function(*args, **kwargs) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] admin_password, network_info, block_device_info) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] return function(self, *args, **kwds) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self.force_reraise() 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] raise self.value 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] should_plug_vifs=False) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 'req_state': req_state}) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self.force_reraise() 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] raise self.value 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] time.sleep(sleep_time) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self.force_reraise() 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] raise self.value 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] return f(*args, **kwargs) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] return self._wait_for_job(job_path) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] error_desc=err_desc) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000022' failed to start. 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] Not enough memory in the system to start the virtual machine instance-00000022. 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000022' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] Not enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 'instance-00000022' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Error code: 32778. 2021-09-10 16:54:43.810 4088 3038340794856 MainThread TRACE nova.compute.manager [instance: f0b03925-8953-422e-83b5-82f2f00745af] 2021-09-10 16:54:43.810 4088 3038340794856 MainThread DEBUG nova.compute.utils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] WMI job failed with status 10. Error summary description: 'instance-00000022' failed to start. Not enough memory in the system to start the virtual machine instance-00000022. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:54:43.810 4088 3038340794856 MainThread DEBUG nova.compute.manager [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Build of instance f0b03925-8953-422e-83b5-82f2f00745af was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000022' failed to start. Not enough memory in the system to start the virtual machine instance-00000022. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000022' failed to start. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Not enough memory in the system to start the virtual machine instance-00000022 with ram size 1024 megabytes. (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) 'instance-00000022' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EBE05142-2225-4E0B-93B0-346AE805654B) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:54:43.810 4088 3038340794856 MainThread DEBUG nova.compute.manager [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:54:43.825 4088 3038340794856 MainThread DEBUG nova.compute.manager [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:54:43.825 4088 3038340794856 MainThread DEBUG nova.compute.manager [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:54:43.825 4088 3038340794856 MainThread DEBUG nova.network.neutron [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:54:44.464 4088 3038340796264 MainThread DEBUG nova.network.neutron [req-8eec5598-4228-43c2-b033-fdf5d846e13e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Updated VIF entry in instance network info cache for port d5286e5e-28fa-4987-849a-ba6527ce0a5c. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:54:44.464 4088 3038340796264 MainThread DEBUG nova.network.neutron [req-8eec5598-4228-43c2-b033-fdf5d846e13e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Updating instance_info_cache with network_info: [{"id": "d5286e5e-28fa-4987-849a-ba6527ce0a5c", "address": "fa:16:3e:80:33:cc", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd5286e5e-28", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:54:44.495 4088 3038340796264 MainThread DEBUG oslo_concurrency.lockutils [req-8eec5598-4228-43c2-b033-fdf5d846e13e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-6f3c13e4-15bf-4dd6-ad7e-7870384f5220" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:54:44.761 4088 3038340847048 MainThread DEBUG nova.virt.hyperv.vmops [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:54:45.058 4088 3038340794856 MainThread DEBUG nova.network.neutron [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:54:45.092 4088 3038340794856 MainThread INFO nova.compute.manager [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] [instance: f0b03925-8953-422e-83b5-82f2f00745af] Took 1.27 seconds to deallocate network for instance. 2021-09-10 16:54:45.339 4088 3038340794856 MainThread INFO nova.scheduler.client.report [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Deleted allocations for instance f0b03925-8953-422e-83b5-82f2f00745af 2021-09-10 16:54:45.387 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [req-55bdbb09-3a3e-4ad4-a4a6-a6ab41c6d191 92577cd3faa34912ba4767d0c2bde084 662be160c9d04068bc4711ac9c9433d7 - default default] Lock "f0b03925-8953-422e-83b5-82f2f00745af" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 31.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:50.559 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-22a60522-f38a-45d2-934c-477d1d809d26 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Received event network-vif-plugged-ac4e1fac-eb99-4ce7-95bb-a6ec7e0e2d96 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:54:50.559 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-22a60522-f38a-45d2-934c-477d1d809d26 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "c466fddc-e13c-4586-a808-4e92dcac06cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:50.559 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-22a60522-f38a-45d2-934c-477d1d809d26 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "c466fddc-e13c-4586-a808-4e92dcac06cc-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:50.589 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-22a60522-f38a-45d2-934c-477d1d809d26 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Processing event network-vif-plugged-ac4e1fac-eb99-4ce7-95bb-a6ec7e0e2d96 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:54:50.589 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-22a60522-f38a-45d2-934c-477d1d809d26 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Received event network-vif-plugged-d5286e5e-28fa-4987-849a-ba6527ce0a5c external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:54:50.589 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-22a60522-f38a-45d2-934c-477d1d809d26 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "6f3c13e4-15bf-4dd6-ad7e-7870384f5220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:50.589 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [req-22a60522-f38a-45d2-934c-477d1d809d26 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "6f3c13e4-15bf-4dd6-ad7e-7870384f5220-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:50.589 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-22a60522-f38a-45d2-934c-477d1d809d26 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Processing event network-vif-plugged-d5286e5e-28fa-4987-849a-ba6527ce0a5c _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:54:50.657 4088 3038340796088 MainThread INFO nova.virt.hyperv.vmops [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Using config drive for instance 2021-09-10 16:54:50.657 4088 3038340847048 MainThread INFO nova.virt.hyperv.vmops [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Using config drive for instance 2021-09-10 16:54:51.038 4088 3038340796088 MainThread INFO nova.virt.hyperv.vmops [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Creating config drive at C:\openstack\instances\instance-00000023\configdrive.iso 2021-09-10 16:54:51.140 4088 3038340796088 MainThread DEBUG oslo_concurrency.processutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000023\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp71zz_e2r execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:54:51.294 4088 3038340847048 MainThread INFO nova.virt.hyperv.vmops [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Creating config drive at C:\openstack\instances\instance-00000024\configdrive.iso 2021-09-10 16:54:51.389 4088 3038340847048 MainThread DEBUG oslo_concurrency.processutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000024\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp43rukadr execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:54:51.543 4088 3038340796088 MainThread DEBUG oslo_concurrency.processutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000023\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp71zz_e2r" returned: 0 in 0.406s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:54:51.761 4088 3038340847048 MainThread DEBUG oslo_concurrency.processutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000024\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp43rukadr" returned: 0 in 0.375s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:54:52.200 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Setting boot order for instance: instance-00000023: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:54:52.304 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:54:52.339 4088 3038340796088 MainThread DEBUG os_win.utils.jobutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Waiting for WMI job: {'InstanceID': 'D07821F0-23E4-4DC3-9A52-1C05ECAC799D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20419), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:52.441 4088 3038340847048 MainThread DEBUG nova.virt.hyperv.vmops [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Setting boot order for instance: instance-00000024: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:54:52.589 4088 3038340847048 MainThread DEBUG nova.virt.hyperv.vmops [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:54:52.589 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000023" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:52.589 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000023" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:52.589 4088 3038338907304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:54:52.589 4088 3038338907304 MainThread INFO nova.compute.manager [-] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] VM Stopped (Lifecycle Event) 2021-09-10 16:54:52.621 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-b6038632-c77f-406e-9440-ba9b35f3b0b2 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:54:52.621 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-b6038632-c77f-406e-9440-ba9b35f3b0b2 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:54:52.621 4088 3038340796088 MainThread ERROR os_win.utils.jobutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000023\' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)instance-000000235D7EB666-A5AB-4DB6-B084-17C94092E6B412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)instance-000000235D7EB666-A5AB-4DB6-B084-17C94092E6B410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000023\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)instance-000000235D7EB666-A5AB-4DB6-B084-17C94092E6B4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D07821F0-23E4-4DC3-9A52-1C05ECAC799D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=150203), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 54, 52), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 54, 52), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000023' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)\n\nNot enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)\n\n'instance-00000023' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)", 'ErrorSummaryDescription': "'instance-00000023' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000023.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:54:52.621 4088 3038340796088 MainThread DEBUG os_win._utils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000023' failed to start. Not enough memory in the system to start the virtual machine instance-00000023. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000023' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Not enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) 'instance-00000023' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.3127124309539795 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:54:52.652 4088 3038340847048 MainThread DEBUG os_win.utils.jobutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': '5221F4AD-71B8-471F-80A2-303105C3BE6C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=27089), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:52.692 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-b6038632-c77f-406e-9440-ba9b35f3b0b2 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:54:52.737 4088 3038338907304 MainThread INFO nova.compute.manager [req-b6038632-c77f-406e-9440-ba9b35f3b0b2 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:54:52.829 4088 3038340847048 MainThread ERROR os_win.utils.jobutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000024\' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)instance-000000247FA64EEA-6006-415A-A29E-3DC9661ED6A212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)instance-000000247FA64EEA-6006-415A-A29E-3DC9661ED6A210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000024\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)instance-000000247FA64EEA-6006-415A-A29E-3DC9661ED6A2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5221F4AD-71B8-471F-80A2-303105C3BE6C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=136433), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 54, 52), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 54, 52), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000024' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)\n\nNot enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)\n\n'instance-00000024' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)", 'ErrorSummaryDescription': "'instance-00000024' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000024.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:54:52.829 4088 3038340847048 MainThread DEBUG os_win._utils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000024' failed to start. Not enough memory in the system to start the virtual machine instance-00000024. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000024' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Not enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) 'instance-00000024' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.24044060707092285 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:54:52.845 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000024" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:52.845 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000024" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:52.845 4088 3038338907304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:54:52.845 4088 3038338907304 MainThread INFO nova.compute.manager [-] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] VM Stopped (Lifecycle Event) 2021-09-10 16:54:52.856 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-7e6e06cf-4ee1-41cf-8f29-570f898f9d37 - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:54:52.856 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-7e6e06cf-4ee1-41cf-8f29-570f898f9d37 - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:54:52.918 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-7e6e06cf-4ee1-41cf-8f29-570f898f9d37 - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:54:52.960 4088 3038338907304 MainThread INFO nova.compute.manager [req-7e6e06cf-4ee1-41cf-8f29-570f898f9d37 - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:54:53.653 4088 3038340796088 MainThread DEBUG os_win.utils.jobutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Waiting for WMI job: {'InstanceID': '49505F77-DC69-47F5-A9F5-AF37D2067B47', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18105), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:53.809 4088 3038340796088 MainThread ERROR os_win.utils.jobutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000023\' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)instance-000000235D7EB666-A5AB-4DB6-B084-17C94092E6B412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)instance-000000235D7EB666-A5AB-4DB6-B084-17C94092E6B410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000023\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)instance-000000235D7EB666-A5AB-4DB6-B084-17C94092E6B4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '49505F77-DC69-47F5-A9F5-AF37D2067B47', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120555), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 54, 53), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 54, 53), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000023' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)\n\nNot enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)\n\n'instance-00000023' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)", 'ErrorSummaryDescription': "'instance-00000023' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000023.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:54:53.809 4088 3038340796088 MainThread DEBUG os_win._utils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000023' failed to start. Not enough memory in the system to start the virtual machine instance-00000023. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000023' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Not enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) 'instance-00000023' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.5007615089416504 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:54:53.857 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000023" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:53.874 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000023" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:53.874 4088 3038338907304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:54:53.874 4088 3038338907304 MainThread INFO nova.compute.manager [-] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] VM Stopped (Lifecycle Event) 2021-09-10 16:54:53.874 4088 3038340847048 MainThread DEBUG os_win.utils.jobutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': 'C6CCEB8E-35C6-4986-8652-F7485D82112C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=25670), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:53.892 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-dfa89e12-e0a6-4a02-aafc-f4e07b7a1cd1 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:54:53.892 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-dfa89e12-e0a6-4a02-aafc-f4e07b7a1cd1 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:54:53.961 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-dfa89e12-e0a6-4a02-aafc-f4e07b7a1cd1 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:54:53.995 4088 3038338907304 MainThread INFO nova.compute.manager [req-dfa89e12-e0a6-4a02-aafc-f4e07b7a1cd1 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:54:54.026 4088 3038340847048 MainThread ERROR os_win.utils.jobutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000024\' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)instance-000000247FA64EEA-6006-415A-A29E-3DC9661ED6A212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)instance-000000247FA64EEA-6006-415A-A29E-3DC9661ED6A210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000024\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)instance-000000247FA64EEA-6006-415A-A29E-3DC9661ED6A2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C6CCEB8E-35C6-4986-8652-F7485D82112C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=127290), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 54, 53), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 54, 53), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000024' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)\n\nNot enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)\n\n'instance-00000024' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)", 'ErrorSummaryDescription': "'instance-00000024' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000024.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:54:54.026 4088 3038340847048 MainThread DEBUG os_win._utils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000024' failed to start. Not enough memory in the system to start the virtual machine instance-00000024. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000024' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Not enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) 'instance-00000024' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4374442100524902 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:54:54.060 4088 3038338907304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:54:54.060 4088 3038338907304 MainThread INFO nova.compute.manager [-] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] VM Stopped (Lifecycle Event) 2021-09-10 16:54:54.060 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000024" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:54.060 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000024" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:54.089 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-b2d99aa6-e019-4e51-a517-6009813912e6 - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:54:54.089 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-b2d99aa6-e019-4e51-a517-6009813912e6 - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:54:54.167 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-b2d99aa6-e019-4e51-a517-6009813912e6 - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:54:54.202 4088 3038338907304 MainThread INFO nova.compute.manager [req-b2d99aa6-e019-4e51-a517-6009813912e6 - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:54:54.840 4088 3038340796088 MainThread DEBUG os_win.utils.jobutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Waiting for WMI job: {'InstanceID': '6AD23932-2C17-4D93-9E0B-20B2BA837160', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16928), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:55.012 4088 3038340796088 MainThread ERROR os_win.utils.jobutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000023\' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)instance-000000235D7EB666-A5AB-4DB6-B084-17C94092E6B412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)instance-000000235D7EB666-A5AB-4DB6-B084-17C94092E6B410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000023\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)instance-000000235D7EB666-A5AB-4DB6-B084-17C94092E6B4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6AD23932-2C17-4D93-9E0B-20B2BA837160', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=130969), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 54, 54), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 54, 54), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000023' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)\n\nNot enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)\n\n'instance-00000023' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)", 'ErrorSummaryDescription': "'instance-00000023' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000023.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:54:55.012 4088 3038340796088 MainThread DEBUG os_win._utils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000023' failed to start. Not enough memory in the system to start the virtual machine instance-00000023. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000023' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Not enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) 'instance-00000023' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.7036631107330322 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:54:55.045 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000023" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:55.045 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000023" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:55.045 4088 3038338907304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:54:55.045 4088 3038338907304 MainThread INFO nova.compute.manager [-] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] VM Stopped (Lifecycle Event) 2021-09-10 16:54:55.073 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-663d901a-ea5a-4923-9f9c-c88131436452 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:54:55.073 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-663d901a-ea5a-4923-9f9c-c88131436452 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:54:55.073 4088 3038340847048 MainThread DEBUG os_win.utils.jobutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': 'C2B69B1D-3E9B-4CD3-9F92-2679CB8F7F08', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=23066), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:55.156 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-663d901a-ea5a-4923-9f9c-c88131436452 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:54:55.222 4088 3038338907304 MainThread INFO nova.compute.manager [req-663d901a-ea5a-4923-9f9c-c88131436452 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:54:55.276 4088 3038338907304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:54:55.276 4088 3038338907304 MainThread INFO nova.compute.manager [-] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] VM Stopped (Lifecycle Event) 2021-09-10 16:54:55.276 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000024" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:55.276 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000024" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:55.312 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-fb498895-b7f3-4695-80f2-4bb7342fdcfb - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:54:55.312 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-fb498895-b7f3-4695-80f2-4bb7342fdcfb - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:54:55.341 4088 3038340847048 MainThread ERROR os_win.utils.jobutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000024\' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)instance-000000247FA64EEA-6006-415A-A29E-3DC9661ED6A212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)instance-000000247FA64EEA-6006-415A-A29E-3DC9661ED6A210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000024\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)instance-000000247FA64EEA-6006-415A-A29E-3DC9661ED6A2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C2B69B1D-3E9B-4CD3-9F92-2679CB8F7F08', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=138595), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 54, 55), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 54, 55), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000024' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)\n\nNot enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)\n\n'instance-00000024' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)", 'ErrorSummaryDescription': "'instance-00000024' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000024.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:54:55.341 4088 3038340847048 MainThread DEBUG os_win._utils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000024' failed to start. Not enough memory in the system to start the virtual machine instance-00000024. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000024' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Not enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) 'instance-00000024' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.752819776535034 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:54:55.372 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-fb498895-b7f3-4695-80f2-4bb7342fdcfb - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:54:55.426 4088 3038338907304 MainThread INFO nova.compute.manager [req-fb498895-b7f3-4695-80f2-4bb7342fdcfb - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:54:56.045 4088 3038340796088 MainThread DEBUG os_win.utils.jobutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Waiting for WMI job: {'InstanceID': 'C2A33B71-AF5D-4B97-B9A9-0B08445B873B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17816), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:56.202 4088 3038340796088 MainThread ERROR os_win.utils.jobutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000023\' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)instance-000000235D7EB666-A5AB-4DB6-B084-17C94092E6B412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)instance-000000235D7EB666-A5AB-4DB6-B084-17C94092E6B410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000023\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)instance-000000235D7EB666-A5AB-4DB6-B084-17C94092E6B4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C2A33B71-AF5D-4B97-B9A9-0B08445B873B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=122421), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 54, 56), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 54, 56), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000023' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)\n\nNot enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)\n\n'instance-00000023' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)", 'ErrorSummaryDescription': "'instance-00000023' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000023.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:54:56.202 4088 3038340796088 MainThread DEBUG os_win._utils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000023' failed to start. Not enough memory in the system to start the virtual machine instance-00000023. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000023' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Not enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) 'instance-00000023' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.893930673599243 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:54:56.226 4088 3038338907304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:54:56.226 4088 3038338907304 MainThread INFO nova.compute.manager [-] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] VM Stopped (Lifecycle Event) 2021-09-10 16:54:56.226 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000023" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:56.226 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000023" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:56.250 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-e5e64ee8-263a-414d-a723-bfda02545574 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:54:56.250 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-e5e64ee8-263a-414d-a723-bfda02545574 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:54:56.325 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-e5e64ee8-263a-414d-a723-bfda02545574 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:54:56.378 4088 3038340847048 MainThread DEBUG os_win.utils.jobutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': 'DC2A634B-7069-46B3-849E-2E6CF7443078', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19578), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:56.399 4088 3038338907304 MainThread INFO nova.compute.manager [req-e5e64ee8-263a-414d-a723-bfda02545574 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:54:56.541 4088 3038340847048 MainThread ERROR os_win.utils.jobutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000024\' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)instance-000000247FA64EEA-6006-415A-A29E-3DC9661ED6A212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)instance-000000247FA64EEA-6006-415A-A29E-3DC9661ED6A210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000024\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)instance-000000247FA64EEA-6006-415A-A29E-3DC9661ED6A2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'DC2A634B-7069-46B3-849E-2E6CF7443078', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121904), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 54, 56), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 54, 56), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000024' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)\n\nNot enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)\n\n'instance-00000024' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)", 'ErrorSummaryDescription': "'instance-00000024' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000024.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:54:56.542 4088 3038340847048 MainThread DEBUG os_win._utils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000024' failed to start. Not enough memory in the system to start the virtual machine instance-00000024. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000024' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Not enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) 'instance-00000024' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.9537720680236816 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:54:56.585 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000024" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:56.585 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000024" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:56.585 4088 3038338907304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:54:56.585 4088 3038338907304 MainThread INFO nova.compute.manager [-] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] VM Stopped (Lifecycle Event) 2021-09-10 16:54:56.620 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-b3d22473-2271-4060-a5ad-a38306e9e217 - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:54:56.620 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-b3d22473-2271-4060-a5ad-a38306e9e217 - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:54:56.683 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-b3d22473-2271-4060-a5ad-a38306e9e217 - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:54:56.725 4088 3038338907304 MainThread INFO nova.compute.manager [req-b3d22473-2271-4060-a5ad-a38306e9e217 - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:54:57.252 4088 3038340796088 MainThread DEBUG os_win.utils.jobutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Waiting for WMI job: {'InstanceID': '53B8679C-EC41-4627-9BA1-5F0C94C2C669', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=22049), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:57.417 4088 3038340796088 MainThread ERROR os_win.utils.jobutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000023\' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)instance-000000235D7EB666-A5AB-4DB6-B084-17C94092E6B412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)instance-000000235D7EB666-A5AB-4DB6-B084-17C94092E6B410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000023\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)instance-000000235D7EB666-A5AB-4DB6-B084-17C94092E6B4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '53B8679C-EC41-4627-9BA1-5F0C94C2C669', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=126748), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 54, 57), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 54, 57), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000023' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)\n\nNot enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)\n\n'instance-00000023' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)", 'ErrorSummaryDescription': "'instance-00000023' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000023.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:54:57.417 4088 3038340796088 MainThread DEBUG os_win._utils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000023' failed to start. Not enough memory in the system to start the virtual machine instance-00000023. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000023' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Not enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) 'instance-00000023' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.109076738357544 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:54:57.439 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000023" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:57.439 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000023" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:57.439 4088 3038338907304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:54:57.439 4088 3038338907304 MainThread INFO nova.compute.manager [-] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] VM Stopped (Lifecycle Event) 2021-09-10 16:54:57.468 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-4c225493-dbac-48a7-9f6b-d6389ed651ab - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:54:57.468 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-4c225493-dbac-48a7-9f6b-d6389ed651ab - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:54:57.534 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-4c225493-dbac-48a7-9f6b-d6389ed651ab - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:54:57.568 4088 3038338907304 MainThread INFO nova.compute.manager [req-4c225493-dbac-48a7-9f6b-d6389ed651ab - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:54:57.574 4088 3038340847048 MainThread DEBUG os_win.utils.jobutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': '8061384E-2365-45B6-B044-9416B49E7FBF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18628), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:57.732 4088 3038340847048 MainThread ERROR os_win.utils.jobutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000024\' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)instance-000000247FA64EEA-6006-415A-A29E-3DC9661ED6A212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)instance-000000247FA64EEA-6006-415A-A29E-3DC9661ED6A210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000024\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)instance-000000247FA64EEA-6006-415A-A29E-3DC9661ED6A2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '8061384E-2365-45B6-B044-9416B49E7FBF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=123682), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 54, 57), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 54, 57), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000024' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)\n\nNot enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)\n\n'instance-00000024' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)", 'ErrorSummaryDescription': "'instance-00000024' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000024.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:54:57.732 4088 3038340847048 MainThread DEBUG os_win._utils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000024' failed to start. Not enough memory in the system to start the virtual machine instance-00000024. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000024' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Not enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) 'instance-00000024' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.143680572509766 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:54:57.760 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000024" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:57.760 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000024" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:57.760 4088 3038338907304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:54:57.760 4088 3038338907304 MainThread INFO nova.compute.manager [-] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] VM Stopped (Lifecycle Event) 2021-09-10 16:54:57.804 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-e6023bb4-709d-40e3-a240-670143d8ae1d - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:54:57.804 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-e6023bb4-709d-40e3-a240-670143d8ae1d - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:54:57.864 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-e6023bb4-709d-40e3-a240-670143d8ae1d - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:54:57.908 4088 3038338907304 MainThread INFO nova.compute.manager [req-e6023bb4-709d-40e3-a240-670143d8ae1d - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:54:58.464 4088 3038340796088 MainThread DEBUG os_win.utils.jobutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Waiting for WMI job: {'InstanceID': '51A0585E-0013-47A7-9494-CF0AD0DE1B36', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17885), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:58.621 4088 3038340796088 MainThread ERROR os_win.utils.jobutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000023\' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)instance-000000235D7EB666-A5AB-4DB6-B084-17C94092E6B412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)instance-000000235D7EB666-A5AB-4DB6-B084-17C94092E6B410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000023\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)instance-000000235D7EB666-A5AB-4DB6-B084-17C94092E6B4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '51A0585E-0013-47A7-9494-CF0AD0DE1B36', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=123871), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 54, 58), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 54, 58), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000023' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)\n\nNot enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)\n\n'instance-00000023' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4)", 'ErrorSummaryDescription': "'instance-00000023' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000023.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:54:58.621 4088 3038340796088 MainThread ERROR nova.virt.hyperv.vmops [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Failed to change vm state of instance-00000023 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000023' failed to start. 2021-09-10 16:54:58.639 4088 3038340796088 MainThread INFO nova.virt.hyperv.vmops [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Got request to destroy instance 2021-09-10 16:54:58.683 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000023" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:58.683 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000023" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:58.683 4088 3038338907304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:54:58.683 4088 3038338907304 MainThread INFO nova.compute.manager [-] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] VM Stopped (Lifecycle Event) 2021-09-10 16:54:58.683 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-3aac2535-ea74-4ec1-85d4-9b4905cbaf20 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:54:58.713 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-3aac2535-ea74-4ec1-85d4-9b4905cbaf20 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:54:58.763 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-3aac2535-ea74-4ec1-85d4-9b4905cbaf20 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:54:58.798 4088 3038338907304 MainThread INFO nova.compute.manager [req-3aac2535-ea74-4ec1-85d4-9b4905cbaf20 - - - - -] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:54:58.838 4088 3038340847048 MainThread DEBUG os_win.utils.jobutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': '34BE13FF-339C-4C38-8A86-1407A671236F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=77757), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:54:58.985 4088 3038340847048 MainThread ERROR os_win.utils.jobutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000024\' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)instance-000000247FA64EEA-6006-415A-A29E-3DC9661ED6A212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)instance-000000247FA64EEA-6006-415A-A29E-3DC9661ED6A210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000024\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)instance-000000247FA64EEA-6006-415A-A29E-3DC9661ED6A2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '34BE13FF-339C-4C38-8A86-1407A671236F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=140801), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 54, 58), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 54, 58), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000024' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)\n\nNot enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)\n\n'instance-00000024' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2)", 'ErrorSummaryDescription': "'instance-00000024' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000024.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:54:58.985 4088 3038340847048 MainThread ERROR nova.virt.hyperv.vmops [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Failed to change vm state of instance-00000024 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000024' failed to start. 2021-09-10 16:54:58.985 4088 3038340847048 MainThread INFO nova.virt.hyperv.vmops [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Got request to destroy instance 2021-09-10 16:54:58.985 4088 3038338907304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:54:58.985 4088 3038338907304 MainThread INFO nova.compute.manager [-] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] VM Stopped (Lifecycle Event) 2021-09-10 16:54:59.005 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000024" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:54:59.005 4088 3038340794856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000024" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:54:59.027 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-a1f621c0-b84d-4867-980a-d3aeddbfbe4e - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:54:59.027 4088 3038338907304 MainThread DEBUG nova.virt.hyperv.vmops [req-a1f621c0-b84d-4867-980a-d3aeddbfbe4e - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:54:59.107 4088 3038338907304 MainThread DEBUG nova.compute.manager [req-a1f621c0-b84d-4867-980a-d3aeddbfbe4e - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:54:59.142 4088 3038338907304 MainThread INFO nova.compute.manager [req-a1f621c0-b84d-4867-980a-d3aeddbfbe4e - - - - -] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:55:00.862 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:55:00.881 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "instance-00000023" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:00.881 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "instance-00000023" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:00.889 4088 3038340796088 MainThread DEBUG os_win.utils.compute.vmutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Successfully changed vm state of instance-00000023 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:55:00.889 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Successfully changed state of VM instance-00000023 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:55:00.938 4088 3038340796088 MainThread DEBUG os_win.utils.jobutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Waiting for WMI job: {'InstanceID': '6E6CF800-64A2-487D-ADFD-88FD6ADDAA49', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16420), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:55:01.053 4088 3038340796088 MainThread DEBUG os_win.utils.jobutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] WMI job succeeded: {'InstanceID': '6E6CF800-64A2-487D-ADFD-88FD6ADDAA49', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=100801), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:55:01.058 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "instance-00000023" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:01.058 4088 3038340796088 MainThread DEBUG os_win.utils.pathutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Removing directory: C:\openstack\instances\instance-00000023 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:55:01.058 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "instance-00000023" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:01.058 4088 3038340796088 MainThread ERROR nova.compute.manager [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000023' failed to start. Not enough memory in the system to start the virtual machine instance-00000023. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000023' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Not enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) 'instance-00000023' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Error code: 32778. 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Traceback (most recent call last): 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] return function(*args, **kwargs) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] admin_password, network_info, block_device_info) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] return function(self, *args, **kwds) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self.force_reraise() 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] raise self.value 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] should_plug_vifs=False) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 'req_state': req_state}) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self.force_reraise() 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] raise self.value 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] time.sleep(sleep_time) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self.force_reraise() 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] raise self.value 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] return f(*args, **kwargs) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] return self._wait_for_job(job_path) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] error_desc=err_desc) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000023' failed to start. 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Not enough memory in the system to start the virtual machine instance-00000023. 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000023' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Not enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 'instance-00000023' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Error code: 32778. 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] During handling of the above exception, another exception occurred: 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Traceback (most recent call last): 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] yield resources 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] accel_info=accel_info) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] return function(*args, **kwargs) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] admin_password, network_info, block_device_info) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] return function(self, *args, **kwds) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self.force_reraise() 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] raise self.value 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] should_plug_vifs=False) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 'req_state': req_state}) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self.force_reraise() 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] raise self.value 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] time.sleep(sleep_time) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self.force_reraise() 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] raise self.value 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] return f(*args, **kwargs) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] return self._wait_for_job(job_path) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] error_desc=err_desc) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000023' failed to start. 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Not enough memory in the system to start the virtual machine instance-00000023. 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000023' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Not enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 'instance-00000023' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Error code: 32778. 2021-09-10 16:55:01.058 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.058 4088 3038340796088 MainThread INFO nova.compute.manager [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Terminating instance 2021-09-10 16:55:01.058 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:55:01.058 4088 3038340796088 MainThread INFO nova.virt.hyperv.vmops [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Got request to destroy instance 2021-09-10 16:55:01.090 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:55:01.090 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "instance-00000023" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:01.090 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "instance-00000023" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:01.090 4088 3038340796088 MainThread INFO nova.compute.manager [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 16:55:01.090 4088 3038340796088 MainThread DEBUG nova.compute.claims [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:55:01.090 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:01.230 4088 3038340847048 MainThread DEBUG nova.virt.hyperv.vmops [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:55:01.230 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000024" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:01.246 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000024" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:01.246 4088 3038340847048 MainThread DEBUG os_win.utils.compute.vmutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Successfully changed vm state of instance-00000024 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:55:01.246 4088 3038340847048 MainThread DEBUG nova.virt.hyperv.vmops [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Successfully changed state of VM instance-00000024 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:55:01.308 4088 3038340847048 MainThread DEBUG os_win.utils.jobutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': '8A3F5179-471D-421C-8FD9-5E0ABBFA6934', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18177), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:55:01.370 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.hostops [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:55:01.397 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.hostops [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:55:01.434 4088 3038340847048 MainThread DEBUG os_win.utils.jobutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job succeeded: {'InstanceID': '8A3F5179-471D-421C-8FD9-5E0ABBFA6934', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=119532), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:55:01.434 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000024" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:01.434 4088 3038340847048 MainThread DEBUG os_win.utils.pathutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Removing directory: C:\openstack\instances\instance-00000024 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:55:01.434 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000024" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:01.434 4088 3038340847048 MainThread ERROR nova.compute.manager [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000024' failed to start. Not enough memory in the system to start the virtual machine instance-00000024. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000024' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Not enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) 'instance-00000024' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Error code: 32778. 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Traceback (most recent call last): 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] return function(*args, **kwargs) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] admin_password, network_info, block_device_info) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] return function(self, *args, **kwds) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self.force_reraise() 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] raise self.value 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] should_plug_vifs=False) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 'req_state': req_state}) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self.force_reraise() 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] raise self.value 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] time.sleep(sleep_time) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self.force_reraise() 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] raise self.value 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] return f(*args, **kwargs) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] return self._wait_for_job(job_path) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] error_desc=err_desc) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000024' failed to start. 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Not enough memory in the system to start the virtual machine instance-00000024. 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000024' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Not enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 'instance-00000024' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Error code: 32778. 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] During handling of the above exception, another exception occurred: 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Traceback (most recent call last): 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] yield resources 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] accel_info=accel_info) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] return function(*args, **kwargs) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] admin_password, network_info, block_device_info) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] return function(self, *args, **kwds) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self.force_reraise() 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] raise self.value 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] should_plug_vifs=False) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 'req_state': req_state}) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self.force_reraise() 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] raise self.value 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] time.sleep(sleep_time) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self.force_reraise() 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] raise self.value 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] return f(*args, **kwargs) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] return self._wait_for_job(job_path) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] error_desc=err_desc) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000024' failed to start. 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Not enough memory in the system to start the virtual machine instance-00000024. 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000024' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Not enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 'instance-00000024' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Error code: 32778. 2021-09-10 16:55:01.434 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:01.459 4088 3038340847048 MainThread INFO nova.compute.manager [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Terminating instance 2021-09-10 16:55:01.459 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:55:01.459 4088 3038340847048 MainThread INFO nova.virt.hyperv.vmops [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Got request to destroy instance 2021-09-10 16:55:01.465 4088 3038340847048 MainThread DEBUG nova.virt.hyperv.vmops [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:55:01.465 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000024" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:01.465 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000024" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:01.465 4088 3038340847048 MainThread INFO nova.compute.manager [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Took 0.00 seconds to destroy the instance on the hypervisor. 2021-09-10 16:55:01.465 4088 3038340847048 MainThread DEBUG nova.compute.claims [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:55:01.635 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Lock "c6fa36bc-df54-4f59-82b7-4db06ead4dd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:01.635 4088 3038340796088 MainThread DEBUG nova.compute.provider_tree [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:55:01.654 4088 3038340796088 MainThread DEBUG nova.scheduler.client.report [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:55:01.654 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.562s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:01.678 4088 3038340796088 MainThread ERROR nova.compute.manager [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000023' failed to start. Not enough memory in the system to start the virtual machine instance-00000023. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000023' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Not enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) 'instance-00000023' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Error code: 32778. 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Traceback (most recent call last): 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] return function(*args, **kwargs) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] admin_password, network_info, block_device_info) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] return function(self, *args, **kwds) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self.force_reraise() 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] raise self.value 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] should_plug_vifs=False) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 'req_state': req_state}) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self.force_reraise() 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] raise self.value 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] time.sleep(sleep_time) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self.force_reraise() 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] raise self.value 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] return f(*args, **kwargs) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] return self._wait_for_job(job_path) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] error_desc=err_desc) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000023' failed to start. 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Not enough memory in the system to start the virtual machine instance-00000023. 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000023' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Not enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 'instance-00000023' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Error code: 32778. 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] During handling of the above exception, another exception occurred: 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Traceback (most recent call last): 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] accel_info=accel_info) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] return function(*args, **kwargs) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] admin_password, network_info, block_device_info) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] return function(self, *args, **kwds) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self.force_reraise() 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] raise self.value 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] should_plug_vifs=False) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 'req_state': req_state}) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self.force_reraise() 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] raise self.value 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] time.sleep(sleep_time) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self.force_reraise() 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] raise self.value 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] return f(*args, **kwargs) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] return self._wait_for_job(job_path) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] error_desc=err_desc) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000023' failed to start. 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Not enough memory in the system to start the virtual machine instance-00000023. 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000023' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Not enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 'instance-00000023' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Error code: 32778. 2021-09-10 16:55:01.678 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] 2021-09-10 16:55:01.678 4088 3038340796088 MainThread DEBUG nova.compute.utils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] WMI job failed with status 10. Error summary description: 'instance-00000023' failed to start. Not enough memory in the system to start the virtual machine instance-00000023. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:55:01.678 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Build of instance c466fddc-e13c-4586-a808-4e92dcac06cc was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000023' failed to start. Not enough memory in the system to start the virtual machine instance-00000023. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000023' failed to start. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Not enough memory in the system to start the virtual machine instance-00000023 with ram size 1024 megabytes. (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) 'instance-00000023' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5D7EB666-A5AB-4DB6-B084-17C94092E6B4) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:55:01.684 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:55:01.684 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:55:01.684 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:55:01.684 4088 3038340796088 MainThread DEBUG nova.network.neutron [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:55:01.684 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.219s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:01.698 4088 3038340847400 MainThread DEBUG nova.compute.manager [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:55:01.921 4088 3038340847048 MainThread DEBUG nova.virt.hyperv.hostops [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:55:01.953 4088 3038340847048 MainThread DEBUG nova.virt.hyperv.hostops [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:55:02.169 4088 3038340847048 MainThread DEBUG nova.compute.provider_tree [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:55:02.200 4088 3038340847048 MainThread DEBUG nova.scheduler.client.report [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:55:02.200 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.515s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:02.200 4088 3038340847048 MainThread ERROR nova.compute.manager [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000024' failed to start. Not enough memory in the system to start the virtual machine instance-00000024. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000024' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Not enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) 'instance-00000024' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Error code: 32778. 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Traceback (most recent call last): 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] return function(*args, **kwargs) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] admin_password, network_info, block_device_info) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] return function(self, *args, **kwds) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self.force_reraise() 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] raise self.value 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] should_plug_vifs=False) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 'req_state': req_state}) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self.force_reraise() 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] raise self.value 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] time.sleep(sleep_time) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self.force_reraise() 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] raise self.value 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] return f(*args, **kwargs) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] return self._wait_for_job(job_path) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] error_desc=err_desc) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000024' failed to start. 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Not enough memory in the system to start the virtual machine instance-00000024. 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000024' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Not enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 'instance-00000024' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Error code: 32778. 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] During handling of the above exception, another exception occurred: 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Traceback (most recent call last): 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] accel_info=accel_info) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] return function(*args, **kwargs) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] admin_password, network_info, block_device_info) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] return function(self, *args, **kwds) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self.force_reraise() 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] raise self.value 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] should_plug_vifs=False) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 'req_state': req_state}) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self.force_reraise() 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] raise self.value 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] time.sleep(sleep_time) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self.force_reraise() 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] raise self.value 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] return f(*args, **kwargs) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] return self._wait_for_job(job_path) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] error_desc=err_desc) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000024' failed to start. 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Not enough memory in the system to start the virtual machine instance-00000024. 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000024' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Not enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 'instance-00000024' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Error code: 32778. 2021-09-10 16:55:02.200 4088 3038340847048 MainThread TRACE nova.compute.manager [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] 2021-09-10 16:55:02.200 4088 3038340847048 MainThread DEBUG nova.compute.utils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] WMI job failed with status 10. Error summary description: 'instance-00000024' failed to start. Not enough memory in the system to start the virtual machine instance-00000024. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:55:02.200 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Build of instance 6f3c13e4-15bf-4dd6-ad7e-7870384f5220 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000024' failed to start. Not enough memory in the system to start the virtual machine instance-00000024. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000024' failed to start. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Not enough memory in the system to start the virtual machine instance-00000024 with ram size 1024 megabytes. (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) 'instance-00000024' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7FA64EEA-6006-415A-A29E-3DC9661ED6A2) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:55:02.200 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:55:02.200 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:55:02.200 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:55:02.200 4088 3038340847048 MainThread DEBUG nova.network.neutron [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:55:02.225 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.313s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:02.225 4088 3038340847400 MainThread DEBUG nova.virt.hardware [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:55:02.225 4088 3038340847400 MainThread INFO nova.compute.claims [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Claim successful on node n-h2-808474-1 2021-09-10 16:55:02.461 4088 3038340847400 MainThread DEBUG nova.virt.hyperv.hostops [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:55:02.479 4088 3038340847400 MainThread DEBUG nova.virt.hyperv.hostops [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:55:02.698 4088 3038340847400 MainThread DEBUG nova.compute.provider_tree [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:55:02.698 4088 3038340847400 MainThread DEBUG nova.scheduler.client.report [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:55:02.698 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:02.698 4088 3038340847400 MainThread DEBUG nova.compute.manager [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:55:02.826 4088 3038340847400 MainThread DEBUG nova.compute.manager [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:55:02.826 4088 3038340845992 GreenThread-28 DEBUG nova.compute.manager [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:55:02.826 4088 3038340845992 GreenThread-28 DEBUG nova.network.neutron [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:55:03.090 4088 3038340845992 GreenThread-28 DEBUG nova.policy [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a884270e965c4547831a05eb6d766a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8104d9820d2e4012a4147616bf84cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:55:03.090 4088 3038340847400 MainThread DEBUG nova.compute.manager [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:55:03.090 4088 3038340847400 MainThread INFO nova.virt.hyperv.vmops [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Spawning new instance 2021-09-10 16:55:03.116 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Lock "instance-00000025" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:03.116 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Lock "instance-00000025" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:03.116 4088 3038340847400 MainThread DEBUG nova.block_device [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:55:03.116 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:03.116 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:03.130 4088 3038340847400 MainThread DEBUG os_win.utils.pathutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Creating directory: C:\openstack\instances\instance-00000025 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:55:03.130 4088 3038340847400 MainThread DEBUG nova.virt.hyperv.vmops [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000025\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:55:03.387 4088 3038340847400 MainThread DEBUG nova.virt.hyperv.vmops [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Resizing VHD C:\openstack\instances\instance-00000025\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:55:03.469 4088 3038340796088 MainThread DEBUG nova.network.neutron [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:55:03.515 4088 3038340796088 MainThread INFO nova.compute.manager [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: c466fddc-e13c-4586-a808-4e92dcac06cc] Took 1.83 seconds to deallocate network for instance. 2021-09-10 16:55:03.831 4088 3038340847048 MainThread DEBUG nova.network.neutron [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:55:03.869 4088 3038340847048 MainThread INFO nova.compute.manager [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 6f3c13e4-15bf-4dd6-ad7e-7870384f5220] Took 1.67 seconds to deallocate network for instance. 2021-09-10 16:55:03.905 4088 3038340796088 MainThread INFO nova.scheduler.client.report [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Deleted allocations for instance c466fddc-e13c-4586-a808-4e92dcac06cc 2021-09-10 16:55:04.073 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-4b7967d0-32d0-47b8-8bc1-ef1f7575e815 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "c466fddc-e13c-4586-a808-4e92dcac06cc" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 36.656s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:04.273 4088 3038340847048 MainThread INFO nova.scheduler.client.report [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Deleted allocations for instance 6f3c13e4-15bf-4dd6-ad7e-7870384f5220 2021-09-10 16:55:04.339 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-4c12700e-58e1-44d6-83bf-81c24936952b d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "6f3c13e4-15bf-4dd6-ad7e-7870384f5220" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 31.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:06.102 4088 3038340845992 GreenThread-28 DEBUG nova.network.neutron [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Successfully created port: d0d4427d-8b2d-4937-957c-f2ce208c73ae _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:55:07.445 4088 3038340845992 GreenThread-28 DEBUG nova.network.neutron [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Successfully updated port: d0d4427d-8b2d-4937-957c-f2ce208c73ae _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:55:07.464 4088 3038340845992 GreenThread-28 DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Acquired lock "refresh_cache-c6fa36bc-df54-4f59-82b7-4db06ead4dd7" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:55:07.464 4088 3038340845992 GreenThread-28 DEBUG nova.network.neutron [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:55:07.599 4088 3038340845992 GreenThread-28 DEBUG nova.network.neutron [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:55:08.231 4088 3038340845992 GreenThread-28 DEBUG nova.network.neutron [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Updating instance_info_cache with network_info: [{"id": "d0d4427d-8b2d-4937-957c-f2ce208c73ae", "address": "fa:16:3e:a5:28:82", "network": {"id": "6a1373b1-59c8-4186-817b-9e6d041358e3", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-613717313-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8104d9820d2e4012a4147616bf84cac4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd0d4427d-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:55:08.272 4088 3038340845992 GreenThread-28 DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Releasing lock "refresh_cache-c6fa36bc-df54-4f59-82b7-4db06ead4dd7" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:55:08.272 4088 3038340845992 GreenThread-28 DEBUG nova.compute.manager [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Instance network_info: |[{"id": "d0d4427d-8b2d-4937-957c-f2ce208c73ae", "address": "fa:16:3e:a5:28:82", "network": {"id": "6a1373b1-59c8-4186-817b-9e6d041358e3", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-613717313-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8104d9820d2e4012a4147616bf84cac4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd0d4427d-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:55:08.276 4088 3038340847400 MainThread DEBUG nova.compute.manager [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Preparing to wait for external event network-vif-plugged-d0d4427d-8b2d-4937-957c-f2ce208c73ae prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:55:08.276 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Lock "c6fa36bc-df54-4f59-82b7-4db06ead4dd7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:08.276 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Lock "c6fa36bc-df54-4f59-82b7-4db06ead4dd7-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:08.276 4088 3038340847400 MainThread DEBUG os_win.utils.compute.vmutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Creating VM instance-00000025 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:55:09.355 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-8cf32e92-cd69-4262-a47e-1ce2e1911a37 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Received event network-changed-d0d4427d-8b2d-4937-957c-f2ce208c73ae external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:55:09.355 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-8cf32e92-cd69-4262-a47e-1ce2e1911a37 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Refreshing instance network info cache due to event network-changed-d0d4427d-8b2d-4937-957c-f2ce208c73ae. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:55:09.355 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-8cf32e92-cd69-4262-a47e-1ce2e1911a37 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-c6fa36bc-df54-4f59-82b7-4db06ead4dd7" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:55:09.355 4088 3038340796088 MainThread DEBUG nova.network.neutron [req-8cf32e92-cd69-4262-a47e-1ce2e1911a37 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Refreshing network info cache for port d0d4427d-8b2d-4937-957c-f2ce208c73ae _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:55:10.119 4088 3038340847400 MainThread DEBUG nova.virt.hyperv.vmops [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:55:10.186 4088 3038340796088 MainThread DEBUG nova.network.neutron [req-8cf32e92-cd69-4262-a47e-1ce2e1911a37 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Updated VIF entry in instance network info cache for port d0d4427d-8b2d-4937-957c-f2ce208c73ae. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:55:10.202 4088 3038340796088 MainThread DEBUG nova.network.neutron [req-8cf32e92-cd69-4262-a47e-1ce2e1911a37 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Updating instance_info_cache with network_info: [{"id": "d0d4427d-8b2d-4937-957c-f2ce208c73ae", "address": "fa:16:3e:a5:28:82", "network": {"id": "6a1373b1-59c8-4186-817b-9e6d041358e3", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-613717313-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8104d9820d2e4012a4147616bf84cac4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd0d4427d-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:55:10.202 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-8cf32e92-cd69-4262-a47e-1ce2e1911a37 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-c6fa36bc-df54-4f59-82b7-4db06ead4dd7" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:55:16.744 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-a2f0291e-05f5-4d37-b944-f6dca5efc02a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Received event network-vif-plugged-d0d4427d-8b2d-4937-957c-f2ce208c73ae external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:55:16.744 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-a2f0291e-05f5-4d37-b944-f6dca5efc02a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "c6fa36bc-df54-4f59-82b7-4db06ead4dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:16.744 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-a2f0291e-05f5-4d37-b944-f6dca5efc02a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "c6fa36bc-df54-4f59-82b7-4db06ead4dd7-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:16.744 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-a2f0291e-05f5-4d37-b944-f6dca5efc02a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Processing event network-vif-plugged-d0d4427d-8b2d-4937-957c-f2ce208c73ae _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:55:16.792 4088 3038340847400 MainThread INFO nova.virt.hyperv.vmops [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Using config drive for instance 2021-09-10 16:55:17.182 4088 3038340847400 MainThread INFO nova.virt.hyperv.vmops [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Creating config drive at C:\openstack\instances\instance-00000025\configdrive.iso 2021-09-10 16:55:17.281 4088 3038340847400 MainThread DEBUG oslo_concurrency.processutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000025\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpe0mtoyoj execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:55:17.605 4088 3038340847400 MainThread DEBUG oslo_concurrency.processutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000025\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpe0mtoyoj" returned: 0 in 0.329s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:55:18.136 4088 3038340847400 MainThread DEBUG nova.virt.hyperv.vmops [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Setting boot order for instance: instance-00000025: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:55:18.244 4088 3038340847400 MainThread DEBUG nova.virt.hyperv.vmops [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:55:18.276 4088 3038340847400 MainThread DEBUG os_win.utils.jobutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Waiting for WMI job: {'InstanceID': '28048976-01E0-43E2-87B2-B6D7B48AE07E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16653), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:55:18.431 4088 3038340847400 MainThread ERROR os_win.utils.jobutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000025\' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)instance-0000002558677D80-A79F-4B56-AAA9-29A520A6607012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)instance-0000002558677D80-A79F-4B56-AAA9-29A520A6607010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000025\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)instance-0000002558677D80-A79F-4B56-AAA9-29A520A66070%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '28048976-01E0-43E2-87B2-B6D7B48AE07E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114849), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 55, 18), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 55, 18), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000025' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)\n\nNot enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)\n\n'instance-00000025' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)", 'ErrorSummaryDescription': "'instance-00000025' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000025.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:55:18.431 4088 3038340847400 MainThread DEBUG os_win._utils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000025' failed to start. Not enough memory in the system to start the virtual machine instance-00000025. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000025' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Not enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) 'instance-00000025' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18692708015441895 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:55:18.463 4088 3038340796088 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:55:18.463 4088 3038340796088 MainThread INFO nova.compute.manager [-] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] VM Stopped (Lifecycle Event) 2021-09-10 16:55:18.463 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000025" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:18.463 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000025" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:18.480 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-98e810a4-2c26-41fe-8c0b-26c41d038b6f - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:55:18.480 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-98e810a4-2c26-41fe-8c0b-26c41d038b6f - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:55:18.542 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-98e810a4-2c26-41fe-8c0b-26c41d038b6f - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:55:18.572 4088 3038340796088 MainThread INFO nova.compute.manager [req-98e810a4-2c26-41fe-8c0b-26c41d038b6f - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:55:19.464 4088 3038340847400 MainThread DEBUG os_win.utils.jobutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Waiting for WMI job: {'InstanceID': '8B6955A6-CD5B-4F08-AEE0-80790263CC5F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17188), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:55:19.610 4088 3038340847400 MainThread ERROR os_win.utils.jobutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000025\' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)instance-0000002558677D80-A79F-4B56-AAA9-29A520A6607012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)instance-0000002558677D80-A79F-4B56-AAA9-29A520A6607010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000025\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)instance-0000002558677D80-A79F-4B56-AAA9-29A520A66070%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '8B6955A6-CD5B-4F08-AEE0-80790263CC5F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116617), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 55, 19), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 55, 19), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000025' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)\n\nNot enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)\n\n'instance-00000025' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)", 'ErrorSummaryDescription': "'instance-00000025' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000025.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:55:19.610 4088 3038340847400 MainThread DEBUG os_win._utils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000025' failed to start. Not enough memory in the system to start the virtual machine instance-00000025. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000025' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Not enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) 'instance-00000025' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3653781414031982 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:55:19.651 4088 3038340796088 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:55:19.651 4088 3038340796088 MainThread INFO nova.compute.manager [-] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] VM Stopped (Lifecycle Event) 2021-09-10 16:55:19.651 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000025" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:19.651 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000025" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:19.683 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-24732a44-bddb-41bc-bc6c-967361ee17da - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:55:19.683 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-24732a44-bddb-41bc-bc6c-967361ee17da - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:55:19.732 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-24732a44-bddb-41bc-bc6c-967361ee17da - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:55:19.778 4088 3038340796088 MainThread INFO nova.compute.manager [req-24732a44-bddb-41bc-bc6c-967361ee17da - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:55:20.638 4088 3038340847400 MainThread DEBUG os_win.utils.jobutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Waiting for WMI job: {'InstanceID': 'DE921C8B-3B58-4448-B559-05215DCDDFCC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15262), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:55:20.777 4088 3038340847400 MainThread ERROR os_win.utils.jobutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000025\' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)instance-0000002558677D80-A79F-4B56-AAA9-29A520A6607012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)instance-0000002558677D80-A79F-4B56-AAA9-29A520A6607010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000025\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)instance-0000002558677D80-A79F-4B56-AAA9-29A520A66070%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'DE921C8B-3B58-4448-B559-05215DCDDFCC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115826), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 55, 20), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 55, 20), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000025' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)\n\nNot enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)\n\n'instance-00000025' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)", 'ErrorSummaryDescription': "'instance-00000025' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000025.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:55:20.777 4088 3038340847400 MainThread DEBUG os_win._utils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000025' failed to start. Not enough memory in the system to start the virtual machine instance-00000025. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000025' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Not enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) 'instance-00000025' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5329208374023438 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:55:20.825 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000025" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:20.825 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000025" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:20.825 4088 3038340796088 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:55:20.825 4088 3038340796088 MainThread INFO nova.compute.manager [-] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] VM Stopped (Lifecycle Event) 2021-09-10 16:55:20.839 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-cd8a3d2b-d08c-4ac5-8bce-ee3df2e3e61a - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:55:20.839 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-cd8a3d2b-d08c-4ac5-8bce-ee3df2e3e61a - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:55:20.887 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-cd8a3d2b-d08c-4ac5-8bce-ee3df2e3e61a - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:55:20.924 4088 3038340796088 MainThread INFO nova.compute.manager [req-cd8a3d2b-d08c-4ac5-8bce-ee3df2e3e61a - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:55:21.825 4088 3038340847400 MainThread DEBUG os_win.utils.jobutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Waiting for WMI job: {'InstanceID': '579435FF-C835-4527-843C-E649BAC82C1F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16423), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:55:21.947 4088 3038340847400 MainThread ERROR os_win.utils.jobutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000025\' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)instance-0000002558677D80-A79F-4B56-AAA9-29A520A6607012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)instance-0000002558677D80-A79F-4B56-AAA9-29A520A6607010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000025\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)instance-0000002558677D80-A79F-4B56-AAA9-29A520A66070%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '579435FF-C835-4527-843C-E649BAC82C1F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116120), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 55, 21), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 55, 21), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000025' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)\n\nNot enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)\n\n'instance-00000025' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)", 'ErrorSummaryDescription': "'instance-00000025' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000025.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:55:21.947 4088 3038340847400 MainThread DEBUG os_win._utils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000025' failed to start. Not enough memory in the system to start the virtual machine instance-00000025. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000025' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Not enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) 'instance-00000025' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.703054428100586 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:55:22.013 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000025" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:22.013 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000025" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:22.013 4088 3038340796088 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:55:22.013 4088 3038340796088 MainThread INFO nova.compute.manager [-] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] VM Stopped (Lifecycle Event) 2021-09-10 16:55:22.074 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-e29d6816-79b7-4cf0-a759-cd1433f90635 - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:55:22.074 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-e29d6816-79b7-4cf0-a759-cd1433f90635 - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:55:22.119 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-e29d6816-79b7-4cf0-a759-cd1433f90635 - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:55:22.135 4088 3038340796088 MainThread INFO nova.compute.manager [req-e29d6816-79b7-4cf0-a759-cd1433f90635 - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:55:22.980 4088 3038340847400 MainThread DEBUG os_win.utils.jobutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Waiting for WMI job: {'InstanceID': '5F25016C-1A6F-4967-B4EC-B0F2EBF9A312', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16016), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:55:23.120 4088 3038340847400 MainThread ERROR os_win.utils.jobutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000025\' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)instance-0000002558677D80-A79F-4B56-AAA9-29A520A6607012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)instance-0000002558677D80-A79F-4B56-AAA9-29A520A6607010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000025\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)instance-0000002558677D80-A79F-4B56-AAA9-29A520A66070%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5F25016C-1A6F-4967-B4EC-B0F2EBF9A312', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120982), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 55, 22), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 55, 23), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000025' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)\n\nNot enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)\n\n'instance-00000025' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)", 'ErrorSummaryDescription': "'instance-00000025' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000025.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:55:23.120 4088 3038340847400 MainThread DEBUG os_win._utils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000025' failed to start. Not enough memory in the system to start the virtual machine instance-00000025. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000025' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Not enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) 'instance-00000025' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.875476121902466 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:55:23.191 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000025" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:23.191 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000025" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:23.191 4088 3038340796088 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:55:23.191 4088 3038340796088 MainThread INFO nova.compute.manager [-] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] VM Stopped (Lifecycle Event) 2021-09-10 16:55:23.200 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-833aba1f-0fbc-4966-98bc-6990b7b2590b - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:55:23.200 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-833aba1f-0fbc-4966-98bc-6990b7b2590b - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:55:23.261 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-833aba1f-0fbc-4966-98bc-6990b7b2590b - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:55:23.291 4088 3038340796088 MainThread INFO nova.compute.manager [req-833aba1f-0fbc-4966-98bc-6990b7b2590b - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:55:24.150 4088 3038340847400 MainThread DEBUG os_win.utils.jobutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Waiting for WMI job: {'InstanceID': '201197B2-D731-4F26-8FBD-AFE9711F4122', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15412), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:55:24.295 4088 3038340847400 MainThread ERROR os_win.utils.jobutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000025\' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)instance-0000002558677D80-A79F-4B56-AAA9-29A520A6607012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)instance-0000002558677D80-A79F-4B56-AAA9-29A520A6607010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000025\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)instance-0000002558677D80-A79F-4B56-AAA9-29A520A66070%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '201197B2-D731-4F26-8FBD-AFE9711F4122', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114598), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 55, 24), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 55, 24), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000025' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)\n\nNot enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)\n\n'instance-00000025' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070)", 'ErrorSummaryDescription': "'instance-00000025' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000025.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:55:24.295 4088 3038340847400 MainThread ERROR nova.virt.hyperv.vmops [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Failed to change vm state of instance-00000025 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000025' failed to start. 2021-09-10 16:55:24.295 4088 3038340847400 MainThread INFO nova.virt.hyperv.vmops [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Got request to destroy instance 2021-09-10 16:55:24.355 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000025" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:24.355 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000025" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:24.355 4088 3038340796088 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:55:24.355 4088 3038340796088 MainThread INFO nova.compute.manager [-] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] VM Stopped (Lifecycle Event) 2021-09-10 16:55:24.386 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-02e233a6-b55d-419c-9b1e-26ee2bd81414 - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:55:24.386 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-02e233a6-b55d-419c-9b1e-26ee2bd81414 - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:55:24.433 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-02e233a6-b55d-419c-9b1e-26ee2bd81414 - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:55:24.466 4088 3038340796088 MainThread INFO nova.compute.manager [req-02e233a6-b55d-419c-9b1e-26ee2bd81414 - - - - -] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:55:26.260 4088 3038340847400 MainThread DEBUG nova.virt.hyperv.vmops [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:55:26.260 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Lock "instance-00000025" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:26.260 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Lock "instance-00000025" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:26.291 4088 3038340847400 MainThread DEBUG os_win.utils.compute.vmutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Successfully changed vm state of instance-00000025 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:55:26.291 4088 3038340847400 MainThread DEBUG nova.virt.hyperv.vmops [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Successfully changed state of VM instance-00000025 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:55:26.354 4088 3038340847400 MainThread DEBUG os_win.utils.jobutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Waiting for WMI job: {'InstanceID': 'C430EE8D-B121-4DD6-B571-FC9D7DF04242', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19886), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:55:26.478 4088 3038340847400 MainThread DEBUG os_win.utils.jobutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] WMI job succeeded: {'InstanceID': 'C430EE8D-B121-4DD6-B571-FC9D7DF04242', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=128952), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:55:26.478 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Lock "instance-00000025" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:26.478 4088 3038340847400 MainThread DEBUG os_win.utils.pathutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Removing directory: C:\openstack\instances\instance-00000025 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:55:26.478 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Lock "instance-00000025" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:26.478 4088 3038340847400 MainThread ERROR nova.compute.manager [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000025' failed to start. Not enough memory in the system to start the virtual machine instance-00000025. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000025' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Not enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) 'instance-00000025' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Error code: 32778. 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Traceback (most recent call last): 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] return function(*args, **kwargs) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] admin_password, network_info, block_device_info) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] return function(self, *args, **kwds) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self.force_reraise() 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] raise self.value 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] should_plug_vifs=False) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 'req_state': req_state}) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self.force_reraise() 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] raise self.value 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] time.sleep(sleep_time) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self.force_reraise() 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] raise self.value 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] return f(*args, **kwargs) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] return self._wait_for_job(job_path) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] error_desc=err_desc) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000025' failed to start. 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Not enough memory in the system to start the virtual machine instance-00000025. 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000025' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Not enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 'instance-00000025' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Error code: 32778. 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] During handling of the above exception, another exception occurred: 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Traceback (most recent call last): 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] yield resources 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] accel_info=accel_info) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] return function(*args, **kwargs) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] admin_password, network_info, block_device_info) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] return function(self, *args, **kwds) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self.force_reraise() 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] raise self.value 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] should_plug_vifs=False) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 'req_state': req_state}) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self.force_reraise() 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] raise self.value 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] time.sleep(sleep_time) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self.force_reraise() 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] raise self.value 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] return f(*args, **kwargs) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] return self._wait_for_job(job_path) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] error_desc=err_desc) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000025' failed to start. 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Not enough memory in the system to start the virtual machine instance-00000025. 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000025' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Not enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 'instance-00000025' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Error code: 32778. 2021-09-10 16:55:26.478 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.478 4088 3038340847400 MainThread INFO nova.compute.manager [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Terminating instance 2021-09-10 16:55:26.478 4088 3038340847400 MainThread DEBUG nova.compute.manager [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:55:26.478 4088 3038340847400 MainThread INFO nova.virt.hyperv.vmops [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Got request to destroy instance 2021-09-10 16:55:26.499 4088 3038340847400 MainThread DEBUG nova.virt.hyperv.vmops [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:55:26.499 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Lock "instance-00000025" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:26.499 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Lock "instance-00000025" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:26.499 4088 3038340847400 MainThread INFO nova.compute.manager [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Took 0.01 seconds to destroy the instance on the hypervisor. 2021-09-10 16:55:26.511 4088 3038340847400 MainThread DEBUG nova.compute.claims [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:55:26.511 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:26.635 4088 3038340847400 MainThread DEBUG nova.virt.hyperv.hostops [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:55:26.656 4088 3038340847400 MainThread DEBUG nova.virt.hyperv.hostops [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:55:26.872 4088 3038340847400 MainThread DEBUG nova.compute.provider_tree [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:55:26.872 4088 3038340847400 MainThread DEBUG nova.scheduler.client.report [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:55:26.872 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.359s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:26.872 4088 3038340847400 MainThread ERROR nova.compute.manager [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000025' failed to start. Not enough memory in the system to start the virtual machine instance-00000025. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000025' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Not enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) 'instance-00000025' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Error code: 32778. 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Traceback (most recent call last): 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] return function(*args, **kwargs) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] admin_password, network_info, block_device_info) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] return function(self, *args, **kwds) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self.force_reraise() 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] raise self.value 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] should_plug_vifs=False) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 'req_state': req_state}) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self.force_reraise() 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] raise self.value 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] time.sleep(sleep_time) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self.force_reraise() 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] raise self.value 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] return f(*args, **kwargs) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] return self._wait_for_job(job_path) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] error_desc=err_desc) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000025' failed to start. 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Not enough memory in the system to start the virtual machine instance-00000025. 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000025' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Not enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 'instance-00000025' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Error code: 32778. 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] During handling of the above exception, another exception occurred: 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Traceback (most recent call last): 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] accel_info=accel_info) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] return function(*args, **kwargs) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] admin_password, network_info, block_device_info) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] return function(self, *args, **kwds) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self.force_reraise() 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] raise self.value 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] should_plug_vifs=False) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 'req_state': req_state}) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self.force_reraise() 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] raise self.value 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] time.sleep(sleep_time) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self.force_reraise() 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] raise self.value 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] return f(*args, **kwargs) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] return self._wait_for_job(job_path) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] error_desc=err_desc) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000025' failed to start. 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Not enough memory in the system to start the virtual machine instance-00000025. 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000025' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Not enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 'instance-00000025' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Error code: 32778. 2021-09-10 16:55:26.872 4088 3038340847400 MainThread TRACE nova.compute.manager [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] 2021-09-10 16:55:26.872 4088 3038340847400 MainThread DEBUG nova.compute.utils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] WMI job failed with status 10. Error summary description: 'instance-00000025' failed to start. Not enough memory in the system to start the virtual machine instance-00000025. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:55:26.872 4088 3038340847400 MainThread DEBUG nova.compute.manager [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Build of instance c6fa36bc-df54-4f59-82b7-4db06ead4dd7 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000025' failed to start. Not enough memory in the system to start the virtual machine instance-00000025. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000025' failed to start. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Not enough memory in the system to start the virtual machine instance-00000025 with ram size 1024 megabytes. (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) 'instance-00000025' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 58677D80-A79F-4B56-AAA9-29A520A66070) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:55:26.900 4088 3038340847400 MainThread DEBUG nova.compute.manager [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:55:26.900 4088 3038340847400 MainThread DEBUG nova.compute.manager [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:55:26.900 4088 3038340847400 MainThread DEBUG nova.compute.manager [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:55:26.900 4088 3038340847400 MainThread DEBUG nova.network.neutron [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:55:27.688 4088 3038340847400 MainThread DEBUG nova.network.neutron [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:55:27.719 4088 3038340847400 MainThread INFO nova.compute.manager [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] [instance: c6fa36bc-df54-4f59-82b7-4db06ead4dd7] Took 0.81 seconds to deallocate network for instance. 2021-09-10 16:55:27.734 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "60d9f1cb-95b4-472e-999a-d08935125ced" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:27.783 4088 3038340846520 MainThread DEBUG nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:55:27.936 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:27.936 4088 3038340846520 MainThread DEBUG nova.virt.hardware [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:55:27.936 4088 3038340846520 MainThread INFO nova.compute.claims [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Claim successful on node n-h2-808474-1 2021-09-10 16:55:27.936 4088 3038340847400 MainThread INFO nova.scheduler.client.report [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Deleted allocations for instance c6fa36bc-df54-4f59-82b7-4db06ead4dd7 2021-09-10 16:55:27.995 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [req-3f65a557-26d6-4962-aded-bf4250af178b a884270e965c4547831a05eb6d766a49 8104d9820d2e4012a4147616bf84cac4 - default default] Lock "c6fa36bc-df54-4f59-82b7-4db06ead4dd7" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 26.359s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:28.078 4088 3038340846520 MainThread DEBUG nova.virt.hyperv.hostops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:55:28.088 4088 3038340846520 MainThread DEBUG nova.virt.hyperv.hostops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:55:28.314 4088 3038340846520 MainThread DEBUG nova.compute.provider_tree [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:55:28.314 4088 3038340846520 MainThread DEBUG nova.scheduler.client.report [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:55:28.314 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:28.337 4088 3038340846520 MainThread DEBUG nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:55:28.379 4088 3038340847400 MainThread DEBUG nova.compute.manager [req-e6860581-9586-402e-ab77-77d812042967 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Received event network-vif-deleted-299081df-ec8d-4d29-b4a3-234b773d5d47 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:55:28.417 4088 3038340846520 MainThread DEBUG nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:55:28.431 4088 3038340847400 GreenThread-29 DEBUG nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:55:28.431 4088 3038340847400 GreenThread-29 DEBUG nova.network.neutron [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:55:28.652 4088 3038340846520 MainThread DEBUG nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:55:28.666 4088 3038340846520 MainThread INFO nova.virt.hyperv.vmops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Spawning new instance 2021-09-10 16:55:28.681 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "instance-00000026" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:28.681 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "instance-00000026" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:28.681 4088 3038340846520 MainThread DEBUG nova.block_device [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:55:28.681 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:28.681 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:28.698 4088 3038340846520 MainThread DEBUG os_win.utils.pathutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Creating directory: C:\openstack\instances\instance-00000026 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:55:28.698 4088 3038340846520 MainThread DEBUG nova.virt.hyperv.vmops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000026\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:55:28.766 4088 3038340847400 GreenThread-29 DEBUG nova.policy [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73ac9100b70e4fa1b6ad7751b223e5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778686f367c642f39349bb208103a3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:55:28.995 4088 3038340846520 MainThread DEBUG nova.virt.hyperv.vmops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Resizing VHD C:\openstack\instances\instance-00000026\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:55:30.151 4088 3038340847400 GreenThread-29 DEBUG nova.network.neutron [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Successfully created port: 1f342a4b-8bbc-4cf3-8d5a-3b5ff85c281d _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:55:31.322 4088 3038340847400 GreenThread-29 DEBUG nova.network.neutron [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Successfully created port: 91b74a84-3e8d-4519-9b49-6d076198996b _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:55:32.635 4088 3038340847400 GreenThread-29 DEBUG nova.network.neutron [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Successfully created port: 6f29478a-ac56-4449-b052-2ba78061242c _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:55:33.561 4088 3038340847400 GreenThread-29 DEBUG nova.network.neutron [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Successfully updated port: 1f342a4b-8bbc-4cf3-8d5a-3b5ff85c281d _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:55:34.401 4088 3038340845640 MainThread DEBUG nova.compute.manager [req-d7e02bf0-6677-4865-b3b4-03ef96de7c71 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Received event network-changed-1f342a4b-8bbc-4cf3-8d5a-3b5ff85c281d external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:55:34.401 4088 3038340845640 MainThread DEBUG nova.compute.manager [req-d7e02bf0-6677-4865-b3b4-03ef96de7c71 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Refreshing instance network info cache due to event network-changed-1f342a4b-8bbc-4cf3-8d5a-3b5ff85c281d. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:55:34.420 4088 3038340845640 MainThread DEBUG oslo_concurrency.lockutils [req-d7e02bf0-6677-4865-b3b4-03ef96de7c71 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-60d9f1cb-95b4-472e-999a-d08935125ced" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:55:34.420 4088 3038340845640 MainThread DEBUG nova.network.neutron [req-d7e02bf0-6677-4865-b3b4-03ef96de7c71 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Refreshing network info cache for port 1f342a4b-8bbc-4cf3-8d5a-3b5ff85c281d _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:55:34.514 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:55:34.514 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:55:34.514 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 16:55:34.541 4088 3038340847400 GreenThread-29 DEBUG nova.network.neutron [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Successfully updated port: 91b74a84-3e8d-4519-9b49-6d076198996b _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:55:35.196 4088 3038340845640 MainThread DEBUG nova.network.neutron [req-d7e02bf0-6677-4865-b3b4-03ef96de7c71 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:55:35.525 4088 3038340847400 GreenThread-29 DEBUG nova.network.neutron [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Successfully updated port: 6f29478a-ac56-4449-b052-2ba78061242c _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:55:35.564 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:55:36.033 4088 3038340845640 MainThread DEBUG nova.network.neutron [req-d7e02bf0-6677-4865-b3b4-03ef96de7c71 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:55:36.041 4088 3038340845640 MainThread DEBUG oslo_concurrency.lockutils [req-d7e02bf0-6677-4865-b3b4-03ef96de7c71 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-60d9f1cb-95b4-472e-999a-d08935125ced" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:55:36.041 4088 3038340847400 GreenThread-29 DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Acquired lock "refresh_cache-60d9f1cb-95b4-472e-999a-d08935125ced" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:55:36.041 4088 3038340847400 GreenThread-29 DEBUG nova.network.neutron [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:55:36.282 4088 3038340847400 GreenThread-29 DEBUG nova.network.neutron [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:55:36.563 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:55:36.563 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 16:55:36.652 4088 3038340845640 MainThread DEBUG nova.compute.manager [req-edb07df3-1daa-4db3-85fe-9eda45074023 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Received event network-changed-91b74a84-3e8d-4519-9b49-6d076198996b external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:55:36.652 4088 3038340845640 MainThread DEBUG nova.compute.manager [req-edb07df3-1daa-4db3-85fe-9eda45074023 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Refreshing instance network info cache due to event network-changed-91b74a84-3e8d-4519-9b49-6d076198996b. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:55:36.791 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-0e77fafa-3f8a-4513-bb64-518c77e99029" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:55:36.791 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 16:55:37.541 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Updating instance_info_cache with network_info: [{"id": "a8d3d6fd-c535-4f42-b11d-348191f22a38", "address": "fa:16:3e:61:e8:c4", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa8d3d6fd-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:55:37.561 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-0e77fafa-3f8a-4513-bb64-518c77e99029" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:55:37.561 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 16:55:37.561 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:55:37.561 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:55:37.604 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:55:38.558 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:55:39.419 4088 3038340847400 GreenThread-29 DEBUG nova.network.neutron [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Updating instance_info_cache with network_info: [{"id": "1f342a4b-8bbc-4cf3-8d5a-3b5ff85c281d", "address": "fa:16:3e:18:34:fb", "network": {"id": "22036b3c-62ab-4fc4-9c35-6bc38af85735", "bridge": null, "label": "tempest-ServersTestMultiNic-1292035885", "subnets": [{"cidr": "19.80.0.0/24", "dns": [], "gateway": {"address": "19.80.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "19.80.0.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "19.80.0.2"}}], "meta": {"injected": false, "tenant_id": "778686f367c642f39349bb208103a3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap1f342a4b-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91b74a84-3e8d-4519-9b49-6d076198996b", "address": "fa:16:3e:8e:ef:e2", "network": {"id": "2902a8f7-f5a1-41cb-848f-1eec8ed03eb3", "bridge": null, "label": "tempest-ServersTestMultiNic-1455612463", "subnets": [{"cidr": "19.86.0.0/24", "dns": [], "gateway": {"address": "19.86.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "19.86.0.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "19.86.0.2"}}], "meta": {"injected": false, "tenant_id": "778686f367c642f39349bb208103a3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap91b74a84-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f29478a-ac56-4449-b052-2ba78061242c", "address": "fa:16:3e:2c:62:4f", "network": {"id": "22036b3c-62ab-4fc4-9c35-6bc38af85735", "bridge": null, "label": "tempest-ServersTestMultiNic-1292035885", "subnets": [{"cidr": "19.80.0.0/24", "dns": [], "gateway": {"address": "19.80.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "19.80.0.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "19.80.0.2"}}], "meta": {"injected": false, "tenant_id": "778686f367c642f39349bb208103a3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap6f29478a-ac", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:55:39.435 4088 3038340847400 GreenThread-29 DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Releasing lock "refresh_cache-60d9f1cb-95b4-472e-999a-d08935125ced" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:55:39.435 4088 3038340847400 GreenThread-29 DEBUG nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Instance network_info: |[{"id": "1f342a4b-8bbc-4cf3-8d5a-3b5ff85c281d", "address": "fa:16:3e:18:34:fb", "network": {"id": "22036b3c-62ab-4fc4-9c35-6bc38af85735", "bridge": null, "label": "tempest-ServersTestMultiNic-1292035885", "subnets": [{"cidr": "19.80.0.0/24", "dns": [], "gateway": {"address": "19.80.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "19.80.0.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "19.80.0.2"}}], "meta": {"injected": false, "tenant_id": "778686f367c642f39349bb208103a3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap1f342a4b-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91b74a84-3e8d-4519-9b49-6d076198996b", "address": "fa:16:3e:8e:ef:e2", "network": {"id": "2902a8f7-f5a1-41cb-848f-1eec8ed03eb3", "bridge": null, "label": "tempest-ServersTestMultiNic-1455612463", "subnets": [{"cidr": "19.86.0.0/24", "dns": [], "gateway": {"address": "19.86.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "19.86.0.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "19.86.0.2"}}], "meta": {"injected": false, "tenant_id": "778686f367c642f39349bb208103a3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap91b74a84-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f29478a-ac56-4449-b052-2ba78061242c", "address": "fa:16:3e:2c:62:4f", "network": {"id": "22036b3c-62ab-4fc4-9c35-6bc38af85735", "bridge": null, "label": "tempest-ServersTestMultiNic-1292035885", "subnets": [{"cidr": "19.80.0.0/24", "dns": [], "gateway": {"address": "19.80.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "19.80.0.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "19.80.0.2"}}], "meta": {"injected": false, "tenant_id": "778686f367c642f39349bb208103a3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap6f29478a-ac", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:55:39.435 4088 3038340846520 MainThread DEBUG nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Preparing to wait for external event network-vif-plugged-1f342a4b-8bbc-4cf3-8d5a-3b5ff85c281d prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:55:39.435 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "60d9f1cb-95b4-472e-999a-d08935125ced-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:39.435 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "60d9f1cb-95b4-472e-999a-d08935125ced-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:39.435 4088 3038340846520 MainThread DEBUG nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Preparing to wait for external event network-vif-plugged-91b74a84-3e8d-4519-9b49-6d076198996b prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:55:39.435 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "60d9f1cb-95b4-472e-999a-d08935125ced-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:39.435 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "60d9f1cb-95b4-472e-999a-d08935125ced-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:39.435 4088 3038340846520 MainThread DEBUG nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Preparing to wait for external event network-vif-plugged-6f29478a-ac56-4449-b052-2ba78061242c prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:55:39.435 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "60d9f1cb-95b4-472e-999a-d08935125ced-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:39.435 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "60d9f1cb-95b4-472e-999a-d08935125ced-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:39.435 4088 3038340846520 MainThread DEBUG os_win.utils.compute.vmutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Creating VM instance-00000026 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:55:39.435 4088 3038340845640 MainThread DEBUG oslo_concurrency.lockutils [req-edb07df3-1daa-4db3-85fe-9eda45074023 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-60d9f1cb-95b4-472e-999a-d08935125ced" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:55:39.435 4088 3038340845640 MainThread DEBUG nova.network.neutron [req-edb07df3-1daa-4db3-85fe-9eda45074023 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Refreshing network info cache for port 91b74a84-3e8d-4519-9b49-6d076198996b _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:55:40.571 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:55:40.630 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:40.630 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:40.630 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 16:55:40.630 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:55:40.654 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:55:40.683 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Lock "714fea12-52ae-4277-8f3d-b0db2b2ee548" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:40.704 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:55:40.843 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:40.843 4088 3038341021768 MainThread DEBUG nova.virt.hardware [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:55:40.843 4088 3038341021768 MainThread INFO nova.compute.claims [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Claim successful on node n-h2-808474-1 2021-09-10 16:55:40.892 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2171MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 16:55:40.932 4088 3038340845640 MainThread DEBUG nova.network.neutron [req-edb07df3-1daa-4db3-85fe-9eda45074023 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Updated VIF entry in instance network info cache for port 91b74a84-3e8d-4519-9b49-6d076198996b. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:55:40.947 4088 3038340845640 MainThread DEBUG nova.network.neutron [req-edb07df3-1daa-4db3-85fe-9eda45074023 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Updating instance_info_cache with network_info: [{"id": "1f342a4b-8bbc-4cf3-8d5a-3b5ff85c281d", "address": "fa:16:3e:18:34:fb", "network": {"id": "22036b3c-62ab-4fc4-9c35-6bc38af85735", "bridge": null, "label": "tempest-ServersTestMultiNic-1292035885", "subnets": [{"cidr": "19.80.0.0/24", "dns": [], "gateway": {"address": "19.80.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "19.80.0.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "19.80.0.2"}}], "meta": {"injected": false, "tenant_id": "778686f367c642f39349bb208103a3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap1f342a4b-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91b74a84-3e8d-4519-9b49-6d076198996b", "address": "fa:16:3e:8e:ef:e2", "network": {"id": "2902a8f7-f5a1-41cb-848f-1eec8ed03eb3", "bridge": null, "label": "tempest-ServersTestMultiNic-1455612463", "subnets": [{"cidr": "19.86.0.0/24", "dns": [], "gateway": {"address": "19.86.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "19.86.0.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "19.86.0.2"}}], "meta": {"injected": false, "tenant_id": "778686f367c642f39349bb208103a3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap91b74a84-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f29478a-ac56-4449-b052-2ba78061242c", "address": "fa:16:3e:2c:62:4f", "network": {"id": "22036b3c-62ab-4fc4-9c35-6bc38af85735", "bridge": null, "label": "tempest-ServersTestMultiNic-1292035885", "subnets": [{"cidr": "19.80.0.0/24", "dns": [], "gateway": {"address": "19.80.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "19.80.0.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "19.80.0.2"}}], "meta": {"injected": false, "tenant_id": "778686f367c642f39349bb208103a3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap6f29478a-ac", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:55:41.003 4088 3038340845640 MainThread DEBUG oslo_concurrency.lockutils [req-edb07df3-1daa-4db3-85fe-9eda45074023 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-60d9f1cb-95b4-472e-999a-d08935125ced" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:55:41.003 4088 3038340845640 MainThread DEBUG nova.compute.manager [req-edb07df3-1daa-4db3-85fe-9eda45074023 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Received event network-changed-6f29478a-ac56-4449-b052-2ba78061242c external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:55:41.003 4088 3038340845640 MainThread DEBUG nova.compute.manager [req-edb07df3-1daa-4db3-85fe-9eda45074023 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Refreshing instance network info cache due to event network-changed-6f29478a-ac56-4449-b052-2ba78061242c. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:55:41.003 4088 3038340845640 MainThread DEBUG oslo_concurrency.lockutils [req-edb07df3-1daa-4db3-85fe-9eda45074023 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-60d9f1cb-95b4-472e-999a-d08935125ced" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:55:41.003 4088 3038340845640 MainThread DEBUG nova.network.neutron [req-edb07df3-1daa-4db3-85fe-9eda45074023 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Refreshing network info cache for port 6f29478a-ac56-4449-b052-2ba78061242c _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:55:41.120 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.hostops [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:55:41.134 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.hostops [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:55:41.291 4088 3038340846520 MainThread DEBUG nova.virt.hyperv.vmops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:55:41.389 4088 3038340849512 MainThread DEBUG nova.compute.manager [req-cee62463-9276-4a71-a445-4eed43c5786c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Received event network-vif-deleted-7419ede1-6b4f-46c3-b4f6-5325702963d3 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:55:41.418 4088 3038341021768 MainThread DEBUG nova.compute.provider_tree [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:55:41.433 4088 3038341021768 MainThread DEBUG nova.scheduler.client.report [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:55:41.433 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.594s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:41.433 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:55:41.433 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.547s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:41.494 4088 3038340846520 MainThread DEBUG nova.virt.hyperv.vmops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:55:41.684 4088 3038340846520 MainThread DEBUG nova.virt.hyperv.vmops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:55:41.775 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:55:41.790 4088 3038341021944 GreenThread-30 DEBUG nova.compute.manager [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:55:41.790 4088 3038341021944 GreenThread-30 DEBUG nova.network.neutron [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:55:41.790 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:55:41.790 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:55:41.790 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:55:41.790 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:55:41.790 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:55:41.790 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:55:41.790 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 714fea12-52ae-4277-8f3d-b0db2b2ee548 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:55:41.790 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:55:41.790 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:55:41.790 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:55:41.806 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 60d9f1cb-95b4-472e-999a-d08935125ced actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:55:41.806 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:55:41.806 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:55:41.806 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:55:41.806 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:55:41.806 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 15 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 16:55:41.806 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=15872MB phys_disk=79GB used_disk=15GB total_vcpus=6 used_vcpus=15 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 16:55:41.838 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:55:41.855 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:55:41.994 4088 3038341021944 GreenThread-30 DEBUG nova.policy [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82eb2bcce085415e8b748990e15c58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad3c7e6a94d4d6ca45d20d801674ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:55:42.026 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:55:42.041 4088 3038341021768 MainThread INFO nova.virt.hyperv.vmops [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Spawning new instance 2021-09-10 16:55:42.057 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Lock "instance-00000028" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:42.057 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Lock "instance-00000028" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:42.057 4088 3038341021768 MainThread DEBUG nova.block_device [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:55:42.057 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:42.057 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:42.074 4088 3038341021768 MainThread DEBUG os_win.utils.pathutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Creating directory: C:\openstack\instances\instance-00000028 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:55:42.074 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.vmops [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000028\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:55:42.100 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:55:42.119 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:55:42.119 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 16:55:42.119 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.687s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:42.402 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.vmops [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Resizing VHD C:\openstack\instances\instance-00000028\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:55:42.708 4088 3038340845640 MainThread DEBUG nova.network.neutron [req-edb07df3-1daa-4db3-85fe-9eda45074023 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Updated VIF entry in instance network info cache for port 6f29478a-ac56-4449-b052-2ba78061242c. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:55:42.708 4088 3038340845640 MainThread DEBUG nova.network.neutron [req-edb07df3-1daa-4db3-85fe-9eda45074023 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Updating instance_info_cache with network_info: [{"id": "1f342a4b-8bbc-4cf3-8d5a-3b5ff85c281d", "address": "fa:16:3e:18:34:fb", "network": {"id": "22036b3c-62ab-4fc4-9c35-6bc38af85735", "bridge": null, "label": "tempest-ServersTestMultiNic-1292035885", "subnets": [{"cidr": "19.80.0.0/24", "dns": [], "gateway": {"address": "19.80.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "19.80.0.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "19.80.0.2"}}], "meta": {"injected": false, "tenant_id": "778686f367c642f39349bb208103a3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap1f342a4b-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91b74a84-3e8d-4519-9b49-6d076198996b", "address": "fa:16:3e:8e:ef:e2", "network": {"id": "2902a8f7-f5a1-41cb-848f-1eec8ed03eb3", "bridge": null, "label": "tempest-ServersTestMultiNic-1455612463", "subnets": [{"cidr": "19.86.0.0/24", "dns": [], "gateway": {"address": "19.86.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "19.86.0.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "19.86.0.2"}}], "meta": {"injected": false, "tenant_id": "778686f367c642f39349bb208103a3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap91b74a84-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f29478a-ac56-4449-b052-2ba78061242c", "address": "fa:16:3e:2c:62:4f", "network": {"id": "22036b3c-62ab-4fc4-9c35-6bc38af85735", "bridge": null, "label": "tempest-ServersTestMultiNic-1292035885", "subnets": [{"cidr": "19.80.0.0/24", "dns": [], "gateway": {"address": "19.80.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "19.80.0.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "19.80.0.2"}}], "meta": {"injected": false, "tenant_id": "778686f367c642f39349bb208103a3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap6f29478a-ac", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:55:42.742 4088 3038340845640 MainThread DEBUG oslo_concurrency.lockutils [req-edb07df3-1daa-4db3-85fe-9eda45074023 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-60d9f1cb-95b4-472e-999a-d08935125ced" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:55:43.612 4088 3038341021944 GreenThread-30 DEBUG nova.network.neutron [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Successfully created port: 277d7897-e0ee-4e5f-a82e-183ef6193aea _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:55:43.681 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "f0c24368-9e06-4126-bbb0-d52db1f2141b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:43.698 4088 3038341023000 MainThread DEBUG nova.compute.manager [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:55:43.868 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:43.868 4088 3038341023000 MainThread DEBUG nova.virt.hardware [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:55:43.868 4088 3038341023000 MainThread INFO nova.compute.claims [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Claim successful on node n-h2-808474-1 2021-09-10 16:55:44.024 4088 3038341023000 MainThread DEBUG nova.virt.hyperv.hostops [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:55:44.052 4088 3038341023000 MainThread DEBUG nova.virt.hyperv.hostops [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:55:44.248 4088 3038341022824 MainThread DEBUG nova.compute.manager [req-ea5ab400-0896-4f98-8095-628a7e102b7f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Received event network-vif-deleted-cd6ab33b-3f48-4910-aac6-7d9f710bee54 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:55:44.277 4088 3038341023000 MainThread DEBUG nova.compute.provider_tree [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:55:44.292 4088 3038341023000 MainThread DEBUG nova.scheduler.client.report [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:55:44.292 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:44.292 4088 3038341023000 MainThread DEBUG nova.compute.manager [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:55:44.400 4088 3038341023000 MainThread DEBUG nova.compute.manager [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:55:44.400 4088 3038341022824 GreenThread-31 DEBUG nova.compute.manager [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:55:44.400 4088 3038341022824 GreenThread-31 DEBUG nova.network.neutron [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:55:44.635 4088 3038341023000 MainThread DEBUG nova.compute.manager [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:55:44.635 4088 3038341023000 MainThread INFO nova.virt.hyperv.vmops [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Spawning new instance 2021-09-10 16:55:44.635 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000029" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:44.635 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000029" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:44.635 4088 3038341023000 MainThread DEBUG nova.block_device [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:55:44.671 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:44.671 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:44.671 4088 3038341023000 MainThread DEBUG os_win.utils.pathutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Creating directory: C:\openstack\instances\instance-00000029 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:55:44.671 4088 3038341023000 MainThread DEBUG nova.virt.hyperv.vmops [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000029\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:55:44.823 4088 3038341022824 GreenThread-31 DEBUG nova.policy [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd33d11497a91483d93fe0ed8f5c26603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc5deaa89294889821f303976e2d776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:55:44.931 4088 3038341023000 MainThread DEBUG nova.virt.hyperv.vmops [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Resizing VHD C:\openstack\instances\instance-00000029\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:55:46.310 4088 3038341021944 GreenThread-30 DEBUG nova.network.neutron [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Successfully updated port: 277d7897-e0ee-4e5f-a82e-183ef6193aea _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:55:46.352 4088 3038341021944 GreenThread-30 DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Acquired lock "refresh_cache-714fea12-52ae-4277-8f3d-b0db2b2ee548" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:55:46.367 4088 3038341021944 GreenThread-30 DEBUG nova.network.neutron [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:55:46.496 4088 3038341021944 GreenThread-30 DEBUG nova.network.neutron [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:55:46.521 4088 3038341024408 MainThread DEBUG oslo_concurrency.lockutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "5bd3ad21-3959-40c2-8698-b816b7176efc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:46.542 4088 3038341024408 MainThread DEBUG nova.compute.manager [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:55:46.712 4088 3038341024408 MainThread DEBUG oslo_concurrency.lockutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:46.727 4088 3038341024408 MainThread DEBUG nova.virt.hardware [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:55:46.727 4088 3038341024408 MainThread INFO nova.compute.claims [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Claim successful on node n-h2-808474-1 2021-09-10 16:55:46.727 4088 3038341025640 MainThread DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "6aac7cdb-fa5e-417b-bf36-fe5eb161a90b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:46.767 4088 3038341025640 MainThread DEBUG nova.compute.manager [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:55:46.946 4088 3038341024408 MainThread DEBUG nova.virt.hyperv.hostops [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:55:46.949 4088 3038341024408 MainThread DEBUG nova.virt.hyperv.hostops [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:55:47.217 4088 3038341021944 GreenThread-30 DEBUG nova.network.neutron [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Updating instance_info_cache with network_info: [{"id": "277d7897-e0ee-4e5f-a82e-183ef6193aea", "address": "fa:16:3e:4e:00:ca", "network": {"id": "fd33a796-d83b-4f71-bce3-ee0ffa82326d", "bridge": null, "label": "tempest-ServersTestManualDisk-1887493174-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4ad3c7e6a94d4d6ca45d20d801674ca6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap277d7897-e0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:55:47.241 4088 3038341021944 GreenThread-30 DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Releasing lock "refresh_cache-714fea12-52ae-4277-8f3d-b0db2b2ee548" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:55:47.241 4088 3038341021944 GreenThread-30 DEBUG nova.compute.manager [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Instance network_info: |[{"id": "277d7897-e0ee-4e5f-a82e-183ef6193aea", "address": "fa:16:3e:4e:00:ca", "network": {"id": "fd33a796-d83b-4f71-bce3-ee0ffa82326d", "bridge": null, "label": "tempest-ServersTestManualDisk-1887493174-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4ad3c7e6a94d4d6ca45d20d801674ca6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap277d7897-e0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:55:47.241 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Preparing to wait for external event network-vif-plugged-277d7897-e0ee-4e5f-a82e-183ef6193aea prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:55:47.241 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Lock "714fea12-52ae-4277-8f3d-b0db2b2ee548-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:47.241 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Lock "714fea12-52ae-4277-8f3d-b0db2b2ee548-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:47.241 4088 3038341021768 MainThread DEBUG os_win.utils.compute.vmutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Creating VM instance-00000028 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:55:47.241 4088 3038341024408 MainThread DEBUG nova.compute.provider_tree [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:55:47.259 4088 3038341024408 MainThread DEBUG nova.scheduler.client.report [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:55:47.267 4088 3038341024408 MainThread DEBUG oslo_concurrency.lockutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:47.267 4088 3038341024408 MainThread DEBUG nova.compute.manager [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:55:47.278 4088 3038341025640 MainThread DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:47.278 4088 3038341025640 MainThread DEBUG nova.virt.hardware [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:55:47.278 4088 3038341025640 MainThread INFO nova.compute.claims [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Claim successful on node n-h2-808474-1 2021-09-10 16:55:47.392 4088 3038341024408 MainThread DEBUG nova.compute.manager [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:55:47.399 4088 3038340796088 GreenThread-32 DEBUG nova.compute.manager [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:55:47.399 4088 3038340796088 GreenThread-32 DEBUG nova.network.neutron [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:55:47.417 4088 3038341022824 GreenThread-31 DEBUG nova.network.neutron [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Successfully created port: 425a57e4-c9b8-452a-aa0c-c3d8a8e68e1f _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:55:47.493 4088 3038341025640 MainThread DEBUG nova.virt.hyperv.hostops [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:55:47.510 4088 3038341025640 MainThread DEBUG nova.virt.hyperv.hostops [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:55:47.510 4088 3038341024408 MainThread INFO nova.virt.block_device [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Booting with volume 52401085-77e7-4280-b78c-bad720b115d8 at /dev/sda 2021-09-10 16:55:47.634 4088 3038341024408 MainThread DEBUG os_brick.utils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:55:47.634 4088 3038341024408 MainThread DEBUG os_brick.utils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] <== get_connector_properties: return (0ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:55:47.634 4088 3038341024408 MainThread DEBUG nova.virt.block_device [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Updating existing volume attachment record: f24236a4-51c1-4a02-b9a4-013732272122 _volume_attach c:\openstack\build\nova\nova\virt\block_device.py:556 2021-09-10 16:55:47.713 4088 3038340796088 GreenThread-32 DEBUG nova.policy [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'beffe9ba8529426fbb27e549254bd679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91237ebda1b54d2dbc761e48fdd93516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:55:47.885 4088 3038341025640 MainThread DEBUG nova.compute.provider_tree [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:55:47.922 4088 3038341025640 MainThread DEBUG nova.scheduler.client.report [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:55:47.931 4088 3038341025640 MainThread DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.657s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:47.931 4088 3038341025640 MainThread DEBUG nova.compute.manager [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:55:48.024 4088 3038341025640 MainThread DEBUG nova.compute.manager [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:55:48.032 4088 3038341304392 GreenThread-33 DEBUG nova.compute.manager [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:55:48.032 4088 3038341304392 GreenThread-33 DEBUG nova.network.neutron [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:55:48.243 4088 3038341025640 MainThread DEBUG nova.compute.manager [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:55:48.243 4088 3038341025640 MainThread INFO nova.virt.hyperv.vmops [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Spawning new instance 2021-09-10 16:55:48.311 4088 3038341025640 MainThread DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "instance-0000002a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:48.311 4088 3038341025640 MainThread DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "instance-0000002a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:48.311 4088 3038341025640 MainThread DEBUG nova.block_device [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:55:48.311 4088 3038341025640 MainThread DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:48.311 4088 3038341025640 MainThread DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:48.323 4088 3038341025640 MainThread DEBUG os_win.utils.pathutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Creating directory: C:\openstack\instances\instance-0000002a check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:55:48.323 4088 3038341025640 MainThread DEBUG nova.virt.hyperv.vmops [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000002a\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:55:48.602 4088 3038341304392 GreenThread-33 DEBUG nova.policy [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14929f631b514b1ba7de48ea6f7875b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12d8e551e4d4d599a26e3249f7560f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:55:48.638 4088 3038341025640 MainThread DEBUG nova.virt.hyperv.vmops [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Resizing VHD C:\openstack\instances\instance-0000002a\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:55:49.429 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.vmops [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:55:49.977 4088 3038340796088 GreenThread-32 DEBUG nova.network.neutron [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Successfully created port: 5521086c-3b7c-4aaf-a1da-cbd50850d8f6 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:55:50.367 4088 3038341022824 GreenThread-31 DEBUG nova.network.neutron [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Successfully updated port: 425a57e4-c9b8-452a-aa0c-c3d8a8e68e1f _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:55:50.382 4088 3038341022824 GreenThread-31 DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Acquired lock "refresh_cache-f0c24368-9e06-4126-bbb0-d52db1f2141b" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:55:50.382 4088 3038341022824 GreenThread-31 DEBUG nova.network.neutron [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:55:50.542 4088 3038341022824 GreenThread-31 DEBUG nova.network.neutron [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:55:50.542 4088 3038341304392 GreenThread-33 DEBUG nova.network.neutron [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Successfully created port: 62c144ee-03ae-47c7-935c-70cf7bfd5697 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:55:50.617 4088 3038341304568 MainThread DEBUG nova.compute.manager [req-fcad960f-f84a-479c-8fd4-7c1f6d03f9ba 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Received event network-vif-plugged-6f29478a-ac56-4449-b052-2ba78061242c external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:55:50.617 4088 3038341304568 MainThread DEBUG oslo_concurrency.lockutils [req-fcad960f-f84a-479c-8fd4-7c1f6d03f9ba 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "60d9f1cb-95b4-472e-999a-d08935125ced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:50.617 4088 3038341304568 MainThread DEBUG oslo_concurrency.lockutils [req-fcad960f-f84a-479c-8fd4-7c1f6d03f9ba 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "60d9f1cb-95b4-472e-999a-d08935125ced-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:50.617 4088 3038341304568 MainThread DEBUG nova.compute.manager [req-fcad960f-f84a-479c-8fd4-7c1f6d03f9ba 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Processing event network-vif-plugged-6f29478a-ac56-4449-b052-2ba78061242c _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:55:50.729 4088 3038341304568 MainThread DEBUG nova.compute.manager [req-a1f90dae-3e52-4b43-a197-deae7667eff7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Received event network-changed-277d7897-e0ee-4e5f-a82e-183ef6193aea external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:55:50.729 4088 3038341304568 MainThread DEBUG nova.compute.manager [req-a1f90dae-3e52-4b43-a197-deae7667eff7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Refreshing instance network info cache due to event network-changed-277d7897-e0ee-4e5f-a82e-183ef6193aea. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:55:50.729 4088 3038341304568 MainThread DEBUG oslo_concurrency.lockutils [req-a1f90dae-3e52-4b43-a197-deae7667eff7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-714fea12-52ae-4277-8f3d-b0db2b2ee548" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:55:50.729 4088 3038341304568 MainThread DEBUG nova.network.neutron [req-a1f90dae-3e52-4b43-a197-deae7667eff7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Refreshing network info cache for port 277d7897-e0ee-4e5f-a82e-183ef6193aea _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:55:51.822 4088 3038341304920 MainThread DEBUG nova.compute.manager [req-e6e4a550-0ad1-4857-b926-dca49e930565 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Received event network-changed-425a57e4-c9b8-452a-aa0c-c3d8a8e68e1f external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:55:51.822 4088 3038341304920 MainThread DEBUG nova.compute.manager [req-e6e4a550-0ad1-4857-b926-dca49e930565 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Refreshing instance network info cache due to event network-changed-425a57e4-c9b8-452a-aa0c-c3d8a8e68e1f. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:55:51.822 4088 3038341022824 GreenThread-31 DEBUG nova.network.neutron [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Updating instance_info_cache with network_info: [{"id": "425a57e4-c9b8-452a-aa0c-c3d8a8e68e1f", "address": "fa:16:3e:6c:27:78", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap425a57e4-c9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:55:51.836 4088 3038341022824 GreenThread-31 DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Releasing lock "refresh_cache-f0c24368-9e06-4126-bbb0-d52db1f2141b" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:55:51.836 4088 3038341022824 GreenThread-31 DEBUG nova.compute.manager [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Instance network_info: |[{"id": "425a57e4-c9b8-452a-aa0c-c3d8a8e68e1f", "address": "fa:16:3e:6c:27:78", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap425a57e4-c9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:55:51.855 4088 3038341304920 MainThread DEBUG oslo_concurrency.lockutils [req-e6e4a550-0ad1-4857-b926-dca49e930565 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-f0c24368-9e06-4126-bbb0-d52db1f2141b" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:55:51.855 4088 3038341304920 MainThread DEBUG nova.network.neutron [req-e6e4a550-0ad1-4857-b926-dca49e930565 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Refreshing network info cache for port 425a57e4-c9b8-452a-aa0c-c3d8a8e68e1f _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:55:51.855 4088 3038341023000 MainThread DEBUG nova.compute.manager [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Preparing to wait for external event network-vif-plugged-425a57e4-c9b8-452a-aa0c-c3d8a8e68e1f prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:55:51.855 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "f0c24368-9e06-4126-bbb0-d52db1f2141b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:51.855 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "f0c24368-9e06-4126-bbb0-d52db1f2141b-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:51.855 4088 3038341023000 MainThread DEBUG os_win.utils.compute.vmutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Creating VM instance-00000029 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:55:52.119 4088 3038340796088 GreenThread-32 DEBUG nova.network.neutron [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Successfully updated port: 5521086c-3b7c-4aaf-a1da-cbd50850d8f6 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:55:52.149 4088 3038340796088 GreenThread-32 DEBUG oslo_concurrency.lockutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Acquired lock "refresh_cache-5bd3ad21-3959-40c2-8698-b816b7176efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:55:52.149 4088 3038340796088 GreenThread-32 DEBUG nova.network.neutron [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:55:52.277 4088 3038340796088 GreenThread-32 DEBUG nova.network.neutron [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:55:52.449 4088 3038341304568 MainThread DEBUG nova.network.neutron [req-a1f90dae-3e52-4b43-a197-deae7667eff7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Updated VIF entry in instance network info cache for port 277d7897-e0ee-4e5f-a82e-183ef6193aea. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:55:52.449 4088 3038341304568 MainThread DEBUG nova.network.neutron [req-a1f90dae-3e52-4b43-a197-deae7667eff7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Updating instance_info_cache with network_info: [{"id": "277d7897-e0ee-4e5f-a82e-183ef6193aea", "address": "fa:16:3e:4e:00:ca", "network": {"id": "fd33a796-d83b-4f71-bce3-ee0ffa82326d", "bridge": null, "label": "tempest-ServersTestManualDisk-1887493174-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4ad3c7e6a94d4d6ca45d20d801674ca6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap277d7897-e0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:55:52.462 4088 3038341304568 MainThread DEBUG oslo_concurrency.lockutils [req-a1f90dae-3e52-4b43-a197-deae7667eff7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-714fea12-52ae-4277-8f3d-b0db2b2ee548" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:55:52.633 4088 3038341304392 GreenThread-33 DEBUG nova.network.neutron [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Successfully updated port: 62c144ee-03ae-47c7-935c-70cf7bfd5697 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:55:52.649 4088 3038341304392 GreenThread-33 DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Acquired lock "refresh_cache-6aac7cdb-fa5e-417b-bf36-fe5eb161a90b" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:55:52.649 4088 3038341304392 GreenThread-33 DEBUG nova.network.neutron [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:55:52.742 4088 3038341304392 GreenThread-33 DEBUG nova.network.neutron [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:55:52.916 4088 3038340796088 GreenThread-32 DEBUG nova.network.neutron [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Updating instance_info_cache with network_info: [{"id": "5521086c-3b7c-4aaf-a1da-cbd50850d8f6", "address": "fa:16:3e:27:8a:5c", "network": {"id": "7434a41e-b78f-4cb9-8ffe-b2514d097201", "bridge": null, "label": "tempest-LiveAutoBlockMigrationV225Test-1499875764-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91237ebda1b54d2dbc761e48fdd93516", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap5521086c-3b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:55:52.946 4088 3038340796088 GreenThread-32 DEBUG oslo_concurrency.lockutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Releasing lock "refresh_cache-5bd3ad21-3959-40c2-8698-b816b7176efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:55:52.946 4088 3038340796088 GreenThread-32 DEBUG nova.compute.manager [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Instance network_info: |[{"id": "5521086c-3b7c-4aaf-a1da-cbd50850d8f6", "address": "fa:16:3e:27:8a:5c", "network": {"id": "7434a41e-b78f-4cb9-8ffe-b2514d097201", "bridge": null, "label": "tempest-LiveAutoBlockMigrationV225Test-1499875764-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91237ebda1b54d2dbc761e48fdd93516", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap5521086c-3b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:55:53.274 4088 3038341304392 GreenThread-33 DEBUG nova.network.neutron [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Updating instance_info_cache with network_info: [{"id": "62c144ee-03ae-47c7-935c-70cf7bfd5697", "address": "fa:16:3e:8c:3c:56", "network": {"id": "2b8d2ab0-2056-4c92-9f13-38b73897c01b", "bridge": null, "label": "tempest-SecurityGroupsTestJSON-625655316-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f12d8e551e4d4d599a26e3249f7560f1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap62c144ee-03", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:55:53.306 4088 3038341304392 GreenThread-33 DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Releasing lock "refresh_cache-6aac7cdb-fa5e-417b-bf36-fe5eb161a90b" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:55:53.306 4088 3038341304392 GreenThread-33 DEBUG nova.compute.manager [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Instance network_info: |[{"id": "62c144ee-03ae-47c7-935c-70cf7bfd5697", "address": "fa:16:3e:8c:3c:56", "network": {"id": "2b8d2ab0-2056-4c92-9f13-38b73897c01b", "bridge": null, "label": "tempest-SecurityGroupsTestJSON-625655316-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f12d8e551e4d4d599a26e3249f7560f1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap62c144ee-03", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:55:53.306 4088 3038341025640 MainThread DEBUG nova.compute.manager [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Preparing to wait for external event network-vif-plugged-62c144ee-03ae-47c7-935c-70cf7bfd5697 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:55:53.306 4088 3038341025640 MainThread DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "6aac7cdb-fa5e-417b-bf36-fe5eb161a90b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:53.306 4088 3038341025640 MainThread DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "6aac7cdb-fa5e-417b-bf36-fe5eb161a90b-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:53.306 4088 3038341025640 MainThread DEBUG os_win.utils.compute.vmutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Creating VM instance-0000002a create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:55:53.510 4088 3038341024408 MainThread DEBUG nova.compute.manager [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:55:53.510 4088 3038341024408 MainThread INFO nova.virt.hyperv.vmops [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Spawning new instance 2021-09-10 16:55:53.618 4088 3038341304920 MainThread DEBUG nova.network.neutron [req-e6e4a550-0ad1-4857-b926-dca49e930565 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Updated VIF entry in instance network info cache for port 425a57e4-c9b8-452a-aa0c-c3d8a8e68e1f. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:55:53.618 4088 3038341304920 MainThread DEBUG nova.network.neutron [req-e6e4a550-0ad1-4857-b926-dca49e930565 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Updating instance_info_cache with network_info: [{"id": "425a57e4-c9b8-452a-aa0c-c3d8a8e68e1f", "address": "fa:16:3e:6c:27:78", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap425a57e4-c9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:55:53.653 4088 3038341304920 MainThread DEBUG oslo_concurrency.lockutils [req-e6e4a550-0ad1-4857-b926-dca49e930565 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-f0c24368-9e06-4126-bbb0-d52db1f2141b" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:55:53.728 4088 3038341024408 MainThread DEBUG oslo_concurrency.lockutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-00000027" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:53.743 4088 3038341024408 MainThread DEBUG oslo_concurrency.lockutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-00000027" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:53.743 4088 3038341024408 MainThread DEBUG nova.block_device [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] block_device_list ['sda'] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:55:53.743 4088 3038341024408 MainThread DEBUG nova.compute.manager [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Preparing to wait for external event network-vif-plugged-5521086c-3b7c-4aaf-a1da-cbd50850d8f6 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:55:53.743 4088 3038341024408 MainThread DEBUG oslo_concurrency.lockutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "5bd3ad21-3959-40c2-8698-b816b7176efc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:53.743 4088 3038341024408 MainThread DEBUG oslo_concurrency.lockutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "5bd3ad21-3959-40c2-8698-b816b7176efc-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:53.743 4088 3038341024408 MainThread DEBUG os_win.utils.compute.vmutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Creating VM instance-00000027 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:55:53.837 4088 3038341023000 MainThread DEBUG nova.virt.hyperv.vmops [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:55:53.853 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-ddc41a43-8713-4870-bd5f-f7886dcc32b1 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:53.853 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-ddc41a43-8713-4870-bd5f-f7886dcc32b1 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:53.853 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-ddc41a43-8713-4870-bd5f-f7886dcc32b1 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:53.853 4088 3038340796088 MainThread ERROR nova.compute.manager [req-ddc41a43-8713-4870-bd5f-f7886dcc32b1 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Setting instance vm_state to ERROR: NameError: name 'instant' is not defined 2021-09-10 16:55:53.853 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Traceback (most recent call last): 2021-09-10 16:55:53.853 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:55:53.853 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] self._delete_instance(context, instance, bdms) 2021-09-10 16:55:53.853 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:55:53.853 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:55:53.853 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] NameError: name 'instant' is not defined 2021-09-10 16:55:53.853 4088 3038340796088 MainThread TRACE nova.compute.manager [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] 2021-09-10 16:55:53.885 4088 3038340849512 MainThread DEBUG nova.compute.manager [req-e8836272-60b0-4e20-bd99-09cade0070ba 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Received event network-vif-plugged-91b74a84-3e8d-4519-9b49-6d076198996b external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:55:53.885 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [req-e8836272-60b0-4e20-bd99-09cade0070ba 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "60d9f1cb-95b4-472e-999a-d08935125ced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:53.885 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [req-e8836272-60b0-4e20-bd99-09cade0070ba 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "60d9f1cb-95b4-472e-999a-d08935125ced-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:53.885 4088 3038340849512 MainThread DEBUG nova.compute.manager [req-e8836272-60b0-4e20-bd99-09cade0070ba 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Processing event network-vif-plugged-91b74a84-3e8d-4519-9b49-6d076198996b _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:55:53.885 4088 3038340849512 MainThread DEBUG nova.compute.manager [req-e8836272-60b0-4e20-bd99-09cade0070ba 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Received event network-vif-plugged-1f342a4b-8bbc-4cf3-8d5a-3b5ff85c281d external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:55:53.885 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [req-e8836272-60b0-4e20-bd99-09cade0070ba 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "60d9f1cb-95b4-472e-999a-d08935125ced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:53.885 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [req-e8836272-60b0-4e20-bd99-09cade0070ba 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "60d9f1cb-95b4-472e-999a-d08935125ced-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:53.885 4088 3038340849512 MainThread DEBUG nova.compute.manager [req-e8836272-60b0-4e20-bd99-09cade0070ba 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Processing event network-vif-plugged-1f342a4b-8bbc-4cf3-8d5a-3b5ff85c281d _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:55:53.914 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-ddc41a43-8713-4870-bd5f-f7886dcc32b1 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e" released by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 0.062s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:53.914 4088 3038340846520 MainThread INFO nova.virt.hyperv.vmops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Using config drive for instance 2021-09-10 16:55:53.943 4088 3038340849512 MainThread DEBUG nova.compute.manager [req-779fface-82b4-4382-81c2-8bd45afc9fef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Received event network-changed-5521086c-3b7c-4aaf-a1da-cbd50850d8f6 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:55:53.943 4088 3038340849512 MainThread DEBUG nova.compute.manager [req-779fface-82b4-4382-81c2-8bd45afc9fef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Refreshing instance network info cache due to event network-changed-5521086c-3b7c-4aaf-a1da-cbd50850d8f6. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:55:53.943 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [req-779fface-82b4-4382-81c2-8bd45afc9fef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-5bd3ad21-3959-40c2-8698-b816b7176efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:55:53.943 4088 3038340849512 MainThread DEBUG nova.network.neutron [req-779fface-82b4-4382-81c2-8bd45afc9fef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Refreshing network info cache for port 5521086c-3b7c-4aaf-a1da-cbd50850d8f6 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:55:54.024 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-ddc41a43-8713-4870-bd5f-f7886dcc32b1 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:54.024 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.hostops [req-ddc41a43-8713-4870-bd5f-f7886dcc32b1 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:55:54.047 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.hostops [req-ddc41a43-8713-4870-bd5f-f7886dcc32b1 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:55:54.149 4088 3038340846520 MainThread INFO nova.virt.hyperv.vmops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Creating config drive at C:\openstack\instances\instance-00000026\configdrive.iso 2021-09-10 16:55:54.243 4088 3038340846520 MainThread DEBUG oslo_concurrency.processutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000026\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpjexumw3t execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:55:54.634 4088 3038340846520 MainThread DEBUG oslo_concurrency.processutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000026\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpjexumw3t" returned: 0 in 0.391s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:55:54.652 4088 3038340796088 MainThread DEBUG nova.compute.provider_tree [req-ddc41a43-8713-4870-bd5f-f7886dcc32b1 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:55:54.671 4088 3038340796088 MainThread DEBUG nova.scheduler.client.report [req-ddc41a43-8713-4870-bd5f-f7886dcc32b1 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:55:54.671 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-ddc41a43-8713-4870-bd5f-f7886dcc32b1 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.641s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:54.671 4088 3038340796088 MainThread INFO nova.compute.manager [req-ddc41a43-8713-4870-bd5f-f7886dcc32b1 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Successfully reverted task state from deleting on failure for instance. 2021-09-10 16:55:54.671 4088 3038340796088 MainThread ERROR oslo_messaging.rpc.server [req-ddc41a43-8713-4870-bd5f-f7886dcc32b1 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Exception during message handling: NameError: name 'instant' is not defined 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server Traceback (most recent call last): 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 72, in wrapped 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server context, exc, binary) 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server return f(self, context, *args, **kw) 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 184, in decorated_function 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server "Error: %s", e, instance=instance) 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 154, in decorated_function 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\utils.py", line 1433, in decorated_function 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 200, in decorated_function 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3106, in terminate_instance 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server do_terminate_instance(instance, bdms) 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_concurrency\lockutils.py", line 360, in inner 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server return f(*args, **kwargs) 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3104, in do_terminate_instance 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server self._set_instance_obj_error_state(instance) 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server self._delete_instance(context, instance, bdms) 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server NameError: name 'instant' is not defined 2021-09-10 16:55:54.671 4088 3038340796088 MainThread TRACE oslo_messaging.rpc.server 2021-09-10 16:55:54.962 4088 3038340849512 MainThread DEBUG nova.network.neutron [req-779fface-82b4-4382-81c2-8bd45afc9fef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Updated VIF entry in instance network info cache for port 5521086c-3b7c-4aaf-a1da-cbd50850d8f6. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:55:54.962 4088 3038340849512 MainThread DEBUG nova.network.neutron [req-779fface-82b4-4382-81c2-8bd45afc9fef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Updating instance_info_cache with network_info: [{"id": "5521086c-3b7c-4aaf-a1da-cbd50850d8f6", "address": "fa:16:3e:27:8a:5c", "network": {"id": "7434a41e-b78f-4cb9-8ffe-b2514d097201", "bridge": null, "label": "tempest-LiveAutoBlockMigrationV225Test-1499875764-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91237ebda1b54d2dbc761e48fdd93516", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap5521086c-3b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:55:54.993 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [req-779fface-82b4-4382-81c2-8bd45afc9fef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-5bd3ad21-3959-40c2-8698-b816b7176efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:55:54.993 4088 3038340849512 MainThread DEBUG nova.compute.manager [req-779fface-82b4-4382-81c2-8bd45afc9fef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Received event network-changed-62c144ee-03ae-47c7-935c-70cf7bfd5697 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:55:54.993 4088 3038340849512 MainThread DEBUG nova.compute.manager [req-779fface-82b4-4382-81c2-8bd45afc9fef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Refreshing instance network info cache due to event network-changed-62c144ee-03ae-47c7-935c-70cf7bfd5697. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:55:54.993 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [req-779fface-82b4-4382-81c2-8bd45afc9fef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-6aac7cdb-fa5e-417b-bf36-fe5eb161a90b" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:55:54.993 4088 3038340849512 MainThread DEBUG nova.network.neutron [req-779fface-82b4-4382-81c2-8bd45afc9fef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Refreshing network info cache for port 62c144ee-03ae-47c7-935c-70cf7bfd5697 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:55:55.134 4088 3038341024408 MainThread DEBUG nova.virt.hyperv.volumeops [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Attaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-52401085-77e7-4280-b78c-bad720b115d8', 'target_lun': 0, 'volume_id': '52401085-77e7-4280-b78c-bad720b115d8', 'auth_method': 'CHAP', 'auth_username': 'Kn97TpVi2pyUkEmZbVJX', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'reserved', 'instance': '5bd3ad21-3959-40c2-8698-b816b7176efc', 'attached_at': '', 'detached_at': '', 'volume_id': '52401085-77e7-4280-b78c-bad720b115d8', 'serial': '52401085-77e7-4280-b78c-bad720b115d8'} to instance-00000027 _attach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:108 2021-09-10 16:55:55.134 4088 3038341024408 MainThread DEBUG os_brick.initiator.windows.iscsi [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-52401085-77e7-4280-b78c-bad720b115d8', 'target_lun': 0, 'volume_id': '52401085-77e7-4280-b78c-bad720b115d8', 'auth_method': 'CHAP', 'auth_username': 'Kn97TpVi2pyUkEmZbVJX', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:55:55.134 4088 3038341024408 MainThread INFO os_brick.initiator.windows.iscsi [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Attempting to establish an iSCSI session to target iqn.2010-10.org.openstack:volume-52401085-77e7-4280-b78c-bad720b115d8 on portal 10.222.0.55:3260 accessing LUN 0 using initiator None. 2021-09-10 16:55:55.154 4088 3038341024408 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Logging in iSCSI target iqn.2010-10.org.openstack:volume-52401085-77e7-4280-b78c-bad720b115d8 login_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:401 2021-09-10 16:55:55.274 4088 3038340846520 MainThread DEBUG nova.virt.hyperv.vmops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Setting boot order for instance: instance-00000026: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:55:55.376 4088 3038340846520 MainThread DEBUG nova.virt.hyperv.vmops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:55:55.399 4088 3038340846520 MainThread DEBUG os_win.utils.jobutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Waiting for WMI job: {'InstanceID': '4A15AFB8-D329-4580-9511-7192A0B5DBFA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14743), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:55:55.679 4088 3038340846520 MainThread ERROR os_win.utils.jobutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] WMI job failed: {'RawErrors': (('124\'instance-00000026\' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)instance-00000026408FDEBF-6D06-4D93-8121-8AE68D45B89912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)instance-00000026408FDEBF-6D06-4D93-8121-8AE68D45B89910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000026\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)instance-00000026408FDEBF-6D06-4D93-8121-8AE68D45B899%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4A15AFB8-D329-4580-9511-7192A0B5DBFA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=215543), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 55, 55), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 55, 55), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000026' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)\n\nNot enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)\n\n'instance-00000026' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)", 'ErrorSummaryDescription': "'instance-00000026' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000026.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:55:55.695 4088 3038340846520 MainThread DEBUG os_win._utils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000026' failed to start. Not enough memory in the system to start the virtual machine instance-00000026. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000026' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Not enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) 'instance-00000026' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.31926560401916504 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:55:55.743 4088 3038341021944 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:55:55.743 4088 3038341021944 MainThread INFO nova.compute.manager [-] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] VM Stopped (Lifecycle Event) 2021-09-10 16:55:55.743 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000026" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:55.743 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000026" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:55.759 4088 3038341025464 MainThread DEBUG oslo_concurrency.lockutils [req-50baec37-8d7f-43ce-bcac-504cd6a3c6b9 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:55.759 4088 3038341025464 MainThread DEBUG oslo_concurrency.lockutils [req-50baec37-8d7f-43ce-bcac-504cd6a3c6b9 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:55.759 4088 3038341025464 MainThread DEBUG oslo_concurrency.lockutils [req-50baec37-8d7f-43ce-bcac-504cd6a3c6b9 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:55.759 4088 3038341025464 MainThread ERROR nova.compute.manager [req-50baec37-8d7f-43ce-bcac-504cd6a3c6b9 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Setting instance vm_state to ERROR: NameError: name 'instant' is not defined 2021-09-10 16:55:55.759 4088 3038341025464 MainThread TRACE nova.compute.manager [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Traceback (most recent call last): 2021-09-10 16:55:55.759 4088 3038341025464 MainThread TRACE nova.compute.manager [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:55:55.759 4088 3038341025464 MainThread TRACE nova.compute.manager [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] self._delete_instance(context, instance, bdms) 2021-09-10 16:55:55.759 4088 3038341025464 MainThread TRACE nova.compute.manager [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:55:55.759 4088 3038341025464 MainThread TRACE nova.compute.manager [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:55:55.759 4088 3038341025464 MainThread TRACE nova.compute.manager [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] NameError: name 'instant' is not defined 2021-09-10 16:55:55.759 4088 3038341025464 MainThread TRACE nova.compute.manager [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] 2021-09-10 16:55:55.775 4088 3038341021944 MainThread DEBUG nova.compute.manager [req-498e0c68-6591-4010-ac7f-38236963bb1b - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:55:55.775 4088 3038341021944 MainThread DEBUG nova.virt.hyperv.vmops [req-498e0c68-6591-4010-ac7f-38236963bb1b - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:55:55.790 4088 3038341025464 MainThread DEBUG oslo_concurrency.lockutils [req-50baec37-8d7f-43ce-bcac-504cd6a3c6b9 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc" released by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:55.822 4088 3038341021944 MainThread DEBUG nova.compute.manager [req-498e0c68-6591-4010-ac7f-38236963bb1b - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:55:55.839 4088 3038341021944 MainThread INFO nova.compute.manager [req-498e0c68-6591-4010-ac7f-38236963bb1b - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:55:55.868 4088 3038341025640 MainThread DEBUG nova.virt.hyperv.vmops [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:55:55.915 4088 3038341025464 MainThread DEBUG oslo_concurrency.lockutils [req-50baec37-8d7f-43ce-bcac-504cd6a3c6b9 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:55.931 4088 3038341025464 MainThread DEBUG nova.virt.hyperv.hostops [req-50baec37-8d7f-43ce-bcac-504cd6a3c6b9 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:55:55.946 4088 3038341021944 MainThread DEBUG nova.compute.manager [req-182bf21c-f541-4c15-8df9-9a0f6dd5a00c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Received event network-vif-plugged-277d7897-e0ee-4e5f-a82e-183ef6193aea external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:55:55.946 4088 3038341021944 MainThread DEBUG oslo_concurrency.lockutils [req-182bf21c-f541-4c15-8df9-9a0f6dd5a00c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "714fea12-52ae-4277-8f3d-b0db2b2ee548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:55.946 4088 3038341021944 MainThread DEBUG oslo_concurrency.lockutils [req-182bf21c-f541-4c15-8df9-9a0f6dd5a00c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "714fea12-52ae-4277-8f3d-b0db2b2ee548-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:55.946 4088 3038341021944 MainThread DEBUG nova.compute.manager [req-182bf21c-f541-4c15-8df9-9a0f6dd5a00c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Processing event network-vif-plugged-277d7897-e0ee-4e5f-a82e-183ef6193aea _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:55:55.946 4088 3038341025464 MainThread DEBUG nova.virt.hyperv.hostops [req-50baec37-8d7f-43ce-bcac-504cd6a3c6b9 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:55:55.993 4088 3038341021768 MainThread INFO nova.virt.hyperv.vmops [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Using config drive for instance 2021-09-10 16:55:56.183 4088 3038340849512 MainThread DEBUG nova.network.neutron [req-779fface-82b4-4382-81c2-8bd45afc9fef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Updated VIF entry in instance network info cache for port 62c144ee-03ae-47c7-935c-70cf7bfd5697. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:55:56.183 4088 3038340849512 MainThread DEBUG nova.network.neutron [req-779fface-82b4-4382-81c2-8bd45afc9fef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Updating instance_info_cache with network_info: [{"id": "62c144ee-03ae-47c7-935c-70cf7bfd5697", "address": "fa:16:3e:8c:3c:56", "network": {"id": "2b8d2ab0-2056-4c92-9f13-38b73897c01b", "bridge": null, "label": "tempest-SecurityGroupsTestJSON-625655316-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f12d8e551e4d4d599a26e3249f7560f1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap62c144ee-03", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:55:56.183 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [req-779fface-82b4-4382-81c2-8bd45afc9fef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-6aac7cdb-fa5e-417b-bf36-fe5eb161a90b" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:55:56.227 4088 3038341025464 MainThread DEBUG nova.compute.provider_tree [req-50baec37-8d7f-43ce-bcac-504cd6a3c6b9 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:55:56.237 4088 3038341021768 MainThread INFO nova.virt.hyperv.vmops [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Creating config drive at C:\openstack\instances\instance-00000028\configdrive.iso 2021-09-10 16:55:56.336 4088 3038341021768 MainThread DEBUG oslo_concurrency.processutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000028\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpllmay1av execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:55:56.478 4088 3038341025464 MainThread DEBUG nova.scheduler.client.report [req-50baec37-8d7f-43ce-bcac-504cd6a3c6b9 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:55:56.497 4088 3038341025464 MainThread DEBUG oslo_concurrency.lockutils [req-50baec37-8d7f-43ce-bcac-504cd6a3c6b9 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.578s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:56.497 4088 3038341025464 MainThread INFO nova.compute.manager [req-50baec37-8d7f-43ce-bcac-504cd6a3c6b9 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Successfully reverted task state from deleting on failure for instance. 2021-09-10 16:55:56.497 4088 3038341025464 MainThread ERROR oslo_messaging.rpc.server [req-50baec37-8d7f-43ce-bcac-504cd6a3c6b9 34cd40c589284ea9b37a6a75b63fd6b5 606d7457fc884b1c8b24fa368c946f0b - default default] Exception during message handling: NameError: name 'instant' is not defined 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server Traceback (most recent call last): 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 72, in wrapped 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server context, exc, binary) 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server return f(self, context, *args, **kw) 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 184, in decorated_function 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server "Error: %s", e, instance=instance) 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 154, in decorated_function 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\utils.py", line 1433, in decorated_function 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 200, in decorated_function 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3106, in terminate_instance 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server do_terminate_instance(instance, bdms) 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_concurrency\lockutils.py", line 360, in inner 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server return f(*args, **kwargs) 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3104, in do_terminate_instance 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server self._set_instance_obj_error_state(instance) 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server self._delete_instance(context, instance, bdms) 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server NameError: name 'instant' is not defined 2021-09-10 16:55:56.497 4088 3038341025464 MainThread TRACE oslo_messaging.rpc.server 2021-09-10 16:55:56.701 4088 3038341021768 MainThread DEBUG oslo_concurrency.processutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000028\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpllmay1av" returned: 0 in 0.359s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:55:56.743 4088 3038340846520 MainThread DEBUG os_win.utils.jobutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Waiting for WMI job: {'InstanceID': '60235D58-219B-479D-86FA-E02E16FB5D3A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16583), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:55:57.041 4088 3038340846520 MainThread ERROR os_win.utils.jobutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] WMI job failed: {'RawErrors': (('124\'instance-00000026\' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)instance-00000026408FDEBF-6D06-4D93-8121-8AE68D45B89912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)instance-00000026408FDEBF-6D06-4D93-8121-8AE68D45B89910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000026\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)instance-00000026408FDEBF-6D06-4D93-8121-8AE68D45B899%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '60235D58-219B-479D-86FA-E02E16FB5D3A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=206397), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 55, 56), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 55, 56), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000026' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)\n\nNot enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)\n\n'instance-00000026' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)", 'ErrorSummaryDescription': "'instance-00000026' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000026.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:55:57.041 4088 3038340846520 MainThread DEBUG os_win._utils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000026' failed to start. Not enough memory in the system to start the virtual machine instance-00000026. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000026' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Not enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) 'instance-00000026' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.664966344833374 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:55:57.058 4088 3038340796088 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:55:57.058 4088 3038340796088 MainThread INFO nova.compute.manager [-] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] VM Stopped (Lifecycle Event) 2021-09-10 16:55:57.058 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000026" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:57.058 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000026" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:57.070 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-5da010c5-fd5e-490d-952a-6ee808ad7251 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:55:57.070 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-5da010c5-fd5e-490d-952a-6ee808ad7251 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:55:57.129 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-5da010c5-fd5e-490d-952a-6ee808ad7251 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:55:57.152 4088 3038340796088 MainThread INFO nova.compute.manager [req-5da010c5-fd5e-490d-952a-6ee808ad7251 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:55:57.383 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.vmops [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Setting boot order for instance: instance-00000028: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:55:57.466 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.vmops [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:55:57.516 4088 3038341021768 MainThread DEBUG os_win.utils.jobutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Waiting for WMI job: {'InstanceID': 'F044C26E-9810-4ED0-AD17-09B67C27C443', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16786), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:55:57.667 4088 3038341021768 MainThread ERROR os_win.utils.jobutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000028\' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)instance-000000286A986702-F2E9-4AF9-B908-CFA12182740512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)instance-000000286A986702-F2E9-4AF9-B908-CFA12182740510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000028\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)instance-000000286A986702-F2E9-4AF9-B908-CFA121827405%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'F044C26E-9810-4ED0-AD17-09B67C27C443', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=125888), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 55, 57), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 55, 57), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000028' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)\n\nNot enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)\n\n'instance-00000028' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)", 'ErrorSummaryDescription': "'instance-00000028' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000028.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:55:57.683 4088 3038341021768 MainThread DEBUG os_win._utils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000028' failed to start. Not enough memory in the system to start the virtual machine instance-00000028. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000028' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Not enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) 'instance-00000028' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.21710205078125 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:55:57.732 4088 3038340796088 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:55:57.732 4088 3038340796088 MainThread INFO nova.compute.manager [-] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] VM Stopped (Lifecycle Event) 2021-09-10 16:55:57.732 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000028" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:57.732 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000028" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:57.758 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-668932b7-25a7-4a0d-849d-cc7d25f0d164 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:55:57.758 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-668932b7-25a7-4a0d-849d-cc7d25f0d164 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:55:57.823 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-668932b7-25a7-4a0d-849d-cc7d25f0d164 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:55:57.853 4088 3038340796088 MainThread INFO nova.compute.manager [req-668932b7-25a7-4a0d-849d-cc7d25f0d164 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:55:58.070 4088 3038340846520 MainThread DEBUG os_win.utils.jobutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Waiting for WMI job: {'InstanceID': 'D5E495CF-046D-4B88-9FF7-9F22F993E03F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15145), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:55:58.305 4088 3038340846520 MainThread ERROR os_win.utils.jobutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] WMI job failed: {'RawErrors': (('124\'instance-00000026\' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)instance-00000026408FDEBF-6D06-4D93-8121-8AE68D45B89912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)instance-00000026408FDEBF-6D06-4D93-8121-8AE68D45B89910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000026\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)instance-00000026408FDEBF-6D06-4D93-8121-8AE68D45B899%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D5E495CF-046D-4B88-9FF7-9F22F993E03F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=191513), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 55, 58), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 55, 58), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000026' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)\n\nNot enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)\n\n'instance-00000026' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)", 'ErrorSummaryDescription': "'instance-00000026' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000026.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:55:58.305 4088 3038340846520 MainThread DEBUG os_win._utils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000026' failed to start. Not enough memory in the system to start the virtual machine instance-00000026. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000026' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Not enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) 'instance-00000026' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.9289066791534424 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:55:58.373 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000026" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:58.373 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000026" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:58.373 4088 3038340796088 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:55:58.373 4088 3038340796088 MainThread INFO nova.compute.manager [-] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] VM Stopped (Lifecycle Event) 2021-09-10 16:55:58.384 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-5f55950e-7318-4a6f-afc4-6b89953deb13 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:55:58.384 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-5f55950e-7318-4a6f-afc4-6b89953deb13 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:55:58.432 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-5f55950e-7318-4a6f-afc4-6b89953deb13 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:55:58.478 4088 3038340796088 MainThread INFO nova.compute.manager [req-5f55950e-7318-4a6f-afc4-6b89953deb13 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:55:58.728 4088 3038341021768 MainThread DEBUG os_win.utils.jobutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Waiting for WMI job: {'InstanceID': '82BDF731-0A1D-4E51-8128-54D7332AE036', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18639), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:55:58.886 4088 3038341021768 MainThread ERROR os_win.utils.jobutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000028\' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)instance-000000286A986702-F2E9-4AF9-B908-CFA12182740512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)instance-000000286A986702-F2E9-4AF9-B908-CFA12182740510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000028\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)instance-000000286A986702-F2E9-4AF9-B908-CFA121827405%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '82BDF731-0A1D-4E51-8128-54D7332AE036', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=128989), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 55, 58), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 55, 58), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000028' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)\n\nNot enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)\n\n'instance-00000028' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)", 'ErrorSummaryDescription': "'instance-00000028' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000028.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:55:58.886 4088 3038341021768 MainThread DEBUG os_win._utils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000028' failed to start. Not enough memory in the system to start the virtual machine instance-00000028. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000028' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Not enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) 'instance-00000028' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4207851886749268 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:55:58.947 4088 3038340796088 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:55:58.947 4088 3038340796088 MainThread INFO nova.compute.manager [-] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] VM Stopped (Lifecycle Event) 2021-09-10 16:55:58.947 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000028" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:58.947 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000028" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:58.964 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-ac9ace62-eb73-4cb7-97cb-0aba1d76a8c7 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:55:58.964 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-ac9ace62-eb73-4cb7-97cb-0aba1d76a8c7 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:55:59.027 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-ac9ace62-eb73-4cb7-97cb-0aba1d76a8c7 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:55:59.040 4088 3038340796088 MainThread INFO nova.compute.manager [req-ac9ace62-eb73-4cb7-97cb-0aba1d76a8c7 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:55:59.338 4088 3038340846520 MainThread DEBUG os_win.utils.jobutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Waiting for WMI job: {'InstanceID': '40655AC4-7EF3-4C76-AD81-E96D05CF32DA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16015), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:55:59.588 4088 3038340846520 MainThread ERROR os_win.utils.jobutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] WMI job failed: {'RawErrors': (('124\'instance-00000026\' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)instance-00000026408FDEBF-6D06-4D93-8121-8AE68D45B89912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)instance-00000026408FDEBF-6D06-4D93-8121-8AE68D45B89910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000026\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)instance-00000026408FDEBF-6D06-4D93-8121-8AE68D45B899%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '40655AC4-7EF3-4C76-AD81-E96D05CF32DA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=199533), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 55, 59), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 55, 59), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000026' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)\n\nNot enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)\n\n'instance-00000026' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)", 'ErrorSummaryDescription': "'instance-00000026' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000026.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:55:59.588 4088 3038340846520 MainThread DEBUG os_win._utils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000026' failed to start. Not enough memory in the system to start the virtual machine instance-00000026. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000026' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Not enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) 'instance-00000026' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 4.211498737335205 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:55:59.742 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000026" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:55:59.742 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000026" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:55:59.742 4088 3038340796088 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:55:59.742 4088 3038340796088 MainThread INFO nova.compute.manager [-] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] VM Stopped (Lifecycle Event) 2021-09-10 16:55:59.759 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-86980230-cac4-4ade-956c-340d19a35c32 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:55:59.759 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-86980230-cac4-4ade-956c-340d19a35c32 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:55:59.815 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-86980230-cac4-4ade-956c-340d19a35c32 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:55:59.837 4088 3038340796088 MainThread INFO nova.compute.manager [req-86980230-cac4-4ade-956c-340d19a35c32 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:55:59.914 4088 3038341021768 MainThread DEBUG os_win.utils.jobutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Waiting for WMI job: {'InstanceID': '96375604-8CAB-48C9-8DB8-9F84BE744667', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15123), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:00.070 4088 3038341021768 MainThread ERROR os_win.utils.jobutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000028\' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)instance-000000286A986702-F2E9-4AF9-B908-CFA12182740512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)instance-000000286A986702-F2E9-4AF9-B908-CFA12182740510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000028\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)instance-000000286A986702-F2E9-4AF9-B908-CFA121827405%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '96375604-8CAB-48C9-8DB8-9F84BE744667', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111708), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 55, 59), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 55, 59), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000028' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)\n\nNot enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)\n\n'instance-00000028' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)", 'ErrorSummaryDescription': "'instance-00000028' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000028.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:00.070 4088 3038341021768 MainThread DEBUG os_win._utils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000028' failed to start. Not enough memory in the system to start the virtual machine instance-00000028. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000028' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Not enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) 'instance-00000028' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.6047275066375732 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:00.095 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000028" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:00.095 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000028" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:00.095 4088 3038340796088 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:00.095 4088 3038340796088 MainThread INFO nova.compute.manager [-] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] VM Stopped (Lifecycle Event) 2021-09-10 16:56:00.109 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-7e929026-398d-411d-a377-234e5d879ec7 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:00.109 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-7e929026-398d-411d-a377-234e5d879ec7 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:00.164 4088 3038341024408 MainThread DEBUG os_win.utils.storage.diskutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 16:56:00.198 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-7e929026-398d-411d-a377-234e5d879ec7 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:00.246 4088 3038340796088 MainThread INFO nova.compute.manager [req-7e929026-398d-411d-a377-234e5d879ec7 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:00.313 4088 3038341024408 MainThread DEBUG os_win.utils.storage.diskutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 16:56:00.368 4088 3038341024408 MainThread DEBUG os_brick.initiator.windows.iscsi [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] <== connect_volume: return (5233ms) {'type': 'block', 'path': '\\\\.\\PhysicalDrive1', 'number': 1, 'scsi_wwn': '3600140513CCEB62445E4DEC83CB8600C'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:56:00.578 4088 3038340849512 MainThread DEBUG nova.compute.manager [req-fec0c0ca-0175-49d4-836d-838756939046 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Received event network-vif-plugged-425a57e4-c9b8-452a-aa0c-c3d8a8e68e1f external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:56:00.578 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [req-fec0c0ca-0175-49d4-836d-838756939046 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "f0c24368-9e06-4126-bbb0-d52db1f2141b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:00.578 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [req-fec0c0ca-0175-49d4-836d-838756939046 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "f0c24368-9e06-4126-bbb0-d52db1f2141b-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:00.578 4088 3038340849512 MainThread DEBUG nova.compute.manager [req-fec0c0ca-0175-49d4-836d-838756939046 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Processing event network-vif-plugged-425a57e4-c9b8-452a-aa0c-c3d8a8e68e1f _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:56:00.619 4088 3038341023000 MainThread INFO nova.virt.hyperv.vmops [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Using config drive for instance 2021-09-10 16:56:00.634 4088 3038340846520 MainThread DEBUG os_win.utils.jobutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Waiting for WMI job: {'InstanceID': 'C7C6B780-2A0C-4E71-8F3C-0E13206A137C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18241), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:00.792 4088 3038341023000 MainThread INFO nova.virt.hyperv.vmops [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Creating config drive at C:\openstack\instances\instance-00000029\configdrive.iso 2021-09-10 16:56:00.915 4088 3038341023000 MainThread DEBUG oslo_concurrency.processutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000029\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpqgvg9y9n execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:56:01.091 4088 3038341025464 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000026" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:01.091 4088 3038341025464 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000026" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:01.091 4088 3038341021944 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:01.091 4088 3038341021944 MainThread INFO nova.compute.manager [-] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] VM Stopped (Lifecycle Event) 2021-09-10 16:56:01.111 4088 3038341021768 MainThread DEBUG os_win.utils.jobutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Waiting for WMI job: {'InstanceID': '88D01C34-C0B9-4343-ABD2-86FA264E2AE8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19332), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:01.119 4088 3038340846520 MainThread ERROR os_win.utils.jobutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] WMI job failed: {'RawErrors': (('124\'instance-00000026\' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)instance-00000026408FDEBF-6D06-4D93-8121-8AE68D45B89912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)instance-00000026408FDEBF-6D06-4D93-8121-8AE68D45B89910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000026\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)instance-00000026408FDEBF-6D06-4D93-8121-8AE68D45B899%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C7C6B780-2A0C-4E71-8F3C-0E13206A137C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=202560), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000026' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)\n\nNot enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)\n\n'instance-00000026' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)", 'ErrorSummaryDescription': "'instance-00000026' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000026.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:01.119 4088 3038340846520 MainThread DEBUG os_win._utils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000026' failed to start. Not enough memory in the system to start the virtual machine instance-00000026. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000026' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Not enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) 'instance-00000026' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.742639541625977 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:01.119 4088 3038341021944 MainThread DEBUG nova.compute.manager [req-b9280125-366c-48c6-896e-849c6c415f30 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:01.119 4088 3038341021944 MainThread DEBUG nova.virt.hyperv.vmops [req-b9280125-366c-48c6-896e-849c6c415f30 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:01.229 4088 3038341021944 MainThread DEBUG nova.compute.manager [req-b9280125-366c-48c6-896e-849c6c415f30 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:01.258 4088 3038341021944 MainThread INFO nova.compute.manager [req-b9280125-366c-48c6-896e-849c6c415f30 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:01.258 4088 3038341021768 MainThread ERROR os_win.utils.jobutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000028\' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)instance-000000286A986702-F2E9-4AF9-B908-CFA12182740512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)instance-000000286A986702-F2E9-4AF9-B908-CFA12182740510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000028\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)instance-000000286A986702-F2E9-4AF9-B908-CFA121827405%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '88D01C34-C0B9-4343-ABD2-86FA264E2AE8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=130184), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 1), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 1), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000028' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)\n\nNot enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)\n\n'instance-00000028' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)", 'ErrorSummaryDescription': "'instance-00000028' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000028.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:01.258 4088 3038341021768 MainThread DEBUG os_win._utils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000028' failed to start. Not enough memory in the system to start the virtual machine instance-00000028. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000028' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Not enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) 'instance-00000028' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7921175956726074 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:01.274 4088 3038341023000 MainThread DEBUG oslo_concurrency.processutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000029\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpqgvg9y9n" returned: 0 in 0.359s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:56:01.307 4088 3038340796088 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:01.307 4088 3038340796088 MainThread INFO nova.compute.manager [-] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] VM Stopped (Lifecycle Event) 2021-09-10 16:56:01.307 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000028" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:01.307 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000028" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:01.345 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-bbbc79ff-9c16-4163-93d1-8c00a4478e86 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:01.345 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-bbbc79ff-9c16-4163-93d1-8c00a4478e86 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:01.394 4088 3038341024408 MainThread DEBUG nova.virt.hyperv.vmops [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:56:01.430 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-bbbc79ff-9c16-4163-93d1-8c00a4478e86 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:01.450 4088 3038340796088 MainThread INFO nova.compute.manager [req-bbbc79ff-9c16-4163-93d1-8c00a4478e86 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:01.899 4088 3038341023000 MainThread DEBUG nova.virt.hyperv.vmops [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Setting boot order for instance: instance-00000029: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:56:01.994 4088 3038341023000 MainThread DEBUG nova.virt.hyperv.vmops [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:56:02.039 4088 3038341023000 MainThread DEBUG os_win.utils.jobutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': '64F1B00D-C657-4A37-8567-9EE980889237', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17808), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:02.151 4088 3038340846520 MainThread DEBUG os_win.utils.jobutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Waiting for WMI job: {'InstanceID': '39D6415B-77DC-472F-B8C3-06DD54B0B9AF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17863), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:02.167 4088 3038341023000 MainThread ERROR os_win.utils.jobutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000029\' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)instance-000000290774ABAD-090D-446A-B0DC-59D168AABD7F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)instance-000000290774ABAD-090D-446A-B0DC-59D168AABD7F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000029\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)instance-000000290774ABAD-090D-446A-B0DC-59D168AABD7F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '64F1B00D-C657-4A37-8567-9EE980889237', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114882), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 2), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 2), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000029' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)\n\nNot enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)\n\n'instance-00000029' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)", 'ErrorSummaryDescription': "'instance-00000029' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000029.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:02.167 4088 3038341023000 MainThread DEBUG os_win._utils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000029' failed to start. Not enough memory in the system to start the virtual machine instance-00000029. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000029' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Not enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) 'instance-00000029' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.17369461059570312 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:02.222 4088 3038340849512 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:02.230 4088 3038340849512 MainThread INFO nova.compute.manager [-] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] VM Stopped (Lifecycle Event) 2021-09-10 16:56:02.230 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000029" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:02.230 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000029" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:02.243 4088 3038340849512 MainThread DEBUG nova.compute.manager [req-21e40d22-4950-4ed7-aaf5-b145dae4e7b3 - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:02.243 4088 3038340849512 MainThread DEBUG nova.virt.hyperv.vmops [req-21e40d22-4950-4ed7-aaf5-b145dae4e7b3 - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:02.293 4088 3038341021768 MainThread DEBUG os_win.utils.jobutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Waiting for WMI job: {'InstanceID': '222B1241-C8B3-42AA-AFF6-5A66B95FF4A3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15669), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:02.293 4088 3038340849512 MainThread DEBUG nova.compute.manager [req-21e40d22-4950-4ed7-aaf5-b145dae4e7b3 - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:02.353 4088 3038340849512 MainThread INFO nova.compute.manager [req-21e40d22-4950-4ed7-aaf5-b145dae4e7b3 - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:02.425 4088 3038340846520 MainThread ERROR os_win.utils.jobutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] WMI job failed: {'RawErrors': (('124\'instance-00000026\' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)instance-00000026408FDEBF-6D06-4D93-8121-8AE68D45B89912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)instance-00000026408FDEBF-6D06-4D93-8121-8AE68D45B89910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000026\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)instance-00000026408FDEBF-6D06-4D93-8121-8AE68D45B899%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '39D6415B-77DC-472F-B8C3-06DD54B0B9AF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=211044), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 2), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 2), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000026' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)\n\nNot enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)\n\n'instance-00000026' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899)", 'ErrorSummaryDescription': "'instance-00000026' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000026.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:02.425 4088 3038340846520 MainThread ERROR nova.virt.hyperv.vmops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Failed to change vm state of instance-00000026 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000026' failed to start. 2021-09-10 16:56:02.425 4088 3038340846520 MainThread INFO nova.virt.hyperv.vmops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Got request to destroy instance 2021-09-10 16:56:02.471 4088 3038340849512 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:02.480 4088 3038340849512 MainThread INFO nova.compute.manager [-] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] VM Stopped (Lifecycle Event) 2021-09-10 16:56:02.480 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000026" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:02.480 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000026" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:02.493 4088 3038340849512 MainThread DEBUG nova.compute.manager [req-746cf7cf-0cb9-4701-82a0-33b8fadeab20 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:02.493 4088 3038340849512 MainThread DEBUG nova.virt.hyperv.vmops [req-746cf7cf-0cb9-4701-82a0-33b8fadeab20 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:02.539 4088 3038341021768 MainThread ERROR os_win.utils.jobutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000028\' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)instance-000000286A986702-F2E9-4AF9-B908-CFA12182740512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)instance-000000286A986702-F2E9-4AF9-B908-CFA12182740510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000028\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)instance-000000286A986702-F2E9-4AF9-B908-CFA121827405%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '222B1241-C8B3-42AA-AFF6-5A66B95FF4A3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=198301), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 2), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 2), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000028' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)\n\nNot enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)\n\n'instance-00000028' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)", 'ErrorSummaryDescription': "'instance-00000028' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000028.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:02.539 4088 3038341021768 MainThread DEBUG os_win._utils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000028' failed to start. Not enough memory in the system to start the virtual machine instance-00000028. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000028' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Not enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) 'instance-00000028' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.073511123657227 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:02.603 4088 3038340796088 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:02.603 4088 3038340796088 MainThread INFO nova.compute.manager [-] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] VM Stopped (Lifecycle Event) 2021-09-10 16:56:02.603 4088 3038341022824 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000028" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:02.603 4088 3038341022824 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000028" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:02.623 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-c37dff9b-98b1-4b77-a0d9-4bb1527aa2af - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:02.623 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-c37dff9b-98b1-4b77-a0d9-4bb1527aa2af - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:02.623 4088 3038340849512 MainThread DEBUG nova.compute.manager [req-746cf7cf-0cb9-4701-82a0-33b8fadeab20 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:02.649 4088 3038340849512 MainThread INFO nova.compute.manager [req-746cf7cf-0cb9-4701-82a0-33b8fadeab20 - - - - -] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:02.684 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-c37dff9b-98b1-4b77-a0d9-4bb1527aa2af - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:02.696 4088 3038340796088 MainThread INFO nova.compute.manager [req-c37dff9b-98b1-4b77-a0d9-4bb1527aa2af - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:02.743 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-0a9b4598-a4ce-4050-a050-e9fd807e7ca3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Received event network-vif-plugged-62c144ee-03ae-47c7-935c-70cf7bfd5697 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:56:02.743 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-0a9b4598-a4ce-4050-a050-e9fd807e7ca3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "6aac7cdb-fa5e-417b-bf36-fe5eb161a90b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:02.743 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [req-0a9b4598-a4ce-4050-a050-e9fd807e7ca3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "6aac7cdb-fa5e-417b-bf36-fe5eb161a90b-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:02.743 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-0a9b4598-a4ce-4050-a050-e9fd807e7ca3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Processing event network-vif-plugged-62c144ee-03ae-47c7-935c-70cf7bfd5697 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:56:02.775 4088 3038341025640 MainThread INFO nova.virt.hyperv.vmops [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Using config drive for instance 2021-09-10 16:56:03.014 4088 3038341025640 MainThread INFO nova.virt.hyperv.vmops [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Creating config drive at C:\openstack\instances\instance-0000002a\configdrive.iso 2021-09-10 16:56:03.104 4088 3038341025640 MainThread DEBUG oslo_concurrency.processutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000002a\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpy500kbez execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:56:03.281 4088 3038341023000 MainThread DEBUG os_win.utils.jobutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': 'A1A137EC-B393-4E86-8A74-1D2C368EE495', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14657), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:03.418 4088 3038341023000 MainThread ERROR os_win.utils.jobutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000029\' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)instance-000000290774ABAD-090D-446A-B0DC-59D168AABD7F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)instance-000000290774ABAD-090D-446A-B0DC-59D168AABD7F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000029\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)instance-000000290774ABAD-090D-446A-B0DC-59D168AABD7F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A1A137EC-B393-4E86-8A74-1D2C368EE495', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114612), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 3), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000029' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)\n\nNot enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)\n\n'instance-00000029' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)", 'ErrorSummaryDescription': "'instance-00000029' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000029.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:03.418 4088 3038341023000 MainThread DEBUG os_win._utils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000029' failed to start. Not enough memory in the system to start the virtual machine instance-00000029. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000029' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Not enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) 'instance-00000029' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4238495826721191 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:03.418 4088 3038341025640 MainThread DEBUG oslo_concurrency.processutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000002a\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpy500kbez" returned: 0 in 0.312s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:56:03.463 4088 3038341022824 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000029" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:03.463 4088 3038341022824 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000029" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:03.463 4088 3038340849512 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:03.463 4088 3038340849512 MainThread INFO nova.compute.manager [-] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] VM Stopped (Lifecycle Event) 2021-09-10 16:56:03.478 4088 3038340849512 MainThread DEBUG nova.compute.manager [req-4f0ec67f-2b43-4c14-af40-fbd2a294ad8c - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:03.478 4088 3038340849512 MainThread DEBUG nova.virt.hyperv.vmops [req-4f0ec67f-2b43-4c14-af40-fbd2a294ad8c - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:03.524 4088 3038340849512 MainThread DEBUG nova.compute.manager [req-4f0ec67f-2b43-4c14-af40-fbd2a294ad8c - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:03.556 4088 3038340849512 MainThread INFO nova.compute.manager [req-4f0ec67f-2b43-4c14-af40-fbd2a294ad8c - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:03.590 4088 3038341021768 MainThread DEBUG os_win.utils.jobutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Waiting for WMI job: {'InstanceID': '37AF9551-A664-41D1-B80E-F8A800995CB4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16758), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:03.742 4088 3038341021768 MainThread ERROR os_win.utils.jobutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000028\' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)instance-000000286A986702-F2E9-4AF9-B908-CFA12182740512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)instance-000000286A986702-F2E9-4AF9-B908-CFA12182740510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000028\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)instance-000000286A986702-F2E9-4AF9-B908-CFA121827405%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '37AF9551-A664-41D1-B80E-F8A800995CB4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114215), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 3), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000028' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)\n\nNot enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)\n\n'instance-00000028' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405)", 'ErrorSummaryDescription': "'instance-00000028' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000028.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:03.742 4088 3038341021768 MainThread ERROR nova.virt.hyperv.vmops [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Failed to change vm state of instance-00000028 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000028' failed to start. 2021-09-10 16:56:03.742 4088 3038341021768 MainThread INFO nova.virt.hyperv.vmops [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Got request to destroy instance 2021-09-10 16:56:03.821 4088 3038340796088 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:03.821 4088 3038340796088 MainThread INFO nova.compute.manager [-] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] VM Stopped (Lifecycle Event) 2021-09-10 16:56:03.844 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000028" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:03.852 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000028" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:03.852 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-d2f66483-fa24-4e7f-88ff-2cf3dfcfd8c8 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:03.852 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-d2f66483-fa24-4e7f-88ff-2cf3dfcfd8c8 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:03.916 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-d2f66483-fa24-4e7f-88ff-2cf3dfcfd8c8 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:03.932 4088 3038340796088 MainThread INFO nova.compute.manager [req-d2f66483-fa24-4e7f-88ff-2cf3dfcfd8c8 - - - - -] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:03.984 4088 3038341025640 MainThread DEBUG nova.virt.hyperv.vmops [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Setting boot order for instance: instance-0000002a: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:56:04.075 4088 3038341025640 MainThread DEBUG nova.virt.hyperv.vmops [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:56:04.119 4088 3038341025640 MainThread DEBUG os_win.utils.jobutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Waiting for WMI job: {'InstanceID': '49BFDD7A-CFB7-47D6-A84E-3C8CC276DCB6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17695), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:04.259 4088 3038341025640 MainThread ERROR os_win.utils.jobutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002a\' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)instance-0000002aB90FD6B6-4358-4A2C-BCD8-4EA075ECB15312030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)instance-0000002aB90FD6B6-4358-4A2C-BCD8-4EA075ECB15310243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)instance-0000002aB90FD6B6-4358-4A2C-BCD8-4EA075ECB153%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '49BFDD7A-CFB7-47D6-A84E-3C8CC276DCB6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120902), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 4), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002a' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)\n\nNot enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)\n\n'instance-0000002a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)", 'ErrorSummaryDescription': "'instance-0000002a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:04.259 4088 3038341025640 MainThread DEBUG os_win._utils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002a' failed to start. Not enough memory in the system to start the virtual machine instance-0000002a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002a' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Not enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) 'instance-0000002a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18403410911560059 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:04.306 4088 3038340796088 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:04.306 4088 3038340796088 MainThread INFO nova.compute.manager [-] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] VM Stopped (Lifecycle Event) 2021-09-10 16:56:04.306 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:04.306 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:04.337 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-e5eed1ae-31d0-4623-958a-3dce29e2957d - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:04.337 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-e5eed1ae-31d0-4623-958a-3dce29e2957d - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:04.401 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-e5eed1ae-31d0-4623-958a-3dce29e2957d - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:04.401 4088 3038340796088 MainThread INFO nova.compute.manager [req-e5eed1ae-31d0-4623-958a-3dce29e2957d - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:04.455 4088 3038341023000 MainThread DEBUG os_win.utils.jobutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': '9422C515-AC41-4E64-961B-4356CFB9123A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19324), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:04.619 4088 3038341023000 MainThread ERROR os_win.utils.jobutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000029\' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)instance-000000290774ABAD-090D-446A-B0DC-59D168AABD7F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)instance-000000290774ABAD-090D-446A-B0DC-59D168AABD7F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000029\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)instance-000000290774ABAD-090D-446A-B0DC-59D168AABD7F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9422C515-AC41-4E64-961B-4356CFB9123A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114285), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 4), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000029' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)\n\nNot enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)\n\n'instance-00000029' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)", 'ErrorSummaryDescription': "'instance-00000029' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000029.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:04.619 4088 3038341023000 MainThread DEBUG os_win._utils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000029' failed to start. Not enough memory in the system to start the virtual machine instance-00000029. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000029' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Not enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) 'instance-00000029' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.6251161098480225 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:04.656 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000029" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:04.656 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000029" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:04.656 4088 3038340796088 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:04.656 4088 3038340796088 MainThread INFO nova.compute.manager [-] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] VM Stopped (Lifecycle Event) 2021-09-10 16:56:04.665 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-d948d60e-31bc-4852-ac66-b40f652cae80 - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:04.665 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-d948d60e-31bc-4852-ac66-b40f652cae80 - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:04.728 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-d948d60e-31bc-4852-ac66-b40f652cae80 - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:04.751 4088 3038340796088 MainThread INFO nova.compute.manager [req-d948d60e-31bc-4852-ac66-b40f652cae80 - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:05.001 4088 3038340846520 MainThread DEBUG nova.virt.hyperv.vmops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:56:05.001 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "instance-00000026" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:05.001 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "instance-00000026" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:05.024 4088 3038340846520 MainThread DEBUG os_win.utils.compute.vmutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Successfully changed vm state of instance-00000026 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:56:05.024 4088 3038340846520 MainThread DEBUG nova.virt.hyperv.vmops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Successfully changed state of VM instance-00000026 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:56:05.072 4088 3038340846520 MainThread DEBUG os_win.utils.jobutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Waiting for WMI job: {'InstanceID': '05065659-C9FB-445C-95B9-31EDE13AE97A', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15854), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:05.181 4088 3038340846520 MainThread DEBUG os_win.utils.jobutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] WMI job succeeded: {'InstanceID': '05065659-C9FB-445C-95B9-31EDE13AE97A', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=109076), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:56:05.181 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "instance-00000026" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:05.181 4088 3038340846520 MainThread DEBUG os_win.utils.pathutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Removing directory: C:\openstack\instances\instance-00000026 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:56:05.181 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "instance-00000026" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:05.181 4088 3038340846520 MainThread ERROR nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000026' failed to start. Not enough memory in the system to start the virtual machine instance-00000026. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000026' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Not enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) 'instance-00000026' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Error code: 32778. 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Traceback (most recent call last): 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] return function(*args, **kwargs) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] admin_password, network_info, block_device_info) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] return function(self, *args, **kwds) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self.force_reraise() 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] raise self.value 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] should_plug_vifs=False) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 'req_state': req_state}) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self.force_reraise() 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] raise self.value 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] time.sleep(sleep_time) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self.force_reraise() 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] raise self.value 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] return f(*args, **kwargs) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] return self._wait_for_job(job_path) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] error_desc=err_desc) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000026' failed to start. 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Not enough memory in the system to start the virtual machine instance-00000026. 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000026' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Not enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 'instance-00000026' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Error code: 32778. 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] During handling of the above exception, another exception occurred: 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Traceback (most recent call last): 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] yield resources 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] accel_info=accel_info) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] return function(*args, **kwargs) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] admin_password, network_info, block_device_info) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] return function(self, *args, **kwds) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self.force_reraise() 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] raise self.value 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] should_plug_vifs=False) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 'req_state': req_state}) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self.force_reraise() 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] raise self.value 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] time.sleep(sleep_time) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self.force_reraise() 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] raise self.value 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] return f(*args, **kwargs) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] return self._wait_for_job(job_path) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] error_desc=err_desc) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000026' failed to start. 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Not enough memory in the system to start the virtual machine instance-00000026. 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000026' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Not enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 'instance-00000026' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Error code: 32778. 2021-09-10 16:56:05.181 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.181 4088 3038340846520 MainThread INFO nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Terminating instance 2021-09-10 16:56:05.181 4088 3038340846520 MainThread DEBUG nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:56:05.181 4088 3038340846520 MainThread INFO nova.virt.hyperv.vmops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Got request to destroy instance 2021-09-10 16:56:05.219 4088 3038340846520 MainThread DEBUG nova.virt.hyperv.vmops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:56:05.219 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "instance-00000026" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:05.230 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "instance-00000026" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:05.230 4088 3038340846520 MainThread INFO nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Took 0.05 seconds to destroy the instance on the hypervisor. 2021-09-10 16:56:05.230 4088 3038340846520 MainThread DEBUG nova.compute.claims [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:56:05.230 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:05.290 4088 3038341025640 MainThread DEBUG os_win.utils.jobutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Waiting for WMI job: {'InstanceID': '4D19418B-BD7E-4213-8686-5261F99B162F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16605), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:05.320 4088 3038340846520 MainThread DEBUG nova.virt.hyperv.hostops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:56:05.336 4088 3038340846520 MainThread DEBUG nova.virt.hyperv.hostops [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:56:05.437 4088 3038341025640 MainThread ERROR os_win.utils.jobutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002a\' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)instance-0000002aB90FD6B6-4358-4A2C-BCD8-4EA075ECB15312030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)instance-0000002aB90FD6B6-4358-4A2C-BCD8-4EA075ECB15310243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)instance-0000002aB90FD6B6-4358-4A2C-BCD8-4EA075ECB153%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4D19418B-BD7E-4213-8686-5261F99B162F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118904), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 5), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 5), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002a' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)\n\nNot enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)\n\n'instance-0000002a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)", 'ErrorSummaryDescription': "'instance-0000002a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:05.437 4088 3038341025640 MainThread DEBUG os_win._utils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002a' failed to start. Not enough memory in the system to start the virtual machine instance-0000002a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002a' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Not enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) 'instance-0000002a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3619580268859863 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:05.498 4088 3038340796088 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:05.498 4088 3038340796088 MainThread INFO nova.compute.manager [-] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] VM Stopped (Lifecycle Event) 2021-09-10 16:56:05.498 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:05.498 4088 3038340849512 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:05.524 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-c6a175e1-9960-4349-8103-0cd3576bbc92 - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:05.524 4088 3038340796088 MainThread DEBUG nova.virt.hyperv.vmops [req-c6a175e1-9960-4349-8103-0cd3576bbc92 - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:05.572 4088 3038340846520 MainThread DEBUG nova.compute.provider_tree [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:56:05.595 4088 3038340796088 MainThread DEBUG nova.compute.manager [req-c6a175e1-9960-4349-8103-0cd3576bbc92 - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:05.595 4088 3038340846520 MainThread DEBUG nova.scheduler.client.report [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:56:05.595 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.375s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:05.595 4088 3038340846520 MainThread ERROR nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000026' failed to start. Not enough memory in the system to start the virtual machine instance-00000026. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000026' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Not enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) 'instance-00000026' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Error code: 32778. 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Traceback (most recent call last): 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] return function(*args, **kwargs) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] admin_password, network_info, block_device_info) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] return function(self, *args, **kwds) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self.force_reraise() 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] raise self.value 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] should_plug_vifs=False) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 'req_state': req_state}) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self.force_reraise() 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] raise self.value 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] time.sleep(sleep_time) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self.force_reraise() 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] raise self.value 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] return f(*args, **kwargs) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] return self._wait_for_job(job_path) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] error_desc=err_desc) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000026' failed to start. 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Not enough memory in the system to start the virtual machine instance-00000026. 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000026' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Not enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 'instance-00000026' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Error code: 32778. 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] During handling of the above exception, another exception occurred: 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Traceback (most recent call last): 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] accel_info=accel_info) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] return function(*args, **kwargs) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] admin_password, network_info, block_device_info) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] return function(self, *args, **kwds) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self.force_reraise() 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] raise self.value 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] should_plug_vifs=False) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 'req_state': req_state}) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self.force_reraise() 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] raise self.value 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] time.sleep(sleep_time) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self.force_reraise() 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] raise self.value 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] return f(*args, **kwargs) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] return self._wait_for_job(job_path) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] error_desc=err_desc) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000026' failed to start. 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Not enough memory in the system to start the virtual machine instance-00000026. 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000026' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Not enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 'instance-00000026' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Error code: 32778. 2021-09-10 16:56:05.595 4088 3038340846520 MainThread TRACE nova.compute.manager [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] 2021-09-10 16:56:05.595 4088 3038340846520 MainThread DEBUG nova.compute.utils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] WMI job failed with status 10. Error summary description: 'instance-00000026' failed to start. Not enough memory in the system to start the virtual machine instance-00000026. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:56:05.595 4088 3038340846520 MainThread DEBUG nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Build of instance 60d9f1cb-95b4-472e-999a-d08935125ced was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000026' failed to start. Not enough memory in the system to start the virtual machine instance-00000026. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000026' failed to start. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Not enough memory in the system to start the virtual machine instance-00000026 with ram size 1024 megabytes. (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) 'instance-00000026' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 408FDEBF-6D06-4D93-8121-8AE68D45B899) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:56:05.613 4088 3038340846520 MainThread DEBUG nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:56:05.613 4088 3038340846520 MainThread DEBUG nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:56:05.613 4088 3038340846520 MainThread DEBUG nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:56:05.613 4088 3038340846520 MainThread DEBUG nova.network.neutron [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:56:05.613 4088 3038340796088 MainThread INFO nova.compute.manager [req-c6a175e1-9960-4349-8103-0cd3576bbc92 - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:05.683 4088 3038341023000 MainThread DEBUG os_win.utils.jobutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': '217EB99C-55D8-4505-97DD-339BCC7BC65D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=24285), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:05.837 4088 3038341023000 MainThread ERROR os_win.utils.jobutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000029\' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)instance-000000290774ABAD-090D-446A-B0DC-59D168AABD7F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)instance-000000290774ABAD-090D-446A-B0DC-59D168AABD7F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000029\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)instance-000000290774ABAD-090D-446A-B0DC-59D168AABD7F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '217EB99C-55D8-4505-97DD-339BCC7BC65D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=123130), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 5), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 5), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000029' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)\n\nNot enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)\n\n'instance-00000029' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)", 'ErrorSummaryDescription': "'instance-00000029' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000029.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:05.837 4088 3038341023000 MainThread DEBUG os_win._utils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000029' failed to start. Not enough memory in the system to start the virtual machine instance-00000029. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000029' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Not enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) 'instance-00000029' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.84318208694458 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:05.859 4088 3038341575256 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000029" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:05.859 4088 3038341575256 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000029" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:05.859 4088 3038341575080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:05.859 4088 3038341575080 MainThread INFO nova.compute.manager [-] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] VM Stopped (Lifecycle Event) 2021-09-10 16:56:05.880 4088 3038341575080 MainThread DEBUG nova.compute.manager [req-894502b6-1f44-44da-aabb-aa0fea4df37d - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:05.880 4088 3038341575080 MainThread DEBUG nova.virt.hyperv.vmops [req-894502b6-1f44-44da-aabb-aa0fea4df37d - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:05.901 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.vmops [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:56:05.901 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Lock "instance-00000028" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:05.901 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Lock "instance-00000028" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:05.930 4088 3038341575080 MainThread DEBUG nova.compute.manager [req-894502b6-1f44-44da-aabb-aa0fea4df37d - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:05.930 4088 3038341021768 MainThread DEBUG os_win.utils.compute.vmutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Successfully changed vm state of instance-00000028 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:56:05.930 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.vmops [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Successfully changed state of VM instance-00000028 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:56:05.949 4088 3038341575080 MainThread INFO nova.compute.manager [req-894502b6-1f44-44da-aabb-aa0fea4df37d - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:05.977 4088 3038341021768 MainThread DEBUG os_win.utils.jobutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Waiting for WMI job: {'InstanceID': '103DF06E-3734-419B-B3F5-FE8E22D0593E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15377), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:06.119 4088 3038341021768 MainThread DEBUG os_win.utils.jobutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] WMI job succeeded: {'InstanceID': '103DF06E-3734-419B-B3F5-FE8E22D0593E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=118244), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:56:06.119 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Lock "instance-00000028" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:06.119 4088 3038341021768 MainThread DEBUG os_win.utils.pathutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Removing directory: C:\openstack\instances\instance-00000028 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:56:06.119 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Lock "instance-00000028" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:06.119 4088 3038341021768 MainThread ERROR nova.compute.manager [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000028' failed to start. Not enough memory in the system to start the virtual machine instance-00000028. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000028' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Not enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) 'instance-00000028' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Error code: 32778. 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Traceback (most recent call last): 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] return function(*args, **kwargs) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] admin_password, network_info, block_device_info) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] return function(self, *args, **kwds) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self.force_reraise() 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] raise self.value 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] should_plug_vifs=False) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 'req_state': req_state}) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self.force_reraise() 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] raise self.value 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] time.sleep(sleep_time) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self.force_reraise() 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] raise self.value 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] return f(*args, **kwargs) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] return self._wait_for_job(job_path) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] error_desc=err_desc) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000028' failed to start. 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Not enough memory in the system to start the virtual machine instance-00000028. 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000028' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Not enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 'instance-00000028' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Error code: 32778. 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] During handling of the above exception, another exception occurred: 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Traceback (most recent call last): 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] yield resources 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] accel_info=accel_info) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] return function(*args, **kwargs) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] admin_password, network_info, block_device_info) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] return function(self, *args, **kwds) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self.force_reraise() 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] raise self.value 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] should_plug_vifs=False) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 'req_state': req_state}) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self.force_reraise() 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] raise self.value 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] time.sleep(sleep_time) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self.force_reraise() 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] raise self.value 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] return f(*args, **kwargs) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] return self._wait_for_job(job_path) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] error_desc=err_desc) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000028' failed to start. 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Not enough memory in the system to start the virtual machine instance-00000028. 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000028' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Not enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 'instance-00000028' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Error code: 32778. 2021-09-10 16:56:06.119 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.137 4088 3038341021768 MainThread INFO nova.compute.manager [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Terminating instance 2021-09-10 16:56:06.137 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:56:06.137 4088 3038341021768 MainThread INFO nova.virt.hyperv.vmops [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Got request to destroy instance 2021-09-10 16:56:06.153 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.vmops [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:56:06.153 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Lock "instance-00000028" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:06.153 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Lock "instance-00000028" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:06.153 4088 3038341021768 MainThread INFO nova.compute.manager [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 16:56:06.153 4088 3038341021768 MainThread DEBUG nova.compute.claims [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:56:06.153 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:06.322 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.hostops [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:56:06.336 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.hostops [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:56:06.560 4088 3038341025640 MainThread DEBUG os_win.utils.jobutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Waiting for WMI job: {'InstanceID': '967FCDC1-F95C-4AFE-82B6-87E997D6ED82', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19762), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:06.601 4088 3038341021768 MainThread DEBUG nova.compute.provider_tree [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:56:06.656 4088 3038341576312 MainThread DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Lock "27ece020-a06e-4d29-aedc-cf0d87bdc941" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:06.656 4088 3038341021768 MainThread DEBUG nova.scheduler.client.report [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:56:06.656 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.500s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:06.656 4088 3038341021768 MainThread ERROR nova.compute.manager [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000028' failed to start. Not enough memory in the system to start the virtual machine instance-00000028. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000028' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Not enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) 'instance-00000028' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Error code: 32778. 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Traceback (most recent call last): 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] return function(*args, **kwargs) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] admin_password, network_info, block_device_info) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] return function(self, *args, **kwds) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self.force_reraise() 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] raise self.value 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] should_plug_vifs=False) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 'req_state': req_state}) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self.force_reraise() 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] raise self.value 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] time.sleep(sleep_time) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self.force_reraise() 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] raise self.value 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] return f(*args, **kwargs) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] return self._wait_for_job(job_path) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] error_desc=err_desc) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000028' failed to start. 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Not enough memory in the system to start the virtual machine instance-00000028. 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000028' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Not enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 'instance-00000028' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Error code: 32778. 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] During handling of the above exception, another exception occurred: 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Traceback (most recent call last): 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] accel_info=accel_info) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] return function(*args, **kwargs) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] admin_password, network_info, block_device_info) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] return function(self, *args, **kwds) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self.force_reraise() 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] raise self.value 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] should_plug_vifs=False) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 'req_state': req_state}) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self.force_reraise() 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] raise self.value 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] time.sleep(sleep_time) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self.force_reraise() 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] raise self.value 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] return f(*args, **kwargs) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] return self._wait_for_job(job_path) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] error_desc=err_desc) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000028' failed to start. 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Not enough memory in the system to start the virtual machine instance-00000028. 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000028' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Not enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 'instance-00000028' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Error code: 32778. 2021-09-10 16:56:06.656 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] 2021-09-10 16:56:06.656 4088 3038341021768 MainThread DEBUG nova.compute.utils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] WMI job failed with status 10. Error summary description: 'instance-00000028' failed to start. Not enough memory in the system to start the virtual machine instance-00000028. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:56:06.656 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Build of instance 714fea12-52ae-4277-8f3d-b0db2b2ee548 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000028' failed to start. Not enough memory in the system to start the virtual machine instance-00000028. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000028' failed to start. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Not enough memory in the system to start the virtual machine instance-00000028 with ram size 1024 megabytes. (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) 'instance-00000028' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6A986702-F2E9-4AF9-B908-CFA121827405) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:56:06.656 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:56:06.656 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:56:06.656 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:56:06.656 4088 3038341021768 MainThread DEBUG nova.network.neutron [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:56:06.680 4088 3038341576312 MainThread DEBUG nova.compute.manager [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:56:06.744 4088 3038341025640 MainThread ERROR os_win.utils.jobutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002a\' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)instance-0000002aB90FD6B6-4358-4A2C-BCD8-4EA075ECB15312030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)instance-0000002aB90FD6B6-4358-4A2C-BCD8-4EA075ECB15310243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)instance-0000002aB90FD6B6-4358-4A2C-BCD8-4EA075ECB153%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '967FCDC1-F95C-4AFE-82B6-87E997D6ED82', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=132723), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 6), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 6), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002a' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)\n\nNot enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)\n\n'instance-0000002a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)", 'ErrorSummaryDescription': "'instance-0000002a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:06.776 4088 3038341025640 MainThread DEBUG os_win._utils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002a' failed to start. Not enough memory in the system to start the virtual machine instance-0000002a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002a' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Not enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) 'instance-0000002a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.700714349746704 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:06.792 4088 3038340847400 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:06.792 4088 3038340847400 MainThread INFO nova.compute.manager [-] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] VM Stopped (Lifecycle Event) 2021-09-10 16:56:06.792 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:06.792 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:06.805 4088 3038340847400 MainThread DEBUG nova.compute.manager [req-57a7c7f9-1a4d-476e-a85e-c74506d7d352 - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:06.805 4088 3038340847400 MainThread DEBUG nova.virt.hyperv.vmops [req-57a7c7f9-1a4d-476e-a85e-c74506d7d352 - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:06.836 4088 3038341576312 MainThread DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:06.852 4088 3038341576312 MainThread DEBUG nova.virt.hardware [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:56:06.852 4088 3038341576312 MainThread INFO nova.compute.claims [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Claim successful on node n-h2-808474-1 2021-09-10 16:56:06.884 4088 3038340847400 MainThread DEBUG nova.compute.manager [req-57a7c7f9-1a4d-476e-a85e-c74506d7d352 - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:06.884 4088 3038341023000 MainThread DEBUG os_win.utils.jobutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': 'A2C71398-D57E-45B3-8C62-F486A959F46F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16825), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:06.916 4088 3038340847400 MainThread INFO nova.compute.manager [req-57a7c7f9-1a4d-476e-a85e-c74506d7d352 - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:06.994 4088 3038341576312 MainThread DEBUG nova.virt.hyperv.hostops [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:56:07.028 4088 3038341576312 MainThread DEBUG nova.virt.hyperv.hostops [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:56:07.040 4088 3038341023000 MainThread ERROR os_win.utils.jobutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000029\' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)instance-000000290774ABAD-090D-446A-B0DC-59D168AABD7F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)instance-000000290774ABAD-090D-446A-B0DC-59D168AABD7F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000029\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)instance-000000290774ABAD-090D-446A-B0DC-59D168AABD7F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A2C71398-D57E-45B3-8C62-F486A959F46F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=123984), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 6), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 6), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000029' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)\n\nNot enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)\n\n'instance-00000029' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)", 'ErrorSummaryDescription': "'instance-00000029' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000029.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:07.040 4088 3038341023000 MainThread DEBUG os_win._utils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000029' failed to start. Not enough memory in the system to start the virtual machine instance-00000029. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000029' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Not enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) 'instance-00000029' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.0463104248046875 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:07.089 4088 3038340847400 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:07.089 4088 3038340847400 MainThread INFO nova.compute.manager [-] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] VM Stopped (Lifecycle Event) 2021-09-10 16:56:07.108 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000029" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:07.108 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000029" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:07.118 4088 3038340847400 MainThread DEBUG nova.compute.manager [req-ad968d35-adcf-4967-a475-d61ad5e7a008 - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:07.118 4088 3038340847400 MainThread DEBUG nova.virt.hyperv.vmops [req-ad968d35-adcf-4967-a475-d61ad5e7a008 - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:07.150 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Lock "9d815a45-c30c-4ca8-a66d-6ef7fef6185d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:07.167 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:56:07.185 4088 3038340847400 MainThread DEBUG nova.compute.manager [req-ad968d35-adcf-4967-a475-d61ad5e7a008 - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:07.212 4088 3038340847400 MainThread INFO nova.compute.manager [req-ad968d35-adcf-4967-a475-d61ad5e7a008 - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:07.306 4088 3038341576312 MainThread DEBUG nova.compute.provider_tree [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:56:07.324 4088 3038341576312 MainThread DEBUG nova.scheduler.client.report [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:56:07.324 4088 3038341576312 MainThread DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:07.324 4088 3038341576312 MainThread DEBUG nova.compute.manager [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:56:07.324 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:07.324 4088 3038340845992 MainThread DEBUG nova.virt.hardware [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:56:07.324 4088 3038340845992 MainThread INFO nova.compute.claims [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Claim successful on node n-h2-808474-1 2021-09-10 16:56:07.415 4088 3038341576312 MainThread DEBUG nova.compute.manager [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:56:07.415 4088 3038340847400 GreenThread-34 DEBUG nova.compute.manager [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:56:07.415 4088 3038340847400 GreenThread-34 DEBUG nova.network.neutron [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:56:07.462 4088 3038341021768 MainThread DEBUG nova.network.neutron [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:56:07.492 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.hostops [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:56:07.508 4088 3038341021768 MainThread INFO nova.compute.manager [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] [instance: 714fea12-52ae-4277-8f3d-b0db2b2ee548] Took 0.86 seconds to deallocate network for instance. 2021-09-10 16:56:07.531 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.hostops [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:56:07.604 4088 3038341576312 MainThread DEBUG nova.compute.manager [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:56:07.619 4088 3038341576312 MainThread INFO nova.virt.hyperv.vmops [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Spawning new instance 2021-09-10 16:56:07.619 4088 3038341576312 MainThread DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Lock "instance-0000002b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:07.619 4088 3038341576312 MainThread DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Lock "instance-0000002b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:07.634 4088 3038341576312 MainThread DEBUG nova.block_device [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:56:07.634 4088 3038341576312 MainThread DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:07.634 4088 3038341576312 MainThread DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:07.634 4088 3038340847400 GreenThread-34 DEBUG nova.policy [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd6f0f3184dd48b29f26ac7bd9ea6657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef05fccd42414dbd84e1f21b80c6b71e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:56:07.652 4088 3038341576312 MainThread DEBUG os_win.utils.pathutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Creating directory: C:\openstack\instances\instance-0000002b check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:56:07.664 4088 3038341576312 MainThread DEBUG nova.virt.hyperv.vmops [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000002b\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:56:07.682 4088 3038341021768 MainThread INFO nova.scheduler.client.report [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Deleted allocations for instance 714fea12-52ae-4277-8f3d-b0db2b2ee548 2021-09-10 16:56:07.730 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-4fd51071-05db-489b-9e17-194f1680c759 82eb2bcce085415e8b748990e15c58a4 4ad3c7e6a94d4d6ca45d20d801674ca6 - default default] Lock "714fea12-52ae-4277-8f3d-b0db2b2ee548" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 27.047s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:07.806 4088 3038340845992 MainThread DEBUG nova.compute.provider_tree [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:56:07.822 4088 3038341025640 MainThread DEBUG os_win.utils.jobutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Waiting for WMI job: {'InstanceID': 'E72BB99A-FFB0-4631-A1C7-8CE2F61D0C82', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=30911), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:07.870 4088 3038340845992 MainThread DEBUG nova.scheduler.client.report [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:56:07.870 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:07.870 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:56:07.930 4088 3038341576312 MainThread DEBUG nova.virt.hyperv.vmops [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Resizing VHD C:\openstack\instances\instance-0000002b\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:56:07.964 4088 3038340845992 MainThread DEBUG nova.compute.utils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:56:07.964 4088 3038341021768 GreenThread-35 DEBUG nova.compute.manager [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:56:07.964 4088 3038341021768 GreenThread-35 DEBUG nova.network.neutron [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:56:07.978 4088 3038341025640 MainThread ERROR os_win.utils.jobutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002a\' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)instance-0000002aB90FD6B6-4358-4A2C-BCD8-4EA075ECB15312030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)instance-0000002aB90FD6B6-4358-4A2C-BCD8-4EA075ECB15310243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)instance-0000002aB90FD6B6-4358-4A2C-BCD8-4EA075ECB153%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E72BB99A-FFB0-4631-A1C7-8CE2F61D0C82', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119380), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 7), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002a' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)\n\nNot enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)\n\n'instance-0000002a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)", 'ErrorSummaryDescription': "'instance-0000002a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:07.978 4088 3038341025640 MainThread DEBUG os_win._utils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002a' failed to start. Not enough memory in the system to start the virtual machine instance-0000002a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002a' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Not enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) 'instance-0000002a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.9035048484802246 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:07.993 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:56:07.993 4088 3038340846696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:07.993 4088 3038340846696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:07.993 4088 3038340846344 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:07.993 4088 3038340846344 MainThread INFO nova.compute.manager [-] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] VM Stopped (Lifecycle Event) 2021-09-10 16:56:08.034 4088 3038340846344 MainThread DEBUG nova.compute.manager [req-4e4df66e-48f3-440e-8c74-aaca307e38de - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:08.034 4088 3038340846344 MainThread DEBUG nova.virt.hyperv.vmops [req-4e4df66e-48f3-440e-8c74-aaca307e38de - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:08.060 4088 3038341023000 MainThread DEBUG os_win.utils.jobutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': '79F8AA4C-205A-4531-A595-82E137A926DB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16469), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:08.150 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:56:08.150 4088 3038340846344 MainThread DEBUG nova.compute.manager [req-4e4df66e-48f3-440e-8c74-aaca307e38de - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:08.169 4088 3038340845992 MainThread INFO nova.virt.hyperv.vmops [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Spawning new instance 2021-09-10 16:56:08.180 4088 3038340846344 MainThread INFO nova.compute.manager [req-4e4df66e-48f3-440e-8c74-aaca307e38de - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:08.180 4088 3038341021768 GreenThread-35 DEBUG nova.policy [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9bc7e248f98441caa76226a9e8d21746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e122cd09445d480a826d8bd883b15cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:56:08.211 4088 3038341023000 MainThread ERROR os_win.utils.jobutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000029\' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)instance-000000290774ABAD-090D-446A-B0DC-59D168AABD7F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)instance-000000290774ABAD-090D-446A-B0DC-59D168AABD7F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000029\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)instance-000000290774ABAD-090D-446A-B0DC-59D168AABD7F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '79F8AA4C-205A-4531-A595-82E137A926DB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118211), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 8), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 8), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000029' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)\n\nNot enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)\n\n'instance-00000029' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F)", 'ErrorSummaryDescription': "'instance-00000029' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000029.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:08.211 4088 3038341023000 MainThread ERROR nova.virt.hyperv.vmops [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Failed to change vm state of instance-00000029 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000029' failed to start. 2021-09-10 16:56:08.211 4088 3038341023000 MainThread INFO nova.virt.hyperv.vmops [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Got request to destroy instance 2021-09-10 16:56:08.228 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Lock "instance-0000002d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:08.228 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Lock "instance-0000002d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:08.228 4088 3038340845992 MainThread DEBUG nova.block_device [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:56:08.228 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:08.245 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:08.260 4088 3038340845992 MainThread DEBUG os_win.utils.pathutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Creating directory: C:\openstack\instances\instance-0000002d check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:56:08.260 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.vmops [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000002d\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:56:08.260 4088 3038340846696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000029" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:08.260 4088 3038340846696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000029" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:08.260 4088 3038340846344 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:08.260 4088 3038340846344 MainThread INFO nova.compute.manager [-] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] VM Stopped (Lifecycle Event) 2021-09-10 16:56:08.292 4088 3038340846344 MainThread DEBUG nova.compute.manager [req-d7fa2cff-21b9-466e-8c10-b413b81a1283 - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:08.292 4088 3038340846344 MainThread DEBUG nova.virt.hyperv.vmops [req-d7fa2cff-21b9-466e-8c10-b413b81a1283 - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:08.336 4088 3038340846344 MainThread DEBUG nova.compute.manager [req-d7fa2cff-21b9-466e-8c10-b413b81a1283 - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:08.404 4088 3038340846344 MainThread INFO nova.compute.manager [req-d7fa2cff-21b9-466e-8c10-b413b81a1283 - - - - -] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:08.542 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.vmops [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Resizing VHD C:\openstack\instances\instance-0000002d\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:56:08.781 4088 3038340847400 GreenThread-34 DEBUG nova.network.neutron [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Successfully created port: 9f753f1c-92e8-4a73-ac6b-03a58d69d1e6 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:56:08.781 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-85ed7239-98da-40c9-829c-dc6b66ccc2f3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Received event network-vif-plugged-5521086c-3b7c-4aaf-a1da-cbd50850d8f6 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:56:08.781 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-85ed7239-98da-40c9-829c-dc6b66ccc2f3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "5bd3ad21-3959-40c2-8698-b816b7176efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:08.781 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-85ed7239-98da-40c9-829c-dc6b66ccc2f3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "5bd3ad21-3959-40c2-8698-b816b7176efc-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:08.781 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-85ed7239-98da-40c9-829c-dc6b66ccc2f3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Processing event network-vif-plugged-5521086c-3b7c-4aaf-a1da-cbd50850d8f6 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:56:08.830 4088 3038341024408 MainThread INFO nova.virt.hyperv.vmops [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Using config drive for instance 2021-09-10 16:56:08.993 4088 3038341025640 MainThread DEBUG os_win.utils.jobutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Waiting for WMI job: {'InstanceID': '40FE974D-B937-4468-884A-FEB34BCB387D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15277), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:09.080 4088 3038340846520 MainThread DEBUG nova.network.neutron [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:56:09.106 4088 3038340846520 MainThread INFO nova.compute.manager [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: 60d9f1cb-95b4-472e-999a-d08935125ced] Took 3.49 seconds to deallocate network for instance. 2021-09-10 16:56:09.152 4088 3038341025640 MainThread ERROR os_win.utils.jobutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002a\' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)instance-0000002aB90FD6B6-4358-4A2C-BCD8-4EA075ECB15312030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)instance-0000002aB90FD6B6-4358-4A2C-BCD8-4EA075ECB15310243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)instance-0000002aB90FD6B6-4358-4A2C-BCD8-4EA075ECB153%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '40FE974D-B937-4468-884A-FEB34BCB387D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115845), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 8), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 9), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002a' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)\n\nNot enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)\n\n'instance-0000002a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)", 'ErrorSummaryDescription': "'instance-0000002a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:09.152 4088 3038341025640 MainThread DEBUG os_win._utils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002a' failed to start. Not enough memory in the system to start the virtual machine instance-0000002a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002a' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Not enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) 'instance-0000002a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.077054500579834 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:09.152 4088 3038341024408 MainThread INFO nova.virt.hyperv.vmops [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Creating config drive at C:\openstack\instances\instance-00000027\configdrive.iso 2021-09-10 16:56:09.244 4088 3038341024408 MainThread DEBUG oslo_concurrency.processutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000027\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmphm2kl8g4 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:56:09.415 4088 3038341577544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:09.415 4088 3038341577544 MainThread INFO nova.compute.manager [-] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] VM Stopped (Lifecycle Event) 2021-09-10 16:56:09.415 4088 3038341577720 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:09.415 4088 3038341577720 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:09.447 4088 3038340846520 MainThread INFO nova.scheduler.client.report [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Deleted allocations for instance 60d9f1cb-95b4-472e-999a-d08935125ced 2021-09-10 16:56:09.479 4088 3038341577544 MainThread DEBUG nova.compute.manager [req-35cb2095-434e-4609-a37e-ff67b020b9ed - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:09.479 4088 3038341577544 MainThread DEBUG nova.virt.hyperv.vmops [req-35cb2095-434e-4609-a37e-ff67b020b9ed - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:09.511 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [req-c5d82b6b-4ae8-4bf3-a526-ddb7a75ca802 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "60d9f1cb-95b4-472e-999a-d08935125ced" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 41.781s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:09.523 4088 3038341577544 MainThread DEBUG nova.compute.manager [req-35cb2095-434e-4609-a37e-ff67b020b9ed - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:09.556 4088 3038341577544 MainThread INFO nova.compute.manager [req-35cb2095-434e-4609-a37e-ff67b020b9ed - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:09.587 4088 3038341024408 MainThread DEBUG oslo_concurrency.processutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000027\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmphm2kl8g4" returned: 0 in 0.344s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:56:09.825 4088 3038341021768 GreenThread-35 DEBUG nova.network.neutron [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Successfully created port: cedaf97e-b489-4b71-abd1-950cba1f0106 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:56:10.135 4088 3038341024408 MainThread DEBUG nova.virt.hyperv.vmops [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Setting boot order for instance: instance-00000027: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:56:10.188 4088 3038341025640 MainThread DEBUG os_win.utils.jobutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Waiting for WMI job: {'InstanceID': 'A6C174C4-26D4-4950-BD0C-71DA761BA11C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19212), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:10.227 4088 3038341024408 MainThread DEBUG nova.virt.hyperv.vmops [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:56:10.260 4088 3038341024408 MainThread DEBUG os_win.utils.jobutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': 'AFE207CB-44C9-4DDD-B5D7-BDF968D67B16', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14652), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:10.322 4088 3038341025640 MainThread ERROR os_win.utils.jobutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002a\' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)instance-0000002aB90FD6B6-4358-4A2C-BCD8-4EA075ECB15312030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)instance-0000002aB90FD6B6-4358-4A2C-BCD8-4EA075ECB15310243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)instance-0000002aB90FD6B6-4358-4A2C-BCD8-4EA075ECB153%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A6C174C4-26D4-4950-BD0C-71DA761BA11C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115049), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 10), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 10), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002a' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)\n\nNot enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)\n\n'instance-0000002a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153)", 'ErrorSummaryDescription': "'instance-0000002a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:10.322 4088 3038341025640 MainThread ERROR nova.virt.hyperv.vmops [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Failed to change vm state of instance-0000002a to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000002a' failed to start. 2021-09-10 16:56:10.322 4088 3038341025640 MainThread INFO nova.virt.hyperv.vmops [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Got request to destroy instance 2021-09-10 16:56:10.338 4088 3038340848280 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:10.360 4088 3038340848280 MainThread INFO nova.compute.manager [-] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] VM Stopped (Lifecycle Event) 2021-09-10 16:56:10.360 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:10.360 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:10.387 4088 3038340848280 MainThread DEBUG nova.compute.manager [req-a81042e2-a75e-4021-999c-e71d43424fe6 - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:10.387 4088 3038340848280 MainThread DEBUG nova.virt.hyperv.vmops [req-a81042e2-a75e-4021-999c-e71d43424fe6 - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:10.478 4088 3038340846696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000027" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:10.478 4088 3038340846696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000027" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:10.478 4088 3038340846520 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:10.493 4088 3038340846520 MainThread INFO nova.compute.manager [-] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] VM Stopped (Lifecycle Event) 2021-09-10 16:56:10.493 4088 3038340848280 MainThread DEBUG nova.compute.manager [req-a81042e2-a75e-4021-999c-e71d43424fe6 - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:10.508 4088 3038340846520 MainThread DEBUG nova.compute.manager [req-2683b27a-38a1-46d9-b03c-77f3ef2cd5f2 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:10.508 4088 3038340846520 MainThread DEBUG nova.virt.hyperv.vmops [req-2683b27a-38a1-46d9-b03c-77f3ef2cd5f2 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:10.508 4088 3038341024408 MainThread ERROR os_win.utils.jobutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000027\' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)instance-00000027D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)instance-00000027D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000027\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)instance-00000027D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'AFE207CB-44C9-4DDD-B5D7-BDF968D67B16', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=160165), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 10), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 10), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000027' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)\n\nNot enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)\n\n'instance-00000027' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)", 'ErrorSummaryDescription': "'instance-00000027' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000027.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:10.508 4088 3038341024408 MainThread DEBUG os_win._utils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000027' failed to start. Not enough memory in the system to start the virtual machine instance-00000027. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000027' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Not enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) 'instance-00000027' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.2810077667236328 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:10.525 4088 3038340848280 MainThread INFO nova.compute.manager [req-a81042e2-a75e-4021-999c-e71d43424fe6 - - - - -] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:10.570 4088 3038340846520 MainThread DEBUG nova.compute.manager [req-2683b27a-38a1-46d9-b03c-77f3ef2cd5f2 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:10.602 4088 3038340846520 MainThread INFO nova.compute.manager [req-2683b27a-38a1-46d9-b03c-77f3ef2cd5f2 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:10.650 4088 3038341023000 MainThread DEBUG nova.virt.hyperv.vmops [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:56:10.650 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000029" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:10.650 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000029" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:10.666 4088 3038341023000 MainThread DEBUG os_win.utils.compute.vmutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Successfully changed vm state of instance-00000029 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:56:10.666 4088 3038341023000 MainThread DEBUG nova.virt.hyperv.vmops [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Successfully changed state of VM instance-00000029 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:56:10.713 4088 3038341023000 MainThread DEBUG os_win.utils.jobutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': 'B1B271FF-2B19-45F8-A3E7-918CB5510D23', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16010), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:10.851 4088 3038341023000 MainThread DEBUG os_win.utils.jobutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job succeeded: {'InstanceID': 'B1B271FF-2B19-45F8-A3E7-918CB5510D23', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=91239), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:56:10.852 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000029" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:10.852 4088 3038341023000 MainThread DEBUG os_win.utils.pathutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Removing directory: C:\openstack\instances\instance-00000029 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:56:10.852 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000029" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:10.852 4088 3038341023000 MainThread ERROR nova.compute.manager [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000029' failed to start. Not enough memory in the system to start the virtual machine instance-00000029. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000029' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Not enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) 'instance-00000029' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Error code: 32778. 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Traceback (most recent call last): 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] return function(*args, **kwargs) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] admin_password, network_info, block_device_info) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] return function(self, *args, **kwds) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self.force_reraise() 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] raise self.value 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] should_plug_vifs=False) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 'req_state': req_state}) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self.force_reraise() 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] raise self.value 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] time.sleep(sleep_time) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self.force_reraise() 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] raise self.value 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] return f(*args, **kwargs) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] return self._wait_for_job(job_path) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] error_desc=err_desc) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000029' failed to start. 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Not enough memory in the system to start the virtual machine instance-00000029. 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000029' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Not enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 'instance-00000029' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Error code: 32778. 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] During handling of the above exception, another exception occurred: 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Traceback (most recent call last): 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] yield resources 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] accel_info=accel_info) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] return function(*args, **kwargs) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] admin_password, network_info, block_device_info) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] return function(self, *args, **kwds) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self.force_reraise() 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] raise self.value 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] should_plug_vifs=False) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 'req_state': req_state}) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self.force_reraise() 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] raise self.value 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] time.sleep(sleep_time) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self.force_reraise() 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] raise self.value 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] return f(*args, **kwargs) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] return self._wait_for_job(job_path) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] error_desc=err_desc) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000029' failed to start. 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Not enough memory in the system to start the virtual machine instance-00000029. 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000029' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Not enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 'instance-00000029' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Error code: 32778. 2021-09-10 16:56:10.852 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:10.852 4088 3038341023000 MainThread INFO nova.compute.manager [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Terminating instance 2021-09-10 16:56:10.852 4088 3038341023000 MainThread DEBUG nova.compute.manager [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:56:10.852 4088 3038341023000 MainThread INFO nova.virt.hyperv.vmops [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Got request to destroy instance 2021-09-10 16:56:10.876 4088 3038341023000 MainThread DEBUG nova.virt.hyperv.vmops [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:56:10.876 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000029" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:10.876 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-00000029" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:10.876 4088 3038341023000 MainThread INFO nova.compute.manager [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Took 0.01 seconds to destroy the instance on the hypervisor. 2021-09-10 16:56:10.876 4088 3038341023000 MainThread DEBUG nova.compute.claims [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:56:10.876 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:11.000 4088 3038341023000 MainThread DEBUG nova.virt.hyperv.hostops [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:56:11.009 4088 3038341023000 MainThread DEBUG nova.virt.hyperv.hostops [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:56:11.078 4088 3038340847400 GreenThread-34 DEBUG nova.network.neutron [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Successfully updated port: 9f753f1c-92e8-4a73-ac6b-03a58d69d1e6 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:56:11.087 4088 3038340847400 GreenThread-34 DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Acquired lock "refresh_cache-27ece020-a06e-4d29-aedc-cf0d87bdc941" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:56:11.087 4088 3038340847400 GreenThread-34 DEBUG nova.network.neutron [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:56:11.242 4088 3038340846696 MainThread DEBUG nova.compute.manager [req-f991e5cb-147c-4c71-b93d-1a4cd4f3f56e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Received event network-changed-9f753f1c-92e8-4a73-ac6b-03a58d69d1e6 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:56:11.242 4088 3038340846696 MainThread DEBUG nova.compute.manager [req-f991e5cb-147c-4c71-b93d-1a4cd4f3f56e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Refreshing instance network info cache due to event network-changed-9f753f1c-92e8-4a73-ac6b-03a58d69d1e6. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:56:11.242 4088 3038341023000 MainThread DEBUG nova.compute.provider_tree [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:56:11.273 4088 3038341023000 MainThread DEBUG nova.scheduler.client.report [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:56:11.273 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.406s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:11.273 4088 3038341023000 MainThread ERROR nova.compute.manager [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000029' failed to start. Not enough memory in the system to start the virtual machine instance-00000029. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000029' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Not enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) 'instance-00000029' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Error code: 32778. 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Traceback (most recent call last): 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] return function(*args, **kwargs) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] admin_password, network_info, block_device_info) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] return function(self, *args, **kwds) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self.force_reraise() 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] raise self.value 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] should_plug_vifs=False) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 'req_state': req_state}) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self.force_reraise() 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] raise self.value 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] time.sleep(sleep_time) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self.force_reraise() 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] raise self.value 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] return f(*args, **kwargs) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] return self._wait_for_job(job_path) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] error_desc=err_desc) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000029' failed to start. 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Not enough memory in the system to start the virtual machine instance-00000029. 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000029' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Not enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 'instance-00000029' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Error code: 32778. 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] During handling of the above exception, another exception occurred: 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Traceback (most recent call last): 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] accel_info=accel_info) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] return function(*args, **kwargs) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] admin_password, network_info, block_device_info) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] return function(self, *args, **kwds) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self.force_reraise() 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] raise self.value 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] should_plug_vifs=False) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 'req_state': req_state}) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self.force_reraise() 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] raise self.value 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] time.sleep(sleep_time) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self.force_reraise() 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] raise self.value 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] return f(*args, **kwargs) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] return self._wait_for_job(job_path) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] error_desc=err_desc) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000029' failed to start. 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Not enough memory in the system to start the virtual machine instance-00000029. 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000029' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Not enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 'instance-00000029' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Error code: 32778. 2021-09-10 16:56:11.273 4088 3038341023000 MainThread TRACE nova.compute.manager [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] 2021-09-10 16:56:11.273 4088 3038341023000 MainThread DEBUG nova.compute.utils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] WMI job failed with status 10. Error summary description: 'instance-00000029' failed to start. Not enough memory in the system to start the virtual machine instance-00000029. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:56:11.273 4088 3038341023000 MainThread DEBUG nova.compute.manager [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Build of instance f0c24368-9e06-4126-bbb0-d52db1f2141b was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000029' failed to start. Not enough memory in the system to start the virtual machine instance-00000029. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000029' failed to start. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Not enough memory in the system to start the virtual machine instance-00000029 with ram size 1024 megabytes. (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) 'instance-00000029' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0774ABAD-090D-446A-B0DC-59D168AABD7F) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:56:11.273 4088 3038341023000 MainThread DEBUG nova.compute.manager [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:56:11.273 4088 3038341023000 MainThread DEBUG nova.compute.manager [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:56:11.273 4088 3038341023000 MainThread DEBUG nova.compute.manager [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:56:11.273 4088 3038341023000 MainThread DEBUG nova.network.neutron [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:56:11.305 4088 3038340847400 GreenThread-34 DEBUG nova.network.neutron [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:56:11.540 4088 3038341024408 MainThread DEBUG os_win.utils.jobutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': '445091C0-F4B7-4744-AC1B-22328B3E697D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16447), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:11.682 4088 3038341024408 MainThread ERROR os_win.utils.jobutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000027\' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)instance-00000027D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)instance-00000027D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000027\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)instance-00000027D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '445091C0-F4B7-4744-AC1B-22328B3E697D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=124464), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 11), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 11), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000027' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)\n\nNot enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)\n\n'instance-00000027' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)", 'ErrorSummaryDescription': "'instance-00000027' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000027.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:11.682 4088 3038341024408 MainThread DEBUG os_win._utils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000027' failed to start. Not enough memory in the system to start the virtual machine instance-00000027. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000027' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Not enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) 'instance-00000027' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.454822301864624 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:11.728 4088 3038340847048 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:11.728 4088 3038340847048 MainThread INFO nova.compute.manager [-] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] VM Stopped (Lifecycle Event) 2021-09-10 16:56:11.728 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000027" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:11.728 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000027" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:11.750 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-1ae84e54-658b-4997-83f8-a549c6271d70 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:11.750 4088 3038340847048 MainThread DEBUG nova.virt.hyperv.vmops [req-1ae84e54-658b-4997-83f8-a549c6271d70 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:11.791 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-1ae84e54-658b-4997-83f8-a549c6271d70 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:11.852 4088 3038340847048 MainThread INFO nova.compute.manager [req-1ae84e54-658b-4997-83f8-a549c6271d70 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:11.947 4088 3038341021768 GreenThread-35 DEBUG nova.network.neutron [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Successfully updated port: cedaf97e-b489-4b71-abd1-950cba1f0106 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:56:11.977 4088 3038341021768 GreenThread-35 DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Acquired lock "refresh_cache-9d815a45-c30c-4ca8-a66d-6ef7fef6185d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:56:11.977 4088 3038341021768 GreenThread-35 DEBUG nova.network.neutron [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:56:12.337 4088 3038341021768 GreenThread-35 DEBUG nova.network.neutron [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:56:12.337 4088 3038340847400 GreenThread-34 DEBUG nova.network.neutron [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Updating instance_info_cache with network_info: [{"id": "9f753f1c-92e8-4a73-ac6b-03a58d69d1e6", "address": "fa:16:3e:de:fa:c5", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9f753f1c-92", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:56:12.372 4088 3038340847400 GreenThread-34 DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Releasing lock "refresh_cache-27ece020-a06e-4d29-aedc-cf0d87bdc941" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:56:12.372 4088 3038340847400 GreenThread-34 DEBUG nova.compute.manager [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Instance network_info: |[{"id": "9f753f1c-92e8-4a73-ac6b-03a58d69d1e6", "address": "fa:16:3e:de:fa:c5", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9f753f1c-92", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:56:12.372 4088 3038341576312 MainThread DEBUG nova.compute.manager [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Preparing to wait for external event network-vif-plugged-9f753f1c-92e8-4a73-ac6b-03a58d69d1e6 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:56:12.372 4088 3038341576312 MainThread DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Lock "27ece020-a06e-4d29-aedc-cf0d87bdc941-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:12.372 4088 3038341576312 MainThread DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Lock "27ece020-a06e-4d29-aedc-cf0d87bdc941-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:12.372 4088 3038341576312 MainThread DEBUG os_win.utils.compute.vmutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Creating VM instance-0000002b create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:56:12.372 4088 3038340846696 MainThread DEBUG oslo_concurrency.lockutils [req-f991e5cb-147c-4c71-b93d-1a4cd4f3f56e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-27ece020-a06e-4d29-aedc-cf0d87bdc941" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:56:12.372 4088 3038340846696 MainThread DEBUG nova.network.neutron [req-f991e5cb-147c-4c71-b93d-1a4cd4f3f56e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Refreshing network info cache for port 9f753f1c-92e8-4a73-ac6b-03a58d69d1e6 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:56:12.385 4088 3038341025640 MainThread DEBUG nova.virt.hyperv.vmops [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:56:12.385 4088 3038341025640 MainThread DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "instance-0000002a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:12.385 4088 3038341025640 MainThread DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "instance-0000002a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:12.414 4088 3038341025640 MainThread DEBUG os_win.utils.compute.vmutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Successfully changed vm state of instance-0000002a to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:56:12.414 4088 3038341025640 MainThread DEBUG nova.virt.hyperv.vmops [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Successfully changed state of VM instance-0000002a to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:56:12.463 4088 3038341025640 MainThread DEBUG os_win.utils.jobutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Waiting for WMI job: {'InstanceID': 'F8C25F9E-4167-4FF2-9D11-D30B7A9D58AA', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15441), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:12.602 4088 3038341025640 MainThread DEBUG os_win.utils.jobutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] WMI job succeeded: {'InstanceID': 'F8C25F9E-4167-4FF2-9D11-D30B7A9D58AA', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=104015), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:56:12.602 4088 3038341025640 MainThread DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "instance-0000002a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:12.602 4088 3038341025640 MainThread DEBUG os_win.utils.pathutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Removing directory: C:\openstack\instances\instance-0000002a check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:56:12.602 4088 3038341025640 MainThread DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "instance-0000002a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:12.602 4088 3038341025640 MainThread ERROR nova.compute.manager [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002a' failed to start. Not enough memory in the system to start the virtual machine instance-0000002a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002a' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Not enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) 'instance-0000002a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Error code: 32778. 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Traceback (most recent call last): 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] return function(*args, **kwargs) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] admin_password, network_info, block_device_info) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] return function(self, *args, **kwds) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self.force_reraise() 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] raise self.value 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] should_plug_vifs=False) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 'req_state': req_state}) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self.force_reraise() 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] raise self.value 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] time.sleep(sleep_time) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self.force_reraise() 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] raise self.value 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] return f(*args, **kwargs) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] return self._wait_for_job(job_path) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] error_desc=err_desc) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000002a' failed to start. 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Not enough memory in the system to start the virtual machine instance-0000002a. 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002a' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Not enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 'instance-0000002a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Error code: 32778. 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] During handling of the above exception, another exception occurred: 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Traceback (most recent call last): 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] yield resources 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] accel_info=accel_info) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] return function(*args, **kwargs) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] admin_password, network_info, block_device_info) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] return function(self, *args, **kwds) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self.force_reraise() 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] raise self.value 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] should_plug_vifs=False) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 'req_state': req_state}) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self.force_reraise() 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] raise self.value 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] time.sleep(sleep_time) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self.force_reraise() 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] raise self.value 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] return f(*args, **kwargs) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] return self._wait_for_job(job_path) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] error_desc=err_desc) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002a' failed to start. 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Not enough memory in the system to start the virtual machine instance-0000002a. 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002a' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Not enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 'instance-0000002a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Error code: 32778. 2021-09-10 16:56:12.602 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:12.602 4088 3038341025640 MainThread INFO nova.compute.manager [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Terminating instance 2021-09-10 16:56:12.602 4088 3038341025640 MainThread DEBUG nova.compute.manager [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:56:12.602 4088 3038341025640 MainThread INFO nova.virt.hyperv.vmops [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Got request to destroy instance 2021-09-10 16:56:12.765 4088 3038341025640 MainThread DEBUG nova.virt.hyperv.vmops [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:56:12.765 4088 3038341025640 MainThread DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "instance-0000002a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:12.765 4088 3038341025640 MainThread DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "instance-0000002a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:12.765 4088 3038341025640 MainThread INFO nova.compute.manager [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Took 0.16 seconds to destroy the instance on the hypervisor. 2021-09-10 16:56:12.789 4088 3038341025640 MainThread DEBUG nova.compute.claims [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:56:12.789 4088 3038341025640 MainThread DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:12.820 4088 3038341024408 MainThread DEBUG os_win.utils.jobutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': '0F0825B3-F498-47F9-A4AB-EDFBF705FFC5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=33293), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:12.916 4088 3038341025640 MainThread DEBUG nova.virt.hyperv.hostops [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:56:12.930 4088 3038341025640 MainThread DEBUG nova.virt.hyperv.hostops [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:56:12.962 4088 3038341024408 MainThread ERROR os_win.utils.jobutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000027\' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)instance-00000027D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)instance-00000027D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000027\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)instance-00000027D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0F0825B3-F498-47F9-A4AB-EDFBF705FFC5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121007), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 12), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 12), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000027' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)\n\nNot enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)\n\n'instance-00000027' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)", 'ErrorSummaryDescription': "'instance-00000027' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000027.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:12.962 4088 3038341024408 MainThread DEBUG os_win._utils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000027' failed to start. Not enough memory in the system to start the virtual machine instance-00000027. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000027' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Not enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) 'instance-00000027' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.7350316047668457 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:12.995 4088 3038341023000 MainThread DEBUG nova.network.neutron [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:56:13.008 4088 3038340845640 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:13.008 4088 3038340845640 MainThread INFO nova.compute.manager [-] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] VM Stopped (Lifecycle Event) 2021-09-10 16:56:13.027 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000027" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:13.027 4088 3038340847400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000027" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:13.045 4088 3038341023000 MainThread INFO nova.compute.manager [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: f0c24368-9e06-4126-bbb0-d52db1f2141b] Took 1.77 seconds to deallocate network for instance. 2021-09-10 16:56:13.056 4088 3038340845640 MainThread DEBUG nova.compute.manager [req-adf89966-7aff-436c-aefa-814f24e4126c - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:13.056 4088 3038340845640 MainThread DEBUG nova.virt.hyperv.vmops [req-adf89966-7aff-436c-aefa-814f24e4126c - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:13.141 4088 3038340845640 MainThread DEBUG nova.compute.manager [req-adf89966-7aff-436c-aefa-814f24e4126c - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:13.227 4088 3038340845640 MainThread INFO nova.compute.manager [req-adf89966-7aff-436c-aefa-814f24e4126c - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:13.227 4088 3038341025640 MainThread DEBUG nova.compute.provider_tree [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:56:13.259 4088 3038341025640 MainThread DEBUG nova.scheduler.client.report [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:56:13.259 4088 3038341025640 MainThread DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:13.259 4088 3038341025640 MainThread ERROR nova.compute.manager [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002a' failed to start. Not enough memory in the system to start the virtual machine instance-0000002a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002a' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Not enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) 'instance-0000002a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Error code: 32778. 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Traceback (most recent call last): 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] return function(*args, **kwargs) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] admin_password, network_info, block_device_info) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] return function(self, *args, **kwds) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self.force_reraise() 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] raise self.value 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] should_plug_vifs=False) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 'req_state': req_state}) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self.force_reraise() 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] raise self.value 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] time.sleep(sleep_time) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self.force_reraise() 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] raise self.value 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] return f(*args, **kwargs) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] return self._wait_for_job(job_path) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] error_desc=err_desc) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000002a' failed to start. 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Not enough memory in the system to start the virtual machine instance-0000002a. 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002a' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Not enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 'instance-0000002a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Error code: 32778. 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] During handling of the above exception, another exception occurred: 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Traceback (most recent call last): 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] accel_info=accel_info) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] return function(*args, **kwargs) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] admin_password, network_info, block_device_info) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] return function(self, *args, **kwds) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self.force_reraise() 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] raise self.value 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] should_plug_vifs=False) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 'req_state': req_state}) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self.force_reraise() 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] raise self.value 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] time.sleep(sleep_time) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self.force_reraise() 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] raise self.value 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] return f(*args, **kwargs) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] return self._wait_for_job(job_path) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] error_desc=err_desc) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002a' failed to start. 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Not enough memory in the system to start the virtual machine instance-0000002a. 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002a' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Not enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 'instance-0000002a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Error code: 32778. 2021-09-10 16:56:13.259 4088 3038341025640 MainThread TRACE nova.compute.manager [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] 2021-09-10 16:56:13.259 4088 3038341025640 MainThread DEBUG nova.compute.utils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] WMI job failed with status 10. Error summary description: 'instance-0000002a' failed to start. Not enough memory in the system to start the virtual machine instance-0000002a. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:56:13.259 4088 3038341025640 MainThread DEBUG nova.compute.manager [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Build of instance 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000002a' failed to start. Not enough memory in the system to start the virtual machine instance-0000002a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002a' failed to start. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Not enough memory in the system to start the virtual machine instance-0000002a with ram size 1024 megabytes. (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) 'instance-0000002a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B90FD6B6-4358-4A2C-BCD8-4EA075ECB153) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:56:13.274 4088 3038341025640 MainThread DEBUG nova.compute.manager [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:56:13.274 4088 3038341025640 MainThread DEBUG nova.compute.manager [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:56:13.274 4088 3038341025640 MainThread DEBUG nova.compute.manager [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:56:13.274 4088 3038341025640 MainThread DEBUG nova.network.neutron [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:56:13.290 4088 3038341023000 MainThread INFO nova.scheduler.client.report [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Deleted allocations for instance f0c24368-9e06-4126-bbb0-d52db1f2141b 2021-09-10 16:56:13.337 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [req-961b2393-019a-4ec8-a6cc-7b832359a54e d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "f0c24368-9e06-4126-bbb0-d52db1f2141b" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 29.656s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:13.556 4088 3038341024232 MainThread DEBUG nova.compute.manager [req-ddc72c7d-b5e4-4e38-93ba-ffc4cd2aff13 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Received event network-changed-cedaf97e-b489-4b71-abd1-950cba1f0106 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:56:13.556 4088 3038341024232 MainThread DEBUG nova.compute.manager [req-ddc72c7d-b5e4-4e38-93ba-ffc4cd2aff13 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Refreshing instance network info cache due to event network-changed-cedaf97e-b489-4b71-abd1-950cba1f0106. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:56:13.556 4088 3038341021768 GreenThread-35 DEBUG nova.network.neutron [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Updating instance_info_cache with network_info: [{"id": "cedaf97e-b489-4b71-abd1-950cba1f0106", "address": "fa:16:3e:c7:18:c3", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcedaf97e-b4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:56:13.604 4088 3038341021768 GreenThread-35 DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Releasing lock "refresh_cache-9d815a45-c30c-4ca8-a66d-6ef7fef6185d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:56:13.604 4088 3038341021768 GreenThread-35 DEBUG nova.compute.manager [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Instance network_info: |[{"id": "cedaf97e-b489-4b71-abd1-950cba1f0106", "address": "fa:16:3e:c7:18:c3", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcedaf97e-b4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:56:13.604 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-ddc72c7d-b5e4-4e38-93ba-ffc4cd2aff13 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-9d815a45-c30c-4ca8-a66d-6ef7fef6185d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:56:13.604 4088 3038341024232 MainThread DEBUG nova.network.neutron [req-ddc72c7d-b5e4-4e38-93ba-ffc4cd2aff13 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Refreshing network info cache for port cedaf97e-b489-4b71-abd1-950cba1f0106 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:56:13.604 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Preparing to wait for external event network-vif-plugged-cedaf97e-b489-4b71-abd1-950cba1f0106 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:56:13.604 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Lock "9d815a45-c30c-4ca8-a66d-6ef7fef6185d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:13.604 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Lock "9d815a45-c30c-4ca8-a66d-6ef7fef6185d-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:13.604 4088 3038340845992 MainThread DEBUG os_win.utils.compute.vmutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Creating VM instance-0000002d create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:56:13.852 4088 3038340846696 MainThread DEBUG nova.network.neutron [req-f991e5cb-147c-4c71-b93d-1a4cd4f3f56e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Updated VIF entry in instance network info cache for port 9f753f1c-92e8-4a73-ac6b-03a58d69d1e6. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:56:13.867 4088 3038340846696 MainThread DEBUG nova.network.neutron [req-f991e5cb-147c-4c71-b93d-1a4cd4f3f56e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Updating instance_info_cache with network_info: [{"id": "9f753f1c-92e8-4a73-ac6b-03a58d69d1e6", "address": "fa:16:3e:de:fa:c5", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9f753f1c-92", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:56:13.885 4088 3038340846696 MainThread DEBUG oslo_concurrency.lockutils [req-f991e5cb-147c-4c71-b93d-1a4cd4f3f56e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-27ece020-a06e-4d29-aedc-cf0d87bdc941" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:56:14.039 4088 3038341024408 MainThread DEBUG os_win.utils.jobutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': 'C7F8A74B-5332-4765-A52B-809E5783579D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=23874), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:14.181 4088 3038341024408 MainThread ERROR os_win.utils.jobutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000027\' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)instance-00000027D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)instance-00000027D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000027\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)instance-00000027D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C7F8A74B-5332-4765-A52B-809E5783579D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=124804), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 14), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 14), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000027' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)\n\nNot enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)\n\n'instance-00000027' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)", 'ErrorSummaryDescription': "'instance-00000027' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000027.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:14.181 4088 3038341024408 MainThread DEBUG os_win._utils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000027' failed to start. Not enough memory in the system to start the virtual machine instance-00000027. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000027' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Not enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) 'instance-00000027' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.9540390968322754 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:14.227 4088 3038340846696 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:14.227 4088 3038340846696 MainThread INFO nova.compute.manager [-] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] VM Stopped (Lifecycle Event) 2021-09-10 16:56:14.227 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000027" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:14.227 4088 3038340796088 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000027" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:14.261 4088 3038340846696 MainThread DEBUG nova.compute.manager [req-12b289f0-33c2-4240-a57c-45fa1af02949 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:14.261 4088 3038340846696 MainThread DEBUG nova.virt.hyperv.vmops [req-12b289f0-33c2-4240-a57c-45fa1af02949 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:14.324 4088 3038340846696 MainThread DEBUG nova.compute.manager [req-12b289f0-33c2-4240-a57c-45fa1af02949 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:14.353 4088 3038340846696 MainThread INFO nova.compute.manager [req-12b289f0-33c2-4240-a57c-45fa1af02949 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:14.384 4088 3038341576312 MainThread DEBUG nova.virt.hyperv.vmops [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:56:14.540 4088 3038341025640 MainThread DEBUG nova.network.neutron [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:56:14.571 4088 3038341025640 MainThread INFO nova.compute.manager [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] [instance: 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b] Took 1.30 seconds to deallocate network for instance. 2021-09-10 16:56:14.804 4088 3038341025640 MainThread INFO nova.scheduler.client.report [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Deleted allocations for instance 6aac7cdb-fa5e-417b-bf36-fe5eb161a90b 2021-09-10 16:56:14.860 4088 3038341025640 MainThread DEBUG oslo_concurrency.lockutils [req-dc0b74dc-15b3-46ef-83ca-685570e8cce0 14929f631b514b1ba7de48ea6f7875b6 f12d8e551e4d4d599a26e3249f7560f1 - default default] Lock "6aac7cdb-fa5e-417b-bf36-fe5eb161a90b" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 28.125s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:15.024 4088 3038341024232 MainThread DEBUG nova.network.neutron [req-ddc72c7d-b5e4-4e38-93ba-ffc4cd2aff13 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Updated VIF entry in instance network info cache for port cedaf97e-b489-4b71-abd1-950cba1f0106. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:56:15.024 4088 3038341024232 MainThread DEBUG nova.network.neutron [req-ddc72c7d-b5e4-4e38-93ba-ffc4cd2aff13 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Updating instance_info_cache with network_info: [{"id": "cedaf97e-b489-4b71-abd1-950cba1f0106", "address": "fa:16:3e:c7:18:c3", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcedaf97e-b4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:56:15.070 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-ddc72c7d-b5e4-4e38-93ba-ffc4cd2aff13 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-9d815a45-c30c-4ca8-a66d-6ef7fef6185d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:56:15.212 4088 3038341024408 MainThread DEBUG os_win.utils.jobutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': '80A13D6B-DC08-41DE-A807-BD0660CD1AE3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18256), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:15.359 4088 3038341024408 MainThread ERROR os_win.utils.jobutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000027\' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)instance-00000027D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)instance-00000027D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000027\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)instance-00000027D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '80A13D6B-DC08-41DE-A807-BD0660CD1AE3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120343), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 15), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 15), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000027' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)\n\nNot enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)\n\n'instance-00000027' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)", 'ErrorSummaryDescription': "'instance-00000027' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000027.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:15.359 4088 3038341024408 MainThread DEBUG os_win._utils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000027' failed to start. Not enough memory in the system to start the virtual machine instance-00000027. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000027' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Not enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) 'instance-00000027' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.131931304931641 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:15.400 4088 3038340846696 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:15.400 4088 3038340846696 MainThread INFO nova.compute.manager [-] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] VM Stopped (Lifecycle Event) 2021-09-10 16:56:15.400 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000027" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:15.400 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000027" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:15.420 4088 3038340846696 MainThread DEBUG nova.compute.manager [req-a3387ce4-8bf9-4497-ba1e-5ef469b83241 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:15.420 4088 3038340846696 MainThread DEBUG nova.virt.hyperv.vmops [req-a3387ce4-8bf9-4497-ba1e-5ef469b83241 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:15.477 4088 3038340846696 MainThread DEBUG nova.compute.manager [req-a3387ce4-8bf9-4497-ba1e-5ef469b83241 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:15.498 4088 3038340846696 MainThread INFO nova.compute.manager [req-a3387ce4-8bf9-4497-ba1e-5ef469b83241 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:15.577 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.vmops [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:56:16.383 4088 3038341024408 MainThread DEBUG os_win.utils.jobutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': 'DEF6A975-A9A2-4AD5-BE37-F4BFE691F568', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15521), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:16.509 4088 3038341024408 MainThread ERROR os_win.utils.jobutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000027\' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)instance-00000027D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)instance-00000027D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000027\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)instance-00000027D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'DEF6A975-A9A2-4AD5-BE37-F4BFE691F568', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115721), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 16), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 16), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000027' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)\n\nNot enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)\n\n'instance-00000027' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF)", 'ErrorSummaryDescription': "'instance-00000027' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000027.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:16.509 4088 3038341024408 MainThread ERROR nova.virt.hyperv.vmops [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Failed to change vm state of instance-00000027 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000027' failed to start. 2021-09-10 16:56:16.509 4088 3038341024408 MainThread INFO nova.virt.hyperv.vmops [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Got request to destroy instance 2021-09-10 16:56:16.557 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Lock "f8bc590e-89bd-458c-bef5-74846b896168" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:16.557 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000027" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:16.557 4088 3038341023000 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000027" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:16.557 4088 3038341024584 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:16.557 4088 3038341024584 MainThread INFO nova.compute.manager [-] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] VM Stopped (Lifecycle Event) 2021-09-10 16:56:16.572 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:56:16.602 4088 3038341024584 MainThread DEBUG nova.compute.manager [req-5f7ae988-3937-4b58-8f66-9cb81f48d391 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:16.602 4088 3038341024584 MainThread DEBUG nova.virt.hyperv.vmops [req-5f7ae988-3937-4b58-8f66-9cb81f48d391 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:16.652 4088 3038341024584 MainThread DEBUG nova.compute.manager [req-5f7ae988-3937-4b58-8f66-9cb81f48d391 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:16.682 4088 3038341024584 MainThread INFO nova.compute.manager [req-5f7ae988-3937-4b58-8f66-9cb81f48d391 - - - - -] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:16.757 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:16.757 4088 3038341021768 MainThread DEBUG nova.virt.hardware [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:56:16.757 4088 3038341021768 MainThread INFO nova.compute.claims [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Claim successful on node n-h2-808474-1 2021-09-10 16:56:16.948 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.hostops [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:56:16.976 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.hostops [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:56:17.274 4088 3038341021768 MainThread DEBUG nova.compute.provider_tree [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:56:17.292 4088 3038341021768 MainThread DEBUG nova.scheduler.client.report [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:56:17.292 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:17.292 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:56:17.415 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:56:17.415 4088 3038341024584 GreenThread-36 DEBUG nova.compute.manager [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:56:17.415 4088 3038341024584 GreenThread-36 DEBUG nova.network.neutron [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:56:17.681 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:56:17.697 4088 3038341021768 MainThread INFO nova.virt.hyperv.vmops [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Spawning new instance 2021-09-10 16:56:17.711 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Lock "instance-0000002c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:17.711 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Lock "instance-0000002c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:17.711 4088 3038341021768 MainThread DEBUG nova.block_device [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:56:17.711 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:17.711 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:17.711 4088 3038341021768 MainThread DEBUG os_win.utils.pathutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Creating directory: C:\openstack\instances\instance-0000002c check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:56:17.711 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.vmops [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000002c\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:56:17.852 4088 3038341024584 GreenThread-36 DEBUG nova.policy [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc0a11d23457425dafaa2590cadb3647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fab39a080a41888182e794dd32878e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:56:17.947 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.vmops [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Resizing VHD C:\openstack\instances\instance-0000002c\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:56:18.613 4088 3038341024408 MainThread DEBUG nova.virt.hyperv.vmops [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:56:18.613 4088 3038341024408 MainThread DEBUG oslo_concurrency.lockutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-00000027" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:18.613 4088 3038341024408 MainThread DEBUG oslo_concurrency.lockutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-00000027" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:18.685 4088 3038341024408 MainThread DEBUG os_win.utils.compute.vmutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Successfully changed vm state of instance-00000027 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:56:18.685 4088 3038341024408 MainThread DEBUG nova.virt.hyperv.vmops [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Successfully changed state of VM instance-00000027 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:56:18.729 4088 3038341024408 MainThread DEBUG os_win.utils.jobutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Waiting for WMI job: {'InstanceID': 'FF715B38-4F8C-46A7-8D2F-75BB2AB5D035', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15417), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:18.964 4088 3038341024408 MainThread DEBUG os_win.utils.jobutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] WMI job succeeded: {'InstanceID': 'FF715B38-4F8C-46A7-8D2F-75BB2AB5D035', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=141587), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:56:18.964 4088 3038341024408 MainThread DEBUG oslo_concurrency.lockutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-00000027" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:18.964 4088 3038341024408 MainThread DEBUG os_win.utils.pathutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Removing directory: C:\openstack\instances\instance-00000027 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:56:18.964 4088 3038341024408 MainThread DEBUG oslo_concurrency.lockutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-00000027" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:18.964 4088 3038341024408 MainThread ERROR nova.compute.manager [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000027' failed to start. Not enough memory in the system to start the virtual machine instance-00000027. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000027' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Not enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) 'instance-00000027' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Error code: 32778. 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Traceback (most recent call last): 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] return function(*args, **kwargs) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] admin_password, network_info, block_device_info) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] return function(self, *args, **kwds) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self.force_reraise() 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] raise self.value 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] should_plug_vifs=False) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 'req_state': req_state}) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self.force_reraise() 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] raise self.value 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] time.sleep(sleep_time) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self.force_reraise() 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] raise self.value 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] return f(*args, **kwargs) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] return self._wait_for_job(job_path) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] error_desc=err_desc) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000027' failed to start. 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Not enough memory in the system to start the virtual machine instance-00000027. 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000027' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Not enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 'instance-00000027' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Error code: 32778. 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] During handling of the above exception, another exception occurred: 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Traceback (most recent call last): 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] yield resources 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] accel_info=accel_info) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] return function(*args, **kwargs) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] admin_password, network_info, block_device_info) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] return function(self, *args, **kwds) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self.force_reraise() 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] raise self.value 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] should_plug_vifs=False) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 'req_state': req_state}) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self.force_reraise() 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] raise self.value 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] time.sleep(sleep_time) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self.force_reraise() 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] raise self.value 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] return f(*args, **kwargs) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] return self._wait_for_job(job_path) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] error_desc=err_desc) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000027' failed to start. 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Not enough memory in the system to start the virtual machine instance-00000027. 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000027' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Not enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 'instance-00000027' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Error code: 32778. 2021-09-10 16:56:18.964 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:18.964 4088 3038341024408 MainThread INFO nova.compute.manager [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Terminating instance 2021-09-10 16:56:18.964 4088 3038341024408 MainThread DEBUG nova.compute.manager [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:56:18.964 4088 3038341024408 MainThread INFO nova.virt.hyperv.vmops [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Got request to destroy instance 2021-09-10 16:56:18.992 4088 3038341024408 MainThread DEBUG nova.virt.hyperv.vmops [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:56:18.992 4088 3038341024408 MainThread DEBUG os_brick.initiator.windows.iscsi [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-52401085-77e7-4280-b78c-bad720b115d8', 'target_lun': 0, 'volume_id': '52401085-77e7-4280-b78c-bad720b115d8', 'auth_method': 'CHAP', 'auth_username': 'Kn97TpVi2pyUkEmZbVJX', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 16:56:18.992 4088 3038341024408 MainThread DEBUG os_win.utils.storage.diskutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 16:56:19.088 4088 3038341024408 MainThread DEBUG os_win.utils.storage.diskutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 16:56:19.103 4088 3038341024408 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-52401085-77e7-4280-b78c-bad720b115d8 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 16:56:19.166 4088 3038341024408 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Removing iSCSI target persistent login: iqn.2010-10.org.openstack:volume-52401085-77e7-4280-b78c-bad720b115d8 _remove_target_persistent_logins c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:495 2021-09-10 16:56:19.166 4088 3038341024408 MainThread DEBUG os_brick.initiator.windows.iscsi [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] <== disconnect_volume: return (174ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 16:56:19.166 4088 3038341024408 MainThread DEBUG oslo_concurrency.lockutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-00000027" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:19.180 4088 3038341024408 MainThread DEBUG oslo_concurrency.lockutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "instance-00000027" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:19.180 4088 3038341024408 MainThread INFO nova.compute.manager [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Took 0.22 seconds to destroy the instance on the hypervisor. 2021-09-10 16:56:20.338 4088 3038341024584 GreenThread-36 DEBUG nova.network.neutron [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Successfully created port: 09802e32-46dc-4b06-8580-ecc58cbbca67 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:56:22.839 4088 3038341024936 MainThread DEBUG nova.compute.manager [req-1c2a94c4-b74c-436e-8fd0-d8bcfe557565 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Received event network-vif-plugged-9f753f1c-92e8-4a73-ac6b-03a58d69d1e6 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:56:22.839 4088 3038341024936 MainThread DEBUG oslo_concurrency.lockutils [req-1c2a94c4-b74c-436e-8fd0-d8bcfe557565 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "27ece020-a06e-4d29-aedc-cf0d87bdc941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:22.839 4088 3038341024936 MainThread DEBUG oslo_concurrency.lockutils [req-1c2a94c4-b74c-436e-8fd0-d8bcfe557565 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "27ece020-a06e-4d29-aedc-cf0d87bdc941-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:22.839 4088 3038341024936 MainThread DEBUG nova.compute.manager [req-1c2a94c4-b74c-436e-8fd0-d8bcfe557565 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Processing event network-vif-plugged-9f753f1c-92e8-4a73-ac6b-03a58d69d1e6 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:56:22.884 4088 3038341576312 MainThread INFO nova.virt.hyperv.vmops [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Using config drive for instance 2021-09-10 16:56:23.569 4088 3038341576312 MainThread INFO nova.virt.hyperv.vmops [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Creating config drive at C:\openstack\instances\instance-0000002b\configdrive.iso 2021-09-10 16:56:23.650 4088 3038341576312 MainThread DEBUG oslo_concurrency.processutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000002b\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmportft5b1 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:56:23.789 4088 3038341024584 GreenThread-36 DEBUG nova.network.neutron [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Successfully updated port: 09802e32-46dc-4b06-8580-ecc58cbbca67 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:56:23.821 4088 3038341024584 GreenThread-36 DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Acquired lock "refresh_cache-f8bc590e-89bd-458c-bef5-74846b896168" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:56:23.821 4088 3038341024584 GreenThread-36 DEBUG nova.network.neutron [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:56:23.983 4088 3038341576312 MainThread DEBUG oslo_concurrency.processutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000002b\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmportft5b1" returned: 0 in 0.329s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:56:24.355 4088 3038341024584 GreenThread-36 DEBUG nova.network.neutron [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:56:24.496 4088 3038341576312 MainThread DEBUG nova.virt.hyperv.vmops [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Setting boot order for instance: instance-0000002b: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:56:24.602 4088 3038341576312 MainThread DEBUG nova.virt.hyperv.vmops [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:56:24.636 4088 3038341576312 MainThread DEBUG os_win.utils.jobutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Waiting for WMI job: {'InstanceID': '5E7AD581-9B13-4C8A-B9EA-C6A75A29EF74', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14606), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:24.774 4088 3038341576312 MainThread ERROR os_win.utils.jobutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002b\' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)instance-0000002b2302AECC-B5B3-4755-8A4A-C000AC1DFB7212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)instance-0000002b2302AECC-B5B3-4755-8A4A-C000AC1DFB7210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)instance-0000002b2302AECC-B5B3-4755-8A4A-C000AC1DFB72%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5E7AD581-9B13-4C8A-B9EA-C6A75A29EF74', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114617), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 24), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 24), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002b' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)\n\nNot enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)\n\n'instance-0000002b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)", 'ErrorSummaryDescription': "'instance-0000002b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:24.774 4088 3038341576312 MainThread DEBUG os_win._utils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002b' failed to start. Not enough memory in the system to start the virtual machine instance-0000002b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002b' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Not enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) 'instance-0000002b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1719675064086914 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:24.806 4088 3038341022472 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:24.806 4088 3038341022472 MainThread INFO nova.compute.manager [-] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] VM Stopped (Lifecycle Event) 2021-09-10 16:56:24.806 4088 3038341025288 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:24.806 4088 3038341025288 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:24.840 4088 3038341022472 MainThread DEBUG nova.compute.manager [req-b2bda11b-24da-4769-ba1f-c727810ff5ac - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:24.840 4088 3038341022472 MainThread DEBUG nova.virt.hyperv.vmops [req-b2bda11b-24da-4769-ba1f-c727810ff5ac - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:24.884 4088 3038341022472 MainThread DEBUG nova.compute.manager [req-b2bda11b-24da-4769-ba1f-c727810ff5ac - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:24.933 4088 3038341022472 MainThread INFO nova.compute.manager [req-b2bda11b-24da-4769-ba1f-c727810ff5ac - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:25.214 4088 3038341022472 MainThread DEBUG nova.compute.manager [req-467df3bd-d391-4027-906f-ac8e762fac82 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Received event network-vif-plugged-cedaf97e-b489-4b71-abd1-950cba1f0106 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:56:25.214 4088 3038341022472 MainThread DEBUG oslo_concurrency.lockutils [req-467df3bd-d391-4027-906f-ac8e762fac82 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9d815a45-c30c-4ca8-a66d-6ef7fef6185d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:25.214 4088 3038341022472 MainThread DEBUG oslo_concurrency.lockutils [req-467df3bd-d391-4027-906f-ac8e762fac82 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9d815a45-c30c-4ca8-a66d-6ef7fef6185d-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:25.214 4088 3038341022472 MainThread DEBUG nova.compute.manager [req-467df3bd-d391-4027-906f-ac8e762fac82 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Processing event network-vif-plugged-cedaf97e-b489-4b71-abd1-950cba1f0106 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:56:25.214 4088 3038341022472 MainThread DEBUG nova.compute.manager [req-467df3bd-d391-4027-906f-ac8e762fac82 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Received event network-vif-unplugged-5521086c-3b7c-4aaf-a1da-cbd50850d8f6 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:56:25.214 4088 3038341022472 MainThread DEBUG oslo_concurrency.lockutils [req-467df3bd-d391-4027-906f-ac8e762fac82 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "5bd3ad21-3959-40c2-8698-b816b7176efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:25.214 4088 3038341022472 MainThread DEBUG oslo_concurrency.lockutils [req-467df3bd-d391-4027-906f-ac8e762fac82 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "5bd3ad21-3959-40c2-8698-b816b7176efc-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:25.214 4088 3038341022472 MainThread DEBUG nova.compute.manager [req-467df3bd-d391-4027-906f-ac8e762fac82 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] No waiting events found dispatching network-vif-unplugged-5521086c-3b7c-4aaf-a1da-cbd50850d8f6 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 16:56:25.214 4088 3038341022472 MainThread WARNING nova.compute.manager [req-467df3bd-d391-4027-906f-ac8e762fac82 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Received unexpected event network-vif-unplugged-5521086c-3b7c-4aaf-a1da-cbd50850d8f6 for instance with vm_state building and task_state spawning. 2021-09-10 16:56:25.293 4088 3038340845992 MainThread INFO nova.virt.hyperv.vmops [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Using config drive for instance 2021-09-10 16:56:25.511 4088 3038341024584 GreenThread-36 DEBUG nova.network.neutron [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Updating instance_info_cache with network_info: [{"id": "09802e32-46dc-4b06-8580-ecc58cbbca67", "address": "fa:16:3e:a7:f6:cd", "network": {"id": "dd5d187a-141b-46b6-bbf6-8f83ea71d54f", "bridge": null, "label": "tempest-ServersTestJSON-175667746-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "26fab39a080a41888182e794dd32878e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap09802e32-46", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:56:25.539 4088 3038341024584 GreenThread-36 DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Releasing lock "refresh_cache-f8bc590e-89bd-458c-bef5-74846b896168" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:56:25.539 4088 3038341024584 GreenThread-36 DEBUG nova.compute.manager [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Instance network_info: |[{"id": "09802e32-46dc-4b06-8580-ecc58cbbca67", "address": "fa:16:3e:a7:f6:cd", "network": {"id": "dd5d187a-141b-46b6-bbf6-8f83ea71d54f", "bridge": null, "label": "tempest-ServersTestJSON-175667746-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "26fab39a080a41888182e794dd32878e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap09802e32-46", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:56:25.539 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Preparing to wait for external event network-vif-plugged-09802e32-46dc-4b06-8580-ecc58cbbca67 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:56:25.539 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Lock "f8bc590e-89bd-458c-bef5-74846b896168-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:25.539 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Lock "f8bc590e-89bd-458c-bef5-74846b896168-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:25.539 4088 3038341021768 MainThread DEBUG os_win.utils.compute.vmutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Creating VM instance-0000002c create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:56:25.589 4088 3038341024408 MainThread INFO nova.compute.manager [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Took 6.41 seconds to detach 1 volumes for instance. 2021-09-10 16:56:25.589 4088 3038341024408 MainThread DEBUG nova.compute.claims [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:56:25.589 4088 3038341024408 MainThread DEBUG oslo_concurrency.lockutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:25.703 4088 3038341024408 MainThread DEBUG nova.virt.hyperv.hostops [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:56:25.703 4088 3038340845992 MainThread INFO nova.virt.hyperv.vmops [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Creating config drive at C:\openstack\instances\instance-0000002d\configdrive.iso 2021-09-10 16:56:25.804 4088 3038340845992 MainThread DEBUG oslo_concurrency.processutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000002d\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp3xcid7z8 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:56:25.949 4088 3038341024408 MainThread DEBUG nova.virt.hyperv.hostops [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:56:25.981 4088 3038341576312 MainThread DEBUG os_win.utils.jobutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Waiting for WMI job: {'InstanceID': '2D8499F7-0484-43C4-B622-4DFB902D713A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17572), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:26.118 4088 3038341576312 MainThread ERROR os_win.utils.jobutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002b\' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)instance-0000002b2302AECC-B5B3-4755-8A4A-C000AC1DFB7212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)instance-0000002b2302AECC-B5B3-4755-8A4A-C000AC1DFB7210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)instance-0000002b2302AECC-B5B3-4755-8A4A-C000AC1DFB72%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '2D8499F7-0484-43C4-B622-4DFB902D713A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118586), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 25), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 26), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002b' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)\n\nNot enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)\n\n'instance-0000002b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)", 'ErrorSummaryDescription': "'instance-0000002b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:26.118 4088 3038341576312 MainThread DEBUG os_win._utils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002b' failed to start. Not enough memory in the system to start the virtual machine instance-0000002b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002b' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Not enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) 'instance-0000002b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.5162568092346191 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:26.137 4088 3038340845992 MainThread DEBUG oslo_concurrency.processutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000002d\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp3xcid7z8" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:56:26.210 4088 3038341024408 MainThread DEBUG nova.compute.provider_tree [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:56:26.226 4088 3038341024760 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:26.226 4088 3038341024760 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:26.226 4088 3038341022648 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:26.226 4088 3038341022648 MainThread INFO nova.compute.manager [-] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] VM Stopped (Lifecycle Event) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread DEBUG nova.scheduler.client.report [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:56:26.226 4088 3038341024408 MainThread DEBUG oslo_concurrency.lockutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.641s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:26.226 4088 3038341024408 MainThread ERROR nova.compute.manager [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000027' failed to start. Not enough memory in the system to start the virtual machine instance-00000027. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000027' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Not enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) 'instance-00000027' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Error code: 32778. 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Traceback (most recent call last): 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] return function(*args, **kwargs) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] admin_password, network_info, block_device_info) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] return function(self, *args, **kwds) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self.force_reraise() 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] raise self.value 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] should_plug_vifs=False) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 'req_state': req_state}) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self.force_reraise() 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] raise self.value 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] time.sleep(sleep_time) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self.force_reraise() 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] raise self.value 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] return f(*args, **kwargs) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] return self._wait_for_job(job_path) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] error_desc=err_desc) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000027' failed to start. 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Not enough memory in the system to start the virtual machine instance-00000027. 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000027' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Not enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 'instance-00000027' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Error code: 32778. 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] During handling of the above exception, another exception occurred: 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Traceback (most recent call last): 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] accel_info=accel_info) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] return function(*args, **kwargs) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] admin_password, network_info, block_device_info) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] return function(self, *args, **kwds) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self.force_reraise() 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] raise self.value 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] should_plug_vifs=False) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 'req_state': req_state}) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self.force_reraise() 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] raise self.value 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] time.sleep(sleep_time) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self.force_reraise() 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] raise self.value 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] return f(*args, **kwargs) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] return self._wait_for_job(job_path) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] error_desc=err_desc) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000027' failed to start. 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Not enough memory in the system to start the virtual machine instance-00000027. 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000027' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Not enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 'instance-00000027' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Error code: 32778. 2021-09-10 16:56:26.226 4088 3038341024408 MainThread TRACE nova.compute.manager [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] 2021-09-10 16:56:26.226 4088 3038341024408 MainThread DEBUG nova.compute.utils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] WMI job failed with status 10. Error summary description: 'instance-00000027' failed to start. Not enough memory in the system to start the virtual machine instance-00000027. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:56:26.226 4088 3038341024408 MainThread DEBUG nova.compute.manager [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Build of instance 5bd3ad21-3959-40c2-8698-b816b7176efc was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000027' failed to start. Not enough memory in the system to start the virtual machine instance-00000027. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000027' failed to start. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Not enough memory in the system to start the virtual machine instance-00000027 with ram size 1024 megabytes. (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) 'instance-00000027' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D0718599-ABF6-4D40-9AE0-D0B4D1A95FAF) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:56:26.226 4088 3038341024408 MainThread DEBUG nova.compute.manager [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:56:26.226 4088 3038341024408 MainThread DEBUG nova.compute.manager [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:56:26.226 4088 3038341024408 MainThread DEBUG nova.compute.manager [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:56:26.226 4088 3038341024408 MainThread DEBUG nova.network.neutron [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:56:26.251 4088 3038341022648 MainThread DEBUG nova.compute.manager [req-f0beb0da-9106-4919-a087-2f7c17cf4f39 - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:26.251 4088 3038341022648 MainThread DEBUG nova.virt.hyperv.vmops [req-f0beb0da-9106-4919-a087-2f7c17cf4f39 - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:26.340 4088 3038341022648 MainThread DEBUG nova.compute.manager [req-f0beb0da-9106-4919-a087-2f7c17cf4f39 - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:26.370 4088 3038341022648 MainThread INFO nova.compute.manager [req-f0beb0da-9106-4919-a087-2f7c17cf4f39 - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:26.679 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.vmops [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Setting boot order for instance: instance-0000002d: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:56:26.825 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.vmops [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:56:26.856 4088 3038340845992 MainThread DEBUG os_win.utils.jobutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Waiting for WMI job: {'InstanceID': '7EC7A0D9-CF13-4D7E-9D62-832EABD9B69E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19774), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:26.887 4088 3038341578248 MainThread DEBUG nova.compute.manager [req-f176f1ad-3dad-421f-8175-7c7d6539c30a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Received event network-changed-09802e32-46dc-4b06-8580-ecc58cbbca67 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:56:26.887 4088 3038341578248 MainThread DEBUG nova.compute.manager [req-f176f1ad-3dad-421f-8175-7c7d6539c30a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Refreshing instance network info cache due to event network-changed-09802e32-46dc-4b06-8580-ecc58cbbca67. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:56:26.887 4088 3038341578248 MainThread DEBUG oslo_concurrency.lockutils [req-f176f1ad-3dad-421f-8175-7c7d6539c30a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-f8bc590e-89bd-458c-bef5-74846b896168" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:56:26.887 4088 3038341578248 MainThread DEBUG nova.network.neutron [req-f176f1ad-3dad-421f-8175-7c7d6539c30a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Refreshing network info cache for port 09802e32-46dc-4b06-8580-ecc58cbbca67 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:56:27.008 4088 3038340845992 MainThread ERROR os_win.utils.jobutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002d\' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)instance-0000002d62808D9D-5B23-469E-BE7A-AC84B10B5A6D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)instance-0000002d62808D9D-5B23-469E-BE7A-AC84B10B5A6D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)instance-0000002d62808D9D-5B23-469E-BE7A-AC84B10B5A6D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7EC7A0D9-CF13-4D7E-9D62-832EABD9B69E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115630), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 26), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 26), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002d' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)\n\nNot enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)\n\n'instance-0000002d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)", 'ErrorSummaryDescription': "'instance-0000002d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:27.008 4088 3038340845992 MainThread DEBUG os_win._utils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002d' failed to start. Not enough memory in the system to start the virtual machine instance-0000002d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002d' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Not enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) 'instance-0000002d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18233203887939453 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:27.029 4088 3038342049864 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:27.029 4088 3038342049864 MainThread INFO nova.compute.manager [-] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] VM Stopped (Lifecycle Event) 2021-09-10 16:56:27.029 4088 3038342050040 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:27.029 4088 3038342050040 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:27.076 4088 3038342049864 MainThread DEBUG nova.compute.manager [req-b82f6965-086b-4a06-86d5-26fb1198d3be - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:27.076 4088 3038342049864 MainThread DEBUG nova.virt.hyperv.vmops [req-b82f6965-086b-4a06-86d5-26fb1198d3be - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:27.166 4088 3038341576312 MainThread DEBUG os_win.utils.jobutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Waiting for WMI job: {'InstanceID': '80A61516-CD89-43DF-A18D-3CF8BA77531A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17165), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:27.180 4088 3038342049864 MainThread DEBUG nova.compute.manager [req-b82f6965-086b-4a06-86d5-26fb1198d3be - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:27.213 4088 3038342049864 MainThread INFO nova.compute.manager [req-b82f6965-086b-4a06-86d5-26fb1198d3be - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:27.304 4088 3038341576312 MainThread ERROR os_win.utils.jobutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002b\' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)instance-0000002b2302AECC-B5B3-4755-8A4A-C000AC1DFB7212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)instance-0000002b2302AECC-B5B3-4755-8A4A-C000AC1DFB7210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)instance-0000002b2302AECC-B5B3-4755-8A4A-C000AC1DFB72%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '80A61516-CD89-43DF-A18D-3CF8BA77531A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119440), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 27), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 27), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002b' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)\n\nNot enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)\n\n'instance-0000002b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)", 'ErrorSummaryDescription': "'instance-0000002b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:27.304 4088 3038341576312 MainThread DEBUG os_win._utils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002b' failed to start. Not enough memory in the system to start the virtual machine instance-0000002b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002b' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Not enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) 'instance-0000002b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.701981782913208 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:27.338 4088 3038341578424 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:27.338 4088 3038341578424 MainThread INFO nova.compute.manager [-] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] VM Stopped (Lifecycle Event) 2021-09-10 16:56:27.364 4088 3038342033480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:27.364 4088 3038342033480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:27.383 4088 3038341578424 MainThread DEBUG nova.compute.manager [req-d4ee0456-0ca8-43e4-a59c-fdd3e7674b86 - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:27.383 4088 3038341578424 MainThread DEBUG nova.virt.hyperv.vmops [req-d4ee0456-0ca8-43e4-a59c-fdd3e7674b86 - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:27.451 4088 3038341578424 MainThread DEBUG nova.compute.manager [req-d4ee0456-0ca8-43e4-a59c-fdd3e7674b86 - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:27.477 4088 3038341578424 MainThread INFO nova.compute.manager [req-d4ee0456-0ca8-43e4-a59c-fdd3e7674b86 - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:27.514 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.vmops [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:56:28.040 4088 3038340845992 MainThread DEBUG os_win.utils.jobutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Waiting for WMI job: {'InstanceID': '2C0F220A-0425-47B9-ADCA-C01B305674E3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16932), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:28.123 4088 3038341024408 MainThread DEBUG nova.network.neutron [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:56:28.155 4088 3038341024408 MainThread INFO nova.compute.manager [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 5bd3ad21-3959-40c2-8698-b816b7176efc] Took 1.92 seconds to deallocate network for instance. 2021-09-10 16:56:28.182 4088 3038340845992 MainThread ERROR os_win.utils.jobutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002d\' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)instance-0000002d62808D9D-5B23-469E-BE7A-AC84B10B5A6D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)instance-0000002d62808D9D-5B23-469E-BE7A-AC84B10B5A6D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)instance-0000002d62808D9D-5B23-469E-BE7A-AC84B10B5A6D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '2C0F220A-0425-47B9-ADCA-C01B305674E3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116690), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 28), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 28), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002d' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)\n\nNot enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)\n\n'instance-0000002d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)", 'ErrorSummaryDescription': "'instance-0000002d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:28.182 4088 3038340845992 MainThread DEBUG os_win._utils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002d' failed to start. Not enough memory in the system to start the virtual machine instance-0000002d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002d' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Not enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) 'instance-0000002d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3571789264678955 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:28.213 4088 3038341022648 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:28.213 4088 3038341022648 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:28.213 4088 3038341578424 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:28.213 4088 3038341578424 MainThread INFO nova.compute.manager [-] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] VM Stopped (Lifecycle Event) 2021-09-10 16:56:28.264 4088 3038341578424 MainThread DEBUG nova.compute.manager [req-57031901-4383-4bd3-9749-6fa8c83eebfc - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:28.264 4088 3038341578424 MainThread DEBUG nova.virt.hyperv.vmops [req-57031901-4383-4bd3-9749-6fa8c83eebfc - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:28.305 4088 3038341578424 MainThread DEBUG nova.compute.manager [req-57031901-4383-4bd3-9749-6fa8c83eebfc - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:28.338 4088 3038341576312 MainThread DEBUG os_win.utils.jobutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Waiting for WMI job: {'InstanceID': '4F1F3216-F15F-42A6-88B9-CEF3BC37DBCC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=22242), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:28.358 4088 3038341578424 MainThread INFO nova.compute.manager [req-57031901-4383-4bd3-9749-6fa8c83eebfc - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:28.446 4088 3038341024408 MainThread INFO nova.scheduler.client.report [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Deleted allocations for instance 5bd3ad21-3959-40c2-8698-b816b7176efc 2021-09-10 16:56:28.491 4088 3038341576312 MainThread ERROR os_win.utils.jobutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002b\' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)instance-0000002b2302AECC-B5B3-4755-8A4A-C000AC1DFB7212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)instance-0000002b2302AECC-B5B3-4755-8A4A-C000AC1DFB7210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)instance-0000002b2302AECC-B5B3-4755-8A4A-C000AC1DFB72%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4F1F3216-F15F-42A6-88B9-CEF3BC37DBCC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118180), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 28), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 28), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002b' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)\n\nNot enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)\n\n'instance-0000002b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)", 'ErrorSummaryDescription': "'instance-0000002b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:28.491 4088 3038341576312 MainThread DEBUG os_win._utils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002b' failed to start. Not enough memory in the system to start the virtual machine instance-0000002b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002b' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Not enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) 'instance-0000002b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.889509439468384 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:28.491 4088 3038341578248 MainThread DEBUG nova.network.neutron [req-f176f1ad-3dad-421f-8175-7c7d6539c30a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Updated VIF entry in instance network info cache for port 09802e32-46dc-4b06-8580-ecc58cbbca67. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:56:28.491 4088 3038341578248 MainThread DEBUG nova.network.neutron [req-f176f1ad-3dad-421f-8175-7c7d6539c30a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Updating instance_info_cache with network_info: [{"id": "09802e32-46dc-4b06-8580-ecc58cbbca67", "address": "fa:16:3e:a7:f6:cd", "network": {"id": "dd5d187a-141b-46b6-bbf6-8f83ea71d54f", "bridge": null, "label": "tempest-ServersTestJSON-175667746-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "26fab39a080a41888182e794dd32878e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap09802e32-46", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:56:28.491 4088 3038341578424 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:28.491 4088 3038341578424 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:28.514 4088 3038341578600 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:28.514 4088 3038341578600 MainThread INFO nova.compute.manager [-] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] VM Stopped (Lifecycle Event) 2021-09-10 16:56:28.514 4088 3038341024408 MainThread DEBUG oslo_concurrency.lockutils [req-b078a706-54d4-4c9c-a1dd-fdbb7214826a beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "5bd3ad21-3959-40c2-8698-b816b7176efc" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 41.985s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:28.539 4088 3038341578600 MainThread DEBUG nova.compute.manager [req-a0522b7b-3972-491a-bb89-12d461091ea8 - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:28.539 4088 3038341578600 MainThread DEBUG nova.virt.hyperv.vmops [req-a0522b7b-3972-491a-bb89-12d461091ea8 - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:28.539 4088 3038341578248 MainThread DEBUG oslo_concurrency.lockutils [req-f176f1ad-3dad-421f-8175-7c7d6539c30a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-f8bc590e-89bd-458c-bef5-74846b896168" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:56:28.592 4088 3038341578600 MainThread DEBUG nova.compute.manager [req-a0522b7b-3972-491a-bb89-12d461091ea8 - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:28.632 4088 3038341578600 MainThread INFO nova.compute.manager [req-a0522b7b-3972-491a-bb89-12d461091ea8 - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:29.201 4088 3038340845992 MainThread DEBUG os_win.utils.jobutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Waiting for WMI job: {'InstanceID': '8E1D2559-081B-4F81-A0C5-BBD1091BA450', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15872), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:29.357 4088 3038340845992 MainThread ERROR os_win.utils.jobutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002d\' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)instance-0000002d62808D9D-5B23-469E-BE7A-AC84B10B5A6D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)instance-0000002d62808D9D-5B23-469E-BE7A-AC84B10B5A6D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)instance-0000002d62808D9D-5B23-469E-BE7A-AC84B10B5A6D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '8E1D2559-081B-4F81-A0C5-BBD1091BA450', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110960), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 29), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 29), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002d' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)\n\nNot enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)\n\n'instance-0000002d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)", 'ErrorSummaryDescription': "'instance-0000002d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:29.357 4088 3038340845992 MainThread DEBUG os_win._utils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002d' failed to start. Not enough memory in the system to start the virtual machine instance-0000002d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002d' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Not enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) 'instance-0000002d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.531874179840088 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:29.373 4088 3038341578248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:29.373 4088 3038341578248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:29.373 4088 3038341578600 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:29.386 4088 3038341578600 MainThread INFO nova.compute.manager [-] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] VM Stopped (Lifecycle Event) 2021-09-10 16:56:29.400 4088 3038341578600 MainThread DEBUG nova.compute.manager [req-ed478566-db84-4587-8995-40683a7fbb25 - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:29.400 4088 3038341578600 MainThread DEBUG nova.virt.hyperv.vmops [req-ed478566-db84-4587-8995-40683a7fbb25 - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:29.447 4088 3038341578600 MainThread DEBUG nova.compute.manager [req-ed478566-db84-4587-8995-40683a7fbb25 - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:29.488 4088 3038341578600 MainThread INFO nova.compute.manager [req-ed478566-db84-4587-8995-40683a7fbb25 - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:29.511 4088 3038341576312 MainThread DEBUG os_win.utils.jobutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Waiting for WMI job: {'InstanceID': '5C99853A-B4D5-493D-902E-8EA12689588F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16560), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:29.659 4088 3038341576312 MainThread ERROR os_win.utils.jobutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002b\' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)instance-0000002b2302AECC-B5B3-4755-8A4A-C000AC1DFB7212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)instance-0000002b2302AECC-B5B3-4755-8A4A-C000AC1DFB7210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)instance-0000002b2302AECC-B5B3-4755-8A4A-C000AC1DFB72%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5C99853A-B4D5-493D-902E-8EA12689588F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120766), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 29), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 29), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002b' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)\n\nNot enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)\n\n'instance-0000002b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)", 'ErrorSummaryDescription': "'instance-0000002b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:29.659 4088 3038341576312 MainThread DEBUG os_win._utils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002b' failed to start. Not enough memory in the system to start the virtual machine instance-0000002b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002b' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Not enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) 'instance-0000002b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.057435750961304 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:29.702 4088 3038341578600 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:29.702 4088 3038341578600 MainThread INFO nova.compute.manager [-] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] VM Stopped (Lifecycle Event) 2021-09-10 16:56:29.702 4088 3038341578248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:29.702 4088 3038341578248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:29.732 4088 3038341578600 MainThread DEBUG nova.compute.manager [req-b9147844-bae7-4aaf-80ef-9205ce8ea5ac - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:29.732 4088 3038341578600 MainThread DEBUG nova.virt.hyperv.vmops [req-b9147844-bae7-4aaf-80ef-9205ce8ea5ac - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:29.779 4088 3038341578600 MainThread DEBUG nova.compute.manager [req-b9147844-bae7-4aaf-80ef-9205ce8ea5ac - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:29.838 4088 3038341578600 MainThread INFO nova.compute.manager [req-b9147844-bae7-4aaf-80ef-9205ce8ea5ac - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:30.384 4088 3038340845992 MainThread DEBUG os_win.utils.jobutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Waiting for WMI job: {'InstanceID': '51F76F6E-735D-4762-AD8B-1283CA5073D3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16425), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:30.539 4088 3038340845992 MainThread ERROR os_win.utils.jobutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002d\' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)instance-0000002d62808D9D-5B23-469E-BE7A-AC84B10B5A6D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)instance-0000002d62808D9D-5B23-469E-BE7A-AC84B10B5A6D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)instance-0000002d62808D9D-5B23-469E-BE7A-AC84B10B5A6D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '51F76F6E-735D-4762-AD8B-1283CA5073D3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112858), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 30), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 30), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002d' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)\n\nNot enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)\n\n'instance-0000002d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)", 'ErrorSummaryDescription': "'instance-0000002d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:30.539 4088 3038340845992 MainThread DEBUG os_win._utils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002d' failed to start. Not enough memory in the system to start the virtual machine instance-0000002d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002d' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Not enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) 'instance-0000002d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7136552333831787 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:30.561 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_incomplete_migrations run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:56:30.561 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances with incomplete migration _cleanup_incomplete_migrations c:\openstack\build\nova\nova\compute\manager.py:10640 2021-09-10 16:56:30.561 4088 3038341578600 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:30.561 4088 3038341578600 MainThread INFO nova.compute.manager [-] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] VM Stopped (Lifecycle Event) 2021-09-10 16:56:30.561 4088 3038341578248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:30.561 4088 3038341578248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:30.577 4088 3038341578600 MainThread DEBUG nova.compute.manager [req-cb39ea40-ca9c-4b7b-b9d0-527e94b55039 - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:30.577 4088 3038341578600 MainThread DEBUG nova.virt.hyperv.vmops [req-cb39ea40-ca9c-4b7b-b9d0-527e94b55039 - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:30.634 4088 3038341578600 MainThread DEBUG nova.compute.manager [req-cb39ea40-ca9c-4b7b-b9d0-527e94b55039 - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:30.679 4088 3038341578600 MainThread INFO nova.compute.manager [req-cb39ea40-ca9c-4b7b-b9d0-527e94b55039 - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:30.695 4088 3038341576312 MainThread DEBUG os_win.utils.jobutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Waiting for WMI job: {'InstanceID': '852E558A-D08F-4036-A10E-6B1C44882D08', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15769), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:30.837 4088 3038341576312 MainThread ERROR os_win.utils.jobutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002b\' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)instance-0000002b2302AECC-B5B3-4755-8A4A-C000AC1DFB7212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)instance-0000002b2302AECC-B5B3-4755-8A4A-C000AC1DFB7210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)instance-0000002b2302AECC-B5B3-4755-8A4A-C000AC1DFB72%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '852E558A-D08F-4036-A10E-6B1C44882D08', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=122897), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 30), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 30), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002b' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)\n\nNot enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)\n\n'instance-0000002b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72)", 'ErrorSummaryDescription': "'instance-0000002b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:30.837 4088 3038341576312 MainThread ERROR nova.virt.hyperv.vmops [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Failed to change vm state of instance-0000002b to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000002b' failed to start. 2021-09-10 16:56:30.837 4088 3038341576312 MainThread INFO nova.virt.hyperv.vmops [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Got request to destroy instance 2021-09-10 16:56:30.866 4088 3038341578600 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:30.866 4088 3038341578600 MainThread INFO nova.compute.manager [-] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] VM Stopped (Lifecycle Event) 2021-09-10 16:56:30.866 4088 3038341578248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:30.893 4088 3038341578248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:30.897 4088 3038341578600 MainThread DEBUG nova.compute.manager [req-c54c2423-f723-4a95-95d5-d6e7eced963b - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:30.922 4088 3038341578600 MainThread DEBUG nova.virt.hyperv.vmops [req-c54c2423-f723-4a95-95d5-d6e7eced963b - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:30.965 4088 3038341578600 MainThread DEBUG nova.compute.manager [req-c54c2423-f723-4a95-95d5-d6e7eced963b - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:31.010 4088 3038341578600 MainThread INFO nova.compute.manager [req-c54c2423-f723-4a95-95d5-d6e7eced963b - - - - -] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:31.573 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._run_pending_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:56:31.573 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10602 2021-09-10 16:56:31.586 4088 3038340845992 MainThread DEBUG os_win.utils.jobutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Waiting for WMI job: {'InstanceID': '10A1A84F-B622-479A-9758-ABC260560E2B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=25441), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:31.586 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] There are 0 instances to clean _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10611 2021-09-10 16:56:31.586 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:56:31.748 4088 3038340845992 MainThread ERROR os_win.utils.jobutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002d\' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)instance-0000002d62808D9D-5B23-469E-BE7A-AC84B10B5A6D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)instance-0000002d62808D9D-5B23-469E-BE7A-AC84B10B5A6D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)instance-0000002d62808D9D-5B23-469E-BE7A-AC84B10B5A6D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '10A1A84F-B622-479A-9758-ABC260560E2B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=131415), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 31), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 31), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002d' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)\n\nNot enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)\n\n'instance-0000002d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)", 'ErrorSummaryDescription': "'instance-0000002d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:31.748 4088 3038340845992 MainThread DEBUG os_win._utils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002d' failed to start. Not enough memory in the system to start the virtual machine instance-0000002d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002d' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Not enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) 'instance-0000002d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.923054218292236 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:31.779 4088 3038341578600 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:31.779 4088 3038341578600 MainThread INFO nova.compute.manager [-] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] VM Stopped (Lifecycle Event) 2021-09-10 16:56:31.779 4088 3038341578248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:31.779 4088 3038341578248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:31.819 4088 3038341578600 MainThread DEBUG nova.compute.manager [req-c73aab62-b2d9-4587-859f-2e7d20fdd76b - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:31.819 4088 3038341578600 MainThread DEBUG nova.virt.hyperv.vmops [req-c73aab62-b2d9-4587-859f-2e7d20fdd76b - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:31.873 4088 3038341578600 MainThread DEBUG nova.compute.manager [req-c73aab62-b2d9-4587-859f-2e7d20fdd76b - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:31.905 4088 3038341578600 MainThread INFO nova.compute.manager [req-c73aab62-b2d9-4587-859f-2e7d20fdd76b - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:32.761 4088 3038340845992 MainThread DEBUG os_win.utils.jobutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Waiting for WMI job: {'InstanceID': '9B03C999-7AA2-4D4C-9CC8-BF9FB9D28105', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14278), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:32.837 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_power_states run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:56:32.901 4088 3038340845992 MainThread ERROR os_win.utils.jobutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002d\' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)instance-0000002d62808D9D-5B23-469E-BE7A-AC84B10B5A6D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)instance-0000002d62808D9D-5B23-469E-BE7A-AC84B10B5A6D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)instance-0000002d62808D9D-5B23-469E-BE7A-AC84B10B5A6D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9B03C999-7AA2-4D4C-9CC8-BF9FB9D28105', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121344), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 32), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 32), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002d' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)\n\nNot enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)\n\n'instance-0000002d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D)", 'ErrorSummaryDescription': "'instance-0000002d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:32.901 4088 3038340845992 MainThread ERROR nova.virt.hyperv.vmops [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Failed to change vm state of instance-0000002d to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000002d' failed to start. 2021-09-10 16:56:32.901 4088 3038340845992 MainThread INFO nova.virt.hyperv.vmops [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Got request to destroy instance 2021-09-10 16:56:32.940 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 18930e09-cd62-4d3e-b27f-e9541dfa3efc _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 16:56:32.940 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 16:56:32.940 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 66c5445c-c347-4833-8af8-58ba8ff6d95e _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 16:56:32.940 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 16:56:32.940 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9db39d70-5120-4de4-bb87-480a6efb8a3a _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 16:56:32.950 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 0e77fafa-3f8a-4513-bb64-518c77e99029 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 16:56:32.950 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 50586591-86ba-41be-b4e1-5004ea0d76dd _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 16:56:32.950 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 98da4c02-e4db-4a02-a807-c737f9038672 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 16:56:32.950 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 359fd482-69f5-4194-9466-f46ea31258d3 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 16:56:32.950 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 6a33a253-c7b1-44b1-bdc0-eca64733ab55 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 16:56:32.950 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 592bb39a-81cb-43f8-a643-b04092bd9e8a _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 16:56:32.950 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9446e666-4364-4dcd-b041-405653a856bd _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 16:56:32.950 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9bb2d354-2d76-40ea-8b9c-b18a21edefbb _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 16:56:32.950 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 27ece020-a06e-4d29-aedc-cf0d87bdc941 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 16:56:32.950 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid f8bc590e-89bd-458c-bef5-74846b896168 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 16:56:32.950 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9d815a45-c30c-4ca8-a66d-6ef7fef6185d _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 16:56:32.950 4088 3038341578424 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:32.950 4088 3038341578424 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:32.962 4088 3038342144072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:32.962 4088 3038342144072 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:32.962 4088 3038341022648 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:32.962 4088 3038341022648 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:32.962 4088 3038341578600 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:32.962 4088 3038341578600 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:32.962 4088 3038341024408 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:32.962 4088 3038341024408 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:32.962 4088 3038341024584 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:32.962 4088 3038341024584 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:32.962 4088 3038341578248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:32.962 4088 3038341578248 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:32.962 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "359fd482-69f5-4194-9466-f46ea31258d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:32.962 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:32.962 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "98da4c02-e4db-4a02-a807-c737f9038672" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:32.962 4088 3038342144248 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:32.962 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:32.962 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:32.962 4088 3038342144776 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:32.962 4088 3038342144776 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:32.962 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9446e666-4364-4dcd-b041-405653a856bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:32.962 4088 3038342144952 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 9446e666-4364-4dcd-b041-405653a856bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:32.962 4088 3038342145128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:32.962 4088 3038342145128 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:32.982 4088 3038342145832 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:32.982 4088 3038342145832 MainThread INFO nova.compute.manager [-] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] VM Stopped (Lifecycle Event) 2021-09-10 16:56:32.982 4088 3038342146008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:32.982 4088 3038342146008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:33.010 4088 3038342145832 MainThread DEBUG nova.compute.manager [req-a4831277-ec9f-479d-8af7-5caa3f693329 - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:33.010 4088 3038342145832 MainThread DEBUG nova.virt.hyperv.vmops [req-a4831277-ec9f-479d-8af7-5caa3f693329 - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:33.173 4088 3038341578248 MainThread WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 2021-09-10 16:56:33.183 4088 3038342145832 MainThread DEBUG nova.compute.manager [req-a4831277-ec9f-479d-8af7-5caa3f693329 - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:33.201 4088 3038341576312 MainThread DEBUG nova.virt.hyperv.vmops [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:56:33.201 4088 3038341576312 MainThread DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Lock "instance-0000002b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:33.201 4088 3038341576312 MainThread DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Lock "instance-0000002b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:33.214 4088 3038341576312 MainThread DEBUG os_win.utils.compute.vmutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Successfully changed vm state of instance-0000002b to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:56:33.214 4088 3038341576312 MainThread DEBUG nova.virt.hyperv.vmops [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Successfully changed state of VM instance-0000002b to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:56:33.226 4088 3038341578600 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.266s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:33.273 4088 3038341576312 MainThread DEBUG os_win.utils.jobutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Waiting for WMI job: {'InstanceID': '59C20CC5-E2F0-48D9-8451-81D541CDFB1F', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15348), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:33.297 4088 3038342144072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.344s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:33.297 4088 3038342145128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.344s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:33.363 4088 3038341022648 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.406s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:33.371 4088 3038341578248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.406s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:33.388 4088 3038341578424 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.438s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:33.388 4088 3038342144776 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:33.388 4088 3038341024584 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:33.388 4088 3038342145832 MainThread INFO nova.compute.manager [req-a4831277-ec9f-479d-8af7-5caa3f693329 - - - - -] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:33.407 4088 3038341576312 MainThread DEBUG os_win.utils.jobutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] WMI job succeeded: {'InstanceID': '59C20CC5-E2F0-48D9-8451-81D541CDFB1F', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=113250), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:56:33.407 4088 3038341576312 MainThread DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Lock "instance-0000002b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:33.407 4088 3038341576312 MainThread DEBUG os_win.utils.pathutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Removing directory: C:\openstack\instances\instance-0000002b check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:56:33.407 4088 3038341576312 MainThread DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Lock "instance-0000002b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:33.407 4088 3038341576312 MainThread ERROR nova.compute.manager [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002b' failed to start. Not enough memory in the system to start the virtual machine instance-0000002b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002b' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Not enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) 'instance-0000002b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Error code: 32778. 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Traceback (most recent call last): 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] return function(*args, **kwargs) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] admin_password, network_info, block_device_info) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] return function(self, *args, **kwds) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self.force_reraise() 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] raise self.value 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] should_plug_vifs=False) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 'req_state': req_state}) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self.force_reraise() 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] raise self.value 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] time.sleep(sleep_time) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self.force_reraise() 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] raise self.value 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] return f(*args, **kwargs) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] return self._wait_for_job(job_path) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] error_desc=err_desc) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000002b' failed to start. 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Not enough memory in the system to start the virtual machine instance-0000002b. 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002b' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Not enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 'instance-0000002b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Error code: 32778. 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] During handling of the above exception, another exception occurred: 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Traceback (most recent call last): 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] yield resources 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] accel_info=accel_info) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] return function(*args, **kwargs) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] admin_password, network_info, block_device_info) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] return function(self, *args, **kwds) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self.force_reraise() 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] raise self.value 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] should_plug_vifs=False) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 'req_state': req_state}) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self.force_reraise() 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] raise self.value 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] time.sleep(sleep_time) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self.force_reraise() 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] raise self.value 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] return f(*args, **kwargs) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] return self._wait_for_job(job_path) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] error_desc=err_desc) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002b' failed to start. 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Not enough memory in the system to start the virtual machine instance-0000002b. 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002b' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Not enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 'instance-0000002b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Error code: 32778. 2021-09-10 16:56:33.407 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:33.417 4088 3038341576312 MainThread INFO nova.compute.manager [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Terminating instance 2021-09-10 16:56:33.417 4088 3038341576312 MainThread DEBUG nova.compute.manager [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:56:33.417 4088 3038341576312 MainThread INFO nova.virt.hyperv.vmops [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Got request to destroy instance 2021-09-10 16:56:33.417 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9446e666-4364-4dcd-b041-405653a856bd" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:33.417 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:33.435 4088 3038341024408 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:33.435 4088 3038341576312 MainThread DEBUG nova.virt.hyperv.vmops [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:56:33.435 4088 3038341576312 MainThread DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Lock "instance-0000002b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:33.435 4088 3038341576312 MainThread DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Lock "instance-0000002b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:33.435 4088 3038341576312 MainThread INFO nova.compute.manager [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 16:56:33.435 4088 3038341576312 MainThread DEBUG nova.compute.claims [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:56:33.435 4088 3038341576312 MainThread DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:33.510 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "98da4c02-e4db-4a02-a807-c737f9038672" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.547s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:33.510 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "359fd482-69f5-4194-9466-f46ea31258d3" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.547s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:33.564 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:56:33.564 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 16:56:33.686 4088 3038341576312 MainThread DEBUG nova.scheduler.client.report [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Refreshing inventories for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:757 2021-09-10 16:56:33.725 4088 3038341576312 MainThread DEBUG nova.scheduler.client.report [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Updating ProviderTree inventory for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 from _refresh_and_get_inventory using data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} _refresh_and_get_inventory c:\openstack\build\nova\nova\scheduler\client\report.py:723 2021-09-10 16:56:33.725 4088 3038341576312 MainThread DEBUG nova.compute.provider_tree [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Updating inventory in ProviderTree for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 with inventory: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:176 2021-09-10 16:56:33.757 4088 3038341576312 MainThread DEBUG nova.scheduler.client.report [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Refreshing aggregate associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, aggregates: None _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:766 2021-09-10 16:56:33.837 4088 3038341576312 MainThread DEBUG nova.scheduler.client.report [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Refreshing trait associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_VHD,COMPUTE_IMAGE_TYPE_VHDX,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:778 2021-09-10 16:56:33.837 4088 3038341576312 MainThread DEBUG nova.virt.hyperv.hostops [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:56:33.858 4088 3038341576312 MainThread DEBUG nova.virt.hyperv.hostops [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:56:34.102 4088 3038341576312 MainThread DEBUG nova.compute.provider_tree [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:56:34.117 4088 3038341576312 MainThread DEBUG nova.scheduler.client.report [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:56:34.117 4088 3038341576312 MainThread DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.687s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:34.117 4088 3038341576312 MainThread ERROR nova.compute.manager [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002b' failed to start. Not enough memory in the system to start the virtual machine instance-0000002b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002b' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Not enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) 'instance-0000002b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Error code: 32778. 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Traceback (most recent call last): 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] return function(*args, **kwargs) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] admin_password, network_info, block_device_info) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] return function(self, *args, **kwds) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self.force_reraise() 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] raise self.value 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] should_plug_vifs=False) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 'req_state': req_state}) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self.force_reraise() 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] raise self.value 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] time.sleep(sleep_time) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self.force_reraise() 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] raise self.value 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] return f(*args, **kwargs) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] return self._wait_for_job(job_path) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] error_desc=err_desc) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000002b' failed to start. 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Not enough memory in the system to start the virtual machine instance-0000002b. 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002b' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Not enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 'instance-0000002b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Error code: 32778. 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] During handling of the above exception, another exception occurred: 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Traceback (most recent call last): 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] accel_info=accel_info) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] return function(*args, **kwargs) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] admin_password, network_info, block_device_info) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] return function(self, *args, **kwds) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self.force_reraise() 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] raise self.value 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] should_plug_vifs=False) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 'req_state': req_state}) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self.force_reraise() 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] raise self.value 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] time.sleep(sleep_time) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self.force_reraise() 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] raise self.value 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] return f(*args, **kwargs) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] return self._wait_for_job(job_path) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] error_desc=err_desc) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002b' failed to start. 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Not enough memory in the system to start the virtual machine instance-0000002b. 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002b' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Not enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 'instance-0000002b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Error code: 32778. 2021-09-10 16:56:34.117 4088 3038341576312 MainThread TRACE nova.compute.manager [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] 2021-09-10 16:56:34.117 4088 3038341576312 MainThread DEBUG nova.compute.utils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] WMI job failed with status 10. Error summary description: 'instance-0000002b' failed to start. Not enough memory in the system to start the virtual machine instance-0000002b. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:56:34.117 4088 3038341576312 MainThread DEBUG nova.compute.manager [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Build of instance 27ece020-a06e-4d29-aedc-cf0d87bdc941 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000002b' failed to start. Not enough memory in the system to start the virtual machine instance-0000002b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002b' failed to start. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Not enough memory in the system to start the virtual machine instance-0000002b with ram size 1024 megabytes. (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) 'instance-0000002b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2302AECC-B5B3-4755-8A4A-C000AC1DFB72) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:56:34.117 4088 3038341576312 MainThread DEBUG nova.compute.manager [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:56:34.117 4088 3038341576312 MainThread DEBUG nova.compute.manager [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:56:34.117 4088 3038341576312 MainThread DEBUG nova.compute.manager [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:56:34.117 4088 3038341576312 MainThread DEBUG nova.network.neutron [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:56:35.248 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.vmops [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:56:35.248 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Lock "instance-0000002d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:35.248 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Lock "instance-0000002d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:35.273 4088 3038340845992 MainThread DEBUG os_win.utils.compute.vmutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Successfully changed vm state of instance-0000002d to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:56:35.273 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.vmops [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Successfully changed state of VM instance-0000002d to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:56:35.311 4088 3038341576312 MainThread DEBUG nova.network.neutron [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:56:35.335 4088 3038340845992 MainThread DEBUG os_win.utils.jobutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Waiting for WMI job: {'InstanceID': '8D48F214-0334-4CB1-9B73-28C539B1444A', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19125), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:35.335 4088 3038341576312 MainThread INFO nova.compute.manager [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] Took 1.22 seconds to deallocate network for instance. 2021-09-10 16:56:35.460 4088 3038340845992 MainThread DEBUG os_win.utils.jobutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] WMI job succeeded: {'InstanceID': '8D48F214-0334-4CB1-9B73-28C539B1444A', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=118779), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:56:35.460 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Lock "instance-0000002d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:35.460 4088 3038340845992 MainThread DEBUG os_win.utils.pathutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Removing directory: C:\openstack\instances\instance-0000002d check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:56:35.465 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Lock "instance-0000002d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:35.465 4088 3038340845992 MainThread ERROR nova.compute.manager [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002d' failed to start. Not enough memory in the system to start the virtual machine instance-0000002d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002d' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Not enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) 'instance-0000002d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Error code: 32778. 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Traceback (most recent call last): 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] return function(*args, **kwargs) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] admin_password, network_info, block_device_info) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] return function(self, *args, **kwds) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self.force_reraise() 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] raise self.value 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] should_plug_vifs=False) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 'req_state': req_state}) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self.force_reraise() 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] raise self.value 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] time.sleep(sleep_time) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self.force_reraise() 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] raise self.value 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] return f(*args, **kwargs) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] return self._wait_for_job(job_path) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] error_desc=err_desc) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000002d' failed to start. 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Not enough memory in the system to start the virtual machine instance-0000002d. 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002d' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Not enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 'instance-0000002d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Error code: 32778. 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] During handling of the above exception, another exception occurred: 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Traceback (most recent call last): 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] yield resources 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] accel_info=accel_info) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] return function(*args, **kwargs) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] admin_password, network_info, block_device_info) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] return function(self, *args, **kwds) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self.force_reraise() 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] raise self.value 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] should_plug_vifs=False) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 'req_state': req_state}) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self.force_reraise() 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] raise self.value 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] time.sleep(sleep_time) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self.force_reraise() 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] raise self.value 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] return f(*args, **kwargs) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] return self._wait_for_job(job_path) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] error_desc=err_desc) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002d' failed to start. 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Not enough memory in the system to start the virtual machine instance-0000002d. 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002d' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Not enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 'instance-0000002d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Error code: 32778. 2021-09-10 16:56:35.465 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:35.465 4088 3038340845992 MainThread INFO nova.compute.manager [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Terminating instance 2021-09-10 16:56:35.465 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:56:35.465 4088 3038340845992 MainThread INFO nova.virt.hyperv.vmops [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Got request to destroy instance 2021-09-10 16:56:35.492 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.vmops [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:56:35.492 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Lock "instance-0000002d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:35.492 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Lock "instance-0000002d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:35.492 4088 3038340845992 MainThread INFO nova.compute.manager [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 16:56:35.492 4088 3038340845992 MainThread DEBUG nova.compute.claims [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:56:35.492 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:35.530 4088 3038341576312 MainThread INFO nova.scheduler.client.report [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Deleted allocations for instance 27ece020-a06e-4d29-aedc-cf0d87bdc941 2021-09-10 16:56:35.555 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:56:35.595 4088 3038341576312 MainThread DEBUG oslo_concurrency.lockutils [req-807d339a-de30-4b6e-8e3f-0ba4528a600b bd6f0f3184dd48b29f26ac7bd9ea6657 ef05fccd42414dbd84e1f21b80c6b71e - default default] Lock "27ece020-a06e-4d29-aedc-cf0d87bdc941" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 28.954s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:35.595 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "27ece020-a06e-4d29-aedc-cf0d87bdc941" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 2.641s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:35.595 4088 3038342145304 MainThread INFO nova.compute.manager [-] [instance: 27ece020-a06e-4d29-aedc-cf0d87bdc941] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:35.595 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "27ece020-a06e-4d29-aedc-cf0d87bdc941" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:35.638 4088 3038342145304 MainThread DEBUG nova.compute.manager [req-c0c987b0-f2b4-4762-90a4-830b3b563601 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Received event network-vif-plugged-09802e32-46dc-4b06-8580-ecc58cbbca67 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:56:35.638 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-c0c987b0-f2b4-4762-90a4-830b3b563601 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "f8bc590e-89bd-458c-bef5-74846b896168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:35.638 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-c0c987b0-f2b4-4762-90a4-830b3b563601 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "f8bc590e-89bd-458c-bef5-74846b896168-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:35.638 4088 3038342145304 MainThread DEBUG nova.compute.manager [req-c0c987b0-f2b4-4762-90a4-830b3b563601 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Processing event network-vif-plugged-09802e32-46dc-4b06-8580-ecc58cbbca67 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:56:35.694 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.hostops [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:56:35.700 4088 3038341021768 MainThread INFO nova.virt.hyperv.vmops [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Using config drive for instance 2021-09-10 16:56:35.711 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.hostops [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:56:35.881 4088 3038341021768 MainThread INFO nova.virt.hyperv.vmops [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Creating config drive at C:\openstack\instances\instance-0000002c\configdrive.iso 2021-09-10 16:56:35.997 4088 3038341021768 MainThread DEBUG oslo_concurrency.processutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000002c\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmprazh0xq6 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:56:36.165 4088 3038340845992 MainThread DEBUG nova.compute.provider_tree [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:56:36.201 4088 3038340845992 MainThread DEBUG nova.scheduler.client.report [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:56:36.201 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.703s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:36.201 4088 3038340845992 MainThread ERROR nova.compute.manager [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002d' failed to start. Not enough memory in the system to start the virtual machine instance-0000002d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002d' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Not enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) 'instance-0000002d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Error code: 32778. 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Traceback (most recent call last): 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] return function(*args, **kwargs) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] admin_password, network_info, block_device_info) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] return function(self, *args, **kwds) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self.force_reraise() 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] raise self.value 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] should_plug_vifs=False) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 'req_state': req_state}) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self.force_reraise() 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] raise self.value 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] time.sleep(sleep_time) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self.force_reraise() 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] raise self.value 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] return f(*args, **kwargs) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] return self._wait_for_job(job_path) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] error_desc=err_desc) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000002d' failed to start. 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Not enough memory in the system to start the virtual machine instance-0000002d. 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002d' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Not enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 'instance-0000002d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Error code: 32778. 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] During handling of the above exception, another exception occurred: 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Traceback (most recent call last): 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] accel_info=accel_info) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] return function(*args, **kwargs) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] admin_password, network_info, block_device_info) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] return function(self, *args, **kwds) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self.force_reraise() 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] raise self.value 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] should_plug_vifs=False) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 'req_state': req_state}) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self.force_reraise() 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] raise self.value 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] time.sleep(sleep_time) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self.force_reraise() 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] raise self.value 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] return f(*args, **kwargs) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] return self._wait_for_job(job_path) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] error_desc=err_desc) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002d' failed to start. 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Not enough memory in the system to start the virtual machine instance-0000002d. 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002d' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Not enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 'instance-0000002d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Error code: 32778. 2021-09-10 16:56:36.201 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] 2021-09-10 16:56:36.214 4088 3038340845992 MainThread DEBUG nova.compute.utils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] WMI job failed with status 10. Error summary description: 'instance-0000002d' failed to start. Not enough memory in the system to start the virtual machine instance-0000002d. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:56:36.214 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Build of instance 9d815a45-c30c-4ca8-a66d-6ef7fef6185d was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000002d' failed to start. Not enough memory in the system to start the virtual machine instance-0000002d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002d' failed to start. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Not enough memory in the system to start the virtual machine instance-0000002d with ram size 1024 megabytes. (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) 'instance-0000002d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 62808D9D-5B23-469E-BE7A-AC84B10B5A6D) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:56:36.214 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:56:36.214 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:56:36.214 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:56:36.214 4088 3038340845992 MainThread DEBUG nova.network.neutron [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:56:36.373 4088 3038341021768 MainThread DEBUG oslo_concurrency.processutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000002c\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmprazh0xq6" returned: 0 in 0.375s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:56:36.561 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:56:36.576 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 16:56:36.576 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9342 2021-09-10 16:56:36.637 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Skipping network cache update for instance because it is Building. _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9352 2021-09-10 16:56:36.867 4088 3038340845992 MainThread DEBUG nova.network.neutron [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:56:36.897 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.vmops [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Setting boot order for instance: instance-0000002c: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:56:36.897 4088 3038340845992 MainThread INFO nova.compute.manager [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] Took 0.69 seconds to deallocate network for instance. 2021-09-10 16:56:36.983 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.vmops [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:56:37.040 4088 3038341021768 MainThread DEBUG os_win.utils.jobutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Waiting for WMI job: {'InstanceID': '6B44687C-6171-4697-B48D-B07EAF0E935E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=24118), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:37.147 4088 3038340845992 MainThread INFO nova.scheduler.client.report [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Deleted allocations for instance 9d815a45-c30c-4ca8-a66d-6ef7fef6185d 2021-09-10 16:56:37.195 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-18930e09-cd62-4d3e-b27f-e9541dfa3efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:56:37.195 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 16:56:37.195 4088 3038296676664 GreenThread-2 DEBUG nova.objects.instance [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lazy-loading 'info_cache' on Instance uuid 18930e09-cd62-4d3e-b27f-e9541dfa3efc obj_load_attr c:\openstack\build\nova\nova\objects\instance.py:1101 2021-09-10 16:56:37.195 4088 3038341021768 MainThread ERROR os_win.utils.jobutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002c\' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)instance-0000002c444531C6-67E1-4114-8978-DF700B54BE8B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)instance-0000002c444531C6-67E1-4114-8978-DF700B54BE8B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)instance-0000002c444531C6-67E1-4114-8978-DF700B54BE8B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6B44687C-6171-4697-B48D-B07EAF0E935E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=123357), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 37), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 37), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002c' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)\n\nNot enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)\n\n'instance-0000002c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)", 'ErrorSummaryDescription': "'instance-0000002c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:37.195 4088 3038341021768 MainThread DEBUG os_win._utils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002c' failed to start. Not enough memory in the system to start the virtual machine instance-0000002c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002c' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Not enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) 'instance-0000002c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.19863557815551758 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:37.195 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-f9922ce4-cb33-4985-b7ba-5ddcbabe7a3d 9bc7e248f98441caa76226a9e8d21746 e122cd09445d480a826d8bd883b15cad - default default] Lock "9d815a45-c30c-4ca8-a66d-6ef7fef6185d" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 30.047s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:37.225 4088 3038342145656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9d815a45-c30c-4ca8-a66d-6ef7fef6185d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 4.266s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:37.225 4088 3038342145656 MainThread INFO nova.compute.manager [-] [instance: 9d815a45-c30c-4ca8-a66d-6ef7fef6185d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:37.225 4088 3038342145656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9d815a45-c30c-4ca8-a66d-6ef7fef6185d" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:37.232 4088 3038342145656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:37.232 4088 3038342145656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:37.232 4088 3038340845992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:37.232 4088 3038340845992 MainThread INFO nova.compute.manager [-] [instance: f8bc590e-89bd-458c-bef5-74846b896168] VM Stopped (Lifecycle Event) 2021-09-10 16:56:37.257 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-851abbf6-7c25-44ce-9a8b-7203efc0b998 - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:37.257 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.vmops [req-851abbf6-7c25-44ce-9a8b-7203efc0b998 - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:37.304 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-851abbf6-7c25-44ce-9a8b-7203efc0b998 - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:37.342 4088 3038340845992 MainThread INFO nova.compute.manager [req-851abbf6-7c25-44ce-9a8b-7203efc0b998 - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:38.212 4088 3038341021768 MainThread DEBUG os_win.utils.jobutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Waiting for WMI job: {'InstanceID': 'C5E7D84E-C299-44A9-8510-9298B1D9F601', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15333), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:38.367 4088 3038341021768 MainThread ERROR os_win.utils.jobutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002c\' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)instance-0000002c444531C6-67E1-4114-8978-DF700B54BE8B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)instance-0000002c444531C6-67E1-4114-8978-DF700B54BE8B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)instance-0000002c444531C6-67E1-4114-8978-DF700B54BE8B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C5E7D84E-C299-44A9-8510-9298B1D9F601', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115520), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 38), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 38), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002c' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)\n\nNot enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)\n\n'instance-0000002c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)", 'ErrorSummaryDescription': "'instance-0000002c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:38.367 4088 3038341021768 MainThread DEBUG os_win._utils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002c' failed to start. Not enough memory in the system to start the virtual machine instance-0000002c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002c' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Not enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) 'instance-0000002c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3698902130126953 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:38.397 4088 3038342145656 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:38.397 4088 3038342145656 MainThread INFO nova.compute.manager [-] [instance: f8bc590e-89bd-458c-bef5-74846b896168] VM Stopped (Lifecycle Event) 2021-09-10 16:56:38.404 4088 3038342145832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:38.404 4088 3038342145832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:38.451 4088 3038342145656 MainThread DEBUG nova.compute.manager [req-fa854ead-ab93-4173-ac41-73d9b0e3f4be - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:38.451 4088 3038342145656 MainThread DEBUG nova.virt.hyperv.vmops [req-fa854ead-ab93-4173-ac41-73d9b0e3f4be - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:38.493 4088 3038342145656 MainThread DEBUG nova.compute.manager [req-fa854ead-ab93-4173-ac41-73d9b0e3f4be - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:38.507 4088 3038342145656 MainThread INFO nova.compute.manager [req-fa854ead-ab93-4173-ac41-73d9b0e3f4be - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:38.763 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Updating instance_info_cache with network_info: [{"id": "829c891f-1877-4967-a719-113170bb7add", "address": "fa:16:3e:5d:ef:74", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap829c891f-18", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:56:38.794 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-18930e09-cd62-4d3e-b27f-e9541dfa3efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:56:38.794 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 16:56:38.794 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:56:38.794 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:56:38.794 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:56:38.806 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:56:38.975 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-7b1c2ec3-5396-4d2a-ba06-25ac5e43ac4e beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "359fd482-69f5-4194-9466-f46ea31258d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:38.975 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-7b1c2ec3-5396-4d2a-ba06-25ac5e43ac4e beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "359fd482-69f5-4194-9466-f46ea31258d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:38.975 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-7b1c2ec3-5396-4d2a-ba06-25ac5e43ac4e beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "359fd482-69f5-4194-9466-f46ea31258d3-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:38.975 4088 3038340845992 MainThread ERROR nova.compute.manager [req-7b1c2ec3-5396-4d2a-ba06-25ac5e43ac4e beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Setting instance vm_state to ERROR: NameError: name 'instant' is not defined 2021-09-10 16:56:38.975 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Traceback (most recent call last): 2021-09-10 16:56:38.975 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 359fd482-69f5-4194-9466-f46ea31258d3] File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:56:38.975 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 359fd482-69f5-4194-9466-f46ea31258d3] self._delete_instance(context, instance, bdms) 2021-09-10 16:56:38.975 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 359fd482-69f5-4194-9466-f46ea31258d3] File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:56:38.975 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 359fd482-69f5-4194-9466-f46ea31258d3] self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:56:38.975 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 359fd482-69f5-4194-9466-f46ea31258d3] NameError: name 'instant' is not defined 2021-09-10 16:56:38.975 4088 3038340845992 MainThread TRACE nova.compute.manager [instance: 359fd482-69f5-4194-9466-f46ea31258d3] 2021-09-10 16:56:39.085 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-7b1c2ec3-5396-4d2a-ba06-25ac5e43ac4e beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "359fd482-69f5-4194-9466-f46ea31258d3" released by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 0.109s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:39.211 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-7b1c2ec3-5396-4d2a-ba06-25ac5e43ac4e beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:39.257 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.hostops [req-7b1c2ec3-5396-4d2a-ba06-25ac5e43ac4e beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:56:39.257 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.hostops [req-7b1c2ec3-5396-4d2a-ba06-25ac5e43ac4e beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:56:39.402 4088 3038341021768 MainThread DEBUG os_win.utils.jobutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Waiting for WMI job: {'InstanceID': 'AA5FEA31-7A8E-4DCB-BF2A-B31F12E06B84', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17847), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:39.546 4088 3038340845992 MainThread DEBUG nova.compute.provider_tree [req-7b1c2ec3-5396-4d2a-ba06-25ac5e43ac4e beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:56:39.556 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:56:39.556 4088 3038341021768 MainThread ERROR os_win.utils.jobutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002c\' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)instance-0000002c444531C6-67E1-4114-8978-DF700B54BE8B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)instance-0000002c444531C6-67E1-4114-8978-DF700B54BE8B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)instance-0000002c444531C6-67E1-4114-8978-DF700B54BE8B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'AA5FEA31-7A8E-4DCB-BF2A-B31F12E06B84', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117472), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 39), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 39), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002c' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)\n\nNot enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)\n\n'instance-0000002c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)", 'ErrorSummaryDescription': "'instance-0000002c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:39.556 4088 3038341021768 MainThread DEBUG os_win._utils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002c' failed to start. Not enough memory in the system to start the virtual machine instance-0000002c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002c' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Not enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) 'instance-0000002c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5592234134674072 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:39.570 4088 3038340845992 MainThread DEBUG nova.scheduler.client.report [req-7b1c2ec3-5396-4d2a-ba06-25ac5e43ac4e beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:56:39.570 4088 3038340845992 MainThread DEBUG oslo_concurrency.lockutils [req-7b1c2ec3-5396-4d2a-ba06-25ac5e43ac4e beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:39.570 4088 3038340845992 MainThread INFO nova.compute.manager [req-7b1c2ec3-5396-4d2a-ba06-25ac5e43ac4e beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Successfully reverted task state from deleting on failure for instance. 2021-09-10 16:56:39.570 4088 3038340845992 MainThread ERROR oslo_messaging.rpc.server [req-7b1c2ec3-5396-4d2a-ba06-25ac5e43ac4e beffe9ba8529426fbb27e549254bd679 91237ebda1b54d2dbc761e48fdd93516 - default default] Exception during message handling: NameError: name 'instant' is not defined 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server Traceback (most recent call last): 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 72, in wrapped 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server context, exc, binary) 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server return f(self, context, *args, **kw) 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 184, in decorated_function 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server "Error: %s", e, instance=instance) 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 154, in decorated_function 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\utils.py", line 1433, in decorated_function 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 200, in decorated_function 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3106, in terminate_instance 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server do_terminate_instance(instance, bdms) 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_concurrency\lockutils.py", line 360, in inner 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server return f(*args, **kwargs) 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3104, in do_terminate_instance 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server self._set_instance_obj_error_state(instance) 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server self._delete_instance(context, instance, bdms) 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server NameError: name 'instant' is not defined 2021-09-10 16:56:39.570 4088 3038340845992 MainThread TRACE oslo_messaging.rpc.server 2021-09-10 16:56:39.570 4088 3038342145656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:39.570 4088 3038342145656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:39.570 4088 3038340845992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:39.586 4088 3038340845992 MainThread INFO nova.compute.manager [-] [instance: f8bc590e-89bd-458c-bef5-74846b896168] VM Stopped (Lifecycle Event) 2021-09-10 16:56:39.607 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-8654b980-014b-4ade-be98-678d3ede0b6a - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:39.607 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.vmops [req-8654b980-014b-4ade-be98-678d3ede0b6a - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:39.656 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-8654b980-014b-4ade-be98-678d3ede0b6a - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:39.670 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:56:39.709 4088 3038340845992 MainThread INFO nova.compute.manager [req-8654b980-014b-4ade-be98-678d3ede0b6a - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:40.585 4088 3038341021768 MainThread DEBUG os_win.utils.jobutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Waiting for WMI job: {'InstanceID': 'B38450CD-2853-4520-BAA2-53D32153810B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18794), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:40.759 4088 3038341021768 MainThread ERROR os_win.utils.jobutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002c\' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)instance-0000002c444531C6-67E1-4114-8978-DF700B54BE8B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)instance-0000002c444531C6-67E1-4114-8978-DF700B54BE8B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)instance-0000002c444531C6-67E1-4114-8978-DF700B54BE8B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B38450CD-2853-4520-BAA2-53D32153810B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=132988), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 40), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 40), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002c' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)\n\nNot enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)\n\n'instance-0000002c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)", 'ErrorSummaryDescription': "'instance-0000002c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:40.759 4088 3038341021768 MainThread DEBUG os_win._utils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002c' failed to start. Not enough memory in the system to start the virtual machine instance-0000002c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002c' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Not enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) 'instance-0000002c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7622690200805664 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:40.794 4088 3038342145656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:40.794 4088 3038342145656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:40.794 4088 3038340845992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:40.794 4088 3038340845992 MainThread INFO nova.compute.manager [-] [instance: f8bc590e-89bd-458c-bef5-74846b896168] VM Stopped (Lifecycle Event) 2021-09-10 16:56:40.826 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-5d04147f-dec5-4788-a348-16105ebf067e - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:40.826 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.vmops [req-5d04147f-dec5-4788-a348-16105ebf067e - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:40.866 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-5d04147f-dec5-4788-a348-16105ebf067e - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:40.913 4088 3038340845992 MainThread INFO nova.compute.manager [req-5d04147f-dec5-4788-a348-16105ebf067e - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:41.794 4088 3038341021768 MainThread DEBUG os_win.utils.jobutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Waiting for WMI job: {'InstanceID': 'D3ED5733-94EE-47A2-A400-208E8182F19F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21727), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:41.963 4088 3038341021768 MainThread ERROR os_win.utils.jobutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002c\' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)instance-0000002c444531C6-67E1-4114-8978-DF700B54BE8B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)instance-0000002c444531C6-67E1-4114-8978-DF700B54BE8B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)instance-0000002c444531C6-67E1-4114-8978-DF700B54BE8B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D3ED5733-94EE-47A2-A400-208E8182F19F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=132291), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 41), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 41), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002c' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)\n\nNot enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)\n\n'instance-0000002c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)", 'ErrorSummaryDescription': "'instance-0000002c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:41.963 4088 3038341021768 MainThread DEBUG os_win._utils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002c' failed to start. Not enough memory in the system to start the virtual machine instance-0000002c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002c' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Not enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) 'instance-0000002c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.9662840366363525 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:56:41.993 4088 3038342145656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:41.993 4088 3038342145656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:41.993 4088 3038340845992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:41.993 4088 3038340845992 MainThread INFO nova.compute.manager [-] [instance: f8bc590e-89bd-458c-bef5-74846b896168] VM Stopped (Lifecycle Event) 2021-09-10 16:56:42.007 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-388cd7ee-3f52-4172-89c9-45389a185adb - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:42.025 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.vmops [req-388cd7ee-3f52-4172-89c9-45389a185adb - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:42.070 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-388cd7ee-3f52-4172-89c9-45389a185adb - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:42.100 4088 3038340845992 MainThread INFO nova.compute.manager [req-388cd7ee-3f52-4172-89c9-45389a185adb - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:42.553 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:56:42.564 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:42.564 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:42.564 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 16:56:42.564 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:56:42.600 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:56:42.821 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2222MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 16:56:42.821 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:43.038 4088 3038341021768 MainThread DEBUG os_win.utils.jobutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Waiting for WMI job: {'InstanceID': '3E7C7EEF-EFB5-4E7F-87A9-D43B28F8A110', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16113), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:43.122 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:56:43.122 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance f8bc590e-89bd-458c-bef5-74846b896168 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:56:43.122 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:56:43.122 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:56:43.122 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:56:43.122 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:56:43.122 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:56:43.122 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:56:43.122 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:56:43.122 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:56:43.122 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:56:43.122 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:56:43.122 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:56:43.122 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:56:43.133 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 16:56:43.133 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=14GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 16:56:43.165 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:56:43.179 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:56:43.197 4088 3038341021768 MainThread ERROR os_win.utils.jobutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002c\' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)instance-0000002c444531C6-67E1-4114-8978-DF700B54BE8B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)instance-0000002c444531C6-67E1-4114-8978-DF700B54BE8B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)instance-0000002c444531C6-67E1-4114-8978-DF700B54BE8B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3E7C7EEF-EFB5-4E7F-87A9-D43B28F8A110', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116697), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 56, 42), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 56, 43), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002c' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)\n\nNot enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)\n\n'instance-0000002c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B)", 'ErrorSummaryDescription': "'instance-0000002c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:56:43.197 4088 3038341021768 MainThread ERROR nova.virt.hyperv.vmops [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Failed to change vm state of instance-0000002c to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000002c' failed to start. 2021-09-10 16:56:43.197 4088 3038341021768 MainThread INFO nova.virt.hyperv.vmops [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Got request to destroy instance 2021-09-10 16:56:43.197 4088 3038342145656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:43.197 4088 3038342145656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:43.197 4088 3038340845992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:56:43.197 4088 3038340845992 MainThread INFO nova.compute.manager [-] [instance: f8bc590e-89bd-458c-bef5-74846b896168] VM Stopped (Lifecycle Event) 2021-09-10 16:56:43.226 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-45e64461-c6fd-4cf9-ac1a-888c4392b384 - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:56:43.226 4088 3038340845992 MainThread DEBUG nova.virt.hyperv.vmops [req-45e64461-c6fd-4cf9-ac1a-888c4392b384 - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:56:43.289 4088 3038340845992 MainThread DEBUG nova.compute.manager [req-45e64461-c6fd-4cf9-ac1a-888c4392b384 - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:56:43.336 4088 3038340845992 MainThread INFO nova.compute.manager [req-45e64461-c6fd-4cf9-ac1a-888c4392b384 - - - - -] [instance: f8bc590e-89bd-458c-bef5-74846b896168] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:43.451 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:56:43.460 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:56:43.460 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 16:56:43.478 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:43.478 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:56:44.772 4088 3038341575960 MainThread DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "7e8913a3-2544-4f11-9354-908856f92cec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:44.810 4088 3038341575960 MainThread DEBUG nova.compute.manager [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:56:44.928 4088 3038341575960 MainThread DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:44.928 4088 3038341575960 MainThread DEBUG nova.virt.hardware [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:56:44.928 4088 3038341575960 MainThread INFO nova.compute.claims [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Claim successful on node n-h2-808474-1 2021-09-10 16:56:45.060 4088 3038341575960 MainThread DEBUG nova.virt.hyperv.hostops [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:56:45.085 4088 3038341575960 MainThread DEBUG nova.virt.hyperv.hostops [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:56:45.309 4088 3038341575960 MainThread DEBUG nova.compute.provider_tree [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:56:45.321 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.vmops [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:56:45.321 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Lock "instance-0000002c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:45.321 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Lock "instance-0000002c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:45.337 4088 3038341575960 MainThread DEBUG nova.scheduler.client.report [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:56:45.337 4088 3038341575960 MainThread DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:45.337 4088 3038341575960 MainThread DEBUG nova.compute.manager [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:56:45.352 4088 3038341021768 MainThread DEBUG os_win.utils.compute.vmutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Successfully changed vm state of instance-0000002c to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:56:45.352 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.vmops [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Successfully changed state of VM instance-0000002c to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:56:45.381 4088 3038341575960 MainThread DEBUG nova.compute.manager [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:56:45.412 4088 3038342145304 GreenThread-37 DEBUG nova.compute.manager [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:56:45.413 4088 3038342145304 GreenThread-37 DEBUG nova.network.neutron [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:56:45.413 4088 3038341021768 MainThread DEBUG os_win.utils.jobutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Waiting for WMI job: {'InstanceID': '9026FD7E-FB45-41FD-90D9-86085DCB4A9D', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19666), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:56:45.513 4088 3038341575960 MainThread DEBUG nova.compute.manager [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:56:45.538 4088 3038341575960 MainThread INFO nova.virt.hyperv.vmops [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Spawning new instance 2021-09-10 16:56:45.553 4088 3038341021768 MainThread DEBUG os_win.utils.jobutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] WMI job succeeded: {'InstanceID': '9026FD7E-FB45-41FD-90D9-86085DCB4A9D', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=101426), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:56:45.553 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Lock "instance-0000002c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:45.553 4088 3038341021768 MainThread DEBUG os_win.utils.pathutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Removing directory: C:\openstack\instances\instance-0000002c check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:56:45.553 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Lock "instance-0000002c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:45.553 4088 3038341021768 MainThread ERROR nova.compute.manager [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002c' failed to start. Not enough memory in the system to start the virtual machine instance-0000002c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002c' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Not enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) 'instance-0000002c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Error code: 32778. 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] Traceback (most recent call last): 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] return function(*args, **kwargs) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] admin_password, network_info, block_device_info) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] return function(self, *args, **kwds) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self.force_reraise() 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] raise self.value 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] should_plug_vifs=False) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 'req_state': req_state}) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self.force_reraise() 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] raise self.value 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] time.sleep(sleep_time) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self.force_reraise() 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] raise self.value 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] return f(*args, **kwargs) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] return self._wait_for_job(job_path) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] error_desc=err_desc) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000002c' failed to start. 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] Not enough memory in the system to start the virtual machine instance-0000002c. 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002c' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] Not enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 'instance-0000002c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Error code: 32778. 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] During handling of the above exception, another exception occurred: 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] Traceback (most recent call last): 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] yield resources 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] accel_info=accel_info) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] return function(*args, **kwargs) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] admin_password, network_info, block_device_info) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] return function(self, *args, **kwds) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self.force_reraise() 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] raise self.value 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] should_plug_vifs=False) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 'req_state': req_state}) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self.force_reraise() 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] raise self.value 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] time.sleep(sleep_time) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self.force_reraise() 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] raise self.value 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] return f(*args, **kwargs) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] return self._wait_for_job(job_path) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] error_desc=err_desc) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002c' failed to start. 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] Not enough memory in the system to start the virtual machine instance-0000002c. 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002c' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] Not enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 'instance-0000002c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Error code: 32778. 2021-09-10 16:56:45.553 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.553 4088 3038341021768 MainThread INFO nova.compute.manager [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Terminating instance 2021-09-10 16:56:45.553 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:56:45.553 4088 3038341021768 MainThread INFO nova.virt.hyperv.vmops [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Got request to destroy instance 2021-09-10 16:56:45.553 4088 3038341575960 MainThread DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-0000002e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:45.553 4088 3038341575960 MainThread DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-0000002e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:45.553 4088 3038341575960 MainThread DEBUG nova.block_device [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:56:45.553 4088 3038341575960 MainThread DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:45.553 4088 3038341575960 MainThread DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:45.577 4088 3038341575960 MainThread DEBUG os_win.utils.pathutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Creating directory: C:\openstack\instances\instance-0000002e check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:56:45.577 4088 3038341575960 MainThread DEBUG nova.virt.hyperv.vmops [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000002e\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:56:45.577 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.vmops [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:56:45.577 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Lock "instance-0000002c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:45.577 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Lock "instance-0000002c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:45.577 4088 3038341021768 MainThread INFO nova.compute.manager [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Took 0.01 seconds to destroy the instance on the hypervisor. 2021-09-10 16:56:45.577 4088 3038341021768 MainThread DEBUG nova.compute.claims [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:56:45.588 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:45.680 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.hostops [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:56:45.705 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.hostops [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:56:45.810 4088 3038342145304 GreenThread-37 DEBUG nova.policy [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd33d11497a91483d93fe0ed8f5c26603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc5deaa89294889821f303976e2d776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:56:45.835 4088 3038341575960 MainThread DEBUG nova.virt.hyperv.vmops [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Resizing VHD C:\openstack\instances\instance-0000002e\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:56:45.929 4088 3038341021768 MainThread DEBUG nova.compute.provider_tree [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:56:45.949 4088 3038341021768 MainThread DEBUG nova.scheduler.client.report [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:56:45.949 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.359s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:45.960 4088 3038341021768 MainThread ERROR nova.compute.manager [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002c' failed to start. Not enough memory in the system to start the virtual machine instance-0000002c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002c' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Not enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) 'instance-0000002c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Error code: 32778. 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] Traceback (most recent call last): 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] return function(*args, **kwargs) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] admin_password, network_info, block_device_info) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] return function(self, *args, **kwds) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self.force_reraise() 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] raise self.value 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] should_plug_vifs=False) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 'req_state': req_state}) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self.force_reraise() 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] raise self.value 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] time.sleep(sleep_time) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self.force_reraise() 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] raise self.value 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] return f(*args, **kwargs) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] return self._wait_for_job(job_path) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] error_desc=err_desc) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000002c' failed to start. 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] Not enough memory in the system to start the virtual machine instance-0000002c. 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002c' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] Not enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 'instance-0000002c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Error code: 32778. 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] During handling of the above exception, another exception occurred: 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] Traceback (most recent call last): 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] accel_info=accel_info) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] return function(*args, **kwargs) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] admin_password, network_info, block_device_info) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] return function(self, *args, **kwds) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self.force_reraise() 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] raise self.value 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] should_plug_vifs=False) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 'req_state': req_state}) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self.force_reraise() 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] raise self.value 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] time.sleep(sleep_time) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self.force_reraise() 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] raise self.value 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] return f(*args, **kwargs) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] return self._wait_for_job(job_path) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] error_desc=err_desc) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002c' failed to start. 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] Not enough memory in the system to start the virtual machine instance-0000002c. 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002c' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] Not enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 'instance-0000002c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Error code: 32778. 2021-09-10 16:56:45.960 4088 3038341021768 MainThread TRACE nova.compute.manager [instance: f8bc590e-89bd-458c-bef5-74846b896168] 2021-09-10 16:56:45.960 4088 3038341021768 MainThread DEBUG nova.compute.utils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] WMI job failed with status 10. Error summary description: 'instance-0000002c' failed to start. Not enough memory in the system to start the virtual machine instance-0000002c. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:56:45.960 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Build of instance f8bc590e-89bd-458c-bef5-74846b896168 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000002c' failed to start. Not enough memory in the system to start the virtual machine instance-0000002c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002c' failed to start. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Not enough memory in the system to start the virtual machine instance-0000002c with ram size 1024 megabytes. (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) 'instance-0000002c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 444531C6-67E1-4114-8978-DF700B54BE8B) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:56:45.960 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:56:45.960 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:56:45.960 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:56:45.960 4088 3038341021768 MainThread DEBUG nova.network.neutron [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:56:46.680 4088 3038341021768 MainThread DEBUG nova.network.neutron [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:56:46.694 4088 3038341021768 MainThread INFO nova.compute.manager [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] [instance: f8bc590e-89bd-458c-bef5-74846b896168] Took 0.73 seconds to deallocate network for instance. 2021-09-10 16:56:46.857 4088 3038341021768 MainThread INFO nova.scheduler.client.report [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Deleted allocations for instance f8bc590e-89bd-458c-bef5-74846b896168 2021-09-10 16:56:46.913 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [req-9fdce9d4-9a7e-4be2-81fb-f1d18be9b084 bc0a11d23457425dafaa2590cadb3647 26fab39a080a41888182e794dd32878e - default default] Lock "f8bc590e-89bd-458c-bef5-74846b896168" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 30.359s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:46.913 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "f8bc590e-89bd-458c-bef5-74846b896168" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 13.953s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:46.913 4088 3038342145480 MainThread INFO nova.compute.manager [-] [instance: f8bc590e-89bd-458c-bef5-74846b896168] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:56:46.913 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "f8bc590e-89bd-458c-bef5-74846b896168" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:47.273 4088 3038342145304 GreenThread-37 DEBUG nova.network.neutron [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Successfully created port: a20ae8a0-3789-45cd-a39a-82f4e2e72cf6 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:56:49.185 4088 3038342145304 GreenThread-37 DEBUG nova.network.neutron [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Successfully updated port: a20ae8a0-3789-45cd-a39a-82f4e2e72cf6 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:56:49.262 4088 3038342145304 GreenThread-37 DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Acquired lock "refresh_cache-7e8913a3-2544-4f11-9354-908856f92cec" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:56:49.277 4088 3038342145304 GreenThread-37 DEBUG nova.network.neutron [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:56:49.553 4088 3038342145304 GreenThread-37 DEBUG nova.network.neutron [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:56:49.616 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-aa7ee71e-248d-4d15-8436-94f83f9e02ac 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Received event network-changed-a20ae8a0-3789-45cd-a39a-82f4e2e72cf6 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:56:49.616 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-aa7ee71e-248d-4d15-8436-94f83f9e02ac 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Refreshing instance network info cache due to event network-changed-a20ae8a0-3789-45cd-a39a-82f4e2e72cf6. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:56:50.611 4088 3038342145304 GreenThread-37 DEBUG nova.network.neutron [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Updating instance_info_cache with network_info: [{"id": "a20ae8a0-3789-45cd-a39a-82f4e2e72cf6", "address": "fa:16:3e:53:18:59", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa20ae8a0-37", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:56:50.622 4088 3038342145304 GreenThread-37 DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Releasing lock "refresh_cache-7e8913a3-2544-4f11-9354-908856f92cec" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:56:50.622 4088 3038342145304 GreenThread-37 DEBUG nova.compute.manager [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Instance network_info: |[{"id": "a20ae8a0-3789-45cd-a39a-82f4e2e72cf6", "address": "fa:16:3e:53:18:59", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa20ae8a0-37", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:56:50.622 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-aa7ee71e-248d-4d15-8436-94f83f9e02ac 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-7e8913a3-2544-4f11-9354-908856f92cec" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:56:50.622 4088 3038342145480 MainThread DEBUG nova.network.neutron [req-aa7ee71e-248d-4d15-8436-94f83f9e02ac 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Refreshing network info cache for port a20ae8a0-3789-45cd-a39a-82f4e2e72cf6 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:56:50.622 4088 3038341575960 MainThread DEBUG nova.compute.manager [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Preparing to wait for external event network-vif-plugged-a20ae8a0-3789-45cd-a39a-82f4e2e72cf6 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:56:50.622 4088 3038341575960 MainThread DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "7e8913a3-2544-4f11-9354-908856f92cec-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:50.622 4088 3038341575960 MainThread DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "7e8913a3-2544-4f11-9354-908856f92cec-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:50.646 4088 3038341575960 MainThread DEBUG os_win.utils.compute.vmutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Creating VM instance-0000002e create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:56:51.576 4088 3038342145480 MainThread DEBUG nova.network.neutron [req-aa7ee71e-248d-4d15-8436-94f83f9e02ac 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Updated VIF entry in instance network info cache for port a20ae8a0-3789-45cd-a39a-82f4e2e72cf6. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:56:51.589 4088 3038342145480 MainThread DEBUG nova.network.neutron [req-aa7ee71e-248d-4d15-8436-94f83f9e02ac 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Updating instance_info_cache with network_info: [{"id": "a20ae8a0-3789-45cd-a39a-82f4e2e72cf6", "address": "fa:16:3e:53:18:59", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa20ae8a0-37", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:56:51.617 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-aa7ee71e-248d-4d15-8436-94f83f9e02ac 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-7e8913a3-2544-4f11-9354-908856f92cec" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:56:52.492 4088 3038341575960 MainThread DEBUG nova.virt.hyperv.vmops [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:56:56.460 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Lock "a1386320-87c7-493d-a393-4e590b06faa0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:56.492 4088 3038341024232 MainThread DEBUG nova.compute.manager [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:56:56.601 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:56.601 4088 3038341024232 MainThread DEBUG nova.virt.hardware [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:56:56.601 4088 3038341024232 MainThread INFO nova.compute.claims [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Claim successful on node n-h2-808474-1 2021-09-10 16:56:56.869 4088 3038341024232 MainThread DEBUG nova.virt.hyperv.hostops [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:56:56.896 4088 3038341024232 MainThread DEBUG nova.virt.hyperv.hostops [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:56:57.115 4088 3038341024232 MainThread DEBUG nova.compute.provider_tree [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:56:57.138 4088 3038341024232 MainThread DEBUG nova.scheduler.client.report [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:56:57.138 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:57.138 4088 3038341024232 MainThread DEBUG nova.compute.manager [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:56:57.240 4088 3038341024232 MainThread DEBUG nova.compute.manager [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:56:57.240 4088 3038341021768 GreenThread-38 DEBUG nova.compute.manager [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:56:57.240 4088 3038341021768 GreenThread-38 DEBUG nova.network.neutron [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:56:57.483 4088 3038341024232 MainThread DEBUG nova.compute.manager [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:56:57.498 4088 3038341024232 MainThread INFO nova.virt.hyperv.vmops [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Spawning new instance 2021-09-10 16:56:57.512 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Lock "instance-00000030" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:57.512 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Lock "instance-00000030" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:57.512 4088 3038341024232 MainThread DEBUG nova.block_device [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:56:57.512 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:57.512 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:57.512 4088 3038341024232 MainThread DEBUG os_win.utils.pathutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Creating directory: C:\openstack\instances\instance-00000030 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:56:57.512 4088 3038341024232 MainThread DEBUG nova.virt.hyperv.vmops [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000030\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:56:57.716 4088 3038341021768 GreenThread-38 DEBUG nova.policy [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6076248095044dcbd42424ad33c0395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113aff5a9ed47f5bdb3bdee01c77f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:56:57.788 4088 3038341024232 MainThread DEBUG nova.virt.hyperv.vmops [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Resizing VHD C:\openstack\instances\instance-00000030\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:56:59.615 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "a5380419-a846-48fc-891c-d88dc8215cfd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:59.630 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:56:59.710 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:59.740 4088 3038342256424 MainThread DEBUG nova.virt.hardware [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:56:59.740 4088 3038342256424 MainThread INFO nova.compute.claims [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Claim successful on node n-h2-808474-1 2021-09-10 16:56:59.872 4088 3038342256248 MainThread DEBUG nova.compute.manager [req-05c532d8-f886-4581-876e-eccf6130e526 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Received event network-vif-plugged-a20ae8a0-3789-45cd-a39a-82f4e2e72cf6 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:56:59.872 4088 3038342256248 MainThread DEBUG oslo_concurrency.lockutils [req-05c532d8-f886-4581-876e-eccf6130e526 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "7e8913a3-2544-4f11-9354-908856f92cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:56:59.872 4088 3038342256248 MainThread DEBUG oslo_concurrency.lockutils [req-05c532d8-f886-4581-876e-eccf6130e526 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "7e8913a3-2544-4f11-9354-908856f92cec-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:56:59.872 4088 3038342256248 MainThread DEBUG nova.compute.manager [req-05c532d8-f886-4581-876e-eccf6130e526 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Processing event network-vif-plugged-a20ae8a0-3789-45cd-a39a-82f4e2e72cf6 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:56:59.889 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.hostops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:56:59.917 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.hostops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:56:59.935 4088 3038341575960 MainThread INFO nova.virt.hyperv.vmops [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Using config drive for instance 2021-09-10 16:57:00.057 4088 3038341021768 GreenThread-38 DEBUG nova.network.neutron [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Successfully created port: 62591796-4fe6-4966-af18-6050acde8c5e _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:57:00.163 4088 3038341575960 MainThread INFO nova.virt.hyperv.vmops [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Creating config drive at C:\openstack\instances\instance-0000002e\configdrive.iso 2021-09-10 16:57:00.262 4088 3038341575960 MainThread DEBUG oslo_concurrency.processutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000002e\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpu5edwr7r execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:57:00.403 4088 3038342256424 MainThread DEBUG nova.compute.provider_tree [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:57:00.403 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-848e4b3c-a971-4f75-bda1-5c27ba3b5f0f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Received event network-vif-deleted-340a8a65-2d59-45c8-9a7d-18033bd9bbe8 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:57:00.427 4088 3038342256424 MainThread DEBUG nova.scheduler.client.report [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:57:00.427 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.719s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:00.432 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:57:00.513 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:57:00.529 4088 3038342256952 GreenThread-39 DEBUG nova.compute.manager [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:57:00.529 4088 3038342256952 GreenThread-39 DEBUG nova.network.neutron [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:57:00.590 4088 3038341575960 MainThread DEBUG oslo_concurrency.processutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000002e\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpu5edwr7r" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:57:00.650 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:57:00.685 4088 3038342256424 MainThread INFO nova.virt.hyperv.vmops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Spawning new instance 2021-09-10 16:57:00.693 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "instance-0000002f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:00.693 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "instance-0000002f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:00.693 4088 3038342256424 MainThread DEBUG nova.block_device [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:57:00.693 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:00.693 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:00.712 4088 3038342256424 MainThread DEBUG os_win.utils.pathutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Creating directory: C:\openstack\instances\instance-0000002f check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:57:00.712 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.vmops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000002f\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:57:00.726 4088 3038342256952 GreenThread-39 DEBUG nova.policy [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73ac9100b70e4fa1b6ad7751b223e5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778686f367c642f39349bb208103a3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:57:00.937 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.vmops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Resizing VHD C:\openstack\instances\instance-0000002f\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:57:01.116 4088 3038341575960 MainThread DEBUG nova.virt.hyperv.vmops [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Setting boot order for instance: instance-0000002e: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:57:01.216 4088 3038341575960 MainThread DEBUG nova.virt.hyperv.vmops [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:57:01.242 4088 3038341575960 MainThread DEBUG os_win.utils.jobutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': '2FAB5CBA-5C81-4E28-B79C-DA24EF331E4F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14681), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:01.387 4088 3038341575960 MainThread ERROR os_win.utils.jobutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002e\' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)instance-0000002eE15509B5-74C6-4C34-AB04-360C37621AEA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)instance-0000002eE15509B5-74C6-4C34-AB04-360C37621AEA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)instance-0000002eE15509B5-74C6-4C34-AB04-360C37621AEA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '2FAB5CBA-5C81-4E28-B79C-DA24EF331E4F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114100), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 1), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 1), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002e' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)\n\nNot enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)\n\n'instance-0000002e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)", 'ErrorSummaryDescription': "'instance-0000002e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:01.387 4088 3038341575960 MainThread DEBUG os_win._utils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002e' failed to start. Not enough memory in the system to start the virtual machine instance-0000002e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002e' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Not enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) 'instance-0000002e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.17064905166625977 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:01.435 4088 3038342256776 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:01.435 4088 3038342256776 MainThread INFO nova.compute.manager [-] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] VM Stopped (Lifecycle Event) 2021-09-10 16:57:01.435 4088 3038342256248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:01.435 4088 3038342256248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:01.466 4088 3038342256776 MainThread DEBUG nova.compute.manager [req-223bf187-5efb-4204-b4f5-587734204367 - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:01.466 4088 3038342256776 MainThread DEBUG nova.virt.hyperv.vmops [req-223bf187-5efb-4204-b4f5-587734204367 - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:01.524 4088 3038342256776 MainThread DEBUG nova.compute.manager [req-223bf187-5efb-4204-b4f5-587734204367 - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:01.552 4088 3038342256776 MainThread INFO nova.compute.manager [req-223bf187-5efb-4204-b4f5-587734204367 - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:01.670 4088 3038342256952 GreenThread-39 DEBUG nova.network.neutron [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Successfully created port: 8201c931-a835-4ff8-ac41-cda2c95c6f72 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:57:01.778 4088 3038341021768 GreenThread-38 DEBUG nova.network.neutron [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Successfully updated port: 62591796-4fe6-4966-af18-6050acde8c5e _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:57:01.804 4088 3038341021768 GreenThread-38 DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Acquired lock "refresh_cache-a1386320-87c7-493d-a393-4e590b06faa0" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:57:01.804 4088 3038341021768 GreenThread-38 DEBUG nova.network.neutron [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:57:01.997 4088 3038341021768 GreenThread-38 DEBUG nova.network.neutron [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:57:02.412 4088 3038341575960 MainThread DEBUG os_win.utils.jobutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': '561CB4CB-CF7A-4862-8A20-89B04B11BACD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16713), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:02.464 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-9aac6d64-a215-47ac-b0fc-838e99c7dc35 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Received event network-changed-62591796-4fe6-4966-af18-6050acde8c5e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:57:02.464 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-9aac6d64-a215-47ac-b0fc-838e99c7dc35 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Refreshing instance network info cache due to event network-changed-62591796-4fe6-4966-af18-6050acde8c5e. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:57:02.619 4088 3038342256600 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:02.619 4088 3038342256600 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:02.619 4088 3038342256776 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:02.619 4088 3038342256776 MainThread INFO nova.compute.manager [-] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] VM Stopped (Lifecycle Event) 2021-09-10 16:57:02.639 4088 3038342256776 MainThread DEBUG nova.compute.manager [req-7eb4e046-0079-4fec-a83f-110a836e2a87 - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:02.639 4088 3038342256776 MainThread DEBUG nova.virt.hyperv.vmops [req-7eb4e046-0079-4fec-a83f-110a836e2a87 - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:02.669 4088 3038341021768 GreenThread-38 DEBUG nova.network.neutron [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Updating instance_info_cache with network_info: [{"id": "62591796-4fe6-4966-af18-6050acde8c5e", "address": "fa:16:3e:23:50:c6", "network": {"id": "f10caebc-9a04-4a48-a217-b55195b3ed60", "bridge": null, "label": "tempest-InstanceActionsNegativeTestJSON-271879686-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2113aff5a9ed47f5bdb3bdee01c77f67", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap62591796-4f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:57:02.669 4088 3038341575960 MainThread ERROR os_win.utils.jobutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002e\' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)instance-0000002eE15509B5-74C6-4C34-AB04-360C37621AEA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)instance-0000002eE15509B5-74C6-4C34-AB04-360C37621AEA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)instance-0000002eE15509B5-74C6-4C34-AB04-360C37621AEA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '561CB4CB-CF7A-4862-8A20-89B04B11BACD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=131269), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 2), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 2), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002e' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)\n\nNot enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)\n\n'instance-0000002e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)", 'ErrorSummaryDescription': "'instance-0000002e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:02.669 4088 3038341575960 MainThread DEBUG os_win._utils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002e' failed to start. Not enough memory in the system to start the virtual machine instance-0000002e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002e' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Not enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) 'instance-0000002e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.452756404876709 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:02.695 4088 3038342256776 MainThread DEBUG nova.compute.manager [req-7eb4e046-0079-4fec-a83f-110a836e2a87 - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:02.695 4088 3038341021768 GreenThread-38 DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Releasing lock "refresh_cache-a1386320-87c7-493d-a393-4e590b06faa0" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:57:02.695 4088 3038341021768 GreenThread-38 DEBUG nova.compute.manager [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Instance network_info: |[{"id": "62591796-4fe6-4966-af18-6050acde8c5e", "address": "fa:16:3e:23:50:c6", "network": {"id": "f10caebc-9a04-4a48-a217-b55195b3ed60", "bridge": null, "label": "tempest-InstanceActionsNegativeTestJSON-271879686-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2113aff5a9ed47f5bdb3bdee01c77f67", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap62591796-4f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:57:02.695 4088 3038341024232 MainThread DEBUG nova.compute.manager [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Preparing to wait for external event network-vif-plugged-62591796-4fe6-4966-af18-6050acde8c5e prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:57:02.695 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Lock "a1386320-87c7-493d-a393-4e590b06faa0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:02.695 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Lock "a1386320-87c7-493d-a393-4e590b06faa0-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:02.695 4088 3038341024232 MainThread DEBUG os_win.utils.compute.vmutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Creating VM instance-00000030 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:57:02.695 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-9aac6d64-a215-47ac-b0fc-838e99c7dc35 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-a1386320-87c7-493d-a393-4e590b06faa0" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:57:02.695 4088 3038340847048 MainThread DEBUG nova.network.neutron [req-9aac6d64-a215-47ac-b0fc-838e99c7dc35 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Refreshing network info cache for port 62591796-4fe6-4966-af18-6050acde8c5e _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:57:02.744 4088 3038342256776 MainThread INFO nova.compute.manager [req-7eb4e046-0079-4fec-a83f-110a836e2a87 - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:02.884 4088 3038342256952 GreenThread-39 DEBUG nova.network.neutron [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Successfully created port: 9f2f40d5-ee1e-4dfa-87fc-991a62887600 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:57:03.679 4088 3038341575960 MainThread DEBUG os_win.utils.jobutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': '7AB4E099-9347-4462-849B-A4AD93ED9B3F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17258), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:03.819 4088 3038341575960 MainThread ERROR os_win.utils.jobutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002e\' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)instance-0000002eE15509B5-74C6-4C34-AB04-360C37621AEA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)instance-0000002eE15509B5-74C6-4C34-AB04-360C37621AEA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)instance-0000002eE15509B5-74C6-4C34-AB04-360C37621AEA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7AB4E099-9347-4462-849B-A4AD93ED9B3F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118236), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 3), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002e' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)\n\nNot enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)\n\n'instance-0000002e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)", 'ErrorSummaryDescription': "'instance-0000002e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:03.819 4088 3038341575960 MainThread DEBUG os_win._utils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002e' failed to start. Not enough memory in the system to start the virtual machine instance-0000002e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002e' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Not enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) 'instance-0000002e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.6025047302246094 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:03.912 4088 3038342256952 GreenThread-39 DEBUG nova.network.neutron [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Successfully updated port: 8201c931-a835-4ff8-ac41-cda2c95c6f72 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:57:04.170 4088 3038340847048 MainThread DEBUG nova.network.neutron [req-9aac6d64-a215-47ac-b0fc-838e99c7dc35 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Updated VIF entry in instance network info cache for port 62591796-4fe6-4966-af18-6050acde8c5e. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:57:04.170 4088 3038340847048 MainThread DEBUG nova.network.neutron [req-9aac6d64-a215-47ac-b0fc-838e99c7dc35 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Updating instance_info_cache with network_info: [{"id": "62591796-4fe6-4966-af18-6050acde8c5e", "address": "fa:16:3e:23:50:c6", "network": {"id": "f10caebc-9a04-4a48-a217-b55195b3ed60", "bridge": null, "label": "tempest-InstanceActionsNegativeTestJSON-271879686-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2113aff5a9ed47f5bdb3bdee01c77f67", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap62591796-4f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:57:04.197 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-9aac6d64-a215-47ac-b0fc-838e99c7dc35 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-a1386320-87c7-493d-a393-4e590b06faa0" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:57:04.471 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-0b53b7e8-4b0e-42ee-a916-4ed67d691466 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Received event network-changed-8201c931-a835-4ff8-ac41-cda2c95c6f72 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:57:04.471 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-0b53b7e8-4b0e-42ee-a916-4ed67d691466 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Refreshing instance network info cache due to event network-changed-8201c931-a835-4ff8-ac41-cda2c95c6f72. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:57:04.471 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-0b53b7e8-4b0e-42ee-a916-4ed67d691466 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-a5380419-a846-48fc-891c-d88dc8215cfd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:57:04.471 4088 3038340847048 MainThread DEBUG nova.network.neutron [req-0b53b7e8-4b0e-42ee-a916-4ed67d691466 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Refreshing network info cache for port 8201c931-a835-4ff8-ac41-cda2c95c6f72 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:57:04.539 4088 3038340847048 MainThread DEBUG nova.network.neutron [req-0b53b7e8-4b0e-42ee-a916-4ed67d691466 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:57:04.561 4088 3038341024232 MainThread DEBUG nova.virt.hyperv.vmops [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:57:04.837 4088 3038340847048 MainThread DEBUG nova.network.neutron [req-0b53b7e8-4b0e-42ee-a916-4ed67d691466 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:57:04.837 4088 3038341575960 MainThread DEBUG os_win.utils.jobutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': '282061FD-5B31-452D-B9B2-D0F9C9596476', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20455), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:04.855 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-0b53b7e8-4b0e-42ee-a916-4ed67d691466 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-a5380419-a846-48fc-891c-d88dc8215cfd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:57:05.047 4088 3038340847048 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:05.047 4088 3038340847048 MainThread INFO nova.compute.manager [-] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] VM Stopped (Lifecycle Event) 2021-09-10 16:57:05.047 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:05.047 4088 3038341021768 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:05.084 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-ffc4b589-fd12-4ffd-b124-382930bc6196 - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:05.084 4088 3038340847048 MainThread DEBUG nova.virt.hyperv.vmops [req-ffc4b589-fd12-4ffd-b124-382930bc6196 - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:05.084 4088 3038341575960 MainThread ERROR os_win.utils.jobutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002e\' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)instance-0000002eE15509B5-74C6-4C34-AB04-360C37621AEA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)instance-0000002eE15509B5-74C6-4C34-AB04-360C37621AEA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)instance-0000002eE15509B5-74C6-4C34-AB04-360C37621AEA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '282061FD-5B31-452D-B9B2-D0F9C9596476', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=127544), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 4), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002e' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)\n\nNot enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)\n\n'instance-0000002e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)", 'ErrorSummaryDescription': "'instance-0000002e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:05.084 4088 3038341575960 MainThread DEBUG os_win._utils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002e' failed to start. Not enough memory in the system to start the virtual machine instance-0000002e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002e' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Not enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) 'instance-0000002e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.868149757385254 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:05.134 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-ffc4b589-fd12-4ffd-b124-382930bc6196 - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:05.170 4088 3038340847048 MainThread INFO nova.compute.manager [req-ffc4b589-fd12-4ffd-b124-382930bc6196 - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:05.847 4088 3038342256952 GreenThread-39 DEBUG nova.network.neutron [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Successfully updated port: 9f2f40d5-ee1e-4dfa-87fc-991a62887600 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:57:05.854 4088 3038342256952 GreenThread-39 DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Acquired lock "refresh_cache-a5380419-a846-48fc-891c-d88dc8215cfd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:57:05.854 4088 3038342256952 GreenThread-39 DEBUG nova.network.neutron [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:57:06.024 4088 3038342256952 GreenThread-39 DEBUG nova.network.neutron [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:57:06.117 4088 3038341575960 MainThread DEBUG os_win.utils.jobutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': 'B57DB1BA-D193-4A0F-977F-0F6501D0F7E7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17711), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:06.272 4088 3038341575960 MainThread ERROR os_win.utils.jobutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002e\' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)instance-0000002eE15509B5-74C6-4C34-AB04-360C37621AEA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)instance-0000002eE15509B5-74C6-4C34-AB04-360C37621AEA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)instance-0000002eE15509B5-74C6-4C34-AB04-360C37621AEA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B57DB1BA-D193-4A0F-977F-0F6501D0F7E7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=122900), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 6), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 6), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002e' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)\n\nNot enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)\n\n'instance-0000002e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)", 'ErrorSummaryDescription': "'instance-0000002e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:06.272 4088 3038341575960 MainThread DEBUG os_win._utils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002e' failed to start. Not enough memory in the system to start the virtual machine instance-0000002e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002e' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Not enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) 'instance-0000002e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.055757999420166 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:06.303 4088 3038340847048 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:06.303 4088 3038340847048 MainThread INFO nova.compute.manager [-] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] VM Stopped (Lifecycle Event) 2021-09-10 16:57:06.321 4088 3038342257128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:06.321 4088 3038342257128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:06.336 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-d7c390cd-8a8e-4032-b05d-3a4190758cdc - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:06.336 4088 3038340847048 MainThread DEBUG nova.virt.hyperv.vmops [req-d7c390cd-8a8e-4032-b05d-3a4190758cdc - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:06.391 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-d7c390cd-8a8e-4032-b05d-3a4190758cdc - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:06.430 4088 3038340847048 MainThread INFO nova.compute.manager [req-d7c390cd-8a8e-4032-b05d-3a4190758cdc - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:07.211 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-32e4925a-7862-43fa-958d-0e0997ff5d6b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Received event network-changed-9f2f40d5-ee1e-4dfa-87fc-991a62887600 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:57:07.211 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-32e4925a-7862-43fa-958d-0e0997ff5d6b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Refreshing instance network info cache due to event network-changed-9f2f40d5-ee1e-4dfa-87fc-991a62887600. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:57:07.342 4088 3038341575960 MainThread DEBUG os_win.utils.jobutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': 'B97A1FCA-111D-4A4F-96A8-2F241E8A893F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19485), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:07.569 4088 3038342257128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:07.569 4088 3038342257128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:07.569 4088 3038342256776 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:07.569 4088 3038342256776 MainThread INFO nova.compute.manager [-] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] VM Stopped (Lifecycle Event) 2021-09-10 16:57:07.617 4088 3038341575960 MainThread ERROR os_win.utils.jobutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002e\' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)instance-0000002eE15509B5-74C6-4C34-AB04-360C37621AEA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)instance-0000002eE15509B5-74C6-4C34-AB04-360C37621AEA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)instance-0000002eE15509B5-74C6-4C34-AB04-360C37621AEA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B97A1FCA-111D-4A4F-96A8-2F241E8A893F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=148540), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 7), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002e' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)\n\nNot enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)\n\n'instance-0000002e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA)", 'ErrorSummaryDescription': "'instance-0000002e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:07.617 4088 3038341575960 MainThread ERROR nova.virt.hyperv.vmops [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Failed to change vm state of instance-0000002e to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000002e' failed to start. 2021-09-10 16:57:07.617 4088 3038341575960 MainThread INFO nova.virt.hyperv.vmops [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Got request to destroy instance 2021-09-10 16:57:07.649 4088 3038342256776 MainThread DEBUG nova.compute.manager [req-a895e1f9-749f-45c1-9625-9239be0f74fe - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:07.649 4088 3038342256776 MainThread DEBUG nova.virt.hyperv.vmops [req-a895e1f9-749f-45c1-9625-9239be0f74fe - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:07.712 4088 3038342256776 MainThread DEBUG nova.compute.manager [req-a895e1f9-749f-45c1-9625-9239be0f74fe - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:07.724 4088 3038342256776 MainThread INFO nova.compute.manager [req-a895e1f9-749f-45c1-9625-9239be0f74fe - - - - -] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:07.802 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Lock "8636793a-b94f-447d-a53a-4506e8a3032f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:07.836 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:57:07.929 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:07.929 4088 3038342257832 MainThread DEBUG nova.virt.hardware [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:57:07.929 4088 3038342257832 MainThread INFO nova.compute.claims [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Claim successful on node n-h2-808474-1 2021-09-10 16:57:08.052 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.hostops [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:57:08.071 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.hostops [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:57:08.350 4088 3038342257832 MainThread DEBUG nova.compute.provider_tree [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:57:08.350 4088 3038342257832 MainThread DEBUG nova.scheduler.client.report [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:57:08.350 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:08.350 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:57:08.478 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:57:08.494 4088 3038342257656 GreenThread-40 DEBUG nova.compute.manager [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:57:08.494 4088 3038342257656 GreenThread-40 DEBUG nova.network.neutron [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:57:08.538 4088 3038342256952 GreenThread-39 DEBUG nova.network.neutron [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Updating instance_info_cache with network_info: [{"id": "8201c931-a835-4ff8-ac41-cda2c95c6f72", "address": "fa:16:3e:13:11:8f", "network": {"id": "4a075669-fa85-4572-a624-6452ab88ff78", "bridge": null, "label": "tempest-ServersTestMultiNic-1116835284", "subnets": [{"cidr": "19.80.0.0/24", "dns": [], "gateway": {"address": "19.80.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "19.80.0.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "19.80.0.2"}}], "meta": {"injected": false, "tenant_id": "778686f367c642f39349bb208103a3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8201c931-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f2f40d5-ee1e-4dfa-87fc-991a62887600", "address": "fa:16:3e:6c:7a:c1", "network": {"id": "3d66e9cf-4851-479f-b109-f0549cb5725c", "bridge": null, "label": "tempest-ServersTestMultiNic-33965206", "subnets": [{"cidr": "19.86.0.0/24", "dns": [], "gateway": {"address": "19.86.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "19.86.0.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "19.86.0.2"}}], "meta": {"injected": false, "tenant_id": "778686f367c642f39349bb208103a3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9f2f40d5-ee", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:57:08.570 4088 3038342256952 GreenThread-39 DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Releasing lock "refresh_cache-a5380419-a846-48fc-891c-d88dc8215cfd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:57:08.570 4088 3038342256952 GreenThread-39 DEBUG nova.compute.manager [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Instance network_info: |[{"id": "8201c931-a835-4ff8-ac41-cda2c95c6f72", "address": "fa:16:3e:13:11:8f", "network": {"id": "4a075669-fa85-4572-a624-6452ab88ff78", "bridge": null, "label": "tempest-ServersTestMultiNic-1116835284", "subnets": [{"cidr": "19.80.0.0/24", "dns": [], "gateway": {"address": "19.80.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "19.80.0.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "19.80.0.2"}}], "meta": {"injected": false, "tenant_id": "778686f367c642f39349bb208103a3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8201c931-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f2f40d5-ee1e-4dfa-87fc-991a62887600", "address": "fa:16:3e:6c:7a:c1", "network": {"id": "3d66e9cf-4851-479f-b109-f0549cb5725c", "bridge": null, "label": "tempest-ServersTestMultiNic-33965206", "subnets": [{"cidr": "19.86.0.0/24", "dns": [], "gateway": {"address": "19.86.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "19.86.0.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "19.86.0.2"}}], "meta": {"injected": false, "tenant_id": "778686f367c642f39349bb208103a3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9f2f40d5-ee", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:57:08.570 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Preparing to wait for external event network-vif-plugged-8201c931-a835-4ff8-ac41-cda2c95c6f72 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:57:08.570 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "a5380419-a846-48fc-891c-d88dc8215cfd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:08.570 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "a5380419-a846-48fc-891c-d88dc8215cfd-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:08.570 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Preparing to wait for external event network-vif-plugged-9f2f40d5-ee1e-4dfa-87fc-991a62887600 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:57:08.570 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "a5380419-a846-48fc-891c-d88dc8215cfd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:08.570 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "a5380419-a846-48fc-891c-d88dc8215cfd-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:08.570 4088 3038342256424 MainThread DEBUG os_win.utils.compute.vmutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Creating VM instance-0000002f create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:57:08.570 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-32e4925a-7862-43fa-958d-0e0997ff5d6b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-a5380419-a846-48fc-891c-d88dc8215cfd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:57:08.570 4088 3038340847048 MainThread DEBUG nova.network.neutron [req-32e4925a-7862-43fa-958d-0e0997ff5d6b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Refreshing network info cache for port 9f2f40d5-ee1e-4dfa-87fc-991a62887600 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:57:08.648 4088 3038342257656 GreenThread-40 DEBUG nova.policy [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52b9f83ffb604b3388b2c32b65a2e8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36daecbd54a4138802bd46bc59ade0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:57:08.648 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:57:08.694 4088 3038342257832 MainThread INFO nova.virt.hyperv.vmops [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Spawning new instance 2021-09-10 16:57:08.709 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Lock "instance-00000031" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:08.709 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Lock "instance-00000031" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:08.709 4088 3038342257832 MainThread DEBUG nova.block_device [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:57:08.709 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:08.709 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:08.709 4088 3038342257832 MainThread DEBUG os_win.utils.pathutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Creating directory: C:\openstack\instances\instance-00000031 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:57:08.709 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000031\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:57:09.005 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Resizing VHD C:\openstack\instances\instance-00000031\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:57:09.383 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-fe587d13-1e14-42d4-b3aa-c868e09fb411 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Received event network-vif-deleted-99378947-24eb-49f1-b530-d2511c924e32 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:57:09.452 4088 3038340847048 MainThread DEBUG nova.network.neutron [req-32e4925a-7862-43fa-958d-0e0997ff5d6b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Updated VIF entry in instance network info cache for port 9f2f40d5-ee1e-4dfa-87fc-991a62887600. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:57:09.452 4088 3038340847048 MainThread DEBUG nova.network.neutron [req-32e4925a-7862-43fa-958d-0e0997ff5d6b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Updating instance_info_cache with network_info: [{"id": "8201c931-a835-4ff8-ac41-cda2c95c6f72", "address": "fa:16:3e:13:11:8f", "network": {"id": "4a075669-fa85-4572-a624-6452ab88ff78", "bridge": null, "label": "tempest-ServersTestMultiNic-1116835284", "subnets": [{"cidr": "19.80.0.0/24", "dns": [], "gateway": {"address": "19.80.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "19.80.0.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "19.80.0.2"}}], "meta": {"injected": false, "tenant_id": "778686f367c642f39349bb208103a3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8201c931-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f2f40d5-ee1e-4dfa-87fc-991a62887600", "address": "fa:16:3e:6c:7a:c1", "network": {"id": "3d66e9cf-4851-479f-b109-f0549cb5725c", "bridge": null, "label": "tempest-ServersTestMultiNic-33965206", "subnets": [{"cidr": "19.86.0.0/24", "dns": [], "gateway": {"address": "19.86.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "19.86.0.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "19.86.0.2"}}], "meta": {"injected": false, "tenant_id": "778686f367c642f39349bb208103a3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9f2f40d5-ee", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:57:09.472 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-32e4925a-7862-43fa-958d-0e0997ff5d6b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-a5380419-a846-48fc-891c-d88dc8215cfd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:57:09.868 4088 3038341575960 MainThread DEBUG nova.virt.hyperv.vmops [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:57:09.868 4088 3038341575960 MainThread DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-0000002e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:09.868 4088 3038341575960 MainThread DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-0000002e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:09.888 4088 3038341575960 MainThread DEBUG os_win.utils.compute.vmutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Successfully changed vm state of instance-0000002e to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:57:09.888 4088 3038341575960 MainThread DEBUG nova.virt.hyperv.vmops [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Successfully changed state of VM instance-0000002e to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:57:09.951 4088 3038341575960 MainThread DEBUG os_win.utils.jobutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Waiting for WMI job: {'InstanceID': 'ABD3F4A9-72AC-4773-928B-F1ECA77B1447', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14823), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:10.068 4088 3038341575960 MainThread DEBUG os_win.utils.jobutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] WMI job succeeded: {'InstanceID': 'ABD3F4A9-72AC-4773-928B-F1ECA77B1447', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=109023), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:57:10.068 4088 3038341575960 MainThread DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-0000002e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:10.068 4088 3038341575960 MainThread DEBUG os_win.utils.pathutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Removing directory: C:\openstack\instances\instance-0000002e check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:57:10.068 4088 3038341575960 MainThread DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-0000002e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:10.068 4088 3038341575960 MainThread ERROR nova.compute.manager [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002e' failed to start. Not enough memory in the system to start the virtual machine instance-0000002e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002e' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Not enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) 'instance-0000002e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Error code: 32778. 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Traceback (most recent call last): 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] return function(*args, **kwargs) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] admin_password, network_info, block_device_info) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] return function(self, *args, **kwds) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self.force_reraise() 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] raise self.value 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] should_plug_vifs=False) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 'req_state': req_state}) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self.force_reraise() 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] raise self.value 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] time.sleep(sleep_time) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self.force_reraise() 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] raise self.value 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] return f(*args, **kwargs) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] return self._wait_for_job(job_path) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] error_desc=err_desc) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000002e' failed to start. 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Not enough memory in the system to start the virtual machine instance-0000002e. 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002e' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Not enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 'instance-0000002e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Error code: 32778. 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] During handling of the above exception, another exception occurred: 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Traceback (most recent call last): 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] yield resources 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] accel_info=accel_info) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] return function(*args, **kwargs) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] admin_password, network_info, block_device_info) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] return function(self, *args, **kwds) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self.force_reraise() 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] raise self.value 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] should_plug_vifs=False) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 'req_state': req_state}) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self.force_reraise() 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] raise self.value 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] time.sleep(sleep_time) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self.force_reraise() 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] raise self.value 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] return f(*args, **kwargs) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] return self._wait_for_job(job_path) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] error_desc=err_desc) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002e' failed to start. 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Not enough memory in the system to start the virtual machine instance-0000002e. 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002e' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Not enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 'instance-0000002e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Error code: 32778. 2021-09-10 16:57:10.068 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.085 4088 3038341575960 MainThread INFO nova.compute.manager [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Terminating instance 2021-09-10 16:57:10.085 4088 3038341575960 MainThread DEBUG nova.compute.manager [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:57:10.085 4088 3038341575960 MainThread INFO nova.virt.hyperv.vmops [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Got request to destroy instance 2021-09-10 16:57:10.134 4088 3038341575960 MainThread DEBUG nova.virt.hyperv.vmops [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:57:10.134 4088 3038341575960 MainThread DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-0000002e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:10.134 4088 3038341575960 MainThread DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "instance-0000002e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:10.134 4088 3038341575960 MainThread INFO nova.compute.manager [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Took 0.05 seconds to destroy the instance on the hypervisor. 2021-09-10 16:57:10.134 4088 3038341575960 MainThread DEBUG nova.compute.claims [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:57:10.134 4088 3038341575960 MainThread DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:10.333 4088 3038341575960 MainThread DEBUG nova.virt.hyperv.hostops [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:57:10.350 4088 3038341575960 MainThread DEBUG nova.virt.hyperv.hostops [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:57:10.421 4088 3038342257656 GreenThread-40 DEBUG nova.network.neutron [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Successfully created port: 7f3b66d8-9f49-40de-bf17-dd7fcfd91f3d _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:57:10.500 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.vmops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:57:10.632 4088 3038341575960 MainThread DEBUG nova.compute.provider_tree [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:57:10.632 4088 3038341575960 MainThread DEBUG nova.scheduler.client.report [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:57:10.632 4088 3038341575960 MainThread DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.500s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:10.632 4088 3038341575960 MainThread ERROR nova.compute.manager [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002e' failed to start. Not enough memory in the system to start the virtual machine instance-0000002e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002e' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Not enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) 'instance-0000002e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Error code: 32778. 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Traceback (most recent call last): 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] return function(*args, **kwargs) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] admin_password, network_info, block_device_info) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] return function(self, *args, **kwds) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self.force_reraise() 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] raise self.value 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] should_plug_vifs=False) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 'req_state': req_state}) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self.force_reraise() 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] raise self.value 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] time.sleep(sleep_time) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self.force_reraise() 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] raise self.value 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] return f(*args, **kwargs) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] return self._wait_for_job(job_path) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] error_desc=err_desc) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000002e' failed to start. 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Not enough memory in the system to start the virtual machine instance-0000002e. 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002e' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Not enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 'instance-0000002e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Error code: 32778. 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] During handling of the above exception, another exception occurred: 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Traceback (most recent call last): 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] accel_info=accel_info) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] return function(*args, **kwargs) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] admin_password, network_info, block_device_info) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] return function(self, *args, **kwds) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self.force_reraise() 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] raise self.value 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] should_plug_vifs=False) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 'req_state': req_state}) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self.force_reraise() 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] raise self.value 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] time.sleep(sleep_time) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self.force_reraise() 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] raise self.value 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] return f(*args, **kwargs) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] return self._wait_for_job(job_path) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] error_desc=err_desc) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002e' failed to start. 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Not enough memory in the system to start the virtual machine instance-0000002e. 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002e' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Not enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 'instance-0000002e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Error code: 32778. 2021-09-10 16:57:10.632 4088 3038341575960 MainThread TRACE nova.compute.manager [instance: 7e8913a3-2544-4f11-9354-908856f92cec] 2021-09-10 16:57:10.632 4088 3038341575960 MainThread DEBUG nova.compute.utils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] WMI job failed with status 10. Error summary description: 'instance-0000002e' failed to start. Not enough memory in the system to start the virtual machine instance-0000002e. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:57:10.632 4088 3038341575960 MainThread DEBUG nova.compute.manager [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Build of instance 7e8913a3-2544-4f11-9354-908856f92cec was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000002e' failed to start. Not enough memory in the system to start the virtual machine instance-0000002e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002e' failed to start. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Not enough memory in the system to start the virtual machine instance-0000002e with ram size 1024 megabytes. (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) 'instance-0000002e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E15509B5-74C6-4C34-AB04-360C37621AEA) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:57:10.632 4088 3038341575960 MainThread DEBUG nova.compute.manager [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:57:10.632 4088 3038341575960 MainThread DEBUG nova.compute.manager [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:57:10.661 4088 3038341575960 MainThread DEBUG nova.compute.manager [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:57:10.661 4088 3038341575960 MainThread DEBUG nova.network.neutron [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:57:10.678 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.vmops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:57:11.557 4088 3038341575960 MainThread DEBUG nova.network.neutron [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:57:11.631 4088 3038341575960 MainThread INFO nova.compute.manager [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] [instance: 7e8913a3-2544-4f11-9354-908856f92cec] Took 0.97 seconds to deallocate network for instance. 2021-09-10 16:57:11.764 4088 3038359294024 MainThread DEBUG nova.compute.manager [req-bf775c6d-65b3-4dcf-8b23-d8c68df37453 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Received event network-vif-plugged-62591796-4fe6-4966-af18-6050acde8c5e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:57:11.764 4088 3038359294024 MainThread DEBUG oslo_concurrency.lockutils [req-bf775c6d-65b3-4dcf-8b23-d8c68df37453 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "a1386320-87c7-493d-a393-4e590b06faa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:11.764 4088 3038359294024 MainThread DEBUG oslo_concurrency.lockutils [req-bf775c6d-65b3-4dcf-8b23-d8c68df37453 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "a1386320-87c7-493d-a393-4e590b06faa0-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:11.764 4088 3038359294024 MainThread DEBUG nova.compute.manager [req-bf775c6d-65b3-4dcf-8b23-d8c68df37453 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Processing event network-vif-plugged-62591796-4fe6-4966-af18-6050acde8c5e _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:57:11.819 4088 3038341024232 MainThread INFO nova.virt.hyperv.vmops [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Using config drive for instance 2021-09-10 16:57:11.819 4088 3038341575960 MainThread INFO nova.scheduler.client.report [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Deleted allocations for instance 7e8913a3-2544-4f11-9354-908856f92cec 2021-09-10 16:57:11.869 4088 3038341575960 MainThread DEBUG oslo_concurrency.lockutils [req-f9008956-59d6-4265-ab4a-989b1b411141 d33d11497a91483d93fe0ed8f5c26603 efc5deaa89294889821f303976e2d776 - default default] Lock "7e8913a3-2544-4f11-9354-908856f92cec" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 27.094s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:12.005 4088 3038341024232 MainThread INFO nova.virt.hyperv.vmops [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Creating config drive at C:\openstack\instances\instance-00000030\configdrive.iso 2021-09-10 16:57:12.133 4088 3038341024232 MainThread DEBUG oslo_concurrency.processutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000030\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpjzwunlz2 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:57:12.431 4088 3038341024232 MainThread DEBUG oslo_concurrency.processutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000030\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpjzwunlz2" returned: 0 in 0.297s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:57:12.976 4088 3038341024232 MainThread DEBUG nova.virt.hyperv.vmops [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Setting boot order for instance: instance-00000030: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:57:13.056 4088 3038341024232 MainThread DEBUG nova.virt.hyperv.vmops [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:57:13.094 4088 3038359336040 MainThread DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Lock "cf1f3ab0-f978-4556-a81a-1be7a5bbfd12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:13.115 4088 3038341024232 MainThread DEBUG os_win.utils.jobutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Waiting for WMI job: {'InstanceID': '963E612D-0F5A-492F-A5AE-05E147C92989', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21882), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:13.115 4088 3038359336040 MainThread DEBUG nova.compute.manager [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:57:13.229 4088 3038359336040 MainThread DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:13.229 4088 3038359336040 MainThread DEBUG nova.virt.hardware [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:57:13.229 4088 3038359336040 MainThread INFO nova.compute.claims [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Claim successful on node n-h2-808474-1 2021-09-10 16:57:13.261 4088 3038341024232 MainThread ERROR os_win.utils.jobutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000030\' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)instance-00000030BCF46860-7C9C-4CFA-B29A-B90893341DBC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)instance-00000030BCF46860-7C9C-4CFA-B29A-B90893341DBC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000030\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)instance-00000030BCF46860-7C9C-4CFA-B29A-B90893341DBC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '963E612D-0F5A-492F-A5AE-05E147C92989', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114565), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 13), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 13), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000030' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)\n\nNot enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)\n\n'instance-00000030' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)", 'ErrorSummaryDescription': "'instance-00000030' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000030.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:13.261 4088 3038341024232 MainThread DEBUG os_win._utils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000030' failed to start. Not enough memory in the system to start the virtual machine instance-00000030. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000030' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Not enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) 'instance-00000030' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.20487308502197266 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:13.272 4088 3038341021768 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:13.272 4088 3038341021768 MainThread INFO nova.compute.manager [-] [instance: a1386320-87c7-493d-a393-4e590b06faa0] VM Stopped (Lifecycle Event) 2021-09-10 16:57:13.272 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000030" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:13.272 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000030" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:13.302 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-151beaab-90b1-40f1-81b4-143860efa42b - - - - -] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:13.302 4088 3038341021768 MainThread DEBUG nova.virt.hyperv.vmops [req-151beaab-90b1-40f1-81b4-143860efa42b - - - - -] [instance: a1386320-87c7-493d-a393-4e590b06faa0] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:13.354 4088 3038341021768 MainThread DEBUG nova.compute.manager [req-151beaab-90b1-40f1-81b4-143860efa42b - - - - -] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:13.396 4088 3038359336040 MainThread DEBUG nova.virt.hyperv.hostops [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:57:13.396 4088 3038341021768 MainThread INFO nova.compute.manager [req-151beaab-90b1-40f1-81b4-143860efa42b - - - - -] [instance: a1386320-87c7-493d-a393-4e590b06faa0] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:13.416 4088 3038359336040 MainThread DEBUG nova.virt.hyperv.hostops [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:57:13.556 4088 3038342257656 GreenThread-40 DEBUG nova.network.neutron [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Successfully updated port: 7f3b66d8-9f49-40de-bf17-dd7fcfd91f3d _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:57:13.568 4088 3038342257656 GreenThread-40 DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Acquired lock "refresh_cache-8636793a-b94f-447d-a53a-4506e8a3032f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:57:13.568 4088 3038342257656 GreenThread-40 DEBUG nova.network.neutron [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:57:13.636 4088 3038359336040 MainThread DEBUG nova.compute.provider_tree [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:57:13.651 4088 3038359336040 MainThread DEBUG nova.scheduler.client.report [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:57:13.651 4088 3038359336040 MainThread DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:13.651 4088 3038359336040 MainThread DEBUG nova.compute.manager [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:57:13.759 4088 3038359336040 MainThread DEBUG nova.compute.manager [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:57:13.780 4088 3038342258184 GreenThread-41 DEBUG nova.compute.manager [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:57:13.780 4088 3038342258184 GreenThread-41 DEBUG nova.network.neutron [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:57:13.881 4088 3038342257656 GreenThread-40 DEBUG nova.network.neutron [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:57:13.994 4088 3038359336040 MainThread DEBUG nova.compute.manager [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:57:14.006 4088 3038359336040 MainThread INFO nova.virt.hyperv.vmops [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Spawning new instance 2021-09-10 16:57:14.006 4088 3038359336040 MainThread DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Lock "instance-00000032" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:14.006 4088 3038359336040 MainThread DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Lock "instance-00000032" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:14.006 4088 3038359336040 MainThread DEBUG nova.block_device [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:57:14.006 4088 3038359336040 MainThread DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:14.030 4088 3038359336040 MainThread DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:14.039 4088 3038342258184 GreenThread-41 DEBUG nova.policy [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b444bbec44249dda082cd505f5a9c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2902d375c2104912b7ea540517edd89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:57:14.039 4088 3038359336040 MainThread DEBUG os_win.utils.pathutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Creating directory: C:\openstack\instances\instance-00000032 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:57:14.039 4088 3038359336040 MainThread DEBUG nova.virt.hyperv.vmops [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000032\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:57:14.083 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-82f21d37-9ebf-4c86-b0a2-fb0fe746444e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Received event network-changed-7f3b66d8-9f49-40de-bf17-dd7fcfd91f3d external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:57:14.083 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-82f21d37-9ebf-4c86-b0a2-fb0fe746444e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Refreshing instance network info cache due to event network-changed-7f3b66d8-9f49-40de-bf17-dd7fcfd91f3d. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:57:14.288 4088 3038341024232 MainThread DEBUG os_win.utils.jobutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Waiting for WMI job: {'InstanceID': 'B1F3AEE8-EEC5-4107-B970-8903160182E9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15797), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:14.339 4088 3038359336040 MainThread DEBUG nova.virt.hyperv.vmops [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Resizing VHD C:\openstack\instances\instance-00000032\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:57:14.421 4088 3038341024232 MainThread ERROR os_win.utils.jobutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000030\' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)instance-00000030BCF46860-7C9C-4CFA-B29A-B90893341DBC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)instance-00000030BCF46860-7C9C-4CFA-B29A-B90893341DBC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000030\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)instance-00000030BCF46860-7C9C-4CFA-B29A-B90893341DBC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B1F3AEE8-EEC5-4107-B970-8903160182E9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115161), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 14), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 14), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000030' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)\n\nNot enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)\n\n'instance-00000030' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)", 'ErrorSummaryDescription': "'instance-00000030' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000030.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:14.421 4088 3038341024232 MainThread DEBUG os_win._utils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000030' failed to start. Not enough memory in the system to start the virtual machine instance-00000030. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000030' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Not enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) 'instance-00000030' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3652315139770508 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:14.506 4088 3038342258008 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:14.506 4088 3038342258008 MainThread INFO nova.compute.manager [-] [instance: a1386320-87c7-493d-a393-4e590b06faa0] VM Stopped (Lifecycle Event) 2021-09-10 16:57:14.506 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000030" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:14.506 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000030" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:14.554 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-0160f337-e30e-46fc-a7aa-547f73bb2744 - - - - -] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:14.554 4088 3038342258008 MainThread DEBUG nova.virt.hyperv.vmops [req-0160f337-e30e-46fc-a7aa-547f73bb2744 - - - - -] [instance: a1386320-87c7-493d-a393-4e590b06faa0] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:14.586 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-0160f337-e30e-46fc-a7aa-547f73bb2744 - - - - -] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:14.624 4088 3038342258008 MainThread INFO nova.compute.manager [req-0160f337-e30e-46fc-a7aa-547f73bb2744 - - - - -] [instance: a1386320-87c7-493d-a393-4e590b06faa0] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:14.740 4088 3038342257656 GreenThread-40 DEBUG nova.network.neutron [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Updating instance_info_cache with network_info: [{"id": "7f3b66d8-9f49-40de-bf17-dd7fcfd91f3d", "address": "fa:16:3e:27:69:3d", "network": {"id": "40dd43aa-44cf-4bf2-851b-fed44406f736", "bridge": null, "label": "tempest-ImagesOneServerNegativeTestJSON-842854431-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e36daecbd54a4138802bd46bc59ade0d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap7f3b66d8-9f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:57:14.756 4088 3038342257656 GreenThread-40 DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Releasing lock "refresh_cache-8636793a-b94f-447d-a53a-4506e8a3032f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:57:14.756 4088 3038342257656 GreenThread-40 DEBUG nova.compute.manager [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Instance network_info: |[{"id": "7f3b66d8-9f49-40de-bf17-dd7fcfd91f3d", "address": "fa:16:3e:27:69:3d", "network": {"id": "40dd43aa-44cf-4bf2-851b-fed44406f736", "bridge": null, "label": "tempest-ImagesOneServerNegativeTestJSON-842854431-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e36daecbd54a4138802bd46bc59ade0d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap7f3b66d8-9f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:57:14.772 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-82f21d37-9ebf-4c86-b0a2-fb0fe746444e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-8636793a-b94f-447d-a53a-4506e8a3032f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:57:14.772 4088 3038342256952 MainThread DEBUG nova.network.neutron [req-82f21d37-9ebf-4c86-b0a2-fb0fe746444e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Refreshing network info cache for port 7f3b66d8-9f49-40de-bf17-dd7fcfd91f3d _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:57:14.772 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Preparing to wait for external event network-vif-plugged-7f3b66d8-9f49-40de-bf17-dd7fcfd91f3d prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:57:14.772 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Lock "8636793a-b94f-447d-a53a-4506e8a3032f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:14.772 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Lock "8636793a-b94f-447d-a53a-4506e8a3032f-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:14.772 4088 3038342257832 MainThread DEBUG os_win.utils.compute.vmutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Creating VM instance-00000031 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:57:14.772 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-9ece29f9-a756-49c9-9b45-2fab0d3f709d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Received event network-vif-deleted-850df7b1-8ded-4e6b-b6a7-03c93e659d28 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:57:15.445 4088 3038341024232 MainThread DEBUG os_win.utils.jobutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Waiting for WMI job: {'InstanceID': 'DD1BD51F-F9C8-4C10-9B74-FD54FCD59504', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15795), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:15.600 4088 3038341024232 MainThread ERROR os_win.utils.jobutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000030\' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)instance-00000030BCF46860-7C9C-4CFA-B29A-B90893341DBC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)instance-00000030BCF46860-7C9C-4CFA-B29A-B90893341DBC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000030\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)instance-00000030BCF46860-7C9C-4CFA-B29A-B90893341DBC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'DD1BD51F-F9C8-4C10-9B74-FD54FCD59504', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=124724), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 15), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 15), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000030' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)\n\nNot enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)\n\n'instance-00000030' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)", 'ErrorSummaryDescription': "'instance-00000030' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000030.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:15.600 4088 3038341024232 MainThread DEBUG os_win._utils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000030' failed to start. Not enough memory in the system to start the virtual machine instance-00000030. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000030' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Not enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) 'instance-00000030' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.544370412826538 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:16.712 4088 3038341024232 MainThread DEBUG os_win.utils.jobutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Waiting for WMI job: {'InstanceID': 'CDC4CF74-1D8C-4D0E-A6E7-AF4C0EE7AF3C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16306), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:16.843 4088 3038341024232 MainThread ERROR os_win.utils.jobutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000030\' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)instance-00000030BCF46860-7C9C-4CFA-B29A-B90893341DBC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)instance-00000030BCF46860-7C9C-4CFA-B29A-B90893341DBC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000030\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)instance-00000030BCF46860-7C9C-4CFA-B29A-B90893341DBC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'CDC4CF74-1D8C-4D0E-A6E7-AF4C0EE7AF3C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118548), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 16), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 16), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000030' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)\n\nNot enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)\n\n'instance-00000030' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)", 'ErrorSummaryDescription': "'instance-00000030' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000030.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:16.859 4088 3038341024232 MainThread DEBUG os_win._utils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000030' failed to start. Not enough memory in the system to start the virtual machine instance-00000030. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000030' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Not enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) 'instance-00000030' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.8028833866119385 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:16.859 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:57:17.272 4088 3038342256952 MainThread DEBUG nova.network.neutron [req-82f21d37-9ebf-4c86-b0a2-fb0fe746444e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Updated VIF entry in instance network info cache for port 7f3b66d8-9f49-40de-bf17-dd7fcfd91f3d. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:57:17.272 4088 3038342256952 MainThread DEBUG nova.network.neutron [req-82f21d37-9ebf-4c86-b0a2-fb0fe746444e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Updating instance_info_cache with network_info: [{"id": "7f3b66d8-9f49-40de-bf17-dd7fcfd91f3d", "address": "fa:16:3e:27:69:3d", "network": {"id": "40dd43aa-44cf-4bf2-851b-fed44406f736", "bridge": null, "label": "tempest-ImagesOneServerNegativeTestJSON-842854431-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e36daecbd54a4138802bd46bc59ade0d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap7f3b66d8-9f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:57:17.287 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-82f21d37-9ebf-4c86-b0a2-fb0fe746444e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-8636793a-b94f-447d-a53a-4506e8a3032f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:57:17.718 4088 3038342258184 GreenThread-41 DEBUG nova.network.neutron [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Successfully created port: cb01aeef-2779-4f0c-9c98-ed9bfb3c8f6b _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:57:17.896 4088 3038341024232 MainThread DEBUG os_win.utils.jobutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Waiting for WMI job: {'InstanceID': '5EC9AD04-E03B-4FF0-AE66-F3A4A7C31052', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15975), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:18.046 4088 3038341024232 MainThread ERROR os_win.utils.jobutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000030\' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)instance-00000030BCF46860-7C9C-4CFA-B29A-B90893341DBC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)instance-00000030BCF46860-7C9C-4CFA-B29A-B90893341DBC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000030\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)instance-00000030BCF46860-7C9C-4CFA-B29A-B90893341DBC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5EC9AD04-E03B-4FF0-AE66-F3A4A7C31052', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119021), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 17), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 17), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000030' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)\n\nNot enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)\n\n'instance-00000030' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)", 'ErrorSummaryDescription': "'instance-00000030' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000030.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:18.046 4088 3038341024232 MainThread DEBUG os_win._utils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000030' failed to start. Not enough memory in the system to start the virtual machine instance-00000030. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000030' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Not enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) 'instance-00000030' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.990345478057861 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:18.046 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-f2eea0cb-4fd3-4bfb-a676-96a96008cbdb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Received event network-vif-plugged-8201c931-a835-4ff8-ac41-cda2c95c6f72 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:57:18.046 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-f2eea0cb-4fd3-4bfb-a676-96a96008cbdb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "a5380419-a846-48fc-891c-d88dc8215cfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:18.046 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-f2eea0cb-4fd3-4bfb-a676-96a96008cbdb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "a5380419-a846-48fc-891c-d88dc8215cfd-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:18.046 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-f2eea0cb-4fd3-4bfb-a676-96a96008cbdb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Processing event network-vif-plugged-8201c931-a835-4ff8-ac41-cda2c95c6f72 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:57:18.083 4088 3038340847048 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:18.083 4088 3038340847048 MainThread INFO nova.compute.manager [-] [instance: a1386320-87c7-493d-a393-4e590b06faa0] VM Stopped (Lifecycle Event) 2021-09-10 16:57:18.083 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000030" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:18.083 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000030" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:18.099 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-11a73439-dfe5-4144-92a2-2481c840f12c - - - - -] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:18.099 4088 3038340847048 MainThread DEBUG nova.virt.hyperv.vmops [req-11a73439-dfe5-4144-92a2-2481c840f12c - - - - -] [instance: a1386320-87c7-493d-a393-4e590b06faa0] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:18.156 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-11a73439-dfe5-4144-92a2-2481c840f12c - - - - -] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:18.194 4088 3038340847048 MainThread INFO nova.compute.manager [req-11a73439-dfe5-4144-92a2-2481c840f12c - - - - -] [instance: a1386320-87c7-493d-a393-4e590b06faa0] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:19.084 4088 3038341024232 MainThread DEBUG os_win.utils.jobutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Waiting for WMI job: {'InstanceID': '5D8AEA16-71E3-415D-83C6-393E607DCF52', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16359), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:19.225 4088 3038341024232 MainThread ERROR os_win.utils.jobutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000030\' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)instance-00000030BCF46860-7C9C-4CFA-B29A-B90893341DBC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)instance-00000030BCF46860-7C9C-4CFA-B29A-B90893341DBC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000030\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)instance-00000030BCF46860-7C9C-4CFA-B29A-B90893341DBC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5D8AEA16-71E3-415D-83C6-393E607DCF52', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113355), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 19), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 19), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000030' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)\n\nNot enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)\n\n'instance-00000030' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC)", 'ErrorSummaryDescription': "'instance-00000030' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000030.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:19.225 4088 3038341024232 MainThread ERROR nova.virt.hyperv.vmops [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Failed to change vm state of instance-00000030 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000030' failed to start. 2021-09-10 16:57:19.225 4088 3038341024232 MainThread INFO nova.virt.hyperv.vmops [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Got request to destroy instance 2021-09-10 16:57:19.291 4088 3038340847048 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:19.291 4088 3038340847048 MainThread INFO nova.compute.manager [-] [instance: a1386320-87c7-493d-a393-4e590b06faa0] VM Stopped (Lifecycle Event) 2021-09-10 16:57:19.291 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000030" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:19.291 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000030" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:19.305 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-7f6d1abd-b30c-4e26-bb21-35146bf1aea1 - - - - -] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:19.305 4088 3038340847048 MainThread DEBUG nova.virt.hyperv.vmops [req-7f6d1abd-b30c-4e26-bb21-35146bf1aea1 - - - - -] [instance: a1386320-87c7-493d-a393-4e590b06faa0] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:19.361 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-7f6d1abd-b30c-4e26-bb21-35146bf1aea1 - - - - -] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:19.399 4088 3038340847048 MainThread INFO nova.compute.manager [req-7f6d1abd-b30c-4e26-bb21-35146bf1aea1 - - - - -] [instance: a1386320-87c7-493d-a393-4e590b06faa0] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:20.317 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-8d3c8a97-78bd-4b2a-9567-b694d8625e19 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Received event network-vif-plugged-9f2f40d5-ee1e-4dfa-87fc-991a62887600 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:57:20.317 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-8d3c8a97-78bd-4b2a-9567-b694d8625e19 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "a5380419-a846-48fc-891c-d88dc8215cfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:20.317 4088 3038340847048 MainThread DEBUG oslo_concurrency.lockutils [req-8d3c8a97-78bd-4b2a-9567-b694d8625e19 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "a5380419-a846-48fc-891c-d88dc8215cfd-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:20.317 4088 3038340847048 MainThread DEBUG nova.compute.manager [req-8d3c8a97-78bd-4b2a-9567-b694d8625e19 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Processing event network-vif-plugged-9f2f40d5-ee1e-4dfa-87fc-991a62887600 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:57:20.369 4088 3038342256424 MainThread INFO nova.virt.hyperv.vmops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Using config drive for instance 2021-09-10 16:57:21.054 4088 3038342256424 MainThread INFO nova.virt.hyperv.vmops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Creating config drive at C:\openstack\instances\instance-0000002f\configdrive.iso 2021-09-10 16:57:21.161 4088 3038342256424 MainThread DEBUG oslo_concurrency.processutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000002f\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpc32wbxo7 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:57:21.326 4088 3038359336744 MainThread DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "19bd864f-b01d-42d3-8ca6-9b75067146fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:21.371 4088 3038359336744 MainThread DEBUG nova.compute.manager [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:57:21.478 4088 3038341024232 MainThread DEBUG nova.virt.hyperv.vmops [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:57:21.478 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Lock "instance-00000030" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:21.478 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Lock "instance-00000030" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:21.490 4088 3038342256424 MainThread DEBUG oslo_concurrency.processutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000002f\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpc32wbxo7" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:57:21.514 4088 3038341024232 MainThread DEBUG os_win.utils.compute.vmutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Successfully changed vm state of instance-00000030 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:57:21.514 4088 3038341024232 MainThread DEBUG nova.virt.hyperv.vmops [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Successfully changed state of VM instance-00000030 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:57:21.514 4088 3038359336744 MainThread DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:21.528 4088 3038359336744 MainThread DEBUG nova.virt.hardware [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:57:21.528 4088 3038359336744 MainThread INFO nova.compute.claims [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Claim successful on node n-h2-808474-1 2021-09-10 16:57:21.678 4088 3038341024232 MainThread DEBUG os_win.utils.jobutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Waiting for WMI job: {'InstanceID': '2776CA0E-3638-4483-92B3-A2EABFF15586', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15556), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:21.724 4088 3038359336744 MainThread DEBUG nova.virt.hyperv.hostops [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:57:21.740 4088 3038359336744 MainThread DEBUG nova.virt.hyperv.hostops [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:57:21.790 4088 3038341024232 MainThread DEBUG os_win.utils.jobutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] WMI job succeeded: {'InstanceID': '2776CA0E-3638-4483-92B3-A2EABFF15586', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=121274), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:57:21.790 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Lock "instance-00000030" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:21.790 4088 3038341024232 MainThread DEBUG os_win.utils.pathutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Removing directory: C:\openstack\instances\instance-00000030 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:57:21.790 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Lock "instance-00000030" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:21.810 4088 3038341024232 MainThread ERROR nova.compute.manager [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000030' failed to start. Not enough memory in the system to start the virtual machine instance-00000030. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000030' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Not enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) 'instance-00000030' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Error code: 32778. 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] Traceback (most recent call last): 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] return function(*args, **kwargs) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] admin_password, network_info, block_device_info) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] return function(self, *args, **kwds) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self.force_reraise() 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] raise self.value 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] should_plug_vifs=False) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 'req_state': req_state}) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self.force_reraise() 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] raise self.value 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] time.sleep(sleep_time) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self.force_reraise() 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] raise self.value 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] return f(*args, **kwargs) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] return self._wait_for_job(job_path) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] error_desc=err_desc) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000030' failed to start. 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] Not enough memory in the system to start the virtual machine instance-00000030. 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000030' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] Not enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 'instance-00000030' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Error code: 32778. 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] During handling of the above exception, another exception occurred: 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] Traceback (most recent call last): 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] yield resources 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] accel_info=accel_info) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] return function(*args, **kwargs) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] admin_password, network_info, block_device_info) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] return function(self, *args, **kwds) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self.force_reraise() 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] raise self.value 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] should_plug_vifs=False) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 'req_state': req_state}) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self.force_reraise() 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] raise self.value 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] time.sleep(sleep_time) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self.force_reraise() 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] raise self.value 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] return f(*args, **kwargs) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] return self._wait_for_job(job_path) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] error_desc=err_desc) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000030' failed to start. 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] Not enough memory in the system to start the virtual machine instance-00000030. 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000030' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] Not enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 'instance-00000030' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Error code: 32778. 2021-09-10 16:57:21.810 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:21.810 4088 3038341024232 MainThread INFO nova.compute.manager [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Terminating instance 2021-09-10 16:57:21.810 4088 3038341024232 MainThread DEBUG nova.compute.manager [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:57:21.810 4088 3038341024232 MainThread INFO nova.virt.hyperv.vmops [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Got request to destroy instance 2021-09-10 16:57:21.833 4088 3038341024232 MainThread DEBUG nova.virt.hyperv.vmops [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:57:21.833 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Lock "instance-00000030" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:21.833 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Lock "instance-00000030" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:21.833 4088 3038341024232 MainThread INFO nova.compute.manager [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 16:57:21.833 4088 3038341024232 MainThread DEBUG nova.compute.claims [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:57:21.851 4088 3038342258184 GreenThread-41 DEBUG nova.network.neutron [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Successfully updated port: cb01aeef-2779-4f0c-9c98-ed9bfb3c8f6b _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:57:21.866 4088 3038342258184 GreenThread-41 DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Acquired lock "refresh_cache-cf1f3ab0-f978-4556-a81a-1be7a5bbfd12" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:57:21.866 4088 3038342258184 GreenThread-41 DEBUG nova.network.neutron [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:57:21.975 4088 3038359336744 MainThread DEBUG nova.compute.provider_tree [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:57:22.025 4088 3038359336744 MainThread DEBUG nova.scheduler.client.report [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:57:22.025 4088 3038359336744 MainThread DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:22.025 4088 3038359336744 MainThread DEBUG nova.compute.manager [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:57:22.025 4088 3038342258184 GreenThread-41 DEBUG nova.network.neutron [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:57:22.039 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.203s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:22.209 4088 3038359336744 MainThread DEBUG nova.compute.manager [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:57:22.209 4088 3038340847048 GreenThread-42 DEBUG nova.compute.manager [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:57:22.224 4088 3038340847048 GreenThread-42 DEBUG nova.network.neutron [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:57:22.250 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.vmops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Setting boot order for instance: instance-0000002f: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:57:22.272 4088 3038341024232 MainThread DEBUG nova.virt.hyperv.hostops [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:57:22.288 4088 3038341024232 MainThread DEBUG nova.virt.hyperv.hostops [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:57:22.362 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.vmops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:57:22.394 4088 3038342256424 MainThread DEBUG os_win.utils.jobutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Waiting for WMI job: {'InstanceID': '3CBF235E-FF90-41A6-B785-885B97EEF71A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15961), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:22.491 4088 3038359336744 MainThread DEBUG nova.compute.manager [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:57:22.491 4088 3038359336744 MainThread INFO nova.virt.hyperv.vmops [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Spawning new instance 2021-09-10 16:57:22.509 4088 3038359336744 MainThread DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000033" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:22.509 4088 3038359336744 MainThread DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000033" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:22.509 4088 3038359336744 MainThread DEBUG nova.block_device [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:57:22.509 4088 3038359336744 MainThread DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:22.509 4088 3038359336744 MainThread DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:22.521 4088 3038359336744 MainThread DEBUG os_win.utils.pathutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Creating directory: C:\openstack\instances\instance-00000033 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:57:22.521 4088 3038359336744 MainThread DEBUG nova.virt.hyperv.vmops [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000033\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:57:22.555 4088 3038340847048 GreenThread-42 DEBUG nova.policy [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42267190de3648eea52604e6b2444d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca07d9dc99a4581a698a232ffa065db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:57:22.555 4088 3038341024232 MainThread DEBUG nova.compute.provider_tree [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:57:22.593 4088 3038341024232 MainThread DEBUG nova.scheduler.client.report [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:57:22.593 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.563s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:22.593 4088 3038341024232 MainThread ERROR nova.compute.manager [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000030' failed to start. Not enough memory in the system to start the virtual machine instance-00000030. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000030' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Not enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) 'instance-00000030' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Error code: 32778. 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] Traceback (most recent call last): 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] return function(*args, **kwargs) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] admin_password, network_info, block_device_info) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] return function(self, *args, **kwds) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self.force_reraise() 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] raise self.value 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] should_plug_vifs=False) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 'req_state': req_state}) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self.force_reraise() 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] raise self.value 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] time.sleep(sleep_time) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self.force_reraise() 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] raise self.value 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] return f(*args, **kwargs) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] return self._wait_for_job(job_path) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] error_desc=err_desc) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000030' failed to start. 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] Not enough memory in the system to start the virtual machine instance-00000030. 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000030' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] Not enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 'instance-00000030' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Error code: 32778. 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] During handling of the above exception, another exception occurred: 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] Traceback (most recent call last): 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] accel_info=accel_info) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] return function(*args, **kwargs) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] admin_password, network_info, block_device_info) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] return function(self, *args, **kwds) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self.force_reraise() 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] raise self.value 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] should_plug_vifs=False) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 'req_state': req_state}) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self.force_reraise() 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] raise self.value 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] time.sleep(sleep_time) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self.force_reraise() 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] raise self.value 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] return f(*args, **kwargs) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] return self._wait_for_job(job_path) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] error_desc=err_desc) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000030' failed to start. 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] Not enough memory in the system to start the virtual machine instance-00000030. 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000030' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] Not enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 'instance-00000030' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Error code: 32778. 2021-09-10 16:57:22.593 4088 3038341024232 MainThread TRACE nova.compute.manager [instance: a1386320-87c7-493d-a393-4e590b06faa0] 2021-09-10 16:57:22.593 4088 3038341024232 MainThread DEBUG nova.compute.utils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] WMI job failed with status 10. Error summary description: 'instance-00000030' failed to start. Not enough memory in the system to start the virtual machine instance-00000030. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:57:22.600 4088 3038341024232 MainThread DEBUG nova.compute.manager [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Build of instance a1386320-87c7-493d-a393-4e590b06faa0 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000030' failed to start. Not enough memory in the system to start the virtual machine instance-00000030. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000030' failed to start. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Not enough memory in the system to start the virtual machine instance-00000030 with ram size 1024 megabytes. (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) 'instance-00000030' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BCF46860-7C9C-4CFA-B29A-B90893341DBC) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:57:22.600 4088 3038341024232 MainThread DEBUG nova.compute.manager [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:57:22.600 4088 3038341024232 MainThread DEBUG nova.compute.manager [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:57:22.600 4088 3038341024232 MainThread DEBUG nova.compute.manager [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:57:22.600 4088 3038341024232 MainThread DEBUG nova.network.neutron [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:57:22.646 4088 3038342145480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:22.646 4088 3038342145480 MainThread INFO nova.compute.manager [-] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] VM Stopped (Lifecycle Event) 2021-09-10 16:57:22.646 4088 3038341575784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:22.646 4088 3038341575784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:22.664 4088 3038342256424 MainThread ERROR os_win.utils.jobutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002f\' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)instance-0000002f6262FDC1-720E-4C82-9032-A0A2443585A812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)instance-0000002f6262FDC1-720E-4C82-9032-A0A2443585A810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)instance-0000002f6262FDC1-720E-4C82-9032-A0A2443585A8%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3CBF235E-FF90-41A6-B785-885B97EEF71A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=149725), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 22), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 22), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002f' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)\n\nNot enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)\n\n'instance-0000002f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)", 'ErrorSummaryDescription': "'instance-0000002f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:22.664 4088 3038342256424 MainThread DEBUG os_win._utils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002f' failed to start. Not enough memory in the system to start the virtual machine instance-0000002f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002f' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Not enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) 'instance-0000002f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.3011341094970703 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:22.677 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-29fb938b-a388-4fd1-8365-a5e216a8efb3 - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:22.677 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-29fb938b-a388-4fd1-8365-a5e216a8efb3 - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:22.735 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-29fb938b-a388-4fd1-8365-a5e216a8efb3 - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:22.770 4088 3038342145480 MainThread INFO nova.compute.manager [req-29fb938b-a388-4fd1-8365-a5e216a8efb3 - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:22.804 4088 3038359336744 MainThread DEBUG nova.virt.hyperv.vmops [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Resizing VHD C:\openstack\instances\instance-00000033\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:57:23.472 4088 3038342258184 GreenThread-41 DEBUG nova.network.neutron [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Updating instance_info_cache with network_info: [{"id": "cb01aeef-2779-4f0c-9c98-ed9bfb3c8f6b", "address": "fa:16:3e:ef:e4:e3", "network": {"id": "c41f1f8c-6dd1-48a5-8a0a-87f80e196ac9", "bridge": null, "label": "tempest-ServersTestFqdnHostnames-712389274-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2902d375c2104912b7ea540517edd89f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcb01aeef-27", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:57:23.489 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-46411d50-f7dd-4ce2-9bcb-eff392d96baf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Received event network-changed-cb01aeef-2779-4f0c-9c98-ed9bfb3c8f6b external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:57:23.489 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-46411d50-f7dd-4ce2-9bcb-eff392d96baf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Refreshing instance network info cache due to event network-changed-cb01aeef-2779-4f0c-9c98-ed9bfb3c8f6b. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:57:23.489 4088 3038342258184 GreenThread-41 DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Releasing lock "refresh_cache-cf1f3ab0-f978-4556-a81a-1be7a5bbfd12" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:57:23.489 4088 3038342258184 GreenThread-41 DEBUG nova.compute.manager [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Instance network_info: |[{"id": "cb01aeef-2779-4f0c-9c98-ed9bfb3c8f6b", "address": "fa:16:3e:ef:e4:e3", "network": {"id": "c41f1f8c-6dd1-48a5-8a0a-87f80e196ac9", "bridge": null, "label": "tempest-ServersTestFqdnHostnames-712389274-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2902d375c2104912b7ea540517edd89f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcb01aeef-27", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:57:23.489 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-46411d50-f7dd-4ce2-9bcb-eff392d96baf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-cf1f3ab0-f978-4556-a81a-1be7a5bbfd12" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:57:23.489 4088 3038342256952 MainThread DEBUG nova.network.neutron [req-46411d50-f7dd-4ce2-9bcb-eff392d96baf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Refreshing network info cache for port cb01aeef-2779-4f0c-9c98-ed9bfb3c8f6b _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:57:23.489 4088 3038359336040 MainThread DEBUG nova.compute.manager [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Preparing to wait for external event network-vif-plugged-cb01aeef-2779-4f0c-9c98-ed9bfb3c8f6b prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:57:23.489 4088 3038359336040 MainThread DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Lock "cf1f3ab0-f978-4556-a81a-1be7a5bbfd12-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:23.489 4088 3038359336040 MainThread DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Lock "cf1f3ab0-f978-4556-a81a-1be7a5bbfd12-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:23.489 4088 3038359336040 MainThread DEBUG os_win.utils.compute.vmutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Creating VM instance-00000032 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:57:23.612 4088 3038340846696 MainThread DEBUG nova.compute.manager [req-9256feaf-3a41-4066-b1e9-34b46e373e2d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Received event network-vif-plugged-7f3b66d8-9f49-40de-bf17-dd7fcfd91f3d external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:57:23.624 4088 3038340846696 MainThread DEBUG oslo_concurrency.lockutils [req-9256feaf-3a41-4066-b1e9-34b46e373e2d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "8636793a-b94f-447d-a53a-4506e8a3032f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:23.624 4088 3038340846696 MainThread DEBUG oslo_concurrency.lockutils [req-9256feaf-3a41-4066-b1e9-34b46e373e2d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "8636793a-b94f-447d-a53a-4506e8a3032f-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:23.624 4088 3038340846696 MainThread DEBUG nova.compute.manager [req-9256feaf-3a41-4066-b1e9-34b46e373e2d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Processing event network-vif-plugged-7f3b66d8-9f49-40de-bf17-dd7fcfd91f3d _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:57:23.663 4088 3038342257832 MainThread INFO nova.virt.hyperv.vmops [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Using config drive for instance 2021-09-10 16:57:23.692 4088 3038342256424 MainThread DEBUG os_win.utils.jobutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Waiting for WMI job: {'InstanceID': '9B8420B3-B955-4AD2-A44D-2A887EC07935', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=23943), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:23.856 4088 3038342256424 MainThread ERROR os_win.utils.jobutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002f\' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)instance-0000002f6262FDC1-720E-4C82-9032-A0A2443585A812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)instance-0000002f6262FDC1-720E-4C82-9032-A0A2443585A810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)instance-0000002f6262FDC1-720E-4C82-9032-A0A2443585A8%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9B8420B3-B955-4AD2-A44D-2A887EC07935', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=150495), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is running',), 'OperationalStatus': (2,), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 23), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 23), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002f' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)\n\nNot enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)\n\n'instance-0000002f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)", 'ErrorSummaryDescription': "'instance-0000002f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:23.856 4088 3038342256424 MainThread DEBUG os_win._utils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002f' failed to start. Not enough memory in the system to start the virtual machine instance-0000002f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002f' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Not enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) 'instance-0000002f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.493748426437378 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:23.929 4088 3038342145480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:23.929 4088 3038342145480 MainThread INFO nova.compute.manager [-] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] VM Stopped (Lifecycle Event) 2021-09-10 16:57:23.929 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:23.929 4088 3038340846520 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:23.957 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-c6e2d596-e529-4a93-a9f8-be66274ceb1a - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:23.957 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-c6e2d596-e529-4a93-a9f8-be66274ceb1a - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:24.008 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-c6e2d596-e529-4a93-a9f8-be66274ceb1a - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:24.037 4088 3038342145480 MainThread INFO nova.compute.manager [req-c6e2d596-e529-4a93-a9f8-be66274ceb1a - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:24.222 4088 3038342257832 MainThread INFO nova.virt.hyperv.vmops [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Creating config drive at C:\openstack\instances\instance-00000031\configdrive.iso 2021-09-10 16:57:24.304 4088 3038342257832 MainThread DEBUG oslo_concurrency.processutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000031\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpns8qdaz5 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:57:24.576 4088 3038341024232 MainThread DEBUG nova.network.neutron [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:57:24.599 4088 3038341024232 MainThread INFO nova.compute.manager [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] [instance: a1386320-87c7-493d-a393-4e590b06faa0] Took 2.00 seconds to deallocate network for instance. 2021-09-10 16:57:24.621 4088 3038342257832 MainThread DEBUG oslo_concurrency.processutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000031\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpns8qdaz5" returned: 0 in 0.312s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:57:24.849 4088 3038341024232 MainThread INFO nova.scheduler.client.report [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Deleted allocations for instance a1386320-87c7-493d-a393-4e590b06faa0 2021-09-10 16:57:24.920 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [req-fe296b6a-f508-4eba-b0fd-894ddac2fc5b a6076248095044dcbd42424ad33c0395 2113aff5a9ed47f5bdb3bdee01c77f67 - default default] Lock "a1386320-87c7-493d-a393-4e590b06faa0" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 28.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:24.920 4088 3038342256424 MainThread DEBUG os_win.utils.jobutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Waiting for WMI job: {'InstanceID': '6C8189E3-66EF-4595-BF2D-4D7FA56FAF73', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16199), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:25.173 4088 3038341024232 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:25.173 4088 3038341024232 MainThread INFO nova.compute.manager [-] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] VM Stopped (Lifecycle Event) 2021-09-10 16:57:25.173 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:25.193 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:25.195 4088 3038340847048 GreenThread-42 DEBUG nova.network.neutron [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Successfully created port: b43ab003-c273-4a5e-9873-deac1cf294b4 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:57:25.215 4088 3038341024232 MainThread DEBUG nova.compute.manager [req-4f93768c-15de-4f63-98d5-fe90e23daff0 - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:25.215 4088 3038341024232 MainThread DEBUG nova.virt.hyperv.vmops [req-4f93768c-15de-4f63-98d5-fe90e23daff0 - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:25.257 4088 3038342256424 MainThread ERROR os_win.utils.jobutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002f\' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)instance-0000002f6262FDC1-720E-4C82-9032-A0A2443585A812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)instance-0000002f6262FDC1-720E-4C82-9032-A0A2443585A810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)instance-0000002f6262FDC1-720E-4C82-9032-A0A2443585A8%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6C8189E3-66EF-4595-BF2D-4D7FA56FAF73', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=150792), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 24), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 25), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002f' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)\n\nNot enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)\n\n'instance-0000002f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)", 'ErrorSummaryDescription': "'instance-0000002f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:25.257 4088 3038342256424 MainThread DEBUG os_win._utils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002f' failed to start. Not enough memory in the system to start the virtual machine instance-0000002f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002f' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Not enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) 'instance-0000002f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.894195795059204 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:25.301 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Setting boot order for instance: instance-00000031: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:57:25.398 4088 3038341024232 MainThread DEBUG nova.compute.manager [req-4f93768c-15de-4f63-98d5-fe90e23daff0 - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:25.433 4088 3038341024232 MainThread INFO nova.compute.manager [req-4f93768c-15de-4f63-98d5-fe90e23daff0 - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:25.433 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:57:25.489 4088 3038342256952 MainThread DEBUG nova.network.neutron [req-46411d50-f7dd-4ce2-9bcb-eff392d96baf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Updated VIF entry in instance network info cache for port cb01aeef-2779-4f0c-9c98-ed9bfb3c8f6b. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:57:25.489 4088 3038342256952 MainThread DEBUG nova.network.neutron [req-46411d50-f7dd-4ce2-9bcb-eff392d96baf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Updating instance_info_cache with network_info: [{"id": "cb01aeef-2779-4f0c-9c98-ed9bfb3c8f6b", "address": "fa:16:3e:ef:e4:e3", "network": {"id": "c41f1f8c-6dd1-48a5-8a0a-87f80e196ac9", "bridge": null, "label": "tempest-ServersTestFqdnHostnames-712389274-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2902d375c2104912b7ea540517edd89f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcb01aeef-27", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:57:25.489 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-46411d50-f7dd-4ce2-9bcb-eff392d96baf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-cf1f3ab0-f978-4556-a81a-1be7a5bbfd12" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:57:25.600 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Waiting for WMI job: {'InstanceID': 'C92B9B73-7382-4526-9362-7C5563C869B2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15594), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:25.744 4088 3038342257832 MainThread ERROR os_win.utils.jobutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] WMI job failed: {'RawErrors': (('124\'instance-00000031\' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)instance-000000310CEC848F-D11C-4E1D-ABE3-F12FAAB96E7712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)instance-000000310CEC848F-D11C-4E1D-ABE3-F12FAAB96E7710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000031\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)instance-000000310CEC848F-D11C-4E1D-ABE3-F12FAAB96E77%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C92B9B73-7382-4526-9362-7C5563C869B2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114158), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 25), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 25), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000031' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)\n\nNot enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)\n\n'instance-00000031' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)", 'ErrorSummaryDescription': "'instance-00000031' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000031.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:25.744 4088 3038342257832 MainThread DEBUG os_win._utils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000031' failed to start. Not enough memory in the system to start the virtual machine instance-00000031. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000031' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Not enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) 'instance-00000031' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.31141018867492676 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:25.760 4088 3038359336040 MainThread DEBUG nova.virt.hyperv.vmops [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:57:25.802 4088 3038341575784 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:25.802 4088 3038341575784 MainThread INFO nova.compute.manager [-] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] VM Stopped (Lifecycle Event) 2021-09-10 16:57:25.802 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000031" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:25.802 4088 3038341024232 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000031" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:25.820 4088 3038341575784 MainThread DEBUG nova.compute.manager [req-fbf50c41-31e4-4e7b-8f79-94155b90efba - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:25.820 4088 3038341575784 MainThread DEBUG nova.virt.hyperv.vmops [req-fbf50c41-31e4-4e7b-8f79-94155b90efba - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:25.958 4088 3038341575784 MainThread DEBUG nova.compute.manager [req-fbf50c41-31e4-4e7b-8f79-94155b90efba - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:25.990 4088 3038341575784 MainThread INFO nova.compute.manager [req-fbf50c41-31e4-4e7b-8f79-94155b90efba - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:26.287 4088 3038342256424 MainThread DEBUG os_win.utils.jobutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Waiting for WMI job: {'InstanceID': '88391216-1B2E-443E-8766-A112C05A743C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17934), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:26.506 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:26.506 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:26.506 4088 3038342256952 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:26.506 4088 3038342256952 MainThread INFO nova.compute.manager [-] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] VM Stopped (Lifecycle Event) 2021-09-10 16:57:26.540 4088 3038342256424 MainThread ERROR os_win.utils.jobutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002f\' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)instance-0000002f6262FDC1-720E-4C82-9032-A0A2443585A812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)instance-0000002f6262FDC1-720E-4C82-9032-A0A2443585A810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)instance-0000002f6262FDC1-720E-4C82-9032-A0A2443585A8%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '88391216-1B2E-443E-8766-A112C05A743C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=149468), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 26), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 26), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002f' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)\n\nNot enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)\n\n'instance-0000002f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)", 'ErrorSummaryDescription': "'instance-0000002f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:26.540 4088 3038342256424 MainThread DEBUG os_win._utils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002f' failed to start. Not enough memory in the system to start the virtual machine instance-0000002f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002f' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Not enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) 'instance-0000002f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 4.177587032318115 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:26.540 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-141c8f77-9a14-444f-b1f4-951d6778b8d9 - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:26.540 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.vmops [req-141c8f77-9a14-444f-b1f4-951d6778b8d9 - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:26.602 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-141c8f77-9a14-444f-b1f4-951d6778b8d9 - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:26.661 4088 3038342256952 MainThread INFO nova.compute.manager [req-141c8f77-9a14-444f-b1f4-951d6778b8d9 - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:26.773 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Waiting for WMI job: {'InstanceID': '566811C7-6188-43CD-B9D0-314281E59566', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17076), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:26.928 4088 3038342257832 MainThread ERROR os_win.utils.jobutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] WMI job failed: {'RawErrors': (('124\'instance-00000031\' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)instance-000000310CEC848F-D11C-4E1D-ABE3-F12FAAB96E7712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)instance-000000310CEC848F-D11C-4E1D-ABE3-F12FAAB96E7710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000031\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)instance-000000310CEC848F-D11C-4E1D-ABE3-F12FAAB96E77%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '566811C7-6188-43CD-B9D0-314281E59566', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115181), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 26), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 26), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000031' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)\n\nNot enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)\n\n'instance-00000031' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)", 'ErrorSummaryDescription': "'instance-00000031' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000031.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:26.928 4088 3038342257832 MainThread DEBUG os_win._utils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000031' failed to start. Not enough memory in the system to start the virtual machine instance-00000031. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000031' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Not enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) 'instance-00000031' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4953317642211914 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:26.944 4088 3038341575784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000031" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:26.944 4088 3038341575784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000031" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:26.959 4088 3038341024232 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:26.959 4088 3038341024232 MainThread INFO nova.compute.manager [-] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] VM Stopped (Lifecycle Event) 2021-09-10 16:57:26.991 4088 3038341024232 MainThread DEBUG nova.compute.manager [req-fd2c9a38-7bac-446c-9d5e-03df8f7c1c32 - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:26.991 4088 3038341024232 MainThread DEBUG nova.virt.hyperv.vmops [req-fd2c9a38-7bac-446c-9d5e-03df8f7c1c32 - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:27.038 4088 3038341024232 MainThread DEBUG nova.compute.manager [req-fd2c9a38-7bac-446c-9d5e-03df8f7c1c32 - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:27.083 4088 3038341024232 MainThread INFO nova.compute.manager [req-fd2c9a38-7bac-446c-9d5e-03df8f7c1c32 - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:27.459 4088 3038340847048 GreenThread-42 DEBUG nova.network.neutron [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Successfully updated port: b43ab003-c273-4a5e-9873-deac1cf294b4 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:57:27.477 4088 3038340847048 GreenThread-42 DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Acquired lock "refresh_cache-19bd864f-b01d-42d3-8ca6-9b75067146fa" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:57:27.477 4088 3038340847048 GreenThread-42 DEBUG nova.network.neutron [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:57:27.570 4088 3038342256424 MainThread DEBUG os_win.utils.jobutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Waiting for WMI job: {'InstanceID': '3DEEB9AC-ABDD-49B7-80FE-2A247F2FA831', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18998), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:27.754 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-03166770-38d6-4b5f-8e1a-ef1444dd359c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Received event network-changed-b43ab003-c273-4a5e-9873-deac1cf294b4 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:57:27.754 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-03166770-38d6-4b5f-8e1a-ef1444dd359c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Refreshing instance network info cache due to event network-changed-b43ab003-c273-4a5e-9873-deac1cf294b4. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:57:27.817 4088 3038342258184 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:27.817 4088 3038342258184 MainThread INFO nova.compute.manager [-] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] VM Stopped (Lifecycle Event) 2021-09-10 16:57:27.817 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:27.817 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:27.834 4088 3038342256424 MainThread ERROR os_win.utils.jobutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002f\' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)instance-0000002f6262FDC1-720E-4C82-9032-A0A2443585A812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)instance-0000002f6262FDC1-720E-4C82-9032-A0A2443585A810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)instance-0000002f6262FDC1-720E-4C82-9032-A0A2443585A8%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3DEEB9AC-ABDD-49B7-80FE-2A247F2FA831', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=146645), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 27), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 27), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002f' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)\n\nNot enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)\n\n'instance-0000002f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)", 'ErrorSummaryDescription': "'instance-0000002f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:27.834 4088 3038342256424 MainThread DEBUG os_win._utils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000002f' failed to start. Not enough memory in the system to start the virtual machine instance-0000002f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002f' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Not enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) 'instance-0000002f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.471283912658691 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:27.834 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-24acf942-73aa-4433-993f-5566307ffe5d - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:27.834 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.vmops [req-24acf942-73aa-4433-993f-5566307ffe5d - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:27.881 4088 3038340847048 GreenThread-42 DEBUG nova.network.neutron [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:57:27.907 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-24acf942-73aa-4433-993f-5566307ffe5d - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:27.929 4088 3038342258184 MainThread INFO nova.compute.manager [req-24acf942-73aa-4433-993f-5566307ffe5d - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:27.969 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Waiting for WMI job: {'InstanceID': 'A59FFBB2-4317-4B4D-BA3D-74F10F6E4AB9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17577), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:28.100 4088 3038342257832 MainThread ERROR os_win.utils.jobutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] WMI job failed: {'RawErrors': (('124\'instance-00000031\' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)instance-000000310CEC848F-D11C-4E1D-ABE3-F12FAAB96E7712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)instance-000000310CEC848F-D11C-4E1D-ABE3-F12FAAB96E7710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000031\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)instance-000000310CEC848F-D11C-4E1D-ABE3-F12FAAB96E77%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A59FFBB2-4317-4B4D-BA3D-74F10F6E4AB9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113393), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 27), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 28), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000031' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)\n\nNot enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)\n\n'instance-00000031' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)", 'ErrorSummaryDescription': "'instance-00000031' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000031.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:28.100 4088 3038342257832 MainThread DEBUG os_win._utils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000031' failed to start. Not enough memory in the system to start the virtual machine instance-00000031. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000031' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Not enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) 'instance-00000031' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.667285203933716 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:28.145 4088 3038342258184 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:28.145 4088 3038342258184 MainThread INFO nova.compute.manager [-] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] VM Stopped (Lifecycle Event) 2021-09-10 16:57:28.145 4088 3038341575784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000031" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:28.145 4088 3038341575784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000031" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:28.176 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-2dc2320d-f96f-41c1-b3ec-59cf575a7528 - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:28.176 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.vmops [req-2dc2320d-f96f-41c1-b3ec-59cf575a7528 - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:28.236 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-2dc2320d-f96f-41c1-b3ec-59cf575a7528 - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:28.270 4088 3038342258184 MainThread INFO nova.compute.manager [req-2dc2320d-f96f-41c1-b3ec-59cf575a7528 - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:28.851 4088 3038342256424 MainThread DEBUG os_win.utils.jobutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Waiting for WMI job: {'InstanceID': 'F4ED8178-4F00-415B-BE51-B29526FF2CEE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16728), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:29.023 4088 3038340847048 GreenThread-42 DEBUG nova.network.neutron [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Updating instance_info_cache with network_info: [{"id": "b43ab003-c273-4a5e-9873-deac1cf294b4", "address": "fa:16:3e:0d:a0:24", "network": {"id": "dcfd5ed7-c94f-4b68-b56f-95b52ddf921f", "bridge": null, "label": "tempest-ImagesTestJSON-1170675645-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6ca07d9dc99a4581a698a232ffa065db", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapb43ab003-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:57:29.037 4088 3038340847048 GreenThread-42 DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Releasing lock "refresh_cache-19bd864f-b01d-42d3-8ca6-9b75067146fa" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:57:29.037 4088 3038340847048 GreenThread-42 DEBUG nova.compute.manager [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Instance network_info: |[{"id": "b43ab003-c273-4a5e-9873-deac1cf294b4", "address": "fa:16:3e:0d:a0:24", "network": {"id": "dcfd5ed7-c94f-4b68-b56f-95b52ddf921f", "bridge": null, "label": "tempest-ImagesTestJSON-1170675645-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6ca07d9dc99a4581a698a232ffa065db", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapb43ab003-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:57:29.037 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-03166770-38d6-4b5f-8e1a-ef1444dd359c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-19bd864f-b01d-42d3-8ca6-9b75067146fa" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:57:29.037 4088 3038342256952 MainThread DEBUG nova.network.neutron [req-03166770-38d6-4b5f-8e1a-ef1444dd359c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Refreshing network info cache for port b43ab003-c273-4a5e-9873-deac1cf294b4 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:57:29.037 4088 3038359336744 MainThread DEBUG nova.compute.manager [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Preparing to wait for external event network-vif-plugged-b43ab003-c273-4a5e-9873-deac1cf294b4 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:57:29.037 4088 3038359336744 MainThread DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "19bd864f-b01d-42d3-8ca6-9b75067146fa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:29.037 4088 3038359336744 MainThread DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "19bd864f-b01d-42d3-8ca6-9b75067146fa-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:29.037 4088 3038359336744 MainThread DEBUG os_win.utils.compute.vmutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Creating VM instance-00000033 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:57:29.224 4088 3038342256424 MainThread ERROR os_win.utils.jobutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] WMI job failed: {'RawErrors': (('124\'instance-0000002f\' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)instance-0000002f6262FDC1-720E-4C82-9032-A0A2443585A812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)instance-0000002f6262FDC1-720E-4C82-9032-A0A2443585A810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000002f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)instance-0000002f6262FDC1-720E-4C82-9032-A0A2443585A8%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'F4ED8178-4F00-415B-BE51-B29526FF2CEE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=151776), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 28), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 28), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000002f' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)\n\nNot enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)\n\n'instance-0000002f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8)", 'ErrorSummaryDescription': "'instance-0000002f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000002f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:29.224 4088 3038342256424 MainThread ERROR nova.virt.hyperv.vmops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Failed to change vm state of instance-0000002f to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000002f' failed to start. 2021-09-10 16:57:29.224 4088 3038342256424 MainThread INFO nova.virt.hyperv.vmops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Got request to destroy instance 2021-09-10 16:57:29.244 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Waiting for WMI job: {'InstanceID': 'B098825C-082B-4D74-B05F-2594E56557BE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17003), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:29.386 4088 3038342257832 MainThread ERROR os_win.utils.jobutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] WMI job failed: {'RawErrors': (('124\'instance-00000031\' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)instance-000000310CEC848F-D11C-4E1D-ABE3-F12FAAB96E7712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)instance-000000310CEC848F-D11C-4E1D-ABE3-F12FAAB96E7710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000031\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)instance-000000310CEC848F-D11C-4E1D-ABE3-F12FAAB96E77%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B098825C-082B-4D74-B05F-2594E56557BE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112407), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 29), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 29), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000031' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)\n\nNot enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)\n\n'instance-00000031' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)", 'ErrorSummaryDescription': "'instance-00000031' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000031.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:29.386 4088 3038342257832 MainThread DEBUG os_win._utils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000031' failed to start. Not enough memory in the system to start the virtual machine instance-00000031. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000031' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Not enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) 'instance-00000031' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.9531896114349365 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:29.443 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:29.443 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000002f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:29.443 4088 3038338907832 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:29.443 4088 3038338907832 MainThread INFO nova.compute.manager [-] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] VM Stopped (Lifecycle Event) 2021-09-10 16:57:29.479 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000031" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:29.479 4088 3038338907304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000031" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:29.479 4088 3038296623592 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:29.479 4088 3038296623592 MainThread INFO nova.compute.manager [-] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] VM Stopped (Lifecycle Event) 2021-09-10 16:57:29.479 4088 3038338907832 MainThread DEBUG nova.compute.manager [req-cc0f2c2c-c9fb-483f-941c-d3b0679a2fa6 - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:29.479 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.vmops [req-cc0f2c2c-c9fb-483f-941c-d3b0679a2fa6 - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:29.496 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-655b585d-dc25-4d2b-9834-d77651e00c03 - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:29.496 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-655b585d-dc25-4d2b-9834-d77651e00c03 - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:29.615 4088 3038338907832 MainThread DEBUG nova.compute.manager [req-cc0f2c2c-c9fb-483f-941c-d3b0679a2fa6 - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:29.615 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-655b585d-dc25-4d2b-9834-d77651e00c03 - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:29.646 4088 3038338907832 MainThread INFO nova.compute.manager [req-cc0f2c2c-c9fb-483f-941c-d3b0679a2fa6 - - - - -] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:29.661 4088 3038296623592 MainThread INFO nova.compute.manager [req-655b585d-dc25-4d2b-9834-d77651e00c03 - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:30.415 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Waiting for WMI job: {'InstanceID': '5D86DFE6-C69C-49CC-BB8E-83D4999838D5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16619), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:30.554 4088 3038342257832 MainThread ERROR os_win.utils.jobutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] WMI job failed: {'RawErrors': (('124\'instance-00000031\' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)instance-000000310CEC848F-D11C-4E1D-ABE3-F12FAAB96E7712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)instance-000000310CEC848F-D11C-4E1D-ABE3-F12FAAB96E7710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000031\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)instance-000000310CEC848F-D11C-4E1D-ABE3-F12FAAB96E77%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5D86DFE6-C69C-49CC-BB8E-83D4999838D5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117205), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 30), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 30), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000031' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)\n\nNot enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)\n\n'instance-00000031' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)", 'ErrorSummaryDescription': "'instance-00000031' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000031.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:30.572 4088 3038342257832 MainThread DEBUG os_win._utils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000031' failed to start. Not enough memory in the system to start the virtual machine instance-00000031. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000031' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Not enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) 'instance-00000031' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.139545202255249 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:30.647 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000031" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:30.647 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000031" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:30.647 4088 3038296623592 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:30.647 4088 3038296623592 MainThread INFO nova.compute.manager [-] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] VM Stopped (Lifecycle Event) 2021-09-10 16:57:30.671 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-656ddb5e-7308-4d02-9560-e703d25e21ea - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:30.671 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-656ddb5e-7308-4d02-9560-e703d25e21ea - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:30.709 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-656ddb5e-7308-4d02-9560-e703d25e21ea - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:30.741 4088 3038296623592 MainThread INFO nova.compute.manager [req-656ddb5e-7308-4d02-9560-e703d25e21ea - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:30.991 4088 3038359336744 MainThread DEBUG nova.virt.hyperv.vmops [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:57:31.192 4088 3038342256952 MainThread DEBUG nova.network.neutron [req-03166770-38d6-4b5f-8e1a-ef1444dd359c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Updated VIF entry in instance network info cache for port b43ab003-c273-4a5e-9873-deac1cf294b4. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:57:31.192 4088 3038342256952 MainThread DEBUG nova.network.neutron [req-03166770-38d6-4b5f-8e1a-ef1444dd359c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Updating instance_info_cache with network_info: [{"id": "b43ab003-c273-4a5e-9873-deac1cf294b4", "address": "fa:16:3e:0d:a0:24", "network": {"id": "dcfd5ed7-c94f-4b68-b56f-95b52ddf921f", "bridge": null, "label": "tempest-ImagesTestJSON-1170675645-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6ca07d9dc99a4581a698a232ffa065db", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapb43ab003-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:57:31.224 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-03166770-38d6-4b5f-8e1a-ef1444dd359c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-19bd864f-b01d-42d3-8ca6-9b75067146fa" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:57:31.520 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-a2815fda-41ca-4e55-94cf-f9fab7922195 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Received event network-vif-plugged-cb01aeef-2779-4f0c-9c98-ed9bfb3c8f6b external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:57:31.520 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-a2815fda-41ca-4e55-94cf-f9fab7922195 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "cf1f3ab0-f978-4556-a81a-1be7a5bbfd12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:31.520 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-a2815fda-41ca-4e55-94cf-f9fab7922195 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "cf1f3ab0-f978-4556-a81a-1be7a5bbfd12-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:31.520 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-a2815fda-41ca-4e55-94cf-f9fab7922195 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Processing event network-vif-plugged-cb01aeef-2779-4f0c-9c98-ed9bfb3c8f6b _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:57:31.583 4088 3038359336040 MainThread INFO nova.virt.hyperv.vmops [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Using config drive for instance 2021-09-10 16:57:31.599 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.vmops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:57:31.599 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "instance-0000002f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:31.599 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "instance-0000002f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:31.599 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Waiting for WMI job: {'InstanceID': '2E944F81-CE81-4C5D-8405-75A7B1F21964', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=22291), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:31.630 4088 3038342256424 MainThread DEBUG os_win.utils.compute.vmutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Successfully changed vm state of instance-0000002f to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:57:31.630 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.vmops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Successfully changed state of VM instance-0000002f to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:57:31.692 4088 3038342256424 MainThread DEBUG os_win.utils.jobutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Waiting for WMI job: {'InstanceID': '06DC6A53-A3D8-4867-B7FA-F457754F4BFC', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15148), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:31.818 4088 3038342256424 MainThread DEBUG os_win.utils.jobutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] WMI job succeeded: {'InstanceID': '06DC6A53-A3D8-4867-B7FA-F457754F4BFC', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=105865), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:57:31.818 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "instance-0000002f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:31.818 4088 3038342256424 MainThread DEBUG os_win.utils.pathutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Removing directory: C:\openstack\instances\instance-0000002f check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:57:31.833 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "instance-0000002f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:31.833 4088 3038342256424 MainThread ERROR nova.compute.manager [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002f' failed to start. Not enough memory in the system to start the virtual machine instance-0000002f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002f' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Not enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) 'instance-0000002f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Error code: 32778. 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Traceback (most recent call last): 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] return function(*args, **kwargs) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] admin_password, network_info, block_device_info) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] return function(self, *args, **kwds) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self.force_reraise() 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] raise self.value 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] should_plug_vifs=False) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 'req_state': req_state}) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self.force_reraise() 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] raise self.value 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] time.sleep(sleep_time) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self.force_reraise() 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] raise self.value 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] return f(*args, **kwargs) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] return self._wait_for_job(job_path) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] error_desc=err_desc) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000002f' failed to start. 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Not enough memory in the system to start the virtual machine instance-0000002f. 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002f' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Not enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 'instance-0000002f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Error code: 32778. 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] During handling of the above exception, another exception occurred: 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Traceback (most recent call last): 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] yield resources 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] accel_info=accel_info) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] return function(*args, **kwargs) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] admin_password, network_info, block_device_info) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] return function(self, *args, **kwds) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self.force_reraise() 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] raise self.value 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] should_plug_vifs=False) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 'req_state': req_state}) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self.force_reraise() 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] raise self.value 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] time.sleep(sleep_time) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self.force_reraise() 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] raise self.value 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] return f(*args, **kwargs) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] return self._wait_for_job(job_path) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] error_desc=err_desc) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002f' failed to start. 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Not enough memory in the system to start the virtual machine instance-0000002f. 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002f' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Not enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 'instance-0000002f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Error code: 32778. 2021-09-10 16:57:31.833 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:31.833 4088 3038342256424 MainThread INFO nova.compute.manager [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Terminating instance 2021-09-10 16:57:31.833 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:57:31.833 4088 3038342256424 MainThread INFO nova.virt.hyperv.vmops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Got request to destroy instance 2021-09-10 16:57:31.855 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.vmops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:57:31.855 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "instance-0000002f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:31.855 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "instance-0000002f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:31.855 4088 3038342256424 MainThread INFO nova.compute.manager [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 16:57:31.855 4088 3038342256424 MainThread DEBUG nova.compute.claims [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:57:31.855 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:31.855 4088 3038338908008 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:31.855 4088 3038338908008 MainThread INFO nova.compute.manager [-] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] VM Stopped (Lifecycle Event) 2021-09-10 16:57:31.855 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000031" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:31.855 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000031" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:31.880 4088 3038342257832 MainThread ERROR os_win.utils.jobutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] WMI job failed: {'RawErrors': (('124\'instance-00000031\' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)instance-000000310CEC848F-D11C-4E1D-ABE3-F12FAAB96E7712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)instance-000000310CEC848F-D11C-4E1D-ABE3-F12FAAB96E7710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000031\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)instance-000000310CEC848F-D11C-4E1D-ABE3-F12FAAB96E77%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '2E944F81-CE81-4C5D-8405-75A7B1F21964', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=201461), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 31), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 31), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000031' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)\n\nNot enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)\n\n'instance-00000031' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77)", 'ErrorSummaryDescription': "'instance-00000031' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000031.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:31.880 4088 3038342257832 MainThread ERROR nova.virt.hyperv.vmops [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Failed to change vm state of instance-00000031 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000031' failed to start. 2021-09-10 16:57:31.880 4088 3038342257832 MainThread INFO nova.virt.hyperv.vmops [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Got request to destroy instance 2021-09-10 16:57:31.900 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-d86838f6-8895-499a-a51e-f46af6b5e1ef - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:31.900 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-d86838f6-8895-499a-a51e-f46af6b5e1ef - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:31.944 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-d86838f6-8895-499a-a51e-f46af6b5e1ef - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:31.995 4088 3038359336040 MainThread INFO nova.virt.hyperv.vmops [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Creating config drive at C:\openstack\instances\instance-00000032\configdrive.iso 2021-09-10 16:57:32.133 4088 3038359336040 MainThread DEBUG oslo_concurrency.processutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000032\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpzb0giywp execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:57:32.271 4088 3038338908008 MainThread INFO nova.compute.manager [req-d86838f6-8895-499a-a51e-f46af6b5e1ef - - - - -] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:32.271 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.hostops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:57:32.306 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.hostops [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:57:32.523 4088 3038359336040 MainThread DEBUG oslo_concurrency.processutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000032\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpzb0giywp" returned: 0 in 0.390s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:57:32.552 4088 3038342256424 MainThread DEBUG nova.compute.provider_tree [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:57:32.567 4088 3038342256424 MainThread DEBUG nova.scheduler.client.report [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:57:32.567 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.718s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:32.567 4088 3038342256424 MainThread ERROR nova.compute.manager [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002f' failed to start. Not enough memory in the system to start the virtual machine instance-0000002f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002f' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Not enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) 'instance-0000002f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Error code: 32778. 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Traceback (most recent call last): 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] return function(*args, **kwargs) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] admin_password, network_info, block_device_info) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] return function(self, *args, **kwds) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self.force_reraise() 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] raise self.value 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] should_plug_vifs=False) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 'req_state': req_state}) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self.force_reraise() 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] raise self.value 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] time.sleep(sleep_time) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self.force_reraise() 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] raise self.value 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] return f(*args, **kwargs) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] return self._wait_for_job(job_path) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] error_desc=err_desc) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000002f' failed to start. 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Not enough memory in the system to start the virtual machine instance-0000002f. 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002f' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Not enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 'instance-0000002f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Error code: 32778. 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] During handling of the above exception, another exception occurred: 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Traceback (most recent call last): 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] accel_info=accel_info) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] return function(*args, **kwargs) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] admin_password, network_info, block_device_info) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] return function(self, *args, **kwds) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self.force_reraise() 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] raise self.value 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] should_plug_vifs=False) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 'req_state': req_state}) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self.force_reraise() 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] raise self.value 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] time.sleep(sleep_time) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self.force_reraise() 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] raise self.value 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] return f(*args, **kwargs) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] return self._wait_for_job(job_path) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] error_desc=err_desc) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000002f' failed to start. 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Not enough memory in the system to start the virtual machine instance-0000002f. 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002f' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Not enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 'instance-0000002f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Error code: 32778. 2021-09-10 16:57:32.567 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: a5380419-a846-48fc-891c-d88dc8215cfd] 2021-09-10 16:57:32.583 4088 3038342256424 MainThread DEBUG nova.compute.utils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] WMI job failed with status 10. Error summary description: 'instance-0000002f' failed to start. Not enough memory in the system to start the virtual machine instance-0000002f. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:57:32.583 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Build of instance a5380419-a846-48fc-891c-d88dc8215cfd was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000002f' failed to start. Not enough memory in the system to start the virtual machine instance-0000002f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000002f' failed to start. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Not enough memory in the system to start the virtual machine instance-0000002f with ram size 1024 megabytes. (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) 'instance-0000002f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6262FDC1-720E-4C82-9032-A0A2443585A8) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:57:32.583 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:57:32.583 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:57:32.583 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:57:32.583 4088 3038342256424 MainThread DEBUG nova.network.neutron [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:57:33.067 4088 3038359336040 MainThread DEBUG nova.virt.hyperv.vmops [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Setting boot order for instance: instance-00000032: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:57:33.193 4088 3038359336040 MainThread DEBUG nova.virt.hyperv.vmops [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:57:33.230 4088 3038359336040 MainThread DEBUG os_win.utils.jobutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Waiting for WMI job: {'InstanceID': '3D9C5904-8B3F-4AFC-BA05-29CC82AFB6AF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15719), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:33.370 4088 3038359336040 MainThread ERROR os_win.utils.jobutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] WMI job failed: {'RawErrors': (('124\'instance-00000032\' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)instance-00000032BA23F826-5C1F-486F-9BEC-CAA558F4AEFD12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)instance-00000032BA23F826-5C1F-486F-9BEC-CAA558F4AEFD10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000032\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)instance-00000032BA23F826-5C1F-486F-9BEC-CAA558F4AEFD%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3D9C5904-8B3F-4AFC-BA05-29CC82AFB6AF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116962), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 33), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 33), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000032' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)\n\nNot enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)\n\n'instance-00000032' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)", 'ErrorSummaryDescription': "'instance-00000032' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000032.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:33.386 4088 3038359336040 MainThread DEBUG os_win._utils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000032' failed to start. Not enough memory in the system to start the virtual machine instance-00000032. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000032' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Not enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) 'instance-00000032' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.19278311729431152 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:33.412 4088 3038338907656 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:33.412 4088 3038338907656 MainThread INFO nova.compute.manager [-] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] VM Stopped (Lifecycle Event) 2021-09-10 16:57:33.412 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000032" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:33.412 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000032" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:33.442 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-bd534327-9354-4893-8689-022774ebd37d - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:33.460 4088 3038338907656 MainThread DEBUG nova.virt.hyperv.vmops [req-bd534327-9354-4893-8689-022774ebd37d - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:33.506 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-bd534327-9354-4893-8689-022774ebd37d - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:33.569 4088 3038338907656 MainThread INFO nova.compute.manager [req-bd534327-9354-4893-8689-022774ebd37d - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:34.209 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:57:34.209 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Lock "instance-00000031" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:34.233 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Lock "instance-00000031" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:34.241 4088 3038342257832 MainThread DEBUG os_win.utils.compute.vmutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Successfully changed vm state of instance-00000031 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:57:34.241 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Successfully changed state of VM instance-00000031 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:57:34.300 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Waiting for WMI job: {'InstanceID': '4A9DD5BE-4C16-4536-B44A-2349E8567F8E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15468), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:34.427 4088 3038359336040 MainThread DEBUG os_win.utils.jobutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Waiting for WMI job: {'InstanceID': 'FABF206C-2A69-4778-9776-9358B40A5562', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16431), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:34.427 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] WMI job succeeded: {'InstanceID': '4A9DD5BE-4C16-4536-B44A-2349E8567F8E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=119634), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:57:34.446 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Lock "instance-00000031" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:34.446 4088 3038342257832 MainThread DEBUG os_win.utils.pathutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Removing directory: C:\openstack\instances\instance-00000031 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:57:34.446 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Lock "instance-00000031" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:34.446 4088 3038342257832 MainThread ERROR nova.compute.manager [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000031' failed to start. Not enough memory in the system to start the virtual machine instance-00000031. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000031' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Not enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) 'instance-00000031' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Error code: 32778. 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Traceback (most recent call last): 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] return function(*args, **kwargs) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] admin_password, network_info, block_device_info) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] return function(self, *args, **kwds) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self.force_reraise() 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] raise self.value 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] should_plug_vifs=False) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 'req_state': req_state}) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self.force_reraise() 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] raise self.value 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] time.sleep(sleep_time) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self.force_reraise() 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] raise self.value 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] return f(*args, **kwargs) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] return self._wait_for_job(job_path) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] error_desc=err_desc) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000031' failed to start. 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Not enough memory in the system to start the virtual machine instance-00000031. 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000031' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Not enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 'instance-00000031' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Error code: 32778. 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] During handling of the above exception, another exception occurred: 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Traceback (most recent call last): 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] yield resources 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] accel_info=accel_info) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] return function(*args, **kwargs) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] admin_password, network_info, block_device_info) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] return function(self, *args, **kwds) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self.force_reraise() 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] raise self.value 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] should_plug_vifs=False) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 'req_state': req_state}) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self.force_reraise() 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] raise self.value 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] time.sleep(sleep_time) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self.force_reraise() 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] raise self.value 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] return f(*args, **kwargs) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] return self._wait_for_job(job_path) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] error_desc=err_desc) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000031' failed to start. 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Not enough memory in the system to start the virtual machine instance-00000031. 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000031' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Not enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 'instance-00000031' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Error code: 32778. 2021-09-10 16:57:34.446 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.446 4088 3038342257832 MainThread INFO nova.compute.manager [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Terminating instance 2021-09-10 16:57:34.446 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:57:34.446 4088 3038342257832 MainThread INFO nova.virt.hyperv.vmops [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Got request to destroy instance 2021-09-10 16:57:34.506 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:57:34.506 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Lock "instance-00000031" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:34.506 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Lock "instance-00000031" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:34.506 4088 3038342257832 MainThread INFO nova.compute.manager [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Took 0.06 seconds to destroy the instance on the hypervisor. 2021-09-10 16:57:34.506 4088 3038342257832 MainThread DEBUG nova.compute.claims [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:57:34.506 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:34.567 4088 3038359336040 MainThread ERROR os_win.utils.jobutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] WMI job failed: {'RawErrors': (('124\'instance-00000032\' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)instance-00000032BA23F826-5C1F-486F-9BEC-CAA558F4AEFD12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)instance-00000032BA23F826-5C1F-486F-9BEC-CAA558F4AEFD10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000032\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)instance-00000032BA23F826-5C1F-486F-9BEC-CAA558F4AEFD%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'FABF206C-2A69-4778-9776-9358B40A5562', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114722), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 34), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 34), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000032' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)\n\nNot enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)\n\n'instance-00000032' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)", 'ErrorSummaryDescription': "'instance-00000032' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000032.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:34.567 4088 3038359336040 MainThread DEBUG os_win._utils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000032' failed to start. Not enough memory in the system to start the virtual machine instance-00000032. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000032' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Not enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) 'instance-00000032' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.374267339706421 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:34.604 4088 3038338907656 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:34.604 4088 3038338907656 MainThread INFO nova.compute.manager [-] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] VM Stopped (Lifecycle Event) 2021-09-10 16:57:34.604 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000032" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:34.604 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000032" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:34.668 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-fdbf99f1-b221-4228-adcc-a6c63de08cbb - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:34.668 4088 3038338907656 MainThread DEBUG nova.virt.hyperv.vmops [req-fdbf99f1-b221-4228-adcc-a6c63de08cbb - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:34.693 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.hostops [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:57:34.715 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.hostops [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:57:34.729 4088 3038338907656 MainThread DEBUG nova.compute.manager [req-fdbf99f1-b221-4228-adcc-a6c63de08cbb - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:34.757 4088 3038338907656 MainThread INFO nova.compute.manager [req-fdbf99f1-b221-4228-adcc-a6c63de08cbb - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:34.959 4088 3038342257832 MainThread DEBUG nova.compute.provider_tree [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:57:34.991 4088 3038342257832 MainThread DEBUG nova.scheduler.client.report [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:57:34.991 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.484s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:34.991 4088 3038342257832 MainThread ERROR nova.compute.manager [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000031' failed to start. Not enough memory in the system to start the virtual machine instance-00000031. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000031' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Not enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) 'instance-00000031' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Error code: 32778. 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Traceback (most recent call last): 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] return function(*args, **kwargs) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] admin_password, network_info, block_device_info) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] return function(self, *args, **kwds) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self.force_reraise() 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] raise self.value 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] should_plug_vifs=False) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 'req_state': req_state}) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self.force_reraise() 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] raise self.value 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] time.sleep(sleep_time) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self.force_reraise() 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] raise self.value 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] return f(*args, **kwargs) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] return self._wait_for_job(job_path) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] error_desc=err_desc) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000031' failed to start. 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Not enough memory in the system to start the virtual machine instance-00000031. 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000031' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Not enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 'instance-00000031' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Error code: 32778. 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] During handling of the above exception, another exception occurred: 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Traceback (most recent call last): 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] accel_info=accel_info) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] return function(*args, **kwargs) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] admin_password, network_info, block_device_info) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] return function(self, *args, **kwds) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self.force_reraise() 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] raise self.value 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] should_plug_vifs=False) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 'req_state': req_state}) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self.force_reraise() 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] raise self.value 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] time.sleep(sleep_time) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self.force_reraise() 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] raise self.value 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] return f(*args, **kwargs) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] return self._wait_for_job(job_path) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] error_desc=err_desc) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000031' failed to start. 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Not enough memory in the system to start the virtual machine instance-00000031. 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000031' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Not enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 'instance-00000031' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Error code: 32778. 2021-09-10 16:57:34.991 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] 2021-09-10 16:57:34.991 4088 3038342257832 MainThread DEBUG nova.compute.utils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] WMI job failed with status 10. Error summary description: 'instance-00000031' failed to start. Not enough memory in the system to start the virtual machine instance-00000031. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:57:35.012 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Build of instance 8636793a-b94f-447d-a53a-4506e8a3032f was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000031' failed to start. Not enough memory in the system to start the virtual machine instance-00000031. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000031' failed to start. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Not enough memory in the system to start the virtual machine instance-00000031 with ram size 1024 megabytes. (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) 'instance-00000031' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CEC848F-D11C-4E1D-ABE3-F12FAAB96E77) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:57:35.012 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:57:35.012 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:57:35.012 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:57:35.012 4088 3038342257832 MainThread DEBUG nova.network.neutron [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:57:35.615 4088 3038359336040 MainThread DEBUG os_win.utils.jobutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Waiting for WMI job: {'InstanceID': 'FC5DF541-FFB6-469C-868F-4B622D2F4624', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17977), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:35.755 4088 3038359336040 MainThread ERROR os_win.utils.jobutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] WMI job failed: {'RawErrors': (('124\'instance-00000032\' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)instance-00000032BA23F826-5C1F-486F-9BEC-CAA558F4AEFD12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)instance-00000032BA23F826-5C1F-486F-9BEC-CAA558F4AEFD10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000032\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)instance-00000032BA23F826-5C1F-486F-9BEC-CAA558F4AEFD%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'FC5DF541-FFB6-469C-868F-4B622D2F4624', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119119), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 35), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 35), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000032' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)\n\nNot enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)\n\n'instance-00000032' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)", 'ErrorSummaryDescription': "'instance-00000032' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000032.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:35.755 4088 3038359336040 MainThread DEBUG os_win._utils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000032' failed to start. Not enough memory in the system to start the virtual machine instance-00000032. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000032' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Not enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) 'instance-00000032' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5620458126068115 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:35.820 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000032" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:35.820 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000032" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:35.820 4088 3038338905368 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:35.820 4088 3038338905368 MainThread INFO nova.compute.manager [-] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] VM Stopped (Lifecycle Event) 2021-09-10 16:57:35.851 4088 3038338905368 MainThread DEBUG nova.compute.manager [req-cbf4b8fc-2cde-464b-9cc8-b6fc7a86ed54 - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:35.851 4088 3038338905368 MainThread DEBUG nova.virt.hyperv.vmops [req-cbf4b8fc-2cde-464b-9cc8-b6fc7a86ed54 - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:35.913 4088 3038338905368 MainThread DEBUG nova.compute.manager [req-cbf4b8fc-2cde-464b-9cc8-b6fc7a86ed54 - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:35.930 4088 3038338905368 MainThread INFO nova.compute.manager [req-cbf4b8fc-2cde-464b-9cc8-b6fc7a86ed54 - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:36.039 4088 3038342256424 MainThread DEBUG nova.network.neutron [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:57:36.100 4088 3038342256424 MainThread INFO nova.compute.manager [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] [instance: a5380419-a846-48fc-891c-d88dc8215cfd] Took 3.52 seconds to deallocate network for instance. 2021-09-10 16:57:36.364 4088 3038342256424 MainThread INFO nova.scheduler.client.report [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Deleted allocations for instance a5380419-a846-48fc-891c-d88dc8215cfd 2021-09-10 16:57:36.444 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-43584bb6-e95c-41dd-9f96-67158c553862 73ac9100b70e4fa1b6ad7751b223e5ef 778686f367c642f39349bb208103a3ca - default default] Lock "a5380419-a846-48fc-891c-d88dc8215cfd" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 36.828s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:36.521 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:57:36.521 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 16:57:36.552 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:57:36.552 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 16:57:36.586 4088 3038342257832 MainThread DEBUG nova.network.neutron [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:57:36.632 4088 3038342257832 MainThread INFO nova.compute.manager [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] [instance: 8636793a-b94f-447d-a53a-4506e8a3032f] Took 1.62 seconds to deallocate network for instance. 2021-09-10 16:57:36.725 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:57:36.725 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 16:57:36.786 4088 3038359336040 MainThread DEBUG os_win.utils.jobutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Waiting for WMI job: {'InstanceID': 'BED57648-839C-44B5-BC23-CBAEE78E3E31', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15921), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:36.913 4088 3038342257832 MainThread INFO nova.scheduler.client.report [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Deleted allocations for instance 8636793a-b94f-447d-a53a-4506e8a3032f 2021-09-10 16:57:36.948 4088 3038359336040 MainThread ERROR os_win.utils.jobutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] WMI job failed: {'RawErrors': (('124\'instance-00000032\' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)instance-00000032BA23F826-5C1F-486F-9BEC-CAA558F4AEFD12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)instance-00000032BA23F826-5C1F-486F-9BEC-CAA558F4AEFD10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000032\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)instance-00000032BA23F826-5C1F-486F-9BEC-CAA558F4AEFD%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BED57648-839C-44B5-BC23-CBAEE78E3E31', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=123331), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 36), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 36), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000032' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)\n\nNot enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)\n\n'instance-00000032' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)", 'ErrorSummaryDescription': "'instance-00000032' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000032.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:36.948 4088 3038359336040 MainThread DEBUG os_win._utils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000032' failed to start. Not enough memory in the system to start the virtual machine instance-00000032. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000032' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Not enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) 'instance-00000032' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7547199726104736 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:36.960 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-3330bb93-aead-4609-abf4-e7f1b2893ccb 52b9f83ffb604b3388b2c32b65a2e8ff e36daecbd54a4138802bd46bc59ade0d - default default] Lock "8636793a-b94f-447d-a53a-4506e8a3032f" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 29.156s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:36.973 4088 3038338908008 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:36.973 4088 3038338908008 MainThread INFO nova.compute.manager [-] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] VM Stopped (Lifecycle Event) 2021-09-10 16:57:36.973 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000032" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:36.973 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000032" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:37.038 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-6f405c6c-3ed8-453a-9178-36725eaecf51 - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:37.038 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-6f405c6c-3ed8-453a-9178-36725eaecf51 - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:37.084 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-6f405c6c-3ed8-453a-9178-36725eaecf51 - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:37.155 4088 3038338908008 MainThread INFO nova.compute.manager [req-6f405c6c-3ed8-453a-9178-36725eaecf51 - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:37.786 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-6ab4d9bf-4f5b-4747-a6bd-de312f8b3b7f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Received event network-vif-plugged-b43ab003-c273-4a5e-9873-deac1cf294b4 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:57:37.786 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-6ab4d9bf-4f5b-4747-a6bd-de312f8b3b7f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "19bd864f-b01d-42d3-8ca6-9b75067146fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:37.786 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-6ab4d9bf-4f5b-4747-a6bd-de312f8b3b7f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "19bd864f-b01d-42d3-8ca6-9b75067146fa-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:37.786 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-6ab4d9bf-4f5b-4747-a6bd-de312f8b3b7f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Processing event network-vif-plugged-b43ab003-c273-4a5e-9873-deac1cf294b4 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:57:37.803 4088 3038359336744 MainThread INFO nova.virt.hyperv.vmops [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Using config drive for instance 2021-09-10 16:57:37.976 4088 3038359336040 MainThread DEBUG os_win.utils.jobutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Waiting for WMI job: {'InstanceID': '3346C76D-91D0-4657-8274-D00663191296', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15982), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:38.125 4088 3038359336040 MainThread ERROR os_win.utils.jobutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] WMI job failed: {'RawErrors': (('124\'instance-00000032\' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)instance-00000032BA23F826-5C1F-486F-9BEC-CAA558F4AEFD12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)instance-00000032BA23F826-5C1F-486F-9BEC-CAA558F4AEFD10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000032\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)instance-00000032BA23F826-5C1F-486F-9BEC-CAA558F4AEFD%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3346C76D-91D0-4657-8274-D00663191296', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117351), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 37), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 38), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000032' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)\n\nNot enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)\n\n'instance-00000032' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)", 'ErrorSummaryDescription': "'instance-00000032' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000032.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:38.125 4088 3038359336040 MainThread DEBUG os_win._utils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000032' failed to start. Not enough memory in the system to start the virtual machine instance-00000032. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000032' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Not enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) 'instance-00000032' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.932337999343872 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:38.152 4088 3038338908008 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:38.152 4088 3038338908008 MainThread INFO nova.compute.manager [-] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] VM Stopped (Lifecycle Event) 2021-09-10 16:57:38.152 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000032" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:38.152 4088 3038338905192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000032" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:38.165 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-5f1a8bcb-4e8a-4aea-9f65-c1a78056c0ae - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:38.165 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-5f1a8bcb-4e8a-4aea-9f65-c1a78056c0ae - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:38.230 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-5f1a8bcb-4e8a-4aea-9f65-c1a78056c0ae - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:38.263 4088 3038338908008 MainThread INFO nova.compute.manager [req-5f1a8bcb-4e8a-4aea-9f65-c1a78056c0ae - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:38.460 4088 3038359336744 MainThread INFO nova.virt.hyperv.vmops [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Creating config drive at C:\openstack\instances\instance-00000033\configdrive.iso 2021-09-10 16:57:38.537 4088 3038359336744 MainThread DEBUG oslo_concurrency.processutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000033\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpqip1vzl_ execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:57:38.868 4088 3038359336744 MainThread DEBUG oslo_concurrency.processutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000033\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpqip1vzl_" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:57:39.163 4088 3038359336040 MainThread DEBUG os_win.utils.jobutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Waiting for WMI job: {'InstanceID': '3DE35BEC-2DE4-462D-96D7-F927F3D7F1E3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15170), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:39.195 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Updating instance_info_cache with network_info: [{"id": "e94d3f34-4aa5-46a2-9cf3-221c28446067", "address": "fa:16:3e:bd:9b:a0", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape94d3f34-4a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:57:39.223 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:57:39.223 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 16:57:39.223 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:57:39.223 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:57:39.317 4088 3038359336040 MainThread ERROR os_win.utils.jobutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] WMI job failed: {'RawErrors': (('124\'instance-00000032\' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)instance-00000032BA23F826-5C1F-486F-9BEC-CAA558F4AEFD12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)instance-00000032BA23F826-5C1F-486F-9BEC-CAA558F4AEFD10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000032\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)instance-00000032BA23F826-5C1F-486F-9BEC-CAA558F4AEFD%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3DE35BEC-2DE4-462D-96D7-F927F3D7F1E3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118220), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 39), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 39), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000032' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)\n\nNot enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)\n\n'instance-00000032' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD)", 'ErrorSummaryDescription': "'instance-00000032' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000032.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:39.317 4088 3038359336040 MainThread ERROR nova.virt.hyperv.vmops [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Failed to change vm state of instance-00000032 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000032' failed to start. 2021-09-10 16:57:39.317 4088 3038359336040 MainThread INFO nova.virt.hyperv.vmops [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Got request to destroy instance 2021-09-10 16:57:39.317 4088 3038296623592 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:39.317 4088 3038296623592 MainThread INFO nova.compute.manager [-] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] VM Stopped (Lifecycle Event) 2021-09-10 16:57:39.335 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000032" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:39.335 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000032" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:39.350 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-3c8febc9-6c3e-4184-b95f-a815ce915fd4 - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:39.350 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-3c8febc9-6c3e-4184-b95f-a815ce915fd4 - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:39.429 4088 3038359336744 MainThread DEBUG nova.virt.hyperv.vmops [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Setting boot order for instance: instance-00000033: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:57:39.460 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-3c8febc9-6c3e-4184-b95f-a815ce915fd4 - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:39.505 4088 3038296623592 MainThread INFO nova.compute.manager [req-3c8febc9-6c3e-4184-b95f-a815ce915fd4 - - - - -] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:39.535 4088 3038359336744 MainThread DEBUG nova.virt.hyperv.vmops [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:57:39.553 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:57:39.553 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:57:39.569 4088 3038359336744 MainThread DEBUG os_win.utils.jobutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': '983EF0D3-DBD9-4D8D-BC4F-DA0A1F21C81C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19582), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:39.708 4088 3038359336744 MainThread ERROR os_win.utils.jobutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-00000033\' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)instance-000000339839E5D8-4834-4ADB-AF2E-5C9E8FFF09C212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)instance-000000339839E5D8-4834-4ADB-AF2E-5C9E8FFF09C210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000033\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)instance-000000339839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '983EF0D3-DBD9-4D8D-BC4F-DA0A1F21C81C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119162), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 39), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 39), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000033' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)\n\nNot enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)\n\n'instance-00000033' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)", 'ErrorSummaryDescription': "'instance-00000033' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000033.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:39.708 4088 3038359336744 MainThread DEBUG os_win._utils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000033' failed to start. Not enough memory in the system to start the virtual machine instance-00000033. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000033' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Not enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) 'instance-00000033' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.17225217819213867 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:39.734 4088 3038296623592 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:39.734 4088 3038296623592 MainThread INFO nova.compute.manager [-] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] VM Stopped (Lifecycle Event) 2021-09-10 16:57:39.734 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000033" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:39.734 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000033" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:39.770 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-d5673c42-06b4-4815-8935-f40ea44de03d - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:39.784 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-d5673c42-06b4-4815-8935-f40ea44de03d - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:39.819 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-d5673c42-06b4-4815-8935-f40ea44de03d - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:39.856 4088 3038296623592 MainThread INFO nova.compute.manager [req-d5673c42-06b4-4815-8935-f40ea44de03d - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:40.553 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:57:40.553 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:57:40.739 4088 3038359336744 MainThread DEBUG os_win.utils.jobutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': 'C2D16E96-2B33-426F-9105-1E6776FE4CF7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17680), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:40.900 4088 3038359336744 MainThread ERROR os_win.utils.jobutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-00000033\' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)instance-000000339839E5D8-4834-4ADB-AF2E-5C9E8FFF09C212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)instance-000000339839E5D8-4834-4ADB-AF2E-5C9E8FFF09C210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000033\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)instance-000000339839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C2D16E96-2B33-426F-9105-1E6776FE4CF7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121730), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 40), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 40), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000033' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)\n\nNot enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)\n\n'instance-00000033' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)", 'ErrorSummaryDescription': "'instance-00000033' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000033.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:40.900 4088 3038359336744 MainThread DEBUG os_win._utils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000033' failed to start. Not enough memory in the system to start the virtual machine instance-00000033. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000033' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Not enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) 'instance-00000033' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.364377498626709 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:40.910 4088 3038296623592 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:40.910 4088 3038296623592 MainThread INFO nova.compute.manager [-] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] VM Stopped (Lifecycle Event) 2021-09-10 16:57:40.942 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000033" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:40.942 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000033" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:40.959 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-4b6e03c4-d7c7-4aed-a5e2-169394b2bbf6 - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:40.959 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-4b6e03c4-d7c7-4aed-a5e2-169394b2bbf6 - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:41.007 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-4b6e03c4-d7c7-4aed-a5e2-169394b2bbf6 - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:41.085 4088 3038296623592 MainThread INFO nova.compute.manager [req-4b6e03c4-d7c7-4aed-a5e2-169394b2bbf6 - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:41.301 4088 3038359336040 MainThread DEBUG nova.virt.hyperv.vmops [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:57:41.301 4088 3038359336040 MainThread DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Lock "instance-00000032" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:41.301 4088 3038359336040 MainThread DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Lock "instance-00000032" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:41.321 4088 3038359336040 MainThread DEBUG os_win.utils.compute.vmutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Successfully changed vm state of instance-00000032 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:57:41.321 4088 3038359336040 MainThread DEBUG nova.virt.hyperv.vmops [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Successfully changed state of VM instance-00000032 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:57:41.366 4088 3038359336040 MainThread DEBUG os_win.utils.jobutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Waiting for WMI job: {'InstanceID': '5CA48069-D67B-4B66-A0A0-1046EE5A134F', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15315), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:41.491 4088 3038359336040 MainThread DEBUG os_win.utils.jobutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] WMI job succeeded: {'InstanceID': '5CA48069-D67B-4B66-A0A0-1046EE5A134F', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=114250), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:57:41.491 4088 3038359336040 MainThread DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Lock "instance-00000032" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:41.491 4088 3038359336040 MainThread DEBUG os_win.utils.pathutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Removing directory: C:\openstack\instances\instance-00000032 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:57:41.491 4088 3038359336040 MainThread DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Lock "instance-00000032" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:41.491 4088 3038359336040 MainThread ERROR nova.compute.manager [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000032' failed to start. Not enough memory in the system to start the virtual machine instance-00000032. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000032' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Not enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) 'instance-00000032' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Error code: 32778. 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Traceback (most recent call last): 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] return function(*args, **kwargs) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] admin_password, network_info, block_device_info) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] return function(self, *args, **kwds) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self.force_reraise() 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] raise self.value 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] should_plug_vifs=False) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 'req_state': req_state}) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self.force_reraise() 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] raise self.value 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] time.sleep(sleep_time) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self.force_reraise() 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] raise self.value 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] return f(*args, **kwargs) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] return self._wait_for_job(job_path) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] error_desc=err_desc) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000032' failed to start. 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Not enough memory in the system to start the virtual machine instance-00000032. 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000032' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Not enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 'instance-00000032' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Error code: 32778. 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] During handling of the above exception, another exception occurred: 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Traceback (most recent call last): 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] yield resources 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] accel_info=accel_info) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] return function(*args, **kwargs) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] admin_password, network_info, block_device_info) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] return function(self, *args, **kwds) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self.force_reraise() 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] raise self.value 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] should_plug_vifs=False) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 'req_state': req_state}) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self.force_reraise() 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] raise self.value 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] time.sleep(sleep_time) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self.force_reraise() 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] raise self.value 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] return f(*args, **kwargs) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] return self._wait_for_job(job_path) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] error_desc=err_desc) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000032' failed to start. 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Not enough memory in the system to start the virtual machine instance-00000032. 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000032' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Not enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 'instance-00000032' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Error code: 32778. 2021-09-10 16:57:41.491 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:41.491 4088 3038359336040 MainThread INFO nova.compute.manager [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Terminating instance 2021-09-10 16:57:41.491 4088 3038359336040 MainThread DEBUG nova.compute.manager [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:57:41.491 4088 3038359336040 MainThread INFO nova.virt.hyperv.vmops [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Got request to destroy instance 2021-09-10 16:57:41.506 4088 3038359336040 MainThread DEBUG nova.virt.hyperv.vmops [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:57:41.506 4088 3038359336040 MainThread DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Lock "instance-00000032" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:41.506 4088 3038359336040 MainThread DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Lock "instance-00000032" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:41.506 4088 3038359336040 MainThread INFO nova.compute.manager [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 16:57:41.506 4088 3038359336040 MainThread DEBUG nova.compute.claims [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:57:41.506 4088 3038359336040 MainThread DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:41.739 4088 3038359336040 MainThread DEBUG nova.virt.hyperv.hostops [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:57:41.770 4088 3038359336040 MainThread DEBUG nova.virt.hyperv.hostops [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:57:41.928 4088 3038359336744 MainThread DEBUG os_win.utils.jobutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': '5F27B907-BCCA-438C-83C6-ABBD547BF5D2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17506), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:41.975 4088 3038359336040 MainThread DEBUG nova.compute.provider_tree [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:57:42.006 4088 3038359336040 MainThread DEBUG nova.scheduler.client.report [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:57:42.006 4088 3038359336040 MainThread DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.500s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:42.020 4088 3038359336040 MainThread ERROR nova.compute.manager [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000032' failed to start. Not enough memory in the system to start the virtual machine instance-00000032. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000032' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Not enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) 'instance-00000032' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Error code: 32778. 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Traceback (most recent call last): 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] return function(*args, **kwargs) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] admin_password, network_info, block_device_info) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] return function(self, *args, **kwds) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self.force_reraise() 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] raise self.value 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] should_plug_vifs=False) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 'req_state': req_state}) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self.force_reraise() 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] raise self.value 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] time.sleep(sleep_time) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self.force_reraise() 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] raise self.value 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] return f(*args, **kwargs) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] return self._wait_for_job(job_path) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] error_desc=err_desc) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000032' failed to start. 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Not enough memory in the system to start the virtual machine instance-00000032. 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000032' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Not enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 'instance-00000032' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Error code: 32778. 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] During handling of the above exception, another exception occurred: 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Traceback (most recent call last): 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] accel_info=accel_info) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] return function(*args, **kwargs) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] admin_password, network_info, block_device_info) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] return function(self, *args, **kwds) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self.force_reraise() 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] raise self.value 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] should_plug_vifs=False) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 'req_state': req_state}) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self.force_reraise() 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] raise self.value 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] time.sleep(sleep_time) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self.force_reraise() 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] raise self.value 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] return f(*args, **kwargs) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] return self._wait_for_job(job_path) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] error_desc=err_desc) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000032' failed to start. 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Not enough memory in the system to start the virtual machine instance-00000032. 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000032' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Not enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 'instance-00000032' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Error code: 32778. 2021-09-10 16:57:42.020 4088 3038359336040 MainThread TRACE nova.compute.manager [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] 2021-09-10 16:57:42.020 4088 3038359336040 MainThread DEBUG nova.compute.utils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] WMI job failed with status 10. Error summary description: 'instance-00000032' failed to start. Not enough memory in the system to start the virtual machine instance-00000032. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:57:42.020 4088 3038359336040 MainThread DEBUG nova.compute.manager [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Build of instance cf1f3ab0-f978-4556-a81a-1be7a5bbfd12 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000032' failed to start. Not enough memory in the system to start the virtual machine instance-00000032. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000032' failed to start. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Not enough memory in the system to start the virtual machine instance-00000032 with ram size 1024 megabytes. (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) 'instance-00000032' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BA23F826-5C1F-486F-9BEC-CAA558F4AEFD) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:57:42.020 4088 3038359336040 MainThread DEBUG nova.compute.manager [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:57:42.020 4088 3038359336040 MainThread DEBUG nova.compute.manager [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:57:42.020 4088 3038359336040 MainThread DEBUG nova.compute.manager [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:57:42.020 4088 3038359336040 MainThread DEBUG nova.network.neutron [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:57:42.136 4088 3038338906600 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:42.136 4088 3038338906600 MainThread INFO nova.compute.manager [-] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] VM Stopped (Lifecycle Event) 2021-09-10 16:57:42.136 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000033" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:42.136 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000033" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:42.164 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-c3423715-f395-4c58-a33f-75000abd14fc - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:42.164 4088 3038338906600 MainThread DEBUG nova.virt.hyperv.vmops [req-c3423715-f395-4c58-a33f-75000abd14fc - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:42.196 4088 3038359336744 MainThread ERROR os_win.utils.jobutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-00000033\' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)instance-000000339839E5D8-4834-4ADB-AF2E-5C9E8FFF09C212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)instance-000000339839E5D8-4834-4ADB-AF2E-5C9E8FFF09C210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000033\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)instance-000000339839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5F27B907-BCCA-438C-83C6-ABBD547BF5D2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=136888), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 41), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 42), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000033' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)\n\nNot enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)\n\n'instance-00000033' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)", 'ErrorSummaryDescription': "'instance-00000033' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000033.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:42.196 4088 3038359336744 MainThread DEBUG os_win._utils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000033' failed to start. Not enough memory in the system to start the virtual machine instance-00000033. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000033' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Not enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) 'instance-00000033' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.660421371459961 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:42.207 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-c3423715-f395-4c58-a33f-75000abd14fc - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:42.239 4088 3038338906600 MainThread INFO nova.compute.manager [req-c3423715-f395-4c58-a33f-75000abd14fc - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:43.240 4088 3038359336744 MainThread DEBUG os_win.utils.jobutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': '50A75CA6-3265-493F-8F49-B7B58B9D0D22', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15745), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:43.395 4088 3038359336744 MainThread ERROR os_win.utils.jobutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-00000033\' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)instance-000000339839E5D8-4834-4ADB-AF2E-5C9E8FFF09C212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)instance-000000339839E5D8-4834-4ADB-AF2E-5C9E8FFF09C210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000033\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)instance-000000339839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '50A75CA6-3265-493F-8F49-B7B58B9D0D22', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116351), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 43), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 43), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000033' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)\n\nNot enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)\n\n'instance-00000033' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)", 'ErrorSummaryDescription': "'instance-00000033' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000033.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:43.395 4088 3038359336744 MainThread DEBUG os_win._utils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000033' failed to start. Not enough memory in the system to start the virtual machine instance-00000033. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000033' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Not enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) 'instance-00000033' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.859447717666626 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:43.442 4088 3038338906600 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:43.442 4088 3038338906600 MainThread INFO nova.compute.manager [-] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] VM Stopped (Lifecycle Event) 2021-09-10 16:57:43.442 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000033" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:43.442 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000033" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:43.442 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-b3204617-a7bf-47f7-9d06-3f5239dcc898 - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:43.473 4088 3038338906600 MainThread DEBUG nova.virt.hyperv.vmops [req-b3204617-a7bf-47f7-9d06-3f5239dcc898 - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:43.520 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-b3204617-a7bf-47f7-9d06-3f5239dcc898 - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:43.566 4088 3038338906600 MainThread INFO nova.compute.manager [req-b3204617-a7bf-47f7-9d06-3f5239dcc898 - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:43.677 4088 3038359336040 MainThread DEBUG nova.network.neutron [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:57:43.725 4088 3038359336040 MainThread INFO nova.compute.manager [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] [instance: cf1f3ab0-f978-4556-a81a-1be7a5bbfd12] Took 1.70 seconds to deallocate network for instance. 2021-09-10 16:57:43.961 4088 3038359336040 MainThread INFO nova.scheduler.client.report [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Deleted allocations for instance cf1f3ab0-f978-4556-a81a-1be7a5bbfd12 2021-09-10 16:57:43.991 4088 3038359336040 MainThread DEBUG oslo_concurrency.lockutils [req-425c8b52-7152-4944-86e2-3e9c56157ea1 4b444bbec44249dda082cd505f5a9c27 2902d375c2104912b7ea540517edd89f - default default] Lock "cf1f3ab0-f978-4556-a81a-1be7a5bbfd12" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 30.890s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:44.428 4088 3038359336744 MainThread DEBUG os_win.utils.jobutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': '43F503BB-7D4D-4825-99C1-502DA362B723', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16038), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:44.566 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:57:44.566 4088 3038359336744 MainThread ERROR os_win.utils.jobutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-00000033\' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)instance-000000339839E5D8-4834-4ADB-AF2E-5C9E8FFF09C212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)instance-000000339839E5D8-4834-4ADB-AF2E-5C9E8FFF09C210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000033\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)instance-000000339839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '43F503BB-7D4D-4825-99C1-502DA362B723', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111860), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 44), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 44), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000033' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)\n\nNot enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)\n\n'instance-00000033' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)", 'ErrorSummaryDescription': "'instance-00000033' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000033.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:44.566 4088 3038359336744 MainThread DEBUG os_win._utils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000033' failed to start. Not enough memory in the system to start the virtual machine instance-00000033. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000033' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Not enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) 'instance-00000033' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.031236410140991 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:57:44.566 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:44.566 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:44.595 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 16:57:44.595 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:57:44.603 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000033" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:44.603 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000033" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:44.603 4088 3038338904840 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:44.603 4088 3038338904840 MainThread INFO nova.compute.manager [-] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] VM Stopped (Lifecycle Event) 2021-09-10 16:57:44.603 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:57:44.644 4088 3038338904840 MainThread DEBUG nova.compute.manager [req-2e277548-d369-4d24-857f-af39c97e5233 - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:44.644 4088 3038338904840 MainThread DEBUG nova.virt.hyperv.vmops [req-2e277548-d369-4d24-857f-af39c97e5233 - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:44.696 4088 3038338904840 MainThread DEBUG nova.compute.manager [req-2e277548-d369-4d24-857f-af39c97e5233 - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:44.756 4088 3038338904840 MainThread INFO nova.compute.manager [req-2e277548-d369-4d24-857f-af39c97e5233 - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:44.832 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2224MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 16:57:44.863 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:45.095 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:57:45.095 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:57:45.095 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:57:45.095 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:57:45.095 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:57:45.095 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:57:45.095 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:57:45.095 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:57:45.095 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:57:45.095 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:57:45.107 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:57:45.107 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:57:45.107 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:57:45.107 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 19bd864f-b01d-42d3-8ca6-9b75067146fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:57:45.107 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 16:57:45.107 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=14GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 16:57:45.147 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:57:45.179 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:57:45.366 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:57:45.412 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:57:45.412 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 16:57:45.412 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.547s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:45.598 4088 3038359336744 MainThread DEBUG os_win.utils.jobutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': 'CC3DA92D-D9B0-4362-BFF6-0A15E88A5775', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15580), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:45.741 4088 3038359336744 MainThread ERROR os_win.utils.jobutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-00000033\' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)instance-000000339839E5D8-4834-4ADB-AF2E-5C9E8FFF09C212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)instance-000000339839E5D8-4834-4ADB-AF2E-5C9E8FFF09C210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000033\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)instance-000000339839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'CC3DA92D-D9B0-4362-BFF6-0A15E88A5775', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111085), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 57, 45), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 57, 45), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000033' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)\n\nNot enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)\n\n'instance-00000033' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2)", 'ErrorSummaryDescription': "'instance-00000033' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000033.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:57:45.741 4088 3038359336744 MainThread ERROR nova.virt.hyperv.vmops [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Failed to change vm state of instance-00000033 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000033' failed to start. 2021-09-10 16:57:45.741 4088 3038359336744 MainThread INFO nova.virt.hyperv.vmops [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Got request to destroy instance 2021-09-10 16:57:45.756 4088 3038296623592 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:57:45.756 4088 3038296623592 MainThread INFO nova.compute.manager [-] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] VM Stopped (Lifecycle Event) 2021-09-10 16:57:45.756 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000033" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:45.756 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000033" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:45.803 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-1b6c5e3e-3a94-4255-9540-105258770b45 - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:57:45.803 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-1b6c5e3e-3a94-4255-9540-105258770b45 - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:57:45.854 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-1b6c5e3e-3a94-4255-9540-105258770b45 - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:57:45.854 4088 3038296623592 MainThread INFO nova.compute.manager [req-1b6c5e3e-3a94-4255-9540-105258770b45 - - - - -] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:57:47.786 4088 3038359336744 MainThread DEBUG nova.virt.hyperv.vmops [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:57:47.786 4088 3038359336744 MainThread DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000033" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:47.786 4088 3038359336744 MainThread DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000033" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:47.816 4088 3038359336744 MainThread DEBUG os_win.utils.compute.vmutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Successfully changed vm state of instance-00000033 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:57:47.816 4088 3038359336744 MainThread DEBUG nova.virt.hyperv.vmops [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Successfully changed state of VM instance-00000033 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:57:47.864 4088 3038359336744 MainThread DEBUG os_win.utils.jobutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': 'C4DCE84E-BA18-4205-8E6F-CACC47230B10', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18480), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:57:48.097 4088 3038359336744 MainThread DEBUG os_win.utils.jobutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job succeeded: {'InstanceID': 'C4DCE84E-BA18-4205-8E6F-CACC47230B10', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=160265), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:57:48.097 4088 3038359336744 MainThread DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000033" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:48.097 4088 3038359336744 MainThread DEBUG os_win.utils.pathutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Removing directory: C:\openstack\instances\instance-00000033 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:57:48.120 4088 3038359336744 MainThread DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000033" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:48.120 4088 3038359336744 MainThread ERROR nova.compute.manager [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000033' failed to start. Not enough memory in the system to start the virtual machine instance-00000033. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000033' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Not enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) 'instance-00000033' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Error code: 32778. 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Traceback (most recent call last): 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] return function(*args, **kwargs) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] admin_password, network_info, block_device_info) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] return function(self, *args, **kwds) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self.force_reraise() 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] raise self.value 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] should_plug_vifs=False) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 'req_state': req_state}) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self.force_reraise() 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] raise self.value 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] time.sleep(sleep_time) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self.force_reraise() 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] raise self.value 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] return f(*args, **kwargs) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] return self._wait_for_job(job_path) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] error_desc=err_desc) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000033' failed to start. 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Not enough memory in the system to start the virtual machine instance-00000033. 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000033' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Not enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 'instance-00000033' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Error code: 32778. 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] During handling of the above exception, another exception occurred: 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Traceback (most recent call last): 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] yield resources 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] accel_info=accel_info) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] return function(*args, **kwargs) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] admin_password, network_info, block_device_info) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] return function(self, *args, **kwds) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self.force_reraise() 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] raise self.value 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] should_plug_vifs=False) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 'req_state': req_state}) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self.force_reraise() 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] raise self.value 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] time.sleep(sleep_time) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self.force_reraise() 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] raise self.value 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] return f(*args, **kwargs) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] return self._wait_for_job(job_path) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] error_desc=err_desc) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000033' failed to start. 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Not enough memory in the system to start the virtual machine instance-00000033. 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000033' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Not enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 'instance-00000033' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Error code: 32778. 2021-09-10 16:57:48.120 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.120 4088 3038359336744 MainThread INFO nova.compute.manager [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Terminating instance 2021-09-10 16:57:48.120 4088 3038359336744 MainThread DEBUG nova.compute.manager [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:57:48.120 4088 3038359336744 MainThread INFO nova.virt.hyperv.vmops [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Got request to destroy instance 2021-09-10 16:57:48.129 4088 3038359336744 MainThread DEBUG nova.virt.hyperv.vmops [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:57:48.129 4088 3038359336744 MainThread DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000033" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:48.129 4088 3038359336744 MainThread DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000033" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:48.129 4088 3038359336744 MainThread INFO nova.compute.manager [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 16:57:48.129 4088 3038359336744 MainThread DEBUG nova.compute.claims [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:57:48.129 4088 3038359336744 MainThread DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:57:48.285 4088 3038359336744 MainThread DEBUG nova.virt.hyperv.hostops [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:57:48.305 4088 3038359336744 MainThread DEBUG nova.virt.hyperv.hostops [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:57:48.528 4088 3038359336744 MainThread DEBUG nova.compute.provider_tree [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:57:48.528 4088 3038359336744 MainThread DEBUG nova.scheduler.client.report [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:57:48.528 4088 3038359336744 MainThread DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.390s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:57:48.528 4088 3038359336744 MainThread ERROR nova.compute.manager [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000033' failed to start. Not enough memory in the system to start the virtual machine instance-00000033. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000033' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Not enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) 'instance-00000033' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Error code: 32778. 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Traceback (most recent call last): 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] return function(*args, **kwargs) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] admin_password, network_info, block_device_info) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] return function(self, *args, **kwds) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self.force_reraise() 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] raise self.value 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] should_plug_vifs=False) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 'req_state': req_state}) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self.force_reraise() 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] raise self.value 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] time.sleep(sleep_time) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self.force_reraise() 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] raise self.value 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] return f(*args, **kwargs) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] return self._wait_for_job(job_path) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] error_desc=err_desc) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000033' failed to start. 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Not enough memory in the system to start the virtual machine instance-00000033. 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000033' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Not enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 'instance-00000033' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Error code: 32778. 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] During handling of the above exception, another exception occurred: 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Traceback (most recent call last): 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] accel_info=accel_info) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] return function(*args, **kwargs) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] admin_password, network_info, block_device_info) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] return function(self, *args, **kwds) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self.force_reraise() 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] raise self.value 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] should_plug_vifs=False) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 'req_state': req_state}) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self.force_reraise() 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] raise self.value 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] time.sleep(sleep_time) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self.force_reraise() 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] raise self.value 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] return f(*args, **kwargs) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] return self._wait_for_job(job_path) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] error_desc=err_desc) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000033' failed to start. 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Not enough memory in the system to start the virtual machine instance-00000033. 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000033' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Not enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 'instance-00000033' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Error code: 32778. 2021-09-10 16:57:48.528 4088 3038359336744 MainThread TRACE nova.compute.manager [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] 2021-09-10 16:57:48.551 4088 3038359336744 MainThread DEBUG nova.compute.utils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] WMI job failed with status 10. Error summary description: 'instance-00000033' failed to start. Not enough memory in the system to start the virtual machine instance-00000033. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:57:48.551 4088 3038359336744 MainThread DEBUG nova.compute.manager [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Build of instance 19bd864f-b01d-42d3-8ca6-9b75067146fa was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000033' failed to start. Not enough memory in the system to start the virtual machine instance-00000033. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000033' failed to start. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Not enough memory in the system to start the virtual machine instance-00000033 with ram size 1024 megabytes. (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) 'instance-00000033' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9839E5D8-4834-4ADB-AF2E-5C9E8FFF09C2) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:57:48.551 4088 3038359336744 MainThread DEBUG nova.compute.manager [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:57:48.551 4088 3038359336744 MainThread DEBUG nova.compute.manager [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:57:48.551 4088 3038359336744 MainThread DEBUG nova.compute.manager [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:57:48.551 4088 3038359336744 MainThread DEBUG nova.network.neutron [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:57:50.947 4088 3038359336744 MainThread DEBUG nova.network.neutron [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:57:50.947 4088 3038359336744 MainThread INFO nova.compute.manager [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 19bd864f-b01d-42d3-8ca6-9b75067146fa] Took 2.39 seconds to deallocate network for instance. 2021-09-10 16:57:51.178 4088 3038359336744 MainThread INFO nova.scheduler.client.report [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Deleted allocations for instance 19bd864f-b01d-42d3-8ca6-9b75067146fa 2021-09-10 16:57:51.215 4088 3038359336744 MainThread DEBUG oslo_concurrency.lockutils [req-3e4a9c84-ec4f-47c2-b602-881c1f0b63bb 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "19bd864f-b01d-42d3-8ca6-9b75067146fa" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 29.891s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:01.804 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Lock "a60acc40-a373-4430-b931-0d33ee511d49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:01.848 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:58:01.973 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:01.973 4088 3038338906600 MainThread DEBUG nova.virt.hardware [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:58:01.973 4088 3038338906600 MainThread INFO nova.compute.claims [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Claim successful on node n-h2-808474-1 2021-09-10 16:58:02.239 4088 3038338906600 MainThread DEBUG nova.virt.hyperv.hostops [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:58:02.256 4088 3038338906600 MainThread DEBUG nova.virt.hyperv.hostops [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:58:02.489 4088 3038338906600 MainThread DEBUG nova.compute.provider_tree [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:58:02.519 4088 3038338906600 MainThread DEBUG nova.scheduler.client.report [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:58:02.519 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:02.519 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:58:02.691 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:58:02.691 4088 3038338904840 GreenThread-43 DEBUG nova.compute.manager [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:58:02.691 4088 3038338904840 GreenThread-43 DEBUG nova.network.neutron [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:58:02.894 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:58:02.894 4088 3038338906600 MainThread INFO nova.virt.hyperv.vmops [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Spawning new instance 2021-09-10 16:58:02.933 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Lock "instance-00000034" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:02.933 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Lock "instance-00000034" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:02.933 4088 3038338906600 MainThread DEBUG nova.block_device [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:58:02.933 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:02.933 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:02.941 4088 3038338906600 MainThread DEBUG os_win.utils.pathutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Creating directory: C:\openstack\instances\instance-00000034 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:58:02.941 4088 3038338906600 MainThread DEBUG nova.virt.hyperv.vmops [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000034\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:58:03.071 4088 3038338904840 GreenThread-43 DEBUG nova.policy [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e3974028a49412ba2f9310b9ea9829a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6913db09dc4c04925b36d6424e7e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:58:03.184 4088 3038338906600 MainThread DEBUG nova.virt.hyperv.vmops [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Resizing VHD C:\openstack\instances\instance-00000034\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:58:07.106 4088 3038338904840 GreenThread-43 DEBUG nova.network.neutron [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Successfully created port: 16c9c2fe-871a-4a71-a074-3360f1f3deaf _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:58:10.130 4088 3038338904840 GreenThread-43 DEBUG nova.network.neutron [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Successfully updated port: 16c9c2fe-871a-4a71-a074-3360f1f3deaf _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:58:10.162 4088 3038338904840 GreenThread-43 DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Acquired lock "refresh_cache-a60acc40-a373-4430-b931-0d33ee511d49" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:58:10.175 4088 3038338904840 GreenThread-43 DEBUG nova.network.neutron [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:58:10.491 4088 3038300758968 MainThread DEBUG nova.compute.manager [req-bbf6fa82-72c9-4ab2-835c-c792501df50e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Received event network-changed-16c9c2fe-871a-4a71-a074-3360f1f3deaf external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:58:10.491 4088 3038300758968 MainThread DEBUG nova.compute.manager [req-bbf6fa82-72c9-4ab2-835c-c792501df50e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Refreshing instance network info cache due to event network-changed-16c9c2fe-871a-4a71-a074-3360f1f3deaf. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:58:10.674 4088 3038338904840 GreenThread-43 DEBUG nova.network.neutron [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:58:12.802 4088 3038338904840 GreenThread-43 DEBUG nova.network.neutron [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Updating instance_info_cache with network_info: [{"id": "16c9c2fe-871a-4a71-a074-3360f1f3deaf", "address": "fa:16:3e:cb:97:0a", "network": {"id": "b73e1d6e-6c44-444d-ac7e-cc92dc83874a", "bridge": null, "label": "tempest-ServerAddressesTestJSON-1219095971-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3a6913db09dc4c04925b36d6424e7e89", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap16c9c2fe-87", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:58:12.846 4088 3038338904840 GreenThread-43 DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Releasing lock "refresh_cache-a60acc40-a373-4430-b931-0d33ee511d49" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:58:12.846 4088 3038338904840 GreenThread-43 DEBUG nova.compute.manager [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Instance network_info: |[{"id": "16c9c2fe-871a-4a71-a074-3360f1f3deaf", "address": "fa:16:3e:cb:97:0a", "network": {"id": "b73e1d6e-6c44-444d-ac7e-cc92dc83874a", "bridge": null, "label": "tempest-ServerAddressesTestJSON-1219095971-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3a6913db09dc4c04925b36d6424e7e89", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap16c9c2fe-87", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:58:12.846 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Preparing to wait for external event network-vif-plugged-16c9c2fe-871a-4a71-a074-3360f1f3deaf prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:58:12.846 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Lock "a60acc40-a373-4430-b931-0d33ee511d49-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:12.846 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Lock "a60acc40-a373-4430-b931-0d33ee511d49-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:12.857 4088 3038338906600 MainThread DEBUG os_win.utils.compute.vmutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Creating VM instance-00000034 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:58:12.857 4088 3038300758968 MainThread DEBUG oslo_concurrency.lockutils [req-bbf6fa82-72c9-4ab2-835c-c792501df50e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-a60acc40-a373-4430-b931-0d33ee511d49" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:58:12.857 4088 3038300758968 MainThread DEBUG nova.network.neutron [req-bbf6fa82-72c9-4ab2-835c-c792501df50e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Refreshing network info cache for port 16c9c2fe-871a-4a71-a074-3360f1f3deaf _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:58:14.739 4088 3038338906600 MainThread DEBUG nova.virt.hyperv.vmops [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:58:16.191 4088 3038300758968 MainThread DEBUG nova.network.neutron [req-bbf6fa82-72c9-4ab2-835c-c792501df50e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Updated VIF entry in instance network info cache for port 16c9c2fe-871a-4a71-a074-3360f1f3deaf. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:58:16.191 4088 3038300758968 MainThread DEBUG nova.network.neutron [req-bbf6fa82-72c9-4ab2-835c-c792501df50e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Updating instance_info_cache with network_info: [{"id": "16c9c2fe-871a-4a71-a074-3360f1f3deaf", "address": "fa:16:3e:cb:97:0a", "network": {"id": "b73e1d6e-6c44-444d-ac7e-cc92dc83874a", "bridge": null, "label": "tempest-ServerAddressesTestJSON-1219095971-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3a6913db09dc4c04925b36d6424e7e89", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap16c9c2fe-87", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:58:16.210 4088 3038300758968 MainThread DEBUG oslo_concurrency.lockutils [req-bbf6fa82-72c9-4ab2-835c-c792501df50e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-a60acc40-a373-4430-b931-0d33ee511d49" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:58:17.631 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Lock "0713ad83-2fd1-4b7f-bbe2-e9035bfc3538" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:17.674 4088 3038340493160 MainThread DEBUG nova.compute.manager [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:58:17.816 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:17.816 4088 3038340493160 MainThread DEBUG nova.virt.hardware [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:58:17.816 4088 3038340493160 MainThread INFO nova.compute.claims [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Claim successful on node n-h2-808474-1 2021-09-10 16:58:17.991 4088 3038340493160 MainThread DEBUG nova.virt.hyperv.hostops [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:58:18.009 4088 3038340493160 MainThread DEBUG nova.virt.hyperv.hostops [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:58:18.229 4088 3038340493160 MainThread DEBUG nova.compute.provider_tree [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:58:18.256 4088 3038340493160 MainThread DEBUG nova.scheduler.client.report [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:58:18.271 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:18.271 4088 3038340493160 MainThread DEBUG nova.compute.manager [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:58:18.394 4088 3038340493160 MainThread DEBUG nova.compute.manager [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:58:18.394 4088 3038340489288 GreenThread-44 DEBUG nova.compute.manager [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:58:18.394 4088 3038340489288 GreenThread-44 DEBUG nova.network.neutron [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:58:18.647 4088 3038340493160 MainThread DEBUG nova.compute.manager [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:58:18.661 4088 3038340493160 MainThread INFO nova.virt.hyperv.vmops [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Spawning new instance 2021-09-10 16:58:18.674 4088 3038340489288 GreenThread-44 DEBUG nova.policy [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5caa9c73de9d44b4a4001f521e76cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6153c0b18ada42b8b1fc8a04fbd01d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:58:18.674 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Lock "instance-00000035" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:18.674 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Lock "instance-00000035" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:18.674 4088 3038340493160 MainThread DEBUG nova.block_device [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:58:18.674 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:18.674 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:18.694 4088 3038340493160 MainThread DEBUG os_win.utils.pathutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Creating directory: C:\openstack\instances\instance-00000035 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:58:18.694 4088 3038340493160 MainThread DEBUG nova.virt.hyperv.vmops [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000035\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:58:18.950 4088 3038340493160 MainThread DEBUG nova.virt.hyperv.vmops [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Resizing VHD C:\openstack\instances\instance-00000035\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:58:19.768 4088 3038340489288 GreenThread-44 DEBUG nova.network.neutron [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Successfully created port: 9969dfc6-2f77-4bca-8bfe-de18d16ae90f _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:58:20.877 4088 3038340489288 GreenThread-44 DEBUG nova.network.neutron [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Successfully updated port: 9969dfc6-2f77-4bca-8bfe-de18d16ae90f _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:58:20.926 4088 3038340489288 GreenThread-44 DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Acquired lock "refresh_cache-0713ad83-2fd1-4b7f-bbe2-e9035bfc3538" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:58:20.926 4088 3038340489288 GreenThread-44 DEBUG nova.network.neutron [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:58:21.049 4088 3038340489288 GreenThread-44 DEBUG nova.network.neutron [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:58:21.628 4088 3038340489288 GreenThread-44 DEBUG nova.network.neutron [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Updating instance_info_cache with network_info: [{"id": "9969dfc6-2f77-4bca-8bfe-de18d16ae90f", "address": "fa:16:3e:a7:42:f9", "network": {"id": "757f8fb5-ff7d-411a-968b-dea6648df5e2", "bridge": null, "label": "tempest-VolumesAdminNegativeTest-41234616-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6153c0b18ada42b8b1fc8a04fbd01d24", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9969dfc6-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:58:21.628 4088 3038340489288 GreenThread-44 DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Releasing lock "refresh_cache-0713ad83-2fd1-4b7f-bbe2-e9035bfc3538" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:58:21.628 4088 3038340489288 GreenThread-44 DEBUG nova.compute.manager [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Instance network_info: |[{"id": "9969dfc6-2f77-4bca-8bfe-de18d16ae90f", "address": "fa:16:3e:a7:42:f9", "network": {"id": "757f8fb5-ff7d-411a-968b-dea6648df5e2", "bridge": null, "label": "tempest-VolumesAdminNegativeTest-41234616-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6153c0b18ada42b8b1fc8a04fbd01d24", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9969dfc6-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:58:21.628 4088 3038340493160 MainThread DEBUG nova.compute.manager [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Preparing to wait for external event network-vif-plugged-9969dfc6-2f77-4bca-8bfe-de18d16ae90f prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:58:21.655 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Lock "0713ad83-2fd1-4b7f-bbe2-e9035bfc3538-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:21.655 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Lock "0713ad83-2fd1-4b7f-bbe2-e9035bfc3538-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:21.655 4088 3038340493160 MainThread DEBUG os_win.utils.compute.vmutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Creating VM instance-00000035 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:58:22.209 4088 3038300761784 MainThread DEBUG nova.compute.manager [req-17574d40-9a78-4112-abad-2e4511def5ec 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Received event network-changed-9969dfc6-2f77-4bca-8bfe-de18d16ae90f external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:58:22.209 4088 3038300761784 MainThread DEBUG nova.compute.manager [req-17574d40-9a78-4112-abad-2e4511def5ec 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Refreshing instance network info cache due to event network-changed-9969dfc6-2f77-4bca-8bfe-de18d16ae90f. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:58:22.209 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [req-17574d40-9a78-4112-abad-2e4511def5ec 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-0713ad83-2fd1-4b7f-bbe2-e9035bfc3538" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:58:22.209 4088 3038300761784 MainThread DEBUG nova.network.neutron [req-17574d40-9a78-4112-abad-2e4511def5ec 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Refreshing network info cache for port 9969dfc6-2f77-4bca-8bfe-de18d16ae90f _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:58:23.475 4088 3038340493160 MainThread DEBUG nova.virt.hyperv.vmops [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:58:24.615 4088 3038300761784 MainThread DEBUG nova.network.neutron [req-17574d40-9a78-4112-abad-2e4511def5ec 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Updated VIF entry in instance network info cache for port 9969dfc6-2f77-4bca-8bfe-de18d16ae90f. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:58:24.615 4088 3038300761784 MainThread DEBUG nova.network.neutron [req-17574d40-9a78-4112-abad-2e4511def5ec 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Updating instance_info_cache with network_info: [{"id": "9969dfc6-2f77-4bca-8bfe-de18d16ae90f", "address": "fa:16:3e:a7:42:f9", "network": {"id": "757f8fb5-ff7d-411a-968b-dea6648df5e2", "bridge": null, "label": "tempest-VolumesAdminNegativeTest-41234616-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6153c0b18ada42b8b1fc8a04fbd01d24", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9969dfc6-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:58:24.634 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [req-17574d40-9a78-4112-abad-2e4511def5ec 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-0713ad83-2fd1-4b7f-bbe2-e9035bfc3538" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:58:27.077 4088 3038300761784 MainThread DEBUG nova.compute.manager [req-f1d87118-a58f-4a54-8cae-dfbde704fa8d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Received event network-vif-plugged-16c9c2fe-871a-4a71-a074-3360f1f3deaf external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:58:27.077 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [req-f1d87118-a58f-4a54-8cae-dfbde704fa8d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "a60acc40-a373-4430-b931-0d33ee511d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:27.077 4088 3038300761784 MainThread DEBUG oslo_concurrency.lockutils [req-f1d87118-a58f-4a54-8cae-dfbde704fa8d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "a60acc40-a373-4430-b931-0d33ee511d49-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:27.087 4088 3038300761784 MainThread DEBUG nova.compute.manager [req-f1d87118-a58f-4a54-8cae-dfbde704fa8d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Processing event network-vif-plugged-16c9c2fe-871a-4a71-a074-3360f1f3deaf _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:58:27.118 4088 3038338906600 MainThread INFO nova.virt.hyperv.vmops [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Using config drive for instance 2021-09-10 16:58:27.546 4088 3038338906600 MainThread INFO nova.virt.hyperv.vmops [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Creating config drive at C:\openstack\instances\instance-00000034\configdrive.iso 2021-09-10 16:58:27.659 4088 3038338906600 MainThread DEBUG oslo_concurrency.processutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000034\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp2g3e9mj3 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:58:28.004 4088 3038338906600 MainThread DEBUG oslo_concurrency.processutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000034\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp2g3e9mj3" returned: 0 in 0.344s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:58:28.337 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "4bdc3835-ba14-4e1b-bd49-23ec32f15291" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:28.378 4088 3038340492456 MainThread DEBUG nova.compute.manager [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:58:28.540 4088 3038338906600 MainThread DEBUG nova.virt.hyperv.vmops [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Setting boot order for instance: instance-00000034: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:58:28.569 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:28.569 4088 3038340492456 MainThread DEBUG nova.virt.hardware [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:58:28.569 4088 3038340492456 MainThread INFO nova.compute.claims [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Claim successful on node n-h2-808474-1 2021-09-10 16:58:28.629 4088 3038338906600 MainThread DEBUG nova.virt.hyperv.vmops [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:58:28.674 4088 3038338906600 MainThread DEBUG os_win.utils.jobutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Waiting for WMI job: {'InstanceID': '7E7A1D88-E9A4-4EAB-8123-99BC4C4C70FD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=23992), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:28.820 4088 3038338906600 MainThread ERROR os_win.utils.jobutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000034\' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)instance-00000034FE5CCB4C-D764-4E84-9464-D7CF5350FAF512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)instance-00000034FE5CCB4C-D764-4E84-9464-D7CF5350FAF510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000034\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)instance-00000034FE5CCB4C-D764-4E84-9464-D7CF5350FAF5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7E7A1D88-E9A4-4EAB-8123-99BC4C4C70FD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120155), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 28), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 28), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000034' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)\n\nNot enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)\n\n'instance-00000034' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)", 'ErrorSummaryDescription': "'instance-00000034' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000034.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:28.820 4088 3038338906600 MainThread DEBUG os_win._utils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000034' failed to start. Not enough memory in the system to start the virtual machine instance-00000034. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000034' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Not enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) 'instance-00000034' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1914825439453125 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:28.847 4088 3038340492280 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:28.847 4088 3038340492280 MainThread INFO nova.compute.manager [-] [instance: a60acc40-a373-4430-b931-0d33ee511d49] VM Stopped (Lifecycle Event) 2021-09-10 16:58:28.847 4088 3038340489640 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000034" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:28.847 4088 3038340489640 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000034" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:28.877 4088 3038340492456 MainThread DEBUG nova.virt.hyperv.hostops [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:58:28.877 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-fa5a9c2c-ab6d-4175-8162-77fae775537b - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:28.877 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-fa5a9c2c-ab6d-4175-8162-77fae775537b - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:28.900 4088 3038340492456 MainThread DEBUG nova.virt.hyperv.hostops [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:58:28.939 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-fa5a9c2c-ab6d-4175-8162-77fae775537b - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:28.975 4088 3038340492280 MainThread INFO nova.compute.manager [req-fa5a9c2c-ab6d-4175-8162-77fae775537b - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:29.127 4088 3038340492456 MainThread DEBUG nova.compute.provider_tree [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:58:29.150 4088 3038340492456 MainThread DEBUG nova.scheduler.client.report [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:58:29.150 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:29.150 4088 3038340492456 MainThread DEBUG nova.compute.manager [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:58:29.236 4088 3038340492456 MainThread DEBUG nova.compute.manager [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:58:29.236 4088 3038340492280 GreenThread-45 DEBUG nova.compute.manager [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:58:29.236 4088 3038340492280 GreenThread-45 DEBUG nova.network.neutron [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:58:29.533 4088 3038340492456 MainThread DEBUG nova.compute.manager [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:58:29.540 4088 3038340492456 MainThread INFO nova.virt.hyperv.vmops [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Spawning new instance 2021-09-10 16:58:29.540 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000036" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:29.540 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000036" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:29.540 4088 3038340492456 MainThread DEBUG nova.block_device [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:58:29.540 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:29.540 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:29.566 4088 3038340492456 MainThread DEBUG os_win.utils.pathutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Creating directory: C:\openstack\instances\instance-00000036 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:58:29.566 4088 3038340492456 MainThread DEBUG nova.virt.hyperv.vmops [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000036\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:58:29.818 4088 3038340492456 MainThread DEBUG nova.virt.hyperv.vmops [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Resizing VHD C:\openstack\instances\instance-00000036\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:58:29.846 4088 3038338906600 MainThread DEBUG os_win.utils.jobutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Waiting for WMI job: {'InstanceID': 'EB18B09A-0F4C-414D-94D8-0AC352975FBD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19198), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:30.033 4088 3038338906600 MainThread ERROR os_win.utils.jobutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000034\' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)instance-00000034FE5CCB4C-D764-4E84-9464-D7CF5350FAF512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)instance-00000034FE5CCB4C-D764-4E84-9464-D7CF5350FAF510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000034\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)instance-00000034FE5CCB4C-D764-4E84-9464-D7CF5350FAF5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'EB18B09A-0F4C-414D-94D8-0AC352975FBD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118845), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 29), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 29), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000034' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)\n\nNot enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)\n\n'instance-00000034' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)", 'ErrorSummaryDescription': "'instance-00000034' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000034.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:30.033 4088 3038338906600 MainThread DEBUG os_win._utils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000034' failed to start. Not enough memory in the system to start the virtual machine instance-00000034. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000034' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Not enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) 'instance-00000034' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4045629501342773 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:30.033 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000034" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:30.033 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000034" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:30.033 4088 3038340489816 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:30.033 4088 3038340489816 MainThread INFO nova.compute.manager [-] [instance: a60acc40-a373-4430-b931-0d33ee511d49] VM Stopped (Lifecycle Event) 2021-09-10 16:58:30.065 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-0ef9aeec-0151-4d1a-9835-b68b5410a0ed 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Received event network-vif-plugged-9969dfc6-2f77-4bca-8bfe-de18d16ae90f external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:58:30.065 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-0ef9aeec-0151-4d1a-9835-b68b5410a0ed 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "0713ad83-2fd1-4b7f-bbe2-e9035bfc3538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:30.065 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-0ef9aeec-0151-4d1a-9835-b68b5410a0ed 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "0713ad83-2fd1-4b7f-bbe2-e9035bfc3538-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:30.065 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-0ef9aeec-0151-4d1a-9835-b68b5410a0ed 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Processing event network-vif-plugged-9969dfc6-2f77-4bca-8bfe-de18d16ae90f _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:58:30.081 4088 3038340489816 MainThread DEBUG nova.compute.manager [req-39db314f-a092-4298-9c3e-9ff279be93c7 - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:30.081 4088 3038340489816 MainThread DEBUG nova.virt.hyperv.vmops [req-39db314f-a092-4298-9c3e-9ff279be93c7 - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:30.128 4088 3038340489816 MainThread DEBUG nova.compute.manager [req-39db314f-a092-4298-9c3e-9ff279be93c7 - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:30.143 4088 3038340493160 MainThread INFO nova.virt.hyperv.vmops [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Using config drive for instance 2021-09-10 16:58:30.158 4088 3038340492280 GreenThread-45 DEBUG nova.policy [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42267190de3648eea52604e6b2444d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca07d9dc99a4581a698a232ffa065db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:58:30.290 4088 3038340489816 MainThread INFO nova.compute.manager [req-39db314f-a092-4298-9c3e-9ff279be93c7 - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:30.555 4088 3038340493160 MainThread INFO nova.virt.hyperv.vmops [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Creating config drive at C:\openstack\instances\instance-00000035\configdrive.iso 2021-09-10 16:58:30.650 4088 3038340493160 MainThread DEBUG oslo_concurrency.processutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000035\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp1h3qmv5a execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:58:30.978 4088 3038340493160 MainThread DEBUG oslo_concurrency.processutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000035\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp1h3qmv5a" returned: 0 in 0.329s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:58:31.051 4088 3038338906600 MainThread DEBUG os_win.utils.jobutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Waiting for WMI job: {'InstanceID': 'CB3CADB0-98A8-4C1A-8A62-EB59E13735E6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16083), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:31.206 4088 3038338906600 MainThread ERROR os_win.utils.jobutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000034\' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)instance-00000034FE5CCB4C-D764-4E84-9464-D7CF5350FAF512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)instance-00000034FE5CCB4C-D764-4E84-9464-D7CF5350FAF510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000034\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)instance-00000034FE5CCB4C-D764-4E84-9464-D7CF5350FAF5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'CB3CADB0-98A8-4C1A-8A62-EB59E13735E6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112346), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 31), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 31), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000034' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)\n\nNot enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)\n\n'instance-00000034' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)", 'ErrorSummaryDescription': "'instance-00000034' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000034.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:31.206 4088 3038338906600 MainThread DEBUG os_win._utils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000034' failed to start. Not enough memory in the system to start the virtual machine instance-00000034. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000034' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Not enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) 'instance-00000034' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5772128105163574 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:31.252 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000034" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:31.252 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000034" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:31.252 4088 3038340490696 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:31.252 4088 3038340490696 MainThread INFO nova.compute.manager [-] [instance: a60acc40-a373-4430-b931-0d33ee511d49] VM Stopped (Lifecycle Event) 2021-09-10 16:58:31.268 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-f751e93c-2d33-41d0-8e64-76b10995556d - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:31.268 4088 3038340490696 MainThread DEBUG nova.virt.hyperv.vmops [req-f751e93c-2d33-41d0-8e64-76b10995556d - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:31.378 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-f751e93c-2d33-41d0-8e64-76b10995556d - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:31.400 4088 3038340490696 MainThread INFO nova.compute.manager [req-f751e93c-2d33-41d0-8e64-76b10995556d - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:31.493 4088 3038340493160 MainThread DEBUG nova.virt.hyperv.vmops [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Setting boot order for instance: instance-00000035: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:58:31.602 4088 3038340493160 MainThread DEBUG nova.virt.hyperv.vmops [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:58:31.645 4088 3038340493160 MainThread DEBUG os_win.utils.jobutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Waiting for WMI job: {'InstanceID': '36A3CE76-5CC8-4707-B1F6-E1195D1670D2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15250), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:31.806 4088 3038340493160 MainThread ERROR os_win.utils.jobutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000035\' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)instance-00000035C25CF600-06B7-4822-BCB1-1B1210B8678A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)instance-00000035C25CF600-06B7-4822-BCB1-1B1210B8678A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000035\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)instance-00000035C25CF600-06B7-4822-BCB1-1B1210B8678A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '36A3CE76-5CC8-4707-B1F6-E1195D1670D2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117473), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 31), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 31), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000035' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)\n\nNot enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)\n\n'instance-00000035' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)", 'ErrorSummaryDescription': "'instance-00000035' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000035.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:31.806 4088 3038340493160 MainThread DEBUG os_win._utils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000035' failed to start. Not enough memory in the system to start the virtual machine instance-00000035. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000035' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Not enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) 'instance-00000035' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.20331120491027832 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:31.806 4088 3038340490696 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:31.829 4088 3038340490696 MainThread INFO nova.compute.manager [-] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] VM Stopped (Lifecycle Event) 2021-09-10 16:58:31.829 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000035" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:31.829 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000035" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:31.853 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-f8ec786c-9dd2-4cac-b9bd-4bf0b4b960c8 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:31.853 4088 3038340490696 MainThread DEBUG nova.virt.hyperv.vmops [req-f8ec786c-9dd2-4cac-b9bd-4bf0b4b960c8 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:31.900 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-f8ec786c-9dd2-4cac-b9bd-4bf0b4b960c8 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:31.924 4088 3038340490696 MainThread INFO nova.compute.manager [req-f8ec786c-9dd2-4cac-b9bd-4bf0b4b960c8 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:32.036 4088 3038340492280 GreenThread-45 DEBUG nova.network.neutron [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Successfully created port: 7f0d1e99-0601-4fb4-9a8e-1d3c45cc8106 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:58:32.228 4088 3038338906600 MainThread DEBUG os_win.utils.jobutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Waiting for WMI job: {'InstanceID': 'BA54D48F-BFAC-435B-92B5-4CCA49383A8F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15023), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:32.362 4088 3038338906600 MainThread ERROR os_win.utils.jobutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000034\' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)instance-00000034FE5CCB4C-D764-4E84-9464-D7CF5350FAF512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)instance-00000034FE5CCB4C-D764-4E84-9464-D7CF5350FAF510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000034\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)instance-00000034FE5CCB4C-D764-4E84-9464-D7CF5350FAF5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BA54D48F-BFAC-435B-92B5-4CCA49383A8F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113053), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 32), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 32), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000034' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)\n\nNot enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)\n\n'instance-00000034' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)", 'ErrorSummaryDescription': "'instance-00000034' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000034.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:32.362 4088 3038338906600 MainThread DEBUG os_win._utils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000034' failed to start. Not enough memory in the system to start the virtual machine instance-00000034. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000034' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Not enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) 'instance-00000034' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7334165573120117 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:32.400 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000034" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:32.424 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000034" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.032s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:32.424 4088 3038340490696 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:32.424 4088 3038340490696 MainThread INFO nova.compute.manager [-] [instance: a60acc40-a373-4430-b931-0d33ee511d49] VM Stopped (Lifecycle Event) 2021-09-10 16:58:32.441 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-061bcd25-5bb3-4eb0-9639-25ea697b2bf1 - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:32.441 4088 3038340490696 MainThread DEBUG nova.virt.hyperv.vmops [req-061bcd25-5bb3-4eb0-9639-25ea697b2bf1 - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:32.488 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-061bcd25-5bb3-4eb0-9639-25ea697b2bf1 - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:32.524 4088 3038340490696 MainThread INFO nova.compute.manager [req-061bcd25-5bb3-4eb0-9639-25ea697b2bf1 - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:32.834 4088 3038340493160 MainThread DEBUG os_win.utils.jobutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Waiting for WMI job: {'InstanceID': '6911C538-2FB4-484E-B46F-CB5190496BBB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15073), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:33.004 4088 3038340493160 MainThread ERROR os_win.utils.jobutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000035\' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)instance-00000035C25CF600-06B7-4822-BCB1-1B1210B8678A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)instance-00000035C25CF600-06B7-4822-BCB1-1B1210B8678A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000035\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)instance-00000035C25CF600-06B7-4822-BCB1-1B1210B8678A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6911C538-2FB4-484E-B46F-CB5190496BBB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112903), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 32), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 32), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000035' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)\n\nNot enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)\n\n'instance-00000035' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)", 'ErrorSummaryDescription': "'instance-00000035' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000035.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:33.004 4088 3038340493160 MainThread DEBUG os_win._utils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000035' failed to start. Not enough memory in the system to start the virtual machine instance-00000035. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000035' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Not enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) 'instance-00000035' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4016015529632568 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:33.004 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000035" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:33.004 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000035" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:33.004 4088 3038340490696 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:33.004 4088 3038340490696 MainThread INFO nova.compute.manager [-] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] VM Stopped (Lifecycle Event) 2021-09-10 16:58:33.040 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-80563312-fc55-4c10-8be5-2499d6b9b771 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:33.040 4088 3038340490696 MainThread DEBUG nova.virt.hyperv.vmops [req-80563312-fc55-4c10-8be5-2499d6b9b771 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:33.098 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-80563312-fc55-4c10-8be5-2499d6b9b771 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:33.134 4088 3038340490696 MainThread INFO nova.compute.manager [req-80563312-fc55-4c10-8be5-2499d6b9b771 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:33.395 4088 3038338906600 MainThread DEBUG os_win.utils.jobutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Waiting for WMI job: {'InstanceID': '5FC2ED9A-21CA-4882-B973-DB569238A759', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16476), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:33.550 4088 3038338906600 MainThread ERROR os_win.utils.jobutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000034\' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)instance-00000034FE5CCB4C-D764-4E84-9464-D7CF5350FAF512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)instance-00000034FE5CCB4C-D764-4E84-9464-D7CF5350FAF510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000034\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)instance-00000034FE5CCB4C-D764-4E84-9464-D7CF5350FAF5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5FC2ED9A-21CA-4882-B973-DB569238A759', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115068), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 33), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 33), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000034' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)\n\nNot enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)\n\n'instance-00000034' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)", 'ErrorSummaryDescription': "'instance-00000034' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000034.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:33.550 4088 3038338906600 MainThread DEBUG os_win._utils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000034' failed to start. Not enough memory in the system to start the virtual machine instance-00000034. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000034' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Not enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) 'instance-00000034' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.921292781829834 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:33.585 4088 3038340490696 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:33.585 4088 3038340490696 MainThread INFO nova.compute.manager [-] [instance: a60acc40-a373-4430-b931-0d33ee511d49] VM Stopped (Lifecycle Event) 2021-09-10 16:58:33.585 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000034" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:33.585 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000034" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:33.650 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-35ebd1d5-d3eb-4c0f-9f7b-8dceb1a689ec - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:33.650 4088 3038340490696 MainThread DEBUG nova.virt.hyperv.vmops [req-35ebd1d5-d3eb-4c0f-9f7b-8dceb1a689ec - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:33.690 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-35ebd1d5-d3eb-4c0f-9f7b-8dceb1a689ec - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:33.690 4088 3038340492280 GreenThread-45 DEBUG nova.network.neutron [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Successfully updated port: 7f0d1e99-0601-4fb4-9a8e-1d3c45cc8106 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:58:33.729 4088 3038340492280 GreenThread-45 DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Acquired lock "refresh_cache-4bdc3835-ba14-4e1b-bd49-23ec32f15291" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:58:33.729 4088 3038340492280 GreenThread-45 DEBUG nova.network.neutron [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:58:33.752 4088 3038340490696 MainThread INFO nova.compute.manager [req-35ebd1d5-d3eb-4c0f-9f7b-8dceb1a689ec - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:33.884 4088 3038340492280 GreenThread-45 DEBUG nova.network.neutron [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:58:33.980 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "082d9c5d-01d4-43af-8493-80ba655501fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:34.022 4088 3038340491928 MainThread DEBUG nova.compute.manager [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:58:34.036 4088 3038340493160 MainThread DEBUG os_win.utils.jobutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Waiting for WMI job: {'InstanceID': '1B59949D-FAD3-4AE5-B1F9-1C8367831715', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19787), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:34.181 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:34.181 4088 3038340491928 MainThread DEBUG nova.virt.hardware [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:58:34.181 4088 3038340491928 MainThread INFO nova.compute.claims [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Claim successful on node n-h2-808474-1 2021-09-10 16:58:34.205 4088 3038340493160 MainThread ERROR os_win.utils.jobutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000035\' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)instance-00000035C25CF600-06B7-4822-BCB1-1B1210B8678A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)instance-00000035C25CF600-06B7-4822-BCB1-1B1210B8678A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000035\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)instance-00000035C25CF600-06B7-4822-BCB1-1B1210B8678A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1B59949D-FAD3-4AE5-B1F9-1C8367831715', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113858), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 34), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 34), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000035' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)\n\nNot enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)\n\n'instance-00000035' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)", 'ErrorSummaryDescription': "'instance-00000035' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000035.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:34.205 4088 3038340493160 MainThread DEBUG os_win._utils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000035' failed to start. Not enough memory in the system to start the virtual machine instance-00000035. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000035' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Not enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) 'instance-00000035' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.602572202682495 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:34.220 4088 3038340490344 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000035" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:34.220 4088 3038340490344 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000035" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:34.220 4088 3038340491752 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:34.220 4088 3038340491752 MainThread INFO nova.compute.manager [-] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] VM Stopped (Lifecycle Event) 2021-09-10 16:58:34.237 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-245149b4-e0c6-44cb-ae94-b4943c55a7a4 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:34.237 4088 3038340491752 MainThread DEBUG nova.virt.hyperv.vmops [req-245149b4-e0c6-44cb-ae94-b4943c55a7a4 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:34.306 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-245149b4-e0c6-44cb-ae94-b4943c55a7a4 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:34.306 4088 3038340490344 MainThread DEBUG nova.compute.manager [req-8cf35e49-922c-4621-9c3d-c99b7ce14834 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Received event network-vif-deleted-66ec8cb2-5a45-471f-a9e4-5e85bfaab509 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:58:34.341 4088 3038340491752 MainThread INFO nova.compute.manager [req-245149b4-e0c6-44cb-ae94-b4943c55a7a4 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:34.380 4088 3038340491928 MainThread DEBUG nova.virt.hyperv.hostops [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:58:34.393 4088 3038340491928 MainThread DEBUG nova.virt.hyperv.hostops [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:58:34.457 4088 3038340492280 GreenThread-45 DEBUG nova.network.neutron [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Updating instance_info_cache with network_info: [{"id": "7f0d1e99-0601-4fb4-9a8e-1d3c45cc8106", "address": "fa:16:3e:c4:4f:93", "network": {"id": "dcfd5ed7-c94f-4b68-b56f-95b52ddf921f", "bridge": null, "label": "tempest-ImagesTestJSON-1170675645-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6ca07d9dc99a4581a698a232ffa065db", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap7f0d1e99-06", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:58:34.487 4088 3038340492280 GreenThread-45 DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Releasing lock "refresh_cache-4bdc3835-ba14-4e1b-bd49-23ec32f15291" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:58:34.487 4088 3038340492280 GreenThread-45 DEBUG nova.compute.manager [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Instance network_info: |[{"id": "7f0d1e99-0601-4fb4-9a8e-1d3c45cc8106", "address": "fa:16:3e:c4:4f:93", "network": {"id": "dcfd5ed7-c94f-4b68-b56f-95b52ddf921f", "bridge": null, "label": "tempest-ImagesTestJSON-1170675645-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6ca07d9dc99a4581a698a232ffa065db", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap7f0d1e99-06", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:58:34.487 4088 3038340492456 MainThread DEBUG nova.compute.manager [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Preparing to wait for external event network-vif-plugged-7f0d1e99-0601-4fb4-9a8e-1d3c45cc8106 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:58:34.487 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "4bdc3835-ba14-4e1b-bd49-23ec32f15291-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:34.487 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "4bdc3835-ba14-4e1b-bd49-23ec32f15291-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:34.487 4088 3038340492456 MainThread DEBUG os_win.utils.compute.vmutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Creating VM instance-00000036 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:58:34.566 4088 3038338906600 MainThread DEBUG os_win.utils.jobutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Waiting for WMI job: {'InstanceID': '641867B8-EFA4-4784-89C1-9335C6A5C170', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16534), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:34.613 4088 3038340491928 MainThread DEBUG nova.compute.provider_tree [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:58:34.644 4088 3038340491928 MainThread DEBUG nova.scheduler.client.report [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:58:34.644 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:34.644 4088 3038340491928 MainThread DEBUG nova.compute.manager [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:58:34.740 4088 3038338906600 MainThread ERROR os_win.utils.jobutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000034\' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)instance-00000034FE5CCB4C-D764-4E84-9464-D7CF5350FAF512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)instance-00000034FE5CCB4C-D764-4E84-9464-D7CF5350FAF510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000034\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)instance-00000034FE5CCB4C-D764-4E84-9464-D7CF5350FAF5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '641867B8-EFA4-4784-89C1-9335C6A5C170', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117512), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 34), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 34), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000034' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)\n\nNot enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)\n\n'instance-00000034' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5)", 'ErrorSummaryDescription': "'instance-00000034' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000034.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:34.740 4088 3038338906600 MainThread ERROR nova.virt.hyperv.vmops [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Failed to change vm state of instance-00000034 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000034' failed to start. 2021-09-10 16:58:34.740 4088 3038338906600 MainThread INFO nova.virt.hyperv.vmops [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Got request to destroy instance 2021-09-10 16:58:34.802 4088 3038340491928 MainThread DEBUG nova.compute.manager [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:58:34.802 4088 3038340492280 GreenThread-46 DEBUG nova.compute.manager [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:58:34.802 4088 3038340492280 GreenThread-46 DEBUG nova.network.neutron [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:58:34.884 4088 3038340491752 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:34.884 4088 3038340491752 MainThread INFO nova.compute.manager [-] [instance: a60acc40-a373-4430-b931-0d33ee511d49] VM Stopped (Lifecycle Event) 2021-09-10 16:58:34.884 4088 3038340490344 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000034" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:34.884 4088 3038340490344 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000034" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:34.993 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-1905cea9-3027-4acc-8d9f-814d6c40600b - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:34.993 4088 3038340491752 MainThread DEBUG nova.virt.hyperv.vmops [req-1905cea9-3027-4acc-8d9f-814d6c40600b - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:35.128 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-1905cea9-3027-4acc-8d9f-814d6c40600b - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:35.159 4088 3038340492280 GreenThread-46 DEBUG nova.policy [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9b8fdd82fe341dc8eeee9f6dea5f66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8daf6ce3114d6aa694f16669c8ed20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:58:35.239 4088 3038340491752 MainThread INFO nova.compute.manager [req-1905cea9-3027-4acc-8d9f-814d6c40600b - - - - -] [instance: a60acc40-a373-4430-b931-0d33ee511d49] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:35.239 4088 3038340493160 MainThread DEBUG os_win.utils.jobutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Waiting for WMI job: {'InstanceID': 'AA370819-3ADA-4C5A-B5F6-441393313552', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16502), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:35.239 4088 3038340491928 MainThread DEBUG nova.compute.manager [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:58:35.268 4088 3038340491928 MainThread INFO nova.virt.hyperv.vmops [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Spawning new instance 2021-09-10 16:58:35.302 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000037" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:35.302 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000037" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:35.302 4088 3038340491928 MainThread DEBUG nova.block_device [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:58:35.302 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:35.302 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:35.316 4088 3038340491928 MainThread DEBUG os_win.utils.pathutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Creating directory: C:\openstack\instances\instance-00000037 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:58:35.316 4088 3038340491928 MainThread DEBUG nova.virt.hyperv.vmops [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000037\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:58:35.382 4088 3038340493160 MainThread ERROR os_win.utils.jobutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000035\' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)instance-00000035C25CF600-06B7-4822-BCB1-1B1210B8678A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)instance-00000035C25CF600-06B7-4822-BCB1-1B1210B8678A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000035\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)instance-00000035C25CF600-06B7-4822-BCB1-1B1210B8678A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'AA370819-3ADA-4C5A-B5F6-441393313552', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119664), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 35), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 35), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000035' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)\n\nNot enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)\n\n'instance-00000035' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)", 'ErrorSummaryDescription': "'instance-00000035' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000035.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:35.382 4088 3038340493160 MainThread DEBUG os_win._utils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000035' failed to start. Not enough memory in the system to start the virtual machine instance-00000035. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000035' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Not enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) 'instance-00000035' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7796590328216553 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:35.444 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000035" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:35.444 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000035" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:35.444 4088 3038340491752 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:35.444 4088 3038340491752 MainThread INFO nova.compute.manager [-] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] VM Stopped (Lifecycle Event) 2021-09-10 16:58:35.475 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-3bb20be3-fb83-41de-aa8c-3db2e064838d - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:35.475 4088 3038340491752 MainThread DEBUG nova.virt.hyperv.vmops [req-3bb20be3-fb83-41de-aa8c-3db2e064838d - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:35.537 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-3bb20be3-fb83-41de-aa8c-3db2e064838d - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:35.565 4088 3038340491752 MainThread INFO nova.compute.manager [req-3bb20be3-fb83-41de-aa8c-3db2e064838d - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:35.565 4088 3038340491928 MainThread DEBUG nova.virt.hyperv.vmops [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Resizing VHD C:\openstack\instances\instance-00000037\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:58:36.423 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:58:36.426 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 16:58:36.442 4088 3038340493160 MainThread DEBUG os_win.utils.jobutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Waiting for WMI job: {'InstanceID': '3C9DC982-2519-470C-BC93-4D3166267AB9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16703), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:36.585 4088 3038340493160 MainThread ERROR os_win.utils.jobutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000035\' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)instance-00000035C25CF600-06B7-4822-BCB1-1B1210B8678A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)instance-00000035C25CF600-06B7-4822-BCB1-1B1210B8678A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000035\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)instance-00000035C25CF600-06B7-4822-BCB1-1B1210B8678A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3C9DC982-2519-470C-BC93-4D3166267AB9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119627), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 36), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 36), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000035' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)\n\nNot enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)\n\n'instance-00000035' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)", 'ErrorSummaryDescription': "'instance-00000035' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000035.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:36.585 4088 3038340493160 MainThread DEBUG os_win._utils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000035' failed to start. Not enough memory in the system to start the virtual machine instance-00000035. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000035' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Not enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) 'instance-00000035' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.98236346244812 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:36.618 4088 3038340492456 MainThread DEBUG nova.virt.hyperv.vmops [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:58:36.649 4088 3038340491752 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:36.660 4088 3038340491752 MainThread INFO nova.compute.manager [-] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] VM Stopped (Lifecycle Event) 2021-09-10 16:58:36.660 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000035" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:36.660 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000035" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:36.681 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-fa20013c-32d6-4f67-b3e8-21c841a539c9 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:36.681 4088 3038340491752 MainThread DEBUG nova.virt.hyperv.vmops [req-fa20013c-32d6-4f67-b3e8-21c841a539c9 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:36.837 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-fa20013c-32d6-4f67-b3e8-21c841a539c9 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:36.879 4088 3038340491752 MainThread INFO nova.compute.manager [req-fa20013c-32d6-4f67-b3e8-21c841a539c9 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:36.910 4088 3038338906600 MainThread DEBUG nova.virt.hyperv.vmops [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:58:36.910 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Lock "instance-00000034" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:36.910 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Lock "instance-00000034" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:36.941 4088 3038338906600 MainThread DEBUG os_win.utils.compute.vmutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Successfully changed vm state of instance-00000034 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:58:36.941 4088 3038338906600 MainThread DEBUG nova.virt.hyperv.vmops [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Successfully changed state of VM instance-00000034 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:58:36.991 4088 3038338906600 MainThread DEBUG os_win.utils.jobutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Waiting for WMI job: {'InstanceID': '18CADB5F-8B6B-4044-89B3-702B4B5FB281', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14281), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:37.113 4088 3038338906600 MainThread DEBUG os_win.utils.jobutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] WMI job succeeded: {'InstanceID': '18CADB5F-8B6B-4044-89B3-702B4B5FB281', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=132057), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:58:37.113 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Lock "instance-00000034" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:37.113 4088 3038338906600 MainThread DEBUG os_win.utils.pathutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Removing directory: C:\openstack\instances\instance-00000034 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:58:37.113 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Lock "instance-00000034" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:37.113 4088 3038338906600 MainThread ERROR nova.compute.manager [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000034' failed to start. Not enough memory in the system to start the virtual machine instance-00000034. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000034' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Not enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) 'instance-00000034' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Error code: 32778. 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] Traceback (most recent call last): 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] return function(*args, **kwargs) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] admin_password, network_info, block_device_info) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] return function(self, *args, **kwds) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self.force_reraise() 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] raise self.value 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] should_plug_vifs=False) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 'req_state': req_state}) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self.force_reraise() 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] raise self.value 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] time.sleep(sleep_time) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self.force_reraise() 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] raise self.value 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] return f(*args, **kwargs) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] return self._wait_for_job(job_path) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] error_desc=err_desc) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000034' failed to start. 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] Not enough memory in the system to start the virtual machine instance-00000034. 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000034' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] Not enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 'instance-00000034' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Error code: 32778. 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] During handling of the above exception, another exception occurred: 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] Traceback (most recent call last): 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] yield resources 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] accel_info=accel_info) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] return function(*args, **kwargs) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] admin_password, network_info, block_device_info) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] return function(self, *args, **kwds) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self.force_reraise() 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] raise self.value 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] should_plug_vifs=False) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 'req_state': req_state}) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self.force_reraise() 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] raise self.value 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] time.sleep(sleep_time) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self.force_reraise() 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] raise self.value 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] return f(*args, **kwargs) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] return self._wait_for_job(job_path) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] error_desc=err_desc) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000034' failed to start. 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] Not enough memory in the system to start the virtual machine instance-00000034. 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000034' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] Not enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 'instance-00000034' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Error code: 32778. 2021-09-10 16:58:37.113 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.127 4088 3038338906600 MainThread INFO nova.compute.manager [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Terminating instance 2021-09-10 16:58:37.127 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:58:37.127 4088 3038338906600 MainThread INFO nova.virt.hyperv.vmops [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Got request to destroy instance 2021-09-10 16:58:37.127 4088 3038338906600 MainThread DEBUG nova.virt.hyperv.vmops [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:58:37.127 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Lock "instance-00000034" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:37.149 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Lock "instance-00000034" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:37.149 4088 3038338906600 MainThread INFO nova.compute.manager [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 16:58:37.149 4088 3038338906600 MainThread DEBUG nova.compute.claims [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:58:37.149 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:37.224 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-dda5bef7-8b51-4cde-a28e-1124ad6a982d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Received event network-changed-7f0d1e99-0601-4fb4-9a8e-1d3c45cc8106 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:58:37.224 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-dda5bef7-8b51-4cde-a28e-1124ad6a982d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Refreshing instance network info cache due to event network-changed-7f0d1e99-0601-4fb4-9a8e-1d3c45cc8106. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:58:37.224 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [req-dda5bef7-8b51-4cde-a28e-1124ad6a982d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-4bdc3835-ba14-4e1b-bd49-23ec32f15291" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:58:37.224 4088 3038340491752 MainThread DEBUG nova.network.neutron [req-dda5bef7-8b51-4cde-a28e-1124ad6a982d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Refreshing network info cache for port 7f0d1e99-0601-4fb4-9a8e-1d3c45cc8106 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:58:37.336 4088 3038338906600 MainThread DEBUG nova.virt.hyperv.hostops [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:58:37.361 4088 3038338906600 MainThread DEBUG nova.virt.hyperv.hostops [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:58:37.559 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:58:37.559 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:58:37.559 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 16:58:37.571 4088 3038338906600 MainThread DEBUG nova.compute.provider_tree [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:58:37.620 4088 3038340493160 MainThread DEBUG os_win.utils.jobutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Waiting for WMI job: {'InstanceID': '13B1E867-65DC-4C5D-A8C3-FDC25DDCC219', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17672), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:37.620 4088 3038338906600 MainThread DEBUG nova.scheduler.client.report [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:58:37.620 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:37.642 4088 3038338906600 MainThread ERROR nova.compute.manager [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000034' failed to start. Not enough memory in the system to start the virtual machine instance-00000034. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000034' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Not enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) 'instance-00000034' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Error code: 32778. 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] Traceback (most recent call last): 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] return function(*args, **kwargs) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] admin_password, network_info, block_device_info) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] return function(self, *args, **kwds) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self.force_reraise() 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] raise self.value 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] should_plug_vifs=False) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 'req_state': req_state}) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self.force_reraise() 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] raise self.value 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] time.sleep(sleep_time) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self.force_reraise() 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] raise self.value 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] return f(*args, **kwargs) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] return self._wait_for_job(job_path) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] error_desc=err_desc) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000034' failed to start. 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] Not enough memory in the system to start the virtual machine instance-00000034. 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000034' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] Not enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 'instance-00000034' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Error code: 32778. 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] During handling of the above exception, another exception occurred: 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] Traceback (most recent call last): 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] accel_info=accel_info) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] return function(*args, **kwargs) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] admin_password, network_info, block_device_info) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] return function(self, *args, **kwds) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self.force_reraise() 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] raise self.value 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] should_plug_vifs=False) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 'req_state': req_state}) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self.force_reraise() 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] raise self.value 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] time.sleep(sleep_time) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self.force_reraise() 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] raise self.value 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] return f(*args, **kwargs) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] return self._wait_for_job(job_path) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] error_desc=err_desc) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000034' failed to start. 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] Not enough memory in the system to start the virtual machine instance-00000034. 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000034' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] Not enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 'instance-00000034' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Error code: 32778. 2021-09-10 16:58:37.642 4088 3038338906600 MainThread TRACE nova.compute.manager [instance: a60acc40-a373-4430-b931-0d33ee511d49] 2021-09-10 16:58:37.642 4088 3038338906600 MainThread DEBUG nova.compute.utils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] WMI job failed with status 10. Error summary description: 'instance-00000034' failed to start. Not enough memory in the system to start the virtual machine instance-00000034. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:58:37.642 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Build of instance a60acc40-a373-4430-b931-0d33ee511d49 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000034' failed to start. Not enough memory in the system to start the virtual machine instance-00000034. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000034' failed to start. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Not enough memory in the system to start the virtual machine instance-00000034 with ram size 1024 megabytes. (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) 'instance-00000034' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FE5CCB4C-D764-4E84-9464-D7CF5350FAF5) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:58:37.649 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:58:37.649 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:58:37.649 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:58:37.649 4088 3038338906600 MainThread DEBUG nova.network.neutron [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:58:37.771 4088 3038340493160 MainThread ERROR os_win.utils.jobutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000035\' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)instance-00000035C25CF600-06B7-4822-BCB1-1B1210B8678A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)instance-00000035C25CF600-06B7-4822-BCB1-1B1210B8678A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000035\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)instance-00000035C25CF600-06B7-4822-BCB1-1B1210B8678A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '13B1E867-65DC-4C5D-A8C3-FDC25DDCC219', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114918), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 37), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 37), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000035' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)\n\nNot enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)\n\n'instance-00000035' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A)", 'ErrorSummaryDescription': "'instance-00000035' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000035.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:37.771 4088 3038340493160 MainThread ERROR nova.virt.hyperv.vmops [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Failed to change vm state of instance-00000035 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000035' failed to start. 2021-09-10 16:58:37.771 4088 3038340493160 MainThread INFO nova.virt.hyperv.vmops [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Got request to destroy instance 2021-09-10 16:58:37.814 4088 3038342257128 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:37.814 4088 3038342257128 MainThread INFO nova.compute.manager [-] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] VM Stopped (Lifecycle Event) 2021-09-10 16:58:37.814 4088 3038342256248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000035" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:37.814 4088 3038342256248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000035" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:37.852 4088 3038342257128 MainThread DEBUG nova.compute.manager [req-98fa4d92-4816-4910-bf64-285b058a8921 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:37.852 4088 3038342257128 MainThread DEBUG nova.virt.hyperv.vmops [req-98fa4d92-4816-4910-bf64-285b058a8921 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:37.884 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-66c5445c-c347-4833-8af8-58ba8ff6d95e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:58:37.884 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 16:58:37.893 4088 3038340492280 GreenThread-46 DEBUG nova.network.neutron [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Successfully created port: 61b9b1b1-afdc-48e8-ac1d-1af17b15e954 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:58:37.912 4088 3038342257128 MainThread DEBUG nova.compute.manager [req-98fa4d92-4816-4910-bf64-285b058a8921 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:37.926 4088 3038342257128 MainThread INFO nova.compute.manager [req-98fa4d92-4816-4910-bf64-285b058a8921 - - - - -] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:38.428 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "832a0158-f115-480e-a24e-78506e51b9f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:38.446 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:58:38.597 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:38.597 4088 3038342255896 MainThread DEBUG nova.virt.hardware [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:58:38.597 4088 3038342255896 MainThread INFO nova.compute.claims [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Claim successful on node n-h2-808474-1 2021-09-10 16:58:38.756 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.hostops [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:58:38.774 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.hostops [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:58:39.049 4088 3038342255896 MainThread DEBUG nova.compute.provider_tree [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:58:39.066 4088 3038342255896 MainThread DEBUG nova.scheduler.client.report [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:58:39.082 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:39.082 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:58:39.196 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:58:39.215 4088 3038342256600 GreenThread-47 DEBUG nova.compute.manager [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:58:39.215 4088 3038342256600 GreenThread-47 DEBUG nova.network.neutron [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:58:39.424 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Updating instance_info_cache with network_info: [{"id": "fecb5a04-48f6-4c8b-bb0f-748b812daefa", "address": "fa:16:3e:2d:da:04", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfecb5a04-48", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:58:39.441 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-66c5445c-c347-4833-8af8-58ba8ff6d95e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:58:39.441 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 16:58:39.441 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:58:39.441 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:58:39.534 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:58:39.569 4088 3038342255896 MainThread INFO nova.virt.hyperv.vmops [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Spawning new instance 2021-09-10 16:58:39.569 4088 3038340492280 GreenThread-46 DEBUG nova.network.neutron [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Successfully updated port: 61b9b1b1-afdc-48e8-ac1d-1af17b15e954 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:58:39.589 4088 3038340492280 GreenThread-46 DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Acquired lock "refresh_cache-082d9c5d-01d4-43af-8493-80ba655501fd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:58:39.589 4088 3038340492280 GreenThread-46 DEBUG nova.network.neutron [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:58:39.642 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000039" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:39.642 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000039" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:39.647 4088 3038342255896 MainThread DEBUG nova.block_device [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:58:39.647 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:39.647 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:39.647 4088 3038342255896 MainThread DEBUG os_win.utils.pathutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Creating directory: C:\openstack\instances\instance-00000039 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:58:39.647 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.vmops [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000039\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:58:39.695 4088 3038340492280 GreenThread-46 DEBUG nova.network.neutron [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:58:39.880 4088 3038340493160 MainThread DEBUG nova.virt.hyperv.vmops [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:58:39.880 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Lock "instance-00000035" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:39.880 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Lock "instance-00000035" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:39.924 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.vmops [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Resizing VHD C:\openstack\instances\instance-00000039\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:58:39.924 4088 3038340493160 MainThread DEBUG os_win.utils.compute.vmutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Successfully changed vm state of instance-00000035 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:58:39.924 4088 3038340493160 MainThread DEBUG nova.virt.hyperv.vmops [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Successfully changed state of VM instance-00000035 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:58:39.970 4088 3038340493160 MainThread DEBUG os_win.utils.jobutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Waiting for WMI job: {'InstanceID': 'D8CC2884-3AD8-40E5-A17D-05AA52A11F81', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16219), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:40.024 4088 3038342256600 GreenThread-47 DEBUG nova.policy [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9b8fdd82fe341dc8eeee9f6dea5f66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8daf6ce3114d6aa694f16669c8ed20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:58:40.189 4088 3038340492280 GreenThread-46 DEBUG nova.network.neutron [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Updating instance_info_cache with network_info: [{"id": "61b9b1b1-afdc-48e8-ac1d-1af17b15e954", "address": "fa:16:3e:4c:5f:6a", "network": {"id": "99282f2c-b612-4703-8180-12ed8aae404f", "bridge": null, "label": "tempest-ListServerFiltersTestJSON-836490928-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "cc8daf6ce3114d6aa694f16669c8ed20", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap61b9b1b1-af", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:58:40.225 4088 3038340493160 MainThread DEBUG os_win.utils.jobutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] WMI job succeeded: {'InstanceID': 'D8CC2884-3AD8-40E5-A17D-05AA52A11F81', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=183550), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:58:40.225 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Lock "instance-00000035" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:40.225 4088 3038340493160 MainThread DEBUG os_win.utils.pathutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Removing directory: C:\openstack\instances\instance-00000035 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:58:40.225 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Lock "instance-00000035" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:40.225 4088 3038340493160 MainThread ERROR nova.compute.manager [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000035' failed to start. Not enough memory in the system to start the virtual machine instance-00000035. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000035' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Not enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) 'instance-00000035' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Error code: 32778. 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Traceback (most recent call last): 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] return function(*args, **kwargs) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] admin_password, network_info, block_device_info) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] return function(self, *args, **kwds) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self.force_reraise() 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] raise self.value 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] should_plug_vifs=False) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 'req_state': req_state}) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self.force_reraise() 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] raise self.value 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] time.sleep(sleep_time) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self.force_reraise() 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] raise self.value 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] return f(*args, **kwargs) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] return self._wait_for_job(job_path) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] error_desc=err_desc) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000035' failed to start. 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Not enough memory in the system to start the virtual machine instance-00000035. 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000035' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Not enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 'instance-00000035' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Error code: 32778. 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] During handling of the above exception, another exception occurred: 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Traceback (most recent call last): 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] yield resources 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] accel_info=accel_info) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] return function(*args, **kwargs) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] admin_password, network_info, block_device_info) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] return function(self, *args, **kwds) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self.force_reraise() 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] raise self.value 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] should_plug_vifs=False) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 'req_state': req_state}) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self.force_reraise() 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] raise self.value 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] time.sleep(sleep_time) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self.force_reraise() 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] raise self.value 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] return f(*args, **kwargs) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] return self._wait_for_job(job_path) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] error_desc=err_desc) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000035' failed to start. 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Not enough memory in the system to start the virtual machine instance-00000035. 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000035' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Not enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 'instance-00000035' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Error code: 32778. 2021-09-10 16:58:40.225 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.225 4088 3038340493160 MainThread INFO nova.compute.manager [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Terminating instance 2021-09-10 16:58:40.225 4088 3038340493160 MainThread DEBUG nova.compute.manager [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:58:40.225 4088 3038340493160 MainThread INFO nova.virt.hyperv.vmops [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Got request to destroy instance 2021-09-10 16:58:40.252 4088 3038340492280 GreenThread-46 DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Releasing lock "refresh_cache-082d9c5d-01d4-43af-8493-80ba655501fd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:58:40.253 4088 3038340492280 GreenThread-46 DEBUG nova.compute.manager [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Instance network_info: |[{"id": "61b9b1b1-afdc-48e8-ac1d-1af17b15e954", "address": "fa:16:3e:4c:5f:6a", "network": {"id": "99282f2c-b612-4703-8180-12ed8aae404f", "bridge": null, "label": "tempest-ListServerFiltersTestJSON-836490928-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "cc8daf6ce3114d6aa694f16669c8ed20", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap61b9b1b1-af", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:58:40.253 4088 3038340491928 MainThread DEBUG nova.compute.manager [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Preparing to wait for external event network-vif-plugged-61b9b1b1-afdc-48e8-ac1d-1af17b15e954 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:58:40.253 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "082d9c5d-01d4-43af-8493-80ba655501fd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:40.253 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "082d9c5d-01d4-43af-8493-80ba655501fd-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:40.253 4088 3038340491928 MainThread DEBUG os_win.utils.compute.vmutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Creating VM instance-00000037 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:58:40.271 4088 3038340493160 MainThread DEBUG nova.virt.hyperv.vmops [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:58:40.271 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Lock "instance-00000035" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:40.271 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Lock "instance-00000035" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:40.271 4088 3038340493160 MainThread INFO nova.compute.manager [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Took 0.05 seconds to destroy the instance on the hypervisor. 2021-09-10 16:58:40.271 4088 3038340493160 MainThread DEBUG nova.compute.claims [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:58:40.271 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:40.399 4088 3038340491752 MainThread DEBUG nova.network.neutron [req-dda5bef7-8b51-4cde-a28e-1124ad6a982d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Updated VIF entry in instance network info cache for port 7f0d1e99-0601-4fb4-9a8e-1d3c45cc8106. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:58:40.408 4088 3038340491752 MainThread DEBUG nova.network.neutron [req-dda5bef7-8b51-4cde-a28e-1124ad6a982d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Updating instance_info_cache with network_info: [{"id": "7f0d1e99-0601-4fb4-9a8e-1d3c45cc8106", "address": "fa:16:3e:c4:4f:93", "network": {"id": "dcfd5ed7-c94f-4b68-b56f-95b52ddf921f", "bridge": null, "label": "tempest-ImagesTestJSON-1170675645-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6ca07d9dc99a4581a698a232ffa065db", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap7f0d1e99-06", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:58:40.408 4088 3038340493160 MainThread DEBUG nova.virt.hyperv.hostops [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:58:40.408 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [req-dda5bef7-8b51-4cde-a28e-1124ad6a982d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-4bdc3835-ba14-4e1b-bd49-23ec32f15291" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:58:40.431 4088 3038340493160 MainThread DEBUG nova.virt.hyperv.hostops [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:58:40.555 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:58:40.555 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:58:40.900 4088 3038340493160 MainThread DEBUG nova.compute.provider_tree [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:58:40.930 4088 3038340493160 MainThread DEBUG nova.scheduler.client.report [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:58:40.930 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.657s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:40.941 4088 3038340493160 MainThread ERROR nova.compute.manager [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000035' failed to start. Not enough memory in the system to start the virtual machine instance-00000035. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000035' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Not enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) 'instance-00000035' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Error code: 32778. 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Traceback (most recent call last): 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] return function(*args, **kwargs) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] admin_password, network_info, block_device_info) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] return function(self, *args, **kwds) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self.force_reraise() 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] raise self.value 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] should_plug_vifs=False) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 'req_state': req_state}) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self.force_reraise() 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] raise self.value 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] time.sleep(sleep_time) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self.force_reraise() 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] raise self.value 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] return f(*args, **kwargs) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] return self._wait_for_job(job_path) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] error_desc=err_desc) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000035' failed to start. 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Not enough memory in the system to start the virtual machine instance-00000035. 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000035' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Not enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 'instance-00000035' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Error code: 32778. 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] During handling of the above exception, another exception occurred: 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Traceback (most recent call last): 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] accel_info=accel_info) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] return function(*args, **kwargs) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] admin_password, network_info, block_device_info) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] return function(self, *args, **kwds) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self.force_reraise() 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] raise self.value 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] should_plug_vifs=False) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 'req_state': req_state}) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self.force_reraise() 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] raise self.value 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] time.sleep(sleep_time) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self.force_reraise() 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] raise self.value 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] return f(*args, **kwargs) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] return self._wait_for_job(job_path) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] error_desc=err_desc) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000035' failed to start. 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Not enough memory in the system to start the virtual machine instance-00000035. 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000035' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Not enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 'instance-00000035' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Error code: 32778. 2021-09-10 16:58:40.941 4088 3038340493160 MainThread TRACE nova.compute.manager [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] 2021-09-10 16:58:40.941 4088 3038340493160 MainThread DEBUG nova.compute.utils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] WMI job failed with status 10. Error summary description: 'instance-00000035' failed to start. Not enough memory in the system to start the virtual machine instance-00000035. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:58:40.941 4088 3038340493160 MainThread DEBUG nova.compute.manager [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Build of instance 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000035' failed to start. Not enough memory in the system to start the virtual machine instance-00000035. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000035' failed to start. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Not enough memory in the system to start the virtual machine instance-00000035 with ram size 1024 megabytes. (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) 'instance-00000035' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C25CF600-06B7-4822-BCB1-1B1210B8678A) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:58:40.941 4088 3038340493160 MainThread DEBUG nova.compute.manager [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:58:40.941 4088 3038340493160 MainThread DEBUG nova.compute.manager [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:58:40.941 4088 3038340493160 MainThread DEBUG nova.compute.manager [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:58:40.941 4088 3038340493160 MainThread DEBUG nova.network.neutron [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:58:41.486 4088 3038338906600 MainThread DEBUG nova.network.neutron [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:58:41.504 4088 3038338906600 MainThread INFO nova.compute.manager [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] [instance: a60acc40-a373-4430-b931-0d33ee511d49] Took 3.86 seconds to deallocate network for instance. 2021-09-10 16:58:41.541 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-b6aa688e-df6c-4f30-9032-8f89779e1975 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Received event network-vif-deleted-cc3bb767-8404-4c26-903f-4b725fa73128 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:58:41.562 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:58:41.830 4088 3038338906600 MainThread INFO nova.scheduler.client.report [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Deleted allocations for instance a60acc40-a373-4430-b931-0d33ee511d49 2021-09-10 16:58:41.871 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-48498552-4d44-4c01-a370-1246776f8031 3e3974028a49412ba2f9310b9ea9829a 3a6913db09dc4c04925b36d6424e7e89 - default default] Lock "a60acc40-a373-4430-b931-0d33ee511d49" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 40.078s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:42.209 4088 3038340491928 MainThread DEBUG nova.virt.hyperv.vmops [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:58:42.409 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "c7fdc9fc-d133-4f12-ab12-ff417c249240" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:42.439 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:58:42.525 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:42.525 4088 3038342258184 MainThread DEBUG nova.virt.hardware [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:58:42.525 4088 3038342258184 MainThread INFO nova.compute.claims [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Claim successful on node n-h2-808474-1 2021-09-10 16:58:42.548 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:58:42.646 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.hostops [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:58:42.662 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.hostops [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:58:42.885 4088 3038342258184 MainThread DEBUG nova.compute.provider_tree [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:58:42.885 4088 3038342258184 MainThread DEBUG nova.scheduler.client.report [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:58:42.885 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:42.885 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:58:42.970 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:58:42.978 4088 3038342255192 GreenThread-48 DEBUG nova.compute.manager [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:58:42.978 4088 3038342255192 GreenThread-48 DEBUG nova.network.neutron [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:58:43.117 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:58:43.117 4088 3038342258184 MainThread INFO nova.virt.hyperv.vmops [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Spawning new instance 2021-09-10 16:58:43.135 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000038" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:43.135 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000038" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:43.135 4088 3038342258184 MainThread DEBUG nova.block_device [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:58:43.135 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:43.135 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:43.150 4088 3038342258184 MainThread DEBUG os_win.utils.pathutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Creating directory: C:\openstack\instances\instance-00000038 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:58:43.150 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.vmops [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000038\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:58:43.396 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.vmops [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Resizing VHD C:\openstack\instances\instance-00000038\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:58:43.658 4088 3038342255192 GreenThread-48 DEBUG nova.policy [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9b8fdd82fe341dc8eeee9f6dea5f66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8daf6ce3114d6aa694f16669c8ed20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:58:43.704 4088 3038342256600 GreenThread-47 DEBUG nova.network.neutron [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Successfully created port: 4f6f96b9-fc17-44a8-a3d1-d74f18f295f2 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:58:44.298 4088 3038340493160 MainThread DEBUG nova.network.neutron [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:58:44.362 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-fbd0169f-5ac2-45c9-a340-1466fd7a771b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Received event network-vif-deleted-7f3ea6cc-0d3a-4d84-bfc5-88187dda64f7 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:58:44.379 4088 3038340493160 MainThread INFO nova.compute.manager [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] [instance: 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538] Took 3.44 seconds to deallocate network for instance. 2021-09-10 16:58:44.416 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-295ee374-b7fa-4548-bc15-b544dcce20b1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Received event network-changed-61b9b1b1-afdc-48e8-ac1d-1af17b15e954 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:58:44.416 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-295ee374-b7fa-4548-bc15-b544dcce20b1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Refreshing instance network info cache due to event network-changed-61b9b1b1-afdc-48e8-ac1d-1af17b15e954. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:58:44.416 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [req-295ee374-b7fa-4548-bc15-b544dcce20b1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-082d9c5d-01d4-43af-8493-80ba655501fd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:58:44.431 4088 3038342256072 MainThread DEBUG nova.network.neutron [req-295ee374-b7fa-4548-bc15-b544dcce20b1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Refreshing network info cache for port 61b9b1b1-afdc-48e8-ac1d-1af17b15e954 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:58:44.463 4088 3038342146008 MainThread DEBUG nova.compute.manager [req-a23a6627-727b-4209-bd75-51c068b1b371 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Received event network-vif-plugged-7f0d1e99-0601-4fb4-9a8e-1d3c45cc8106 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:58:44.463 4088 3038342146008 MainThread DEBUG oslo_concurrency.lockutils [req-a23a6627-727b-4209-bd75-51c068b1b371 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "4bdc3835-ba14-4e1b-bd49-23ec32f15291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:44.463 4088 3038342146008 MainThread DEBUG oslo_concurrency.lockutils [req-a23a6627-727b-4209-bd75-51c068b1b371 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "4bdc3835-ba14-4e1b-bd49-23ec32f15291-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:44.463 4088 3038342146008 MainThread DEBUG nova.compute.manager [req-a23a6627-727b-4209-bd75-51c068b1b371 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Processing event network-vif-plugged-7f0d1e99-0601-4fb4-9a8e-1d3c45cc8106 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:58:44.548 4088 3038340492456 MainThread INFO nova.virt.hyperv.vmops [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Using config drive for instance 2021-09-10 16:58:44.650 4088 3038340493160 MainThread INFO nova.scheduler.client.report [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Deleted allocations for instance 0713ad83-2fd1-4b7f-bbe2-e9035bfc3538 2021-09-10 16:58:44.694 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-61901d14-7be4-43ae-984e-c7a3d360bfc4 5caa9c73de9d44b4a4001f521e76cb24 6153c0b18ada42b8b1fc8a04fbd01d24 - default default] Lock "0713ad83-2fd1-4b7f-bbe2-e9035bfc3538" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 27.062s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:44.713 4088 3038340492456 MainThread INFO nova.virt.hyperv.vmops [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Creating config drive at C:\openstack\instances\instance-00000036\configdrive.iso 2021-09-10 16:58:44.802 4088 3038340492456 MainThread DEBUG oslo_concurrency.processutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000036\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpmvghpbit execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:58:45.117 4088 3038340492456 MainThread DEBUG oslo_concurrency.processutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000036\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpmvghpbit" returned: 0 in 0.312s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:58:45.728 4088 3038340492456 MainThread DEBUG nova.virt.hyperv.vmops [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Setting boot order for instance: instance-00000036: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:58:45.824 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:58:45.880 4088 3038340492456 MainThread DEBUG nova.virt.hyperv.vmops [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:58:45.910 4088 3038340492456 MainThread DEBUG os_win.utils.jobutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': '57427D53-DFA1-4F24-89DF-DA333EAA16C5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18147), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:46.049 4088 3038340492456 MainThread ERROR os_win.utils.jobutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-00000036\' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)instance-000000367F824B06-3AF2-4655-8DA1-1148F74FC0F812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)instance-000000367F824B06-3AF2-4655-8DA1-1148F74FC0F810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000036\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)instance-000000367F824B06-3AF2-4655-8DA1-1148F74FC0F8%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '57427D53-DFA1-4F24-89DF-DA333EAA16C5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117946), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 45), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 46), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000036' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)\n\nNot enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)\n\n'instance-00000036' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)", 'ErrorSummaryDescription': "'instance-00000036' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000036.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:46.049 4088 3038340492456 MainThread DEBUG os_win._utils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000036' failed to start. Not enough memory in the system to start the virtual machine instance-00000036. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000036' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Not enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) 'instance-00000036' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1692028045654297 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:46.082 4088 3038342146008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000036" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:46.082 4088 3038342146008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000036" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:46.082 4088 3038342147064 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:46.082 4088 3038342147064 MainThread INFO nova.compute.manager [-] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] VM Stopped (Lifecycle Event) 2021-09-10 16:58:46.142 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-f3661698-2fd4-4b48-bf34-484ad6b70970 - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:46.142 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.vmops [req-f3661698-2fd4-4b48-bf34-484ad6b70970 - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:46.175 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-f3661698-2fd4-4b48-bf34-484ad6b70970 - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:46.206 4088 3038342147064 MainThread INFO nova.compute.manager [req-f3661698-2fd4-4b48-bf34-484ad6b70970 - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:46.619 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:58:46.642 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:46.642 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:46.642 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 16:58:46.642 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:58:46.658 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:58:46.897 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2223MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 16:58:46.897 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:47.100 4088 3038340492456 MainThread DEBUG os_win.utils.jobutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': '76E1EE8D-ED0B-474E-8CEE-6CC2BE03AC07', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18609), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:47.168 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:58:47.168 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:58:47.168 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:58:47.168 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:58:47.168 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:58:47.168 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:58:47.168 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:58:47.168 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:58:47.168 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:58:47.168 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:58:47.168 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:58:47.168 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:58:47.168 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:58:47.178 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 4bdc3835-ba14-4e1b-bd49-23ec32f15291 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:58:47.178 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 082d9c5d-01d4-43af-8493-80ba655501fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:58:47.178 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 832a0158-f115-480e-a24e-78506e51b9f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:58:47.178 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance c7fdc9fc-d133-4f12-ab12-ff417c249240 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:58:47.178 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 17 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 16:58:47.178 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=17408MB phys_disk=79GB used_disk=17GB total_vcpus=6 used_vcpus=17 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 16:58:47.251 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:58:47.255 4088 3038340492456 MainThread ERROR os_win.utils.jobutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-00000036\' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)instance-000000367F824B06-3AF2-4655-8DA1-1148F74FC0F812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)instance-000000367F824B06-3AF2-4655-8DA1-1148F74FC0F810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000036\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)instance-000000367F824B06-3AF2-4655-8DA1-1148F74FC0F8%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '76E1EE8D-ED0B-474E-8CEE-6CC2BE03AC07', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118730), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 47), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 47), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000036' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)\n\nNot enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)\n\n'instance-00000036' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)", 'ErrorSummaryDescription': "'instance-00000036' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000036.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:47.255 4088 3038340492456 MainThread DEBUG os_win._utils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000036' failed to start. Not enough memory in the system to start the virtual machine instance-00000036. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000036' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Not enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) 'instance-00000036' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3749141693115234 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:47.255 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:58:47.305 4088 3038342146008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000036" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:47.305 4088 3038342146008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000036" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:47.305 4088 3038342147064 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:47.305 4088 3038342147064 MainThread INFO nova.compute.manager [-] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] VM Stopped (Lifecycle Event) 2021-09-10 16:58:47.332 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-7d6fbfe2-12b9-46ab-992c-20ceaf9c2f49 - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:47.332 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.vmops [req-7d6fbfe2-12b9-46ab-992c-20ceaf9c2f49 - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:47.378 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-7d6fbfe2-12b9-46ab-992c-20ceaf9c2f49 - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:47.396 4088 3038342147064 MainThread INFO nova.compute.manager [req-7d6fbfe2-12b9-46ab-992c-20ceaf9c2f49 - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:47.496 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:58:47.532 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:58:47.542 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 16:58:47.542 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:48.272 4088 3038340492456 MainThread DEBUG os_win.utils.jobutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': '110F5CA7-B680-4E7D-9B92-04D6675DB518', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15571), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:48.426 4088 3038340492456 MainThread ERROR os_win.utils.jobutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-00000036\' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)instance-000000367F824B06-3AF2-4655-8DA1-1148F74FC0F812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)instance-000000367F824B06-3AF2-4655-8DA1-1148F74FC0F810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000036\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)instance-000000367F824B06-3AF2-4655-8DA1-1148F74FC0F8%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '110F5CA7-B680-4E7D-9B92-04D6675DB518', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113176), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 48), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 48), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000036' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)\n\nNot enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)\n\n'instance-00000036' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)", 'ErrorSummaryDescription': "'instance-00000036' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000036.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:48.426 4088 3038340492456 MainThread DEBUG os_win._utils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000036' failed to start. Not enough memory in the system to start the virtual machine instance-00000036. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000036' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Not enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) 'instance-00000036' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5462872982025146 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:48.462 4088 3038342147064 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:48.462 4088 3038342147064 MainThread INFO nova.compute.manager [-] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] VM Stopped (Lifecycle Event) 2021-09-10 16:58:48.462 4088 3038342146008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000036" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:48.462 4088 3038342146008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000036" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:48.494 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-0774e2e7-7a4a-422f-9d81-e0380a87bdac - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:48.503 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.vmops [req-0774e2e7-7a4a-422f-9d81-e0380a87bdac - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:48.503 4088 3038342256600 GreenThread-47 DEBUG nova.network.neutron [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Successfully updated port: 4f6f96b9-fc17-44a8-a3d1-d74f18f295f2 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:58:48.537 4088 3038342256600 GreenThread-47 DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Acquired lock "refresh_cache-832a0158-f115-480e-a24e-78506e51b9f6" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:58:48.537 4088 3038342256600 GreenThread-47 DEBUG nova.network.neutron [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:58:48.537 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-0774e2e7-7a4a-422f-9d81-e0380a87bdac - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:48.579 4088 3038342147064 MainThread INFO nova.compute.manager [req-0774e2e7-7a4a-422f-9d81-e0380a87bdac - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:48.650 4088 3038342256072 MainThread DEBUG nova.network.neutron [req-295ee374-b7fa-4548-bc15-b544dcce20b1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Updated VIF entry in instance network info cache for port 61b9b1b1-afdc-48e8-ac1d-1af17b15e954. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:58:48.650 4088 3038342256072 MainThread DEBUG nova.network.neutron [req-295ee374-b7fa-4548-bc15-b544dcce20b1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Updating instance_info_cache with network_info: [{"id": "61b9b1b1-afdc-48e8-ac1d-1af17b15e954", "address": "fa:16:3e:4c:5f:6a", "network": {"id": "99282f2c-b612-4703-8180-12ed8aae404f", "bridge": null, "label": "tempest-ListServerFiltersTestJSON-836490928-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "cc8daf6ce3114d6aa694f16669c8ed20", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap61b9b1b1-af", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:58:48.675 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [req-295ee374-b7fa-4548-bc15-b544dcce20b1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-082d9c5d-01d4-43af-8493-80ba655501fd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:58:48.978 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-ba55d80f-5a10-48c8-899e-375bcda3c30d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Received event network-vif-plugged-61b9b1b1-afdc-48e8-ac1d-1af17b15e954 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:58:48.978 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [req-ba55d80f-5a10-48c8-899e-375bcda3c30d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "082d9c5d-01d4-43af-8493-80ba655501fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:48.978 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [req-ba55d80f-5a10-48c8-899e-375bcda3c30d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "082d9c5d-01d4-43af-8493-80ba655501fd-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:48.978 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-ba55d80f-5a10-48c8-899e-375bcda3c30d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Processing event network-vif-plugged-61b9b1b1-afdc-48e8-ac1d-1af17b15e954 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:58:49.050 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Lock "04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:49.082 4088 3038340491928 MainThread INFO nova.virt.hyperv.vmops [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Using config drive for instance 2021-09-10 16:58:49.173 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:58:49.207 4088 3038342256600 GreenThread-47 DEBUG nova.network.neutron [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:58:49.314 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:49.314 4088 3038342147592 MainThread DEBUG nova.virt.hardware [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:58:49.314 4088 3038342147592 MainThread INFO nova.compute.claims [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Claim successful on node n-h2-808474-1 2021-09-10 16:58:49.455 4088 3038340492456 MainThread DEBUG os_win.utils.jobutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': '0395BA4E-EFCE-4E93-BA90-1C7D19B2320F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15867), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:49.604 4088 3038340492456 MainThread ERROR os_win.utils.jobutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-00000036\' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)instance-000000367F824B06-3AF2-4655-8DA1-1148F74FC0F812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)instance-000000367F824B06-3AF2-4655-8DA1-1148F74FC0F810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000036\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)instance-000000367F824B06-3AF2-4655-8DA1-1148F74FC0F8%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0395BA4E-EFCE-4E93-BA90-1C7D19B2320F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110512), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 49), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 49), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000036' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)\n\nNot enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)\n\n'instance-00000036' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)", 'ErrorSummaryDescription': "'instance-00000036' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000036.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:49.604 4088 3038340492456 MainThread DEBUG os_win._utils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000036' failed to start. Not enough memory in the system to start the virtual machine instance-00000036. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000036' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Not enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) 'instance-00000036' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.724031925201416 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:49.647 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000036" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:49.647 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000036" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:49.647 4088 3038342146712 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:49.647 4088 3038342146712 MainThread INFO nova.compute.manager [-] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] VM Stopped (Lifecycle Event) 2021-09-10 16:58:49.690 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-b56df914-4089-4d68-a3e6-77d53bba79ad - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:49.690 4088 3038342146712 MainThread DEBUG nova.virt.hyperv.vmops [req-b56df914-4089-4d68-a3e6-77d53bba79ad - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:49.710 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.hostops [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:58:49.721 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.hostops [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:58:49.736 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-b56df914-4089-4d68-a3e6-77d53bba79ad - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:49.752 4088 3038342146712 MainThread INFO nova.compute.manager [req-b56df914-4089-4d68-a3e6-77d53bba79ad - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:49.915 4088 3038342255192 GreenThread-48 DEBUG nova.network.neutron [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Successfully created port: bf834a56-0a12-486b-aefc-598083705b01 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:58:49.939 4088 3038342147592 MainThread DEBUG nova.compute.provider_tree [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:58:50.005 4088 3038342147592 MainThread DEBUG nova.scheduler.client.report [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:58:50.005 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.688s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:50.005 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:58:50.126 4088 3038340491928 MainThread INFO nova.virt.hyperv.vmops [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Creating config drive at C:\openstack\instances\instance-00000037\configdrive.iso 2021-09-10 16:58:50.206 4088 3038340491928 MainThread DEBUG oslo_concurrency.processutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000037\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp1262nxms execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:58:50.338 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:58:50.360 4088 3038342144072 GreenThread-49 DEBUG nova.compute.manager [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:58:50.360 4088 3038342144072 GreenThread-49 DEBUG nova.network.neutron [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:58:50.360 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "1f6d373b-5624-411c-9545-511d98e94f86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:50.408 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:58:50.526 4088 3038340491928 MainThread DEBUG oslo_concurrency.processutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000037\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp1262nxms" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:58:50.617 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:50.626 4088 3038342144424 MainThread DEBUG nova.virt.hardware [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:58:50.626 4088 3038342144424 MainThread INFO nova.compute.claims [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Claim successful on node n-h2-808474-1 2021-09-10 16:58:50.626 4088 3038340492456 MainThread DEBUG os_win.utils.jobutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': '33EBF79D-D95D-4BC0-B0E1-78B62FABADE0', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21470), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:50.706 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:58:50.720 4088 3038342147592 MainThread INFO nova.virt.hyperv.vmops [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Spawning new instance 2021-09-10 16:58:50.720 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Lock "instance-0000003c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:50.720 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Lock "instance-0000003c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:50.720 4088 3038342147592 MainThread DEBUG nova.block_device [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:58:50.737 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:50.737 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:50.737 4088 3038342147592 MainThread DEBUG os_win.utils.pathutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Creating directory: C:\openstack\instances\instance-0000003c check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:58:50.737 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.vmops [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000003c\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:58:50.768 4088 3038340492456 MainThread ERROR os_win.utils.jobutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-00000036\' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)instance-000000367F824B06-3AF2-4655-8DA1-1148F74FC0F812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)instance-000000367F824B06-3AF2-4655-8DA1-1148F74FC0F810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000036\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)instance-000000367F824B06-3AF2-4655-8DA1-1148F74FC0F8%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '33EBF79D-D95D-4BC0-B0E1-78B62FABADE0', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120497), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 50), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 50), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000036' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)\n\nNot enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)\n\n'instance-00000036' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)", 'ErrorSummaryDescription': "'instance-00000036' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000036.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:50.768 4088 3038340492456 MainThread DEBUG os_win._utils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000036' failed to start. Not enough memory in the system to start the virtual machine instance-00000036. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000036' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Not enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) 'instance-00000036' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.887736082077026 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:50.798 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.hostops [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:58:50.798 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.hostops [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:58:50.882 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000036" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:50.882 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000036" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:50.882 4088 3038342146888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:50.882 4088 3038342146888 MainThread INFO nova.compute.manager [-] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] VM Stopped (Lifecycle Event) 2021-09-10 16:58:50.908 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-2c6025ef-a7db-4773-a27f-340158f53d98 - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:50.908 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [req-2c6025ef-a7db-4773-a27f-340158f53d98 - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:51.053 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-2c6025ef-a7db-4773-a27f-340158f53d98 - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:51.053 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.vmops [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Resizing VHD C:\openstack\instances\instance-0000003c\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:58:51.067 4088 3038342144424 MainThread DEBUG nova.compute.provider_tree [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:58:51.067 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-c05620eb-c23e-4a7c-a1b3-f58e582ff247 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Received event network-vif-deleted-20f19fa9-4c3e-43e8-8e22-6987b697fd3b external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:58:51.080 4088 3038342144424 MainThread DEBUG nova.scheduler.client.report [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:58:51.080 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:51.080 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:58:51.080 4088 3038342146888 MainThread INFO nova.compute.manager [req-2c6025ef-a7db-4773-a27f-340158f53d98 - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:51.205 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:58:51.205 4088 3038342146888 GreenThread-50 DEBUG nova.compute.manager [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:58:51.205 4088 3038342146888 GreenThread-50 DEBUG nova.network.neutron [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:58:51.318 4088 3038340491928 MainThread DEBUG nova.virt.hyperv.vmops [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Setting boot order for instance: instance-00000037: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:58:51.394 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:58:51.394 4088 3038342144424 MainThread INFO nova.virt.hyperv.vmops [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Spawning new instance 2021-09-10 16:58:51.418 4088 3038342146888 GreenThread-50 DEBUG nova.policy [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1711a7b02c2433dacfb4017cd0a812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b9dfa46b614e449b6aff88db2cfd6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:58:51.423 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-0000003a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:51.423 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-0000003a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:51.423 4088 3038342144424 MainThread DEBUG nova.block_device [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:58:51.450 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:51.450 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:51.450 4088 3038340491928 MainThread DEBUG nova.virt.hyperv.vmops [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:58:51.455 4088 3038342144424 MainThread DEBUG os_win.utils.pathutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Creating directory: C:\openstack\instances\instance-0000003a check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:58:51.455 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.vmops [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000003a\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:58:51.487 4088 3038340491928 MainThread DEBUG os_win.utils.jobutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': '07D64BE4-DA11-4F78-9D4D-3107CB6E4C0D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16920), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:51.646 4088 3038340491928 MainThread ERROR os_win.utils.jobutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000037\' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)instance-000000372FEE5EA8-29C2-47ED-8D0C-839981AE07D512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)instance-000000372FEE5EA8-29C2-47ED-8D0C-839981AE07D510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000037\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)instance-000000372FEE5EA8-29C2-47ED-8D0C-839981AE07D5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '07D64BE4-DA11-4F78-9D4D-3107CB6E4C0D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=139691), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 51), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 51), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000037' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)\n\nNot enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)\n\n'instance-00000037' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)", 'ErrorSummaryDescription': "'instance-00000037' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000037.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:51.646 4088 3038340491928 MainThread DEBUG os_win._utils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000037' failed to start. Not enough memory in the system to start the virtual machine instance-00000037. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000037' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Not enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) 'instance-00000037' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.19580793380737305 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:51.707 4088 3038342146712 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:51.707 4088 3038342146712 MainThread INFO nova.compute.manager [-] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] VM Stopped (Lifecycle Event) 2021-09-10 16:58:51.707 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000037" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:51.707 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000037" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:51.707 4088 3038342144072 GreenThread-49 DEBUG nova.policy [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd62454119feb46319b4a349e02ddd6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13940e712fe464c8a1b2c3732982edb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:58:51.737 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-92c6d64b-8ad9-492b-ae04-4981cfef5f45 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:51.737 4088 3038342146712 MainThread DEBUG nova.virt.hyperv.vmops [req-92c6d64b-8ad9-492b-ae04-4981cfef5f45 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:51.754 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.vmops [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Resizing VHD C:\openstack\instances\instance-0000003a\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:58:51.809 4088 3038340492456 MainThread DEBUG os_win.utils.jobutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': '26D9A9D8-4E18-4613-8533-8889EBD760EA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21306), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:51.809 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-92c6d64b-8ad9-492b-ae04-4981cfef5f45 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:51.818 4088 3038342256600 GreenThread-47 DEBUG nova.network.neutron [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Updating instance_info_cache with network_info: [{"id": "4f6f96b9-fc17-44a8-a3d1-d74f18f295f2", "address": "fa:16:3e:9d:ca:09", "network": {"id": "99282f2c-b612-4703-8180-12ed8aae404f", "bridge": null, "label": "tempest-ListServerFiltersTestJSON-836490928-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "cc8daf6ce3114d6aa694f16669c8ed20", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4f6f96b9-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:58:51.864 4088 3038342256600 GreenThread-47 DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Releasing lock "refresh_cache-832a0158-f115-480e-a24e-78506e51b9f6" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:58:51.864 4088 3038342256600 GreenThread-47 DEBUG nova.compute.manager [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Instance network_info: |[{"id": "4f6f96b9-fc17-44a8-a3d1-d74f18f295f2", "address": "fa:16:3e:9d:ca:09", "network": {"id": "99282f2c-b612-4703-8180-12ed8aae404f", "bridge": null, "label": "tempest-ListServerFiltersTestJSON-836490928-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "cc8daf6ce3114d6aa694f16669c8ed20", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4f6f96b9-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:58:51.864 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Preparing to wait for external event network-vif-plugged-4f6f96b9-fc17-44a8-a3d1-d74f18f295f2 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:58:51.864 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "832a0158-f115-480e-a24e-78506e51b9f6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:51.864 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "832a0158-f115-480e-a24e-78506e51b9f6-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:51.864 4088 3038342255896 MainThread DEBUG os_win.utils.compute.vmutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Creating VM instance-00000039 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:58:51.864 4088 3038342146712 MainThread INFO nova.compute.manager [req-92c6d64b-8ad9-492b-ae04-4981cfef5f45 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:51.893 4088 3038342256600 MainThread DEBUG nova.compute.manager [req-b17dc05c-2a72-46ab-ac08-e45f70d4d258 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Received event network-changed-4f6f96b9-fc17-44a8-a3d1-d74f18f295f2 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:58:51.893 4088 3038342256600 MainThread DEBUG nova.compute.manager [req-b17dc05c-2a72-46ab-ac08-e45f70d4d258 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Refreshing instance network info cache due to event network-changed-4f6f96b9-fc17-44a8-a3d1-d74f18f295f2. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:58:51.893 4088 3038342256600 MainThread DEBUG oslo_concurrency.lockutils [req-b17dc05c-2a72-46ab-ac08-e45f70d4d258 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-832a0158-f115-480e-a24e-78506e51b9f6" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:58:51.893 4088 3038342256600 MainThread DEBUG nova.network.neutron [req-b17dc05c-2a72-46ab-ac08-e45f70d4d258 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Refreshing network info cache for port 4f6f96b9-fc17-44a8-a3d1-d74f18f295f2 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:58:52.033 4088 3038342144600 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:52.033 4088 3038342144600 MainThread INFO nova.compute.manager [-] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] VM Stopped (Lifecycle Event) 2021-09-10 16:58:52.033 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000036" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:52.033 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000036" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:52.033 4088 3038340492456 MainThread ERROR os_win.utils.jobutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-00000036\' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)instance-000000367F824B06-3AF2-4655-8DA1-1148F74FC0F812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)instance-000000367F824B06-3AF2-4655-8DA1-1148F74FC0F810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000036\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)instance-000000367F824B06-3AF2-4655-8DA1-1148F74FC0F8%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '26D9A9D8-4E18-4613-8533-8889EBD760EA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=144286), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 51), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 51), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000036' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)\n\nNot enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)\n\n'instance-00000036' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8)", 'ErrorSummaryDescription': "'instance-00000036' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000036.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:52.033 4088 3038340492456 MainThread ERROR nova.virt.hyperv.vmops [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Failed to change vm state of instance-00000036 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000036' failed to start. 2021-09-10 16:58:52.033 4088 3038340492456 MainThread INFO nova.virt.hyperv.vmops [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Got request to destroy instance 2021-09-10 16:58:52.051 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-9c9f9d3c-8ea7-4a51-a8f2-a47cdbd5adb5 - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:52.051 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-9c9f9d3c-8ea7-4a51-a8f2-a47cdbd5adb5 - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:52.315 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-9c9f9d3c-8ea7-4a51-a8f2-a47cdbd5adb5 - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:52.330 4088 3038342144600 MainThread INFO nova.compute.manager [req-9c9f9d3c-8ea7-4a51-a8f2-a47cdbd5adb5 - - - - -] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:52.663 4088 3038340491928 MainThread DEBUG os_win.utils.jobutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': '7E64AE38-71DD-4BB4-AA4A-D084D99E24F9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18468), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:52.739 4088 3038342146888 GreenThread-50 DEBUG nova.network.neutron [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Successfully created port: d0d6d930-197b-4dfa-bcee-ceb17a904050 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:58:52.855 4088 3038342147064 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:52.855 4088 3038342147064 MainThread INFO nova.compute.manager [-] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] VM Stopped (Lifecycle Event) 2021-09-10 16:58:52.855 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000037" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:52.855 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000037" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:52.884 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-c89170ab-680a-4fbb-b14c-55adb25d2e47 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:52.884 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.vmops [req-c89170ab-680a-4fbb-b14c-55adb25d2e47 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:52.902 4088 3038340491928 MainThread ERROR os_win.utils.jobutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000037\' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)instance-000000372FEE5EA8-29C2-47ED-8D0C-839981AE07D512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)instance-000000372FEE5EA8-29C2-47ED-8D0C-839981AE07D510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000037\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)instance-000000372FEE5EA8-29C2-47ED-8D0C-839981AE07D5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7E64AE38-71DD-4BB4-AA4A-D084D99E24F9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120562), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 52), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 52), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000037' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)\n\nNot enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)\n\n'instance-00000037' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)", 'ErrorSummaryDescription': "'instance-00000037' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000037.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:52.912 4088 3038340491928 MainThread DEBUG os_win._utils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000037' failed to start. Not enough memory in the system to start the virtual machine instance-00000037. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000037' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Not enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) 'instance-00000037' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4512951374053955 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:52.924 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-c89170ab-680a-4fbb-b14c-55adb25d2e47 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:52.955 4088 3038342147064 MainThread INFO nova.compute.manager [req-c89170ab-680a-4fbb-b14c-55adb25d2e47 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:53.818 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.vmops [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:58:53.954 4088 3038340491928 MainThread DEBUG os_win.utils.jobutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': '397C7B7C-7D07-4571-9EB4-5CB938CF08C8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19279), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:54.097 4088 3038340491928 MainThread ERROR os_win.utils.jobutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000037\' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)instance-000000372FEE5EA8-29C2-47ED-8D0C-839981AE07D512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)instance-000000372FEE5EA8-29C2-47ED-8D0C-839981AE07D510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000037\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)instance-000000372FEE5EA8-29C2-47ED-8D0C-839981AE07D5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '397C7B7C-7D07-4571-9EB4-5CB938CF08C8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=124977), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 53), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 54), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000037' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)\n\nNot enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)\n\n'instance-00000037' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)", 'ErrorSummaryDescription': "'instance-00000037' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000037.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:54.097 4088 3038340491928 MainThread DEBUG os_win._utils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000037' failed to start. Not enough memory in the system to start the virtual machine instance-00000037. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000037' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Not enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) 'instance-00000037' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.6467339992523193 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:54.160 4088 3038342147064 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:54.160 4088 3038342147064 MainThread INFO nova.compute.manager [-] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] VM Stopped (Lifecycle Event) 2021-09-10 16:58:54.160 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000037" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:54.177 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000037" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:54.190 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-8802b5e2-db8d-4ed3-a7ea-fa4bd855a751 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:54.190 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.vmops [req-8802b5e2-db8d-4ed3-a7ea-fa4bd855a751 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:54.223 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-8802b5e2-db8d-4ed3-a7ea-fa4bd855a751 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:54.252 4088 3038340492456 MainThread DEBUG nova.virt.hyperv.vmops [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:58:54.252 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000036" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:54.252 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000036" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:54.252 4088 3038342147064 MainThread INFO nova.compute.manager [req-8802b5e2-db8d-4ed3-a7ea-fa4bd855a751 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:54.272 4088 3038340492456 MainThread DEBUG os_win.utils.compute.vmutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Successfully changed vm state of instance-00000036 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:58:54.272 4088 3038340492456 MainThread DEBUG nova.virt.hyperv.vmops [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Successfully changed state of VM instance-00000036 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:58:54.324 4088 3038340492456 MainThread DEBUG os_win.utils.jobutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': '52D24109-19EB-4360-95AF-1A7309FEF71E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15392), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:54.442 4088 3038340492456 MainThread DEBUG os_win.utils.jobutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job succeeded: {'InstanceID': '52D24109-19EB-4360-95AF-1A7309FEF71E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=111769), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:58:54.442 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000036" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:54.442 4088 3038340492456 MainThread DEBUG os_win.utils.pathutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Removing directory: C:\openstack\instances\instance-00000036 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:58:54.442 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000036" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:54.468 4088 3038340492456 MainThread ERROR nova.compute.manager [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000036' failed to start. Not enough memory in the system to start the virtual machine instance-00000036. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000036' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Not enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) 'instance-00000036' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Error code: 32778. 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Traceback (most recent call last): 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] return function(*args, **kwargs) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] admin_password, network_info, block_device_info) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] return function(self, *args, **kwds) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self.force_reraise() 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] raise self.value 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] should_plug_vifs=False) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 'req_state': req_state}) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self.force_reraise() 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] raise self.value 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] time.sleep(sleep_time) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self.force_reraise() 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] raise self.value 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] return f(*args, **kwargs) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] return self._wait_for_job(job_path) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] error_desc=err_desc) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000036' failed to start. 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Not enough memory in the system to start the virtual machine instance-00000036. 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000036' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Not enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 'instance-00000036' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Error code: 32778. 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] During handling of the above exception, another exception occurred: 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Traceback (most recent call last): 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] yield resources 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] accel_info=accel_info) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] return function(*args, **kwargs) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] admin_password, network_info, block_device_info) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] return function(self, *args, **kwds) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self.force_reraise() 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] raise self.value 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] should_plug_vifs=False) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 'req_state': req_state}) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self.force_reraise() 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] raise self.value 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] time.sleep(sleep_time) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self.force_reraise() 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] raise self.value 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] return f(*args, **kwargs) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] return self._wait_for_job(job_path) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] error_desc=err_desc) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000036' failed to start. 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Not enough memory in the system to start the virtual machine instance-00000036. 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000036' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Not enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 'instance-00000036' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Error code: 32778. 2021-09-10 16:58:54.468 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.472 4088 3038340492456 MainThread INFO nova.compute.manager [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Terminating instance 2021-09-10 16:58:54.472 4088 3038340492456 MainThread DEBUG nova.compute.manager [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:58:54.486 4088 3038340492456 MainThread INFO nova.virt.hyperv.vmops [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Got request to destroy instance 2021-09-10 16:58:54.486 4088 3038340492456 MainThread DEBUG nova.virt.hyperv.vmops [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:58:54.486 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000036" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:54.486 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000036" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:54.486 4088 3038340492456 MainThread INFO nova.compute.manager [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Took 0.00 seconds to destroy the instance on the hypervisor. 2021-09-10 16:58:54.486 4088 3038340492456 MainThread DEBUG nova.compute.claims [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:58:54.486 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:54.620 4088 3038340492456 MainThread DEBUG nova.virt.hyperv.hostops [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:58:54.628 4088 3038340492456 MainThread DEBUG nova.virt.hyperv.hostops [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:58:54.762 4088 3038342146888 GreenThread-50 DEBUG nova.network.neutron [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Successfully updated port: d0d6d930-197b-4dfa-bcee-ceb17a904050 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:58:54.783 4088 3038342146888 GreenThread-50 DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Acquired lock "refresh_cache-1f6d373b-5624-411c-9545-511d98e94f86" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:58:54.783 4088 3038342146888 GreenThread-50 DEBUG nova.network.neutron [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:58:54.855 4088 3038340492456 MainThread DEBUG nova.compute.provider_tree [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:58:54.886 4088 3038342255192 GreenThread-48 DEBUG nova.network.neutron [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Successfully updated port: bf834a56-0a12-486b-aefc-598083705b01 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:58:54.907 4088 3038342255192 GreenThread-48 DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Acquired lock "refresh_cache-c7fdc9fc-d133-4f12-ab12-ff417c249240" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:58:54.907 4088 3038342255192 GreenThread-48 DEBUG nova.network.neutron [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:58:54.907 4088 3038340492456 MainThread DEBUG nova.scheduler.client.report [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:58:54.907 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:54.907 4088 3038340492456 MainThread ERROR nova.compute.manager [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000036' failed to start. Not enough memory in the system to start the virtual machine instance-00000036. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000036' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Not enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) 'instance-00000036' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Error code: 32778. 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Traceback (most recent call last): 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] return function(*args, **kwargs) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] admin_password, network_info, block_device_info) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] return function(self, *args, **kwds) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self.force_reraise() 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] raise self.value 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] should_plug_vifs=False) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 'req_state': req_state}) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self.force_reraise() 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] raise self.value 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] time.sleep(sleep_time) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self.force_reraise() 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] raise self.value 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] return f(*args, **kwargs) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] return self._wait_for_job(job_path) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] error_desc=err_desc) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000036' failed to start. 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Not enough memory in the system to start the virtual machine instance-00000036. 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000036' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Not enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 'instance-00000036' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Error code: 32778. 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] During handling of the above exception, another exception occurred: 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Traceback (most recent call last): 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] accel_info=accel_info) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] return function(*args, **kwargs) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] admin_password, network_info, block_device_info) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] return function(self, *args, **kwds) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self.force_reraise() 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] raise self.value 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] should_plug_vifs=False) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 'req_state': req_state}) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self.force_reraise() 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] raise self.value 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] time.sleep(sleep_time) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self.force_reraise() 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] raise self.value 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] return f(*args, **kwargs) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] return self._wait_for_job(job_path) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] error_desc=err_desc) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000036' failed to start. 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Not enough memory in the system to start the virtual machine instance-00000036. 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000036' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Not enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 'instance-00000036' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Error code: 32778. 2021-09-10 16:58:54.907 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] 2021-09-10 16:58:54.917 4088 3038340492456 MainThread DEBUG nova.compute.utils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] WMI job failed with status 10. Error summary description: 'instance-00000036' failed to start. Not enough memory in the system to start the virtual machine instance-00000036. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:58:54.917 4088 3038340492456 MainThread DEBUG nova.compute.manager [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Build of instance 4bdc3835-ba14-4e1b-bd49-23ec32f15291 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000036' failed to start. Not enough memory in the system to start the virtual machine instance-00000036. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000036' failed to start. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Not enough memory in the system to start the virtual machine instance-00000036 with ram size 1024 megabytes. (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) 'instance-00000036' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7F824B06-3AF2-4655-8DA1-1148F74FC0F8) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:58:54.917 4088 3038340492456 MainThread DEBUG nova.compute.manager [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:58:54.917 4088 3038340492456 MainThread DEBUG nova.compute.manager [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:58:54.917 4088 3038340492456 MainThread DEBUG nova.compute.manager [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:58:54.917 4088 3038340492456 MainThread DEBUG nova.network.neutron [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:58:54.954 4088 3038342146888 GreenThread-50 DEBUG nova.network.neutron [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:58:55.116 4088 3038340491928 MainThread DEBUG os_win.utils.jobutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': '499C6038-2597-42A6-AE2B-24BC214B74AB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18178), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:55.179 4088 3038342255192 GreenThread-48 DEBUG nova.network.neutron [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:58:55.251 4088 3038340491928 MainThread ERROR os_win.utils.jobutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000037\' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)instance-000000372FEE5EA8-29C2-47ED-8D0C-839981AE07D512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)instance-000000372FEE5EA8-29C2-47ED-8D0C-839981AE07D510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000037\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)instance-000000372FEE5EA8-29C2-47ED-8D0C-839981AE07D5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '499C6038-2597-42A6-AE2B-24BC214B74AB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119302), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 55), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 55), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000037' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)\n\nNot enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)\n\n'instance-00000037' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)", 'ErrorSummaryDescription': "'instance-00000037' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000037.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:55.251 4088 3038340491928 MainThread DEBUG os_win._utils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000037' failed to start. Not enough memory in the system to start the virtual machine instance-00000037. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000037' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Not enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) 'instance-00000037' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.8009328842163086 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:55.306 4088 3038340492808 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000037" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:55.306 4088 3038340492808 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000037" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:55.306 4088 3038342146712 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:55.306 4088 3038342146712 MainThread INFO nova.compute.manager [-] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] VM Stopped (Lifecycle Event) 2021-09-10 16:58:55.339 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-f9b881d3-720f-4ede-a9d0-0584d97c3381 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:55.339 4088 3038342146712 MainThread DEBUG nova.virt.hyperv.vmops [req-f9b881d3-720f-4ede-a9d0-0584d97c3381 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:55.392 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-f9b881d3-720f-4ede-a9d0-0584d97c3381 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:55.392 4088 3038342146712 MainThread INFO nova.compute.manager [req-f9b881d3-720f-4ede-a9d0-0584d97c3381 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:55.896 4088 3038342146888 GreenThread-50 DEBUG nova.network.neutron [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Updating instance_info_cache with network_info: [{"id": "d0d6d930-197b-4dfa-bcee-ceb17a904050", "address": "fa:16:3e:36:4b:d8", "network": {"id": "3eb3df69-b47c-4acb-8098-7e28b146140d", "bridge": null, "label": "tempest-ServerDiskConfigTestJSON-1037400376-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e0b9dfa46b614e449b6aff88db2cfd6b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd0d6d930-19", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:58:55.923 4088 3038342146888 GreenThread-50 DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Releasing lock "refresh_cache-1f6d373b-5624-411c-9545-511d98e94f86" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:58:55.923 4088 3038342146888 GreenThread-50 DEBUG nova.compute.manager [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Instance network_info: |[{"id": "d0d6d930-197b-4dfa-bcee-ceb17a904050", "address": "fa:16:3e:36:4b:d8", "network": {"id": "3eb3df69-b47c-4acb-8098-7e28b146140d", "bridge": null, "label": "tempest-ServerDiskConfigTestJSON-1037400376-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e0b9dfa46b614e449b6aff88db2cfd6b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd0d6d930-19", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:58:55.923 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Preparing to wait for external event network-vif-plugged-d0d6d930-197b-4dfa-bcee-ceb17a904050 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:58:55.923 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "1f6d373b-5624-411c-9545-511d98e94f86-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:55.923 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "1f6d373b-5624-411c-9545-511d98e94f86-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:55.923 4088 3038342144424 MainThread DEBUG os_win.utils.compute.vmutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Creating VM instance-0000003a create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:58:56.055 4088 3038342256600 MainThread DEBUG nova.network.neutron [req-b17dc05c-2a72-46ab-ac08-e45f70d4d258 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Updated VIF entry in instance network info cache for port 4f6f96b9-fc17-44a8-a3d1-d74f18f295f2. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:58:56.055 4088 3038342256600 MainThread DEBUG nova.network.neutron [req-b17dc05c-2a72-46ab-ac08-e45f70d4d258 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Updating instance_info_cache with network_info: [{"id": "4f6f96b9-fc17-44a8-a3d1-d74f18f295f2", "address": "fa:16:3e:9d:ca:09", "network": {"id": "99282f2c-b612-4703-8180-12ed8aae404f", "bridge": null, "label": "tempest-ListServerFiltersTestJSON-836490928-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "cc8daf6ce3114d6aa694f16669c8ed20", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4f6f96b9-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:58:56.084 4088 3038342256600 MainThread DEBUG oslo_concurrency.lockutils [req-b17dc05c-2a72-46ab-ac08-e45f70d4d258 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-832a0158-f115-480e-a24e-78506e51b9f6" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:58:56.084 4088 3038342256600 MainThread DEBUG nova.compute.manager [req-b17dc05c-2a72-46ab-ac08-e45f70d4d258 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Received event network-vif-deleted-2ab80196-8434-4424-b44a-f47ed0cf89ad external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:58:56.084 4088 3038342144072 GreenThread-49 DEBUG nova.network.neutron [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Successfully created port: 6e82ace2-7f01-4e23-9eda-cc3b62c12db6 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:58:56.143 4088 3038342255192 GreenThread-48 DEBUG nova.network.neutron [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Updating instance_info_cache with network_info: [{"id": "bf834a56-0a12-486b-aefc-598083705b01", "address": "fa:16:3e:e2:bf:37", "network": {"id": "99282f2c-b612-4703-8180-12ed8aae404f", "bridge": null, "label": "tempest-ListServerFiltersTestJSON-836490928-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "cc8daf6ce3114d6aa694f16669c8ed20", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapbf834a56-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:58:56.181 4088 3038342255192 GreenThread-48 DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Releasing lock "refresh_cache-c7fdc9fc-d133-4f12-ab12-ff417c249240" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:58:56.181 4088 3038342255192 GreenThread-48 DEBUG nova.compute.manager [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Instance network_info: |[{"id": "bf834a56-0a12-486b-aefc-598083705b01", "address": "fa:16:3e:e2:bf:37", "network": {"id": "99282f2c-b612-4703-8180-12ed8aae404f", "bridge": null, "label": "tempest-ListServerFiltersTestJSON-836490928-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "cc8daf6ce3114d6aa694f16669c8ed20", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapbf834a56-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:58:56.181 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Preparing to wait for external event network-vif-plugged-bf834a56-0a12-486b-aefc-598083705b01 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:58:56.181 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "c7fdc9fc-d133-4f12-ab12-ff417c249240-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:56.181 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "c7fdc9fc-d133-4f12-ab12-ff417c249240-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:56.181 4088 3038342258184 MainThread DEBUG os_win.utils.compute.vmutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Creating VM instance-00000038 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:58:56.292 4088 3038342255192 MainThread DEBUG nova.compute.manager [req-7651bd94-4a35-433a-bada-6b873aff88e2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Received event network-changed-d0d6d930-197b-4dfa-bcee-ceb17a904050 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:58:56.292 4088 3038342255192 MainThread DEBUG nova.compute.manager [req-7651bd94-4a35-433a-bada-6b873aff88e2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Refreshing instance network info cache due to event network-changed-d0d6d930-197b-4dfa-bcee-ceb17a904050. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:58:56.292 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [req-7651bd94-4a35-433a-bada-6b873aff88e2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-1f6d373b-5624-411c-9545-511d98e94f86" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:58:56.292 4088 3038342255192 MainThread DEBUG nova.network.neutron [req-7651bd94-4a35-433a-bada-6b873aff88e2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Refreshing network info cache for port d0d6d930-197b-4dfa-bcee-ceb17a904050 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:58:56.330 4088 3038340491928 MainThread DEBUG os_win.utils.jobutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': '92BB3A38-4AB1-4DD5-9C4E-12FEB99413C5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20334), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:56.472 4088 3038340491928 MainThread ERROR os_win.utils.jobutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000037\' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)instance-000000372FEE5EA8-29C2-47ED-8D0C-839981AE07D512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)instance-000000372FEE5EA8-29C2-47ED-8D0C-839981AE07D510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000037\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)instance-000000372FEE5EA8-29C2-47ED-8D0C-839981AE07D5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '92BB3A38-4AB1-4DD5-9C4E-12FEB99413C5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=123728), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 56), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 56), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000037' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)\n\nNot enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)\n\n'instance-00000037' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)", 'ErrorSummaryDescription': "'instance-00000037' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000037.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:56.472 4088 3038340491928 MainThread DEBUG os_win._utils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000037' failed to start. Not enough memory in the system to start the virtual machine instance-00000037. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000037' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Not enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) 'instance-00000037' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.021758556365967 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:58:56.610 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000037" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:56.610 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000037" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:56.610 4088 3038342147064 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:58:56.610 4088 3038342147064 MainThread INFO nova.compute.manager [-] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] VM Stopped (Lifecycle Event) 2021-09-10 16:58:56.627 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-0456718d-601e-454a-9c83-e725fa80a7b3 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:58:56.627 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.vmops [req-0456718d-601e-454a-9c83-e725fa80a7b3 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:58:56.726 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-0456718d-601e-454a-9c83-e725fa80a7b3 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:58:56.759 4088 3038342147064 MainThread INFO nova.compute.manager [req-0456718d-601e-454a-9c83-e725fa80a7b3 - - - - -] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:58:57.026 4088 3038342255192 MainThread DEBUG nova.network.neutron [req-7651bd94-4a35-433a-bada-6b873aff88e2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Updated VIF entry in instance network info cache for port d0d6d930-197b-4dfa-bcee-ceb17a904050. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:58:57.026 4088 3038342255192 MainThread DEBUG nova.network.neutron [req-7651bd94-4a35-433a-bada-6b873aff88e2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Updating instance_info_cache with network_info: [{"id": "d0d6d930-197b-4dfa-bcee-ceb17a904050", "address": "fa:16:3e:36:4b:d8", "network": {"id": "3eb3df69-b47c-4acb-8098-7e28b146140d", "bridge": null, "label": "tempest-ServerDiskConfigTestJSON-1037400376-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e0b9dfa46b614e449b6aff88db2cfd6b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd0d6d930-19", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:58:57.038 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [req-7651bd94-4a35-433a-bada-6b873aff88e2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-1f6d373b-5624-411c-9545-511d98e94f86" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:58:57.492 4088 3038340491928 MainThread DEBUG os_win.utils.jobutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': '7D4E2030-D418-4136-9C8D-5A4791307E67', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15984), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:57.649 4088 3038340491928 MainThread ERROR os_win.utils.jobutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000037\' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)instance-000000372FEE5EA8-29C2-47ED-8D0C-839981AE07D512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)instance-000000372FEE5EA8-29C2-47ED-8D0C-839981AE07D510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000037\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)instance-000000372FEE5EA8-29C2-47ED-8D0C-839981AE07D5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7D4E2030-D418-4136-9C8D-5A4791307E67', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118165), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 58, 57), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 58, 57), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000037' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)\n\nNot enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)\n\n'instance-00000037' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5)", 'ErrorSummaryDescription': "'instance-00000037' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000037.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:58:57.659 4088 3038340491928 MainThread ERROR nova.virt.hyperv.vmops [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Failed to change vm state of instance-00000037 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000037' failed to start. 2021-09-10 16:58:57.659 4088 3038340491928 MainThread INFO nova.virt.hyperv.vmops [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Got request to destroy instance 2021-09-10 16:58:58.002 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.vmops [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:58:58.101 4088 3038342255192 MainThread DEBUG nova.compute.manager [req-c97a9a26-0bba-4786-99a1-de37277c499c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Received event network-changed-bf834a56-0a12-486b-aefc-598083705b01 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:58:58.101 4088 3038342255192 MainThread DEBUG nova.compute.manager [req-c97a9a26-0bba-4786-99a1-de37277c499c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Refreshing instance network info cache due to event network-changed-bf834a56-0a12-486b-aefc-598083705b01. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:58:58.101 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [req-c97a9a26-0bba-4786-99a1-de37277c499c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-c7fdc9fc-d133-4f12-ab12-ff417c249240" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:58:58.101 4088 3038342255192 MainThread DEBUG nova.network.neutron [req-c97a9a26-0bba-4786-99a1-de37277c499c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Refreshing network info cache for port bf834a56-0a12-486b-aefc-598083705b01 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:58:58.284 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.vmops [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:58:58.634 4088 3038340492456 MainThread DEBUG nova.network.neutron [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:58:58.668 4088 3038340492456 MainThread INFO nova.compute.manager [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4bdc3835-ba14-4e1b-bd49-23ec32f15291] Took 3.75 seconds to deallocate network for instance. 2021-09-10 16:58:58.835 4088 3038340492456 MainThread INFO nova.scheduler.client.report [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Deleted allocations for instance 4bdc3835-ba14-4e1b-bd49-23ec32f15291 2021-09-10 16:58:58.879 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-175715cb-af84-422d-af9d-83190916c6c4 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "4bdc3835-ba14-4e1b-bd49-23ec32f15291" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 30.547s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:59.519 4088 3038342255192 MainThread DEBUG nova.network.neutron [req-c97a9a26-0bba-4786-99a1-de37277c499c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Updated VIF entry in instance network info cache for port bf834a56-0a12-486b-aefc-598083705b01. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:58:59.519 4088 3038342255192 MainThread DEBUG nova.network.neutron [req-c97a9a26-0bba-4786-99a1-de37277c499c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Updating instance_info_cache with network_info: [{"id": "bf834a56-0a12-486b-aefc-598083705b01", "address": "fa:16:3e:e2:bf:37", "network": {"id": "99282f2c-b612-4703-8180-12ed8aae404f", "bridge": null, "label": "tempest-ListServerFiltersTestJSON-836490928-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "cc8daf6ce3114d6aa694f16669c8ed20", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapbf834a56-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:58:59.549 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [req-c97a9a26-0bba-4786-99a1-de37277c499c 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-c7fdc9fc-d133-4f12-ab12-ff417c249240" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:58:59.675 4088 3038340491928 MainThread DEBUG nova.virt.hyperv.vmops [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:58:59.675 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000037" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:59.675 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000037" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:59.675 4088 3038342144072 GreenThread-49 DEBUG nova.network.neutron [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Successfully updated port: 6e82ace2-7f01-4e23-9eda-cc3b62c12db6 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:58:59.690 4088 3038340491928 MainThread DEBUG os_win.utils.compute.vmutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Successfully changed vm state of instance-00000037 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:58:59.690 4088 3038340491928 MainThread DEBUG nova.virt.hyperv.vmops [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Successfully changed state of VM instance-00000037 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:58:59.690 4088 3038342144072 GreenThread-49 DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Acquired lock "refresh_cache-04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:58:59.710 4088 3038342144072 GreenThread-49 DEBUG nova.network.neutron [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:58:59.751 4088 3038340491928 MainThread DEBUG os_win.utils.jobutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': '06A66097-2171-48F6-B39B-55C363E40515', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15053), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:58:59.861 4088 3038340491928 MainThread DEBUG os_win.utils.jobutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job succeeded: {'InstanceID': '06A66097-2171-48F6-B39B-55C363E40515', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=114877), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:58:59.861 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000037" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:59.861 4088 3038340491928 MainThread DEBUG os_win.utils.pathutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Removing directory: C:\openstack\instances\instance-00000037 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:58:59.861 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000037" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:59.861 4088 3038340491928 MainThread ERROR nova.compute.manager [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000037' failed to start. Not enough memory in the system to start the virtual machine instance-00000037. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000037' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Not enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) 'instance-00000037' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Error code: 32778. 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Traceback (most recent call last): 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] return function(*args, **kwargs) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] admin_password, network_info, block_device_info) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] return function(self, *args, **kwds) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self.force_reraise() 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] raise self.value 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] should_plug_vifs=False) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 'req_state': req_state}) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self.force_reraise() 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] raise self.value 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] time.sleep(sleep_time) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self.force_reraise() 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] raise self.value 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] return f(*args, **kwargs) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] return self._wait_for_job(job_path) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] error_desc=err_desc) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000037' failed to start. 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Not enough memory in the system to start the virtual machine instance-00000037. 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000037' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Not enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 'instance-00000037' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Error code: 32778. 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] During handling of the above exception, another exception occurred: 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Traceback (most recent call last): 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] yield resources 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] accel_info=accel_info) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] return function(*args, **kwargs) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] admin_password, network_info, block_device_info) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] return function(self, *args, **kwds) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self.force_reraise() 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] raise self.value 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] should_plug_vifs=False) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 'req_state': req_state}) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self.force_reraise() 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] raise self.value 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] time.sleep(sleep_time) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self.force_reraise() 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] raise self.value 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] return f(*args, **kwargs) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] return self._wait_for_job(job_path) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] error_desc=err_desc) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000037' failed to start. 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Not enough memory in the system to start the virtual machine instance-00000037. 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000037' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Not enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 'instance-00000037' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Error code: 32778. 2021-09-10 16:58:59.861 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:58:59.861 4088 3038340491928 MainThread INFO nova.compute.manager [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Terminating instance 2021-09-10 16:58:59.861 4088 3038340491928 MainThread DEBUG nova.compute.manager [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:58:59.861 4088 3038340491928 MainThread INFO nova.virt.hyperv.vmops [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Got request to destroy instance 2021-09-10 16:58:59.891 4088 3038340491928 MainThread DEBUG nova.virt.hyperv.vmops [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:58:59.891 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000037" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:58:59.891 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000037" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:58:59.907 4088 3038340491928 MainThread INFO nova.compute.manager [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Took 0.05 seconds to destroy the instance on the hypervisor. 2021-09-10 16:58:59.907 4088 3038340491928 MainThread DEBUG nova.compute.claims [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:58:59.907 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:00.062 4088 3038340491928 MainThread DEBUG nova.virt.hyperv.hostops [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:59:00.078 4088 3038340491928 MainThread DEBUG nova.virt.hyperv.hostops [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:59:00.285 4088 3038340491928 MainThread DEBUG nova.compute.provider_tree [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:59:00.324 4088 3038340491928 MainThread DEBUG nova.scheduler.client.report [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:59:00.333 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:00.333 4088 3038340491928 MainThread ERROR nova.compute.manager [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000037' failed to start. Not enough memory in the system to start the virtual machine instance-00000037. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000037' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Not enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) 'instance-00000037' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Error code: 32778. 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Traceback (most recent call last): 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] return function(*args, **kwargs) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] admin_password, network_info, block_device_info) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] return function(self, *args, **kwds) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self.force_reraise() 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] raise self.value 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] should_plug_vifs=False) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 'req_state': req_state}) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self.force_reraise() 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] raise self.value 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] time.sleep(sleep_time) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self.force_reraise() 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] raise self.value 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] return f(*args, **kwargs) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] return self._wait_for_job(job_path) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] error_desc=err_desc) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000037' failed to start. 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Not enough memory in the system to start the virtual machine instance-00000037. 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000037' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Not enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 'instance-00000037' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Error code: 32778. 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] During handling of the above exception, another exception occurred: 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Traceback (most recent call last): 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] accel_info=accel_info) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] return function(*args, **kwargs) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] admin_password, network_info, block_device_info) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] return function(self, *args, **kwds) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self.force_reraise() 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] raise self.value 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] should_plug_vifs=False) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 'req_state': req_state}) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self.force_reraise() 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] raise self.value 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] time.sleep(sleep_time) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self.force_reraise() 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] raise self.value 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] return f(*args, **kwargs) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] return self._wait_for_job(job_path) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] error_desc=err_desc) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000037' failed to start. 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Not enough memory in the system to start the virtual machine instance-00000037. 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000037' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Not enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 'instance-00000037' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Error code: 32778. 2021-09-10 16:59:00.333 4088 3038340491928 MainThread TRACE nova.compute.manager [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] 2021-09-10 16:59:00.333 4088 3038340491928 MainThread DEBUG nova.compute.utils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] WMI job failed with status 10. Error summary description: 'instance-00000037' failed to start. Not enough memory in the system to start the virtual machine instance-00000037. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:59:00.333 4088 3038340491928 MainThread DEBUG nova.compute.manager [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Build of instance 082d9c5d-01d4-43af-8493-80ba655501fd was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000037' failed to start. Not enough memory in the system to start the virtual machine instance-00000037. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000037' failed to start. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Not enough memory in the system to start the virtual machine instance-00000037 with ram size 1024 megabytes. (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) 'instance-00000037' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2FEE5EA8-29C2-47ED-8D0C-839981AE07D5) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:59:00.333 4088 3038340491928 MainThread DEBUG nova.compute.manager [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:59:00.333 4088 3038340491928 MainThread DEBUG nova.compute.manager [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:59:00.333 4088 3038340491928 MainThread DEBUG nova.compute.manager [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:59:00.344 4088 3038340491928 MainThread DEBUG nova.network.neutron [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:59:00.379 4088 3038342144072 GreenThread-49 DEBUG nova.network.neutron [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:59:00.706 4088 3038340492456 MainThread DEBUG nova.compute.manager [req-e63087ee-0950-402a-97a8-e62095b5152f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Received event network-changed-6e82ace2-7f01-4e23-9eda-cc3b62c12db6 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:59:00.706 4088 3038340492456 MainThread DEBUG nova.compute.manager [req-e63087ee-0950-402a-97a8-e62095b5152f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Refreshing instance network info cache due to event network-changed-6e82ace2-7f01-4e23-9eda-cc3b62c12db6. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:59:01.220 4088 3038340491928 MainThread DEBUG nova.network.neutron [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:59:01.266 4088 3038340491928 MainThread INFO nova.compute.manager [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 082d9c5d-01d4-43af-8493-80ba655501fd] Took 0.92 seconds to deallocate network for instance. 2021-09-10 16:59:01.474 4088 3038340491928 MainThread INFO nova.scheduler.client.report [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Deleted allocations for instance 082d9c5d-01d4-43af-8493-80ba655501fd 2021-09-10 16:59:01.521 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [req-37148690-7891-402c-9de8-abf1d53bc074 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "082d9c5d-01d4-43af-8493-80ba655501fd" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 27.531s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:01.645 4088 3038342144072 GreenThread-49 DEBUG nova.network.neutron [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Updating instance_info_cache with network_info: [{"id": "6e82ace2-7f01-4e23-9eda-cc3b62c12db6", "address": "fa:16:3e:dd:d1:02", "network": {"id": "6b3d4f05-5619-41ec-8def-1bd17c9bcd14", "bridge": null, "label": "tempest-ServerRescueTestJSON-1067413489-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a13940e712fe464c8a1b2c3732982edb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap6e82ace2-7f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:59:01.672 4088 3038342255192 MainThread DEBUG nova.compute.manager [req-59e48884-b1d1-404c-9b69-87ab1b99fcd6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Received event network-vif-plugged-4f6f96b9-fc17-44a8-a3d1-d74f18f295f2 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:59:01.672 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [req-59e48884-b1d1-404c-9b69-87ab1b99fcd6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "832a0158-f115-480e-a24e-78506e51b9f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:01.672 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [req-59e48884-b1d1-404c-9b69-87ab1b99fcd6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "832a0158-f115-480e-a24e-78506e51b9f6-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:01.672 4088 3038342255192 MainThread DEBUG nova.compute.manager [req-59e48884-b1d1-404c-9b69-87ab1b99fcd6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Processing event network-vif-plugged-4f6f96b9-fc17-44a8-a3d1-d74f18f295f2 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:59:01.684 4088 3038342144072 GreenThread-49 DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Releasing lock "refresh_cache-04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:59:01.684 4088 3038342144072 GreenThread-49 DEBUG nova.compute.manager [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Instance network_info: |[{"id": "6e82ace2-7f01-4e23-9eda-cc3b62c12db6", "address": "fa:16:3e:dd:d1:02", "network": {"id": "6b3d4f05-5619-41ec-8def-1bd17c9bcd14", "bridge": null, "label": "tempest-ServerRescueTestJSON-1067413489-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a13940e712fe464c8a1b2c3732982edb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap6e82ace2-7f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:59:01.684 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-e63087ee-0950-402a-97a8-e62095b5152f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:59:01.684 4088 3038340492456 MainThread DEBUG nova.network.neutron [req-e63087ee-0950-402a-97a8-e62095b5152f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Refreshing network info cache for port 6e82ace2-7f01-4e23-9eda-cc3b62c12db6 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:59:01.684 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Preparing to wait for external event network-vif-plugged-6e82ace2-7f01-4e23-9eda-cc3b62c12db6 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:59:01.684 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Lock "04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:01.684 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Lock "04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:01.684 4088 3038342147592 MainThread DEBUG os_win.utils.compute.vmutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Creating VM instance-0000003c create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:59:01.721 4088 3038342255896 MainThread INFO nova.virt.hyperv.vmops [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Using config drive for instance 2021-09-10 16:59:01.844 4088 3038342255896 MainThread INFO nova.virt.hyperv.vmops [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Creating config drive at C:\openstack\instances\instance-00000039\configdrive.iso 2021-09-10 16:59:01.929 4088 3038342255896 MainThread DEBUG oslo_concurrency.processutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000039\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpbvvq4w7e execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:59:02.268 4088 3038342255896 MainThread DEBUG oslo_concurrency.processutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000039\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpbvvq4w7e" returned: 0 in 0.343s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:59:02.944 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.vmops [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Setting boot order for instance: instance-00000039: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:59:03.036 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.vmops [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:59:03.074 4088 3038342255896 MainThread DEBUG os_win.utils.jobutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': 'B89741EF-7251-496C-89F5-01E13ED9B7BA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20215), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:03.223 4088 3038342255896 MainThread ERROR os_win.utils.jobutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000039\' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)instance-00000039052A344A-EDAF-4D84-98CB-DC5B4B1F9C9112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)instance-00000039052A344A-EDAF-4D84-98CB-DC5B4B1F9C915123122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000039\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)instance-00000039052A344A-EDAF-4D84-98CB-DC5B4B1F9C91%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B89741EF-7251-496C-89F5-01E13ED9B7BA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=128557), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 3), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000039' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)\n\nNot enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)\n\n'instance-00000039' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)", 'ErrorSummaryDescription': "'instance-00000039' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000039.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:03.223 4088 3038342255896 MainThread DEBUG os_win._utils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000039' failed to start. Not enough memory in the system to start the virtual machine instance-00000039. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000039' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Not enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) 'instance-00000039' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18777728080749512 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:03.298 4088 3038296677544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:03.298 4088 3038296677544 MainThread INFO nova.compute.manager [-] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] VM Stopped (Lifecycle Event) 2021-09-10 16:59:03.298 4088 3038342256600 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000039" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:03.298 4088 3038342256600 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000039" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:03.319 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-dc1e6bd5-c4a1-4915-8984-91b5b8a1ec95 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:03.319 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-dc1e6bd5-c4a1-4915-8984-91b5b8a1ec95 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:03.364 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-dc1e6bd5-c4a1-4915-8984-91b5b8a1ec95 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:03.396 4088 3038296677544 MainThread INFO nova.compute.manager [req-dc1e6bd5-c4a1-4915-8984-91b5b8a1ec95 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:03.657 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.vmops [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:59:03.923 4088 3038340492456 MainThread DEBUG nova.network.neutron [req-e63087ee-0950-402a-97a8-e62095b5152f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Updated VIF entry in instance network info cache for port 6e82ace2-7f01-4e23-9eda-cc3b62c12db6. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:59:03.923 4088 3038340492456 MainThread DEBUG nova.network.neutron [req-e63087ee-0950-402a-97a8-e62095b5152f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Updating instance_info_cache with network_info: [{"id": "6e82ace2-7f01-4e23-9eda-cc3b62c12db6", "address": "fa:16:3e:dd:d1:02", "network": {"id": "6b3d4f05-5619-41ec-8def-1bd17c9bcd14", "bridge": null, "label": "tempest-ServerRescueTestJSON-1067413489-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a13940e712fe464c8a1b2c3732982edb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap6e82ace2-7f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:59:03.923 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-e63087ee-0950-402a-97a8-e62095b5152f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:59:04.250 4088 3038342255896 MainThread DEBUG os_win.utils.jobutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': 'AE69CC38-1F4B-4CD3-84CC-8E0527C26F43', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15745), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:04.391 4088 3038342255896 MainThread ERROR os_win.utils.jobutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000039\' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)instance-00000039052A344A-EDAF-4D84-98CB-DC5B4B1F9C9112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)instance-00000039052A344A-EDAF-4D84-98CB-DC5B4B1F9C915123122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000039\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)instance-00000039052A344A-EDAF-4D84-98CB-DC5B4B1F9C91%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'AE69CC38-1F4B-4CD3-84CC-8E0527C26F43', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118803), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 4), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000039' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)\n\nNot enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)\n\n'instance-00000039' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)", 'ErrorSummaryDescription': "'instance-00000039' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000039.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:04.391 4088 3038342255896 MainThread DEBUG os_win._utils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000039' failed to start. Not enough memory in the system to start the virtual machine instance-00000039. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000039' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Not enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) 'instance-00000039' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3554537296295166 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:04.426 4088 3038296677544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:04.426 4088 3038296677544 MainThread INFO nova.compute.manager [-] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] VM Stopped (Lifecycle Event) 2021-09-10 16:59:04.426 4088 3038342144072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000039" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:04.426 4088 3038342144072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000039" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:04.468 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-4810929a-760f-4826-b5c0-d8c6d0bdb0c6 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:04.468 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-4810929a-760f-4826-b5c0-d8c6d0bdb0c6 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:04.506 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-4810929a-760f-4826-b5c0-d8c6d0bdb0c6 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:04.526 4088 3038296677544 MainThread INFO nova.compute.manager [req-4810929a-760f-4826-b5c0-d8c6d0bdb0c6 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:05.437 4088 3038342255896 MainThread DEBUG os_win.utils.jobutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': 'EDCCFD9D-9CA9-43FE-A7F3-CB03E62BF4B6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14931), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:05.579 4088 3038342255896 MainThread ERROR os_win.utils.jobutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000039\' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)instance-00000039052A344A-EDAF-4D84-98CB-DC5B4B1F9C9112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)instance-00000039052A344A-EDAF-4D84-98CB-DC5B4B1F9C915123122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000039\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)instance-00000039052A344A-EDAF-4D84-98CB-DC5B4B1F9C91%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'EDCCFD9D-9CA9-43FE-A7F3-CB03E62BF4B6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113069), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 5), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 5), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000039' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)\n\nNot enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)\n\n'instance-00000039' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)", 'ErrorSummaryDescription': "'instance-00000039' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000039.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:05.579 4088 3038342255896 MainThread DEBUG os_win._utils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000039' failed to start. Not enough memory in the system to start the virtual machine instance-00000039. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000039' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Not enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) 'instance-00000039' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.543499231338501 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:05.610 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000039" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:05.610 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000039" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:05.610 4088 3038296677544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:05.610 4088 3038296677544 MainThread INFO nova.compute.manager [-] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] VM Stopped (Lifecycle Event) 2021-09-10 16:59:05.640 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-e7014242-b901-467a-9be4-50d8a7afb503 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:05.640 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-e7014242-b901-467a-9be4-50d8a7afb503 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:05.687 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-e7014242-b901-467a-9be4-50d8a7afb503 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:05.707 4088 3038296677544 MainThread INFO nova.compute.manager [req-e7014242-b901-467a-9be4-50d8a7afb503 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:06.175 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-d84e12a1-8647-4820-b0dc-10e72bc2df4b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Received event network-vif-plugged-d0d6d930-197b-4dfa-bcee-ceb17a904050 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:59:06.175 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-d84e12a1-8647-4820-b0dc-10e72bc2df4b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "1f6d373b-5624-411c-9545-511d98e94f86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:06.175 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-d84e12a1-8647-4820-b0dc-10e72bc2df4b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "1f6d373b-5624-411c-9545-511d98e94f86-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:06.175 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-d84e12a1-8647-4820-b0dc-10e72bc2df4b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Processing event network-vif-plugged-d0d6d930-197b-4dfa-bcee-ceb17a904050 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:59:06.235 4088 3038342144424 MainThread INFO nova.virt.hyperv.vmops [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Using config drive for instance 2021-09-10 16:59:06.611 4088 3038342255896 MainThread DEBUG os_win.utils.jobutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': 'B5DF9255-5F70-430C-B16C-25858367726F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16868), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:06.753 4088 3038342255896 MainThread ERROR os_win.utils.jobutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000039\' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)instance-00000039052A344A-EDAF-4D84-98CB-DC5B4B1F9C9112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)instance-00000039052A344A-EDAF-4D84-98CB-DC5B4B1F9C915123122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000039\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)instance-00000039052A344A-EDAF-4D84-98CB-DC5B4B1F9C91%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B5DF9255-5F70-430C-B16C-25858367726F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112885), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 6), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 6), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000039' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)\n\nNot enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)\n\n'instance-00000039' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)", 'ErrorSummaryDescription': "'instance-00000039' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000039.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:06.753 4088 3038342255896 MainThread DEBUG os_win._utils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000039' failed to start. Not enough memory in the system to start the virtual machine instance-00000039. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000039' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Not enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) 'instance-00000039' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7170891761779785 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:06.788 4088 3038342144424 MainThread INFO nova.virt.hyperv.vmops [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Creating config drive at C:\openstack\instances\instance-0000003a\configdrive.iso 2021-09-10 16:59:06.894 4088 3038342144424 MainThread DEBUG oslo_concurrency.processutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000003a\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpu8c1j1f5 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:59:07.050 4088 3038342145128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000039" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:07.050 4088 3038342145128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000039" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:07.050 4088 3038342144248 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:07.050 4088 3038342144248 MainThread INFO nova.compute.manager [-] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] VM Stopped (Lifecycle Event) 2021-09-10 16:59:07.066 4088 3038342144248 MainThread DEBUG nova.compute.manager [req-0dfce052-49ab-4eb3-a126-9b624f7b538e - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:07.066 4088 3038342144248 MainThread DEBUG nova.virt.hyperv.vmops [req-0dfce052-49ab-4eb3-a126-9b624f7b538e - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:07.129 4088 3038342144248 MainThread DEBUG nova.compute.manager [req-0dfce052-49ab-4eb3-a126-9b624f7b538e - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:07.151 4088 3038342144248 MainThread INFO nova.compute.manager [req-0dfce052-49ab-4eb3-a126-9b624f7b538e - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:07.219 4088 3038342144424 MainThread DEBUG oslo_concurrency.processutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000003a\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpu8c1j1f5" returned: 0 in 0.329s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:59:07.801 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.vmops [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Setting boot order for instance: instance-0000003a: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:59:07.830 4088 3038342255896 MainThread DEBUG os_win.utils.jobutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': '26A1AE53-C0F4-47A5-A261-2D7BBF2D53CE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15381), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:07.911 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.vmops [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:59:07.978 4088 3038342255896 MainThread ERROR os_win.utils.jobutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000039\' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)instance-00000039052A344A-EDAF-4D84-98CB-DC5B4B1F9C9112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)instance-00000039052A344A-EDAF-4D84-98CB-DC5B4B1F9C915123122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000039\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)instance-00000039052A344A-EDAF-4D84-98CB-DC5B4B1F9C91%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '26A1AE53-C0F4-47A5-A261-2D7BBF2D53CE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=125008), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 7), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000039' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)\n\nNot enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)\n\n'instance-00000039' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)", 'ErrorSummaryDescription': "'instance-00000039' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000039.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:07.978 4088 3038342255896 MainThread DEBUG os_win._utils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000039' failed to start. Not enough memory in the system to start the virtual machine instance-00000039. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000039' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Not enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) 'instance-00000039' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.942180395126343 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:07.999 4088 3038342144424 MainThread DEBUG os_win.utils.jobutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': '536D031D-7964-42F6-A2F3-B52D4D83A9B9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17399), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:08.142 4088 3038342144424 MainThread ERROR os_win.utils.jobutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003a\' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)instance-0000003aA7307675-77FE-4948-AF2F-8BFBA80F445912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)instance-0000003aA7307675-77FE-4948-AF2F-8BFBA80F445910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)instance-0000003aA7307675-77FE-4948-AF2F-8BFBA80F4459%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '536D031D-7964-42F6-A2F3-B52D4D83A9B9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116155), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 8), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003a' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)\n\nNot enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)\n\n'instance-0000003a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)", 'ErrorSummaryDescription': "'instance-0000003a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:08.142 4088 3038342144424 MainThread DEBUG os_win._utils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003a' failed to start. Not enough memory in the system to start the virtual machine instance-0000003a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003a' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Not enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) 'instance-0000003a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.23149561882019043 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:08.142 4088 3038296677544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:08.142 4088 3038296677544 MainThread INFO nova.compute.manager [-] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] VM Stopped (Lifecycle Event) 2021-09-10 16:59:08.158 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000039" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:08.158 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000039" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:08.179 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-294b35e4-6dc9-4187-b9b2-98d3c7921756 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:08.179 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-294b35e4-6dc9-4187-b9b2-98d3c7921756 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:08.179 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:08.179 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:08.188 4088 3038342144248 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:08.188 4088 3038342144248 MainThread INFO nova.compute.manager [-] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] VM Stopped (Lifecycle Event) 2021-09-10 16:59:08.204 4088 3038342144248 MainThread DEBUG nova.compute.manager [req-16847167-d3ee-416c-9eea-88f3ec53b3ea - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:08.204 4088 3038342144248 MainThread DEBUG nova.virt.hyperv.vmops [req-16847167-d3ee-416c-9eea-88f3ec53b3ea - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:08.236 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-294b35e4-6dc9-4187-b9b2-98d3c7921756 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:08.251 4088 3038296677544 MainThread INFO nova.compute.manager [req-294b35e4-6dc9-4187-b9b2-98d3c7921756 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:08.251 4088 3038342144248 MainThread DEBUG nova.compute.manager [req-16847167-d3ee-416c-9eea-88f3ec53b3ea - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:08.283 4088 3038342144248 MainThread INFO nova.compute.manager [req-16847167-d3ee-416c-9eea-88f3ec53b3ea - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:08.305 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Lock "aa775114-9ae9-476f-b4ed-2b6e1846f3bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:08.330 4088 3038342144248 MainThread DEBUG nova.compute.manager [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:59:08.408 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:08.438 4088 3038342144248 MainThread DEBUG nova.virt.hardware [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:59:08.438 4088 3038342144248 MainThread INFO nova.compute.claims [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Claim successful on node n-h2-808474-1 2021-09-10 16:59:08.565 4088 3038342144248 MainThread DEBUG nova.virt.hyperv.hostops [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:59:08.590 4088 3038342144248 MainThread DEBUG nova.virt.hyperv.hostops [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:59:08.814 4088 3038342144248 MainThread DEBUG nova.compute.provider_tree [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:59:08.814 4088 3038342144248 MainThread DEBUG nova.scheduler.client.report [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:59:08.814 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:08.833 4088 3038342144248 MainThread DEBUG nova.compute.manager [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:59:08.891 4088 3038342144248 MainThread DEBUG nova.compute.utils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 16:59:08.900 4088 3038296677544 GreenThread-51 DEBUG nova.compute.manager [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:59:08.900 4088 3038296677544 GreenThread-51 DEBUG nova.network.neutron [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:59:08.912 4088 3038342144248 MainThread DEBUG nova.compute.manager [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:59:09.012 4088 3038342255896 MainThread DEBUG os_win.utils.jobutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': '4B799B54-24E8-4AE2-B4E2-5A7D54FF3107', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=23615), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:09.051 4088 3038342144248 MainThread DEBUG nova.compute.manager [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:59:09.069 4088 3038342144248 MainThread INFO nova.virt.hyperv.vmops [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Spawning new instance 2021-09-10 16:59:09.085 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Lock "instance-0000003e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:09.085 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Lock "instance-0000003e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:09.085 4088 3038342144248 MainThread DEBUG nova.block_device [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:59:09.085 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:09.085 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:09.100 4088 3038342144248 MainThread DEBUG os_win.utils.pathutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Creating directory: C:\openstack\instances\instance-0000003e check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:59:09.100 4088 3038342144248 MainThread DEBUG nova.virt.hyperv.vmops [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000003e\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:59:09.165 4088 3038342255896 MainThread ERROR os_win.utils.jobutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000039\' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)instance-00000039052A344A-EDAF-4D84-98CB-DC5B4B1F9C9112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)instance-00000039052A344A-EDAF-4D84-98CB-DC5B4B1F9C915123122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000039\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)instance-00000039052A344A-EDAF-4D84-98CB-DC5B4B1F9C91%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4B799B54-24E8-4AE2-B4E2-5A7D54FF3107', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119023), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 8), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 9), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000039' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)\n\nNot enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)\n\n'instance-00000039' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91)", 'ErrorSummaryDescription': "'instance-00000039' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000039.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:09.165 4088 3038342255896 MainThread ERROR nova.virt.hyperv.vmops [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Failed to change vm state of instance-00000039 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000039' failed to start. 2021-09-10 16:59:09.165 4088 3038342255896 MainThread INFO nova.virt.hyperv.vmops [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Got request to destroy instance 2021-09-10 16:59:09.189 4088 3038296677544 GreenThread-51 DEBUG nova.policy [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0db4ede2f101460f9ab63db4d0d76a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912aa6945f734abbbd12a58348a3bbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:59:09.189 4088 3038342147064 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:09.189 4088 3038342147064 MainThread INFO nova.compute.manager [-] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] VM Stopped (Lifecycle Event) 2021-09-10 16:59:09.204 4088 3038342145128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000039" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:09.204 4088 3038342145128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000039" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:09.204 4088 3038342144424 MainThread DEBUG os_win.utils.jobutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': '1CB4BA9F-E7F2-4006-BB49-EB7BBDEC6E14', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19061), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:09.223 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-f22170b9-48b6-40d5-a25e-31d258f91c98 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:09.223 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.vmops [req-f22170b9-48b6-40d5-a25e-31d258f91c98 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:09.269 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-f22170b9-48b6-40d5-a25e-31d258f91c98 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:09.297 4088 3038342147064 MainThread INFO nova.compute.manager [req-f22170b9-48b6-40d5-a25e-31d258f91c98 - - - - -] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:09.314 4088 3038342144248 MainThread DEBUG nova.virt.hyperv.vmops [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Resizing VHD C:\openstack\instances\instance-0000003e\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:59:09.349 4088 3038342144424 MainThread ERROR os_win.utils.jobutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003a\' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)instance-0000003aA7307675-77FE-4948-AF2F-8BFBA80F445912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)instance-0000003aA7307675-77FE-4948-AF2F-8BFBA80F445910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)instance-0000003aA7307675-77FE-4948-AF2F-8BFBA80F4459%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1CB4BA9F-E7F2-4006-BB49-EB7BBDEC6E14', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118779), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 9), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 9), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003a' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)\n\nNot enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)\n\n'instance-0000003a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)", 'ErrorSummaryDescription': "'instance-0000003a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:09.349 4088 3038342144424 MainThread DEBUG os_win._utils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003a' failed to start. Not enough memory in the system to start the virtual machine instance-0000003a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003a' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Not enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) 'instance-0000003a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.438218116760254 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:09.378 4088 3038342145128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:09.378 4088 3038342145128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:09.378 4088 3038342147064 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:09.378 4088 3038342147064 MainThread INFO nova.compute.manager [-] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] VM Stopped (Lifecycle Event) 2021-09-10 16:59:09.401 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-1d757c29-6128-4afa-b6cd-2f85c1ad260b - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:09.401 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.vmops [req-1d757c29-6128-4afa-b6cd-2f85c1ad260b - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:09.503 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-1d757c29-6128-4afa-b6cd-2f85c1ad260b - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:09.520 4088 3038342147064 MainThread INFO nova.compute.manager [req-1d757c29-6128-4afa-b6cd-2f85c1ad260b - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:09.910 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-80598fab-9226-4a5d-b68c-d147de2419c2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Received event network-vif-plugged-bf834a56-0a12-486b-aefc-598083705b01 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:59:09.910 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-80598fab-9226-4a5d-b68c-d147de2419c2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "c7fdc9fc-d133-4f12-ab12-ff417c249240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:09.910 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-80598fab-9226-4a5d-b68c-d147de2419c2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "c7fdc9fc-d133-4f12-ab12-ff417c249240-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:09.927 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-80598fab-9226-4a5d-b68c-d147de2419c2 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Processing event network-vif-plugged-bf834a56-0a12-486b-aefc-598083705b01 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:59:09.956 4088 3038342258184 MainThread INFO nova.virt.hyperv.vmops [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Using config drive for instance 2021-09-10 16:59:10.141 4088 3038342258184 MainThread INFO nova.virt.hyperv.vmops [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Creating config drive at C:\openstack\instances\instance-00000038\configdrive.iso 2021-09-10 16:59:10.244 4088 3038342258184 MainThread DEBUG oslo_concurrency.processutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000038\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp8x238hta execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:59:10.432 4088 3038342144424 MainThread DEBUG os_win.utils.jobutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': '37F193F9-2E0C-4ECF-A5DB-311CBC133917', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17314), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:10.579 4088 3038342258184 MainThread DEBUG oslo_concurrency.processutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000038\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp8x238hta" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:59:10.626 4088 3038342144424 MainThread ERROR os_win.utils.jobutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003a\' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)instance-0000003aA7307675-77FE-4948-AF2F-8BFBA80F445912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)instance-0000003aA7307675-77FE-4948-AF2F-8BFBA80F445910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)instance-0000003aA7307675-77FE-4948-AF2F-8BFBA80F4459%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '37F193F9-2E0C-4ECF-A5DB-311CBC133917', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=125282), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 10), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 10), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003a' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)\n\nNot enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)\n\n'instance-0000003a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)", 'ErrorSummaryDescription': "'instance-0000003a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:10.626 4088 3038342144424 MainThread DEBUG os_win._utils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003a' failed to start. Not enough memory in the system to start the virtual machine instance-0000003a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003a' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Not enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) 'instance-0000003a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.7147767543792725 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:10.657 4088 3038342145128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:10.657 4088 3038342145128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:10.657 4088 3038342147064 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:10.657 4088 3038342147064 MainThread INFO nova.compute.manager [-] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] VM Stopped (Lifecycle Event) 2021-09-10 16:59:10.691 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-2c5c7a9e-6864-492c-9e73-6ff515b9987e - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:10.691 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.vmops [req-2c5c7a9e-6864-492c-9e73-6ff515b9987e - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:10.736 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-2c5c7a9e-6864-492c-9e73-6ff515b9987e - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:10.751 4088 3038342147064 MainThread INFO nova.compute.manager [req-2c5c7a9e-6864-492c-9e73-6ff515b9987e - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:11.172 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.vmops [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Setting boot order for instance: instance-00000038: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:59:11.287 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.vmops [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:59:11.341 4088 3038342258184 MainThread DEBUG os_win.utils.jobutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': '2DADDEF5-9D33-4418-AC72-3D9AA8E63F1A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16104), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:11.470 4088 3038342258184 MainThread ERROR os_win.utils.jobutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000038\' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)instance-000000381A6B31D5-A2B7-4B68-863A-CF166AEC149412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)instance-000000381A6B31D5-A2B7-4B68-863A-CF166AEC149410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000038\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)instance-000000381A6B31D5-A2B7-4B68-863A-CF166AEC1494%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '2DADDEF5-9D33-4418-AC72-3D9AA8E63F1A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119329), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 11), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 11), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000038' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)\n\nNot enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)\n\n'instance-00000038' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)", 'ErrorSummaryDescription': "'instance-00000038' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000038.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:11.470 4088 3038342258184 MainThread DEBUG os_win._utils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000038' failed to start. Not enough memory in the system to start the virtual machine instance-00000038. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000038' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Not enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) 'instance-00000038' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18305611610412598 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:11.521 4088 3038342146888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:11.521 4088 3038342146888 MainThread INFO nova.compute.manager [-] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] VM Stopped (Lifecycle Event) 2021-09-10 16:59:11.521 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000038" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:11.521 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000038" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:11.521 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.vmops [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:59:11.521 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000039" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:11.521 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000039" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:11.537 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-c3037d6b-422b-4cec-99bf-385be4b454d2 - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:11.537 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [req-c3037d6b-422b-4cec-99bf-385be4b454d2 - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:11.537 4088 3038342255896 MainThread DEBUG os_win.utils.compute.vmutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Successfully changed vm state of instance-00000039 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:59:11.537 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.vmops [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Successfully changed state of VM instance-00000039 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:59:11.579 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-c3037d6b-422b-4cec-99bf-385be4b454d2 - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:11.579 4088 3038342255896 MainThread DEBUG os_win.utils.jobutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': 'A24D3FCD-9BE2-4D2E-B3FF-ED6403EADD66', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18545), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:11.626 4088 3038342146888 MainThread INFO nova.compute.manager [req-c3037d6b-422b-4cec-99bf-385be4b454d2 - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:11.722 4088 3038342144424 MainThread DEBUG os_win.utils.jobutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': 'F3C90E15-8B07-417E-941E-C0A4AE2F4A95', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16370), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:11.840 4088 3038342255896 MainThread DEBUG os_win.utils.jobutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job succeeded: {'InstanceID': 'A24D3FCD-9BE2-4D2E-B3FF-ED6403EADD66', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=134371), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:59:11.840 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000039" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:11.840 4088 3038342255896 MainThread DEBUG os_win.utils.pathutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Removing directory: C:\openstack\instances\instance-00000039 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:59:11.840 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000039" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:11.840 4088 3038342255896 MainThread ERROR nova.compute.manager [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000039' failed to start. Not enough memory in the system to start the virtual machine instance-00000039. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000039' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Not enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) 'instance-00000039' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Error code: 32778. 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Traceback (most recent call last): 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] return function(*args, **kwargs) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] admin_password, network_info, block_device_info) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] return function(self, *args, **kwds) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self.force_reraise() 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] raise self.value 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] should_plug_vifs=False) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 'req_state': req_state}) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self.force_reraise() 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] raise self.value 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] time.sleep(sleep_time) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self.force_reraise() 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] raise self.value 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] return f(*args, **kwargs) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] return self._wait_for_job(job_path) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] error_desc=err_desc) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000039' failed to start. 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Not enough memory in the system to start the virtual machine instance-00000039. 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000039' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Not enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 'instance-00000039' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Error code: 32778. 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] During handling of the above exception, another exception occurred: 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Traceback (most recent call last): 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] yield resources 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] accel_info=accel_info) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] return function(*args, **kwargs) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] admin_password, network_info, block_device_info) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] return function(self, *args, **kwds) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self.force_reraise() 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] raise self.value 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] should_plug_vifs=False) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 'req_state': req_state}) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self.force_reraise() 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] raise self.value 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] time.sleep(sleep_time) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self.force_reraise() 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] raise self.value 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] return f(*args, **kwargs) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] return self._wait_for_job(job_path) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] error_desc=err_desc) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000039' failed to start. 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Not enough memory in the system to start the virtual machine instance-00000039. 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000039' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Not enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 'instance-00000039' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Error code: 32778. 2021-09-10 16:59:11.840 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:11.854 4088 3038342255896 MainThread INFO nova.compute.manager [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Terminating instance 2021-09-10 16:59:11.854 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:59:11.854 4088 3038342255896 MainThread INFO nova.virt.hyperv.vmops [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Got request to destroy instance 2021-09-10 16:59:11.879 4088 3038342144424 MainThread ERROR os_win.utils.jobutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003a\' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)instance-0000003aA7307675-77FE-4948-AF2F-8BFBA80F445912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)instance-0000003aA7307675-77FE-4948-AF2F-8BFBA80F445910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)instance-0000003aA7307675-77FE-4948-AF2F-8BFBA80F4459%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'F3C90E15-8B07-417E-941E-C0A4AE2F4A95', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112394), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 11), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 11), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003a' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)\n\nNot enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)\n\n'instance-0000003a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)", 'ErrorSummaryDescription': "'instance-0000003a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:11.879 4088 3038342144424 MainThread DEBUG os_win._utils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003a' failed to start. Not enough memory in the system to start the virtual machine instance-0000003a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003a' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Not enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) 'instance-0000003a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.967597246170044 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:11.908 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.vmops [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:59:11.908 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000039" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:11.908 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000039" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:11.908 4088 3038342255896 MainThread INFO nova.compute.manager [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Took 0.05 seconds to destroy the instance on the hypervisor. 2021-09-10 16:59:11.908 4088 3038342255896 MainThread DEBUG nova.compute.claims [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:59:11.908 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:11.908 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:11.908 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:11.908 4088 3038342146888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:11.922 4088 3038342146888 MainThread INFO nova.compute.manager [-] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] VM Stopped (Lifecycle Event) 2021-09-10 16:59:11.957 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-ed1f21c9-fedf-4f29-bdf5-ee0b58f9674f - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:11.957 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [req-ed1f21c9-fedf-4f29-bdf5-ee0b58f9674f - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:12.002 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-ed1f21c9-fedf-4f29-bdf5-ee0b58f9674f - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:12.048 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.hostops [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:59:12.048 4088 3038342146888 MainThread INFO nova.compute.manager [req-ed1f21c9-fedf-4f29-bdf5-ee0b58f9674f - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:12.070 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.hostops [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:59:12.283 4088 3038342255896 MainThread DEBUG nova.compute.provider_tree [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:59:12.314 4088 3038342255896 MainThread DEBUG nova.scheduler.client.report [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:59:12.314 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.406s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:12.314 4088 3038342255896 MainThread ERROR nova.compute.manager [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000039' failed to start. Not enough memory in the system to start the virtual machine instance-00000039. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000039' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Not enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) 'instance-00000039' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Error code: 32778. 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Traceback (most recent call last): 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] return function(*args, **kwargs) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] admin_password, network_info, block_device_info) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] return function(self, *args, **kwds) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self.force_reraise() 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] raise self.value 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] should_plug_vifs=False) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 'req_state': req_state}) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self.force_reraise() 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] raise self.value 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] time.sleep(sleep_time) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self.force_reraise() 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] raise self.value 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] return f(*args, **kwargs) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] return self._wait_for_job(job_path) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] error_desc=err_desc) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000039' failed to start. 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Not enough memory in the system to start the virtual machine instance-00000039. 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000039' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Not enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 'instance-00000039' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Error code: 32778. 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] During handling of the above exception, another exception occurred: 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Traceback (most recent call last): 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] accel_info=accel_info) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] return function(*args, **kwargs) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] admin_password, network_info, block_device_info) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] return function(self, *args, **kwds) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self.force_reraise() 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] raise self.value 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] should_plug_vifs=False) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 'req_state': req_state}) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self.force_reraise() 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] raise self.value 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] time.sleep(sleep_time) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self.force_reraise() 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] raise self.value 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] return f(*args, **kwargs) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] return self._wait_for_job(job_path) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] error_desc=err_desc) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000039' failed to start. 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Not enough memory in the system to start the virtual machine instance-00000039. 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000039' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Not enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 'instance-00000039' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Error code: 32778. 2021-09-10 16:59:12.314 4088 3038342255896 MainThread TRACE nova.compute.manager [instance: 832a0158-f115-480e-a24e-78506e51b9f6] 2021-09-10 16:59:12.314 4088 3038342255896 MainThread DEBUG nova.compute.utils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] WMI job failed with status 10. Error summary description: 'instance-00000039' failed to start. Not enough memory in the system to start the virtual machine instance-00000039. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:59:12.314 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Build of instance 832a0158-f115-480e-a24e-78506e51b9f6 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000039' failed to start. Not enough memory in the system to start the virtual machine instance-00000039. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000039' failed to start. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Not enough memory in the system to start the virtual machine instance-00000039 with ram size 512 megabytes. (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) 'instance-00000039' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 052A344A-EDAF-4D84-98CB-DC5B4B1F9C91) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:59:12.314 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:59:12.314 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:59:12.314 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:59:12.314 4088 3038342255896 MainThread DEBUG nova.network.neutron [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:59:12.377 4088 3038296677544 GreenThread-51 DEBUG nova.network.neutron [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Successfully created port: 889d1613-638f-45b3-8590-8ba5211a3c23 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:59:12.502 4088 3038342258184 MainThread DEBUG os_win.utils.jobutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': '6123124E-42A5-492B-B478-197E76E2FAB7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15345), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:12.502 4088 3038340492456 MainThread DEBUG nova.compute.manager [req-01731d0b-d7b0-462a-a418-15e7980ff6cb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Received event network-vif-plugged-6e82ace2-7f01-4e23-9eda-cc3b62c12db6 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:59:12.502 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-01731d0b-d7b0-462a-a418-15e7980ff6cb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:12.502 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-01731d0b-d7b0-462a-a418-15e7980ff6cb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:12.502 4088 3038340492456 MainThread DEBUG nova.compute.manager [req-01731d0b-d7b0-462a-a418-15e7980ff6cb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Processing event network-vif-plugged-6e82ace2-7f01-4e23-9eda-cc3b62c12db6 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:59:12.550 4088 3038342147592 MainThread INFO nova.virt.hyperv.vmops [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Using config drive for instance 2021-09-10 16:59:12.665 4088 3038342258184 MainThread ERROR os_win.utils.jobutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000038\' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)instance-000000381A6B31D5-A2B7-4B68-863A-CF166AEC149412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)instance-000000381A6B31D5-A2B7-4B68-863A-CF166AEC149410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000038\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)instance-000000381A6B31D5-A2B7-4B68-863A-CF166AEC1494%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6123124E-42A5-492B-B478-197E76E2FAB7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115675), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 12), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 12), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000038' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)\n\nNot enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)\n\n'instance-00000038' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)", 'ErrorSummaryDescription': "'instance-00000038' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000038.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:12.665 4088 3038342258184 MainThread DEBUG os_win._utils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000038' failed to start. Not enough memory in the system to start the virtual machine instance-00000038. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000038' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Not enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) 'instance-00000038' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3784313201904297 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:12.705 4088 3038340492632 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:12.705 4088 3038340492632 MainThread INFO nova.compute.manager [-] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] VM Stopped (Lifecycle Event) 2021-09-10 16:59:12.705 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000038" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:12.705 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000038" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:12.735 4088 3038340492632 MainThread DEBUG nova.compute.manager [req-8db1f26b-584d-4eb5-88f5-1246d04f1d6f - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:12.735 4088 3038340492632 MainThread DEBUG nova.virt.hyperv.vmops [req-8db1f26b-584d-4eb5-88f5-1246d04f1d6f - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:12.782 4088 3038340492632 MainThread DEBUG nova.compute.manager [req-8db1f26b-584d-4eb5-88f5-1246d04f1d6f - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:12.782 4088 3038340492632 MainThread INFO nova.compute.manager [req-8db1f26b-584d-4eb5-88f5-1246d04f1d6f - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:12.916 4088 3038342144424 MainThread DEBUG os_win.utils.jobutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': 'ED541EAC-DAED-4F10-9900-02EAFABF6BE4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15602), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:13.064 4088 3038342144424 MainThread ERROR os_win.utils.jobutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003a\' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)instance-0000003aA7307675-77FE-4948-AF2F-8BFBA80F445912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)instance-0000003aA7307675-77FE-4948-AF2F-8BFBA80F445910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)instance-0000003aA7307675-77FE-4948-AF2F-8BFBA80F4459%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'ED541EAC-DAED-4F10-9900-02EAFABF6BE4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113681), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 12), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 13), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003a' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)\n\nNot enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)\n\n'instance-0000003a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)", 'ErrorSummaryDescription': "'instance-0000003a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:13.080 4088 3038342144424 MainThread DEBUG os_win._utils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003a' failed to start. Not enough memory in the system to start the virtual machine instance-0000003a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003a' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Not enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) 'instance-0000003a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.168794631958008 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:13.098 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:13.098 4088 3038340491928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:13.098 4088 3038340492632 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:13.098 4088 3038340492632 MainThread INFO nova.compute.manager [-] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] VM Stopped (Lifecycle Event) 2021-09-10 16:59:13.125 4088 3038340492632 MainThread DEBUG nova.compute.manager [req-60bff000-d4ea-49c0-b5ff-06429d5c2656 - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:13.125 4088 3038340492632 MainThread DEBUG nova.virt.hyperv.vmops [req-60bff000-d4ea-49c0-b5ff-06429d5c2656 - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:13.173 4088 3038340492632 MainThread DEBUG nova.compute.manager [req-60bff000-d4ea-49c0-b5ff-06429d5c2656 - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:13.189 4088 3038342147592 MainThread INFO nova.virt.hyperv.vmops [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Creating config drive at C:\openstack\instances\instance-0000003c\configdrive.iso 2021-09-10 16:59:13.251 4088 3038342147592 MainThread DEBUG oslo_concurrency.processutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000003c\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmppyaej3az execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:59:13.418 4088 3038340492632 MainThread INFO nova.compute.manager [req-60bff000-d4ea-49c0-b5ff-06429d5c2656 - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:13.418 4088 3038342255896 MainThread DEBUG nova.network.neutron [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:59:13.453 4088 3038342255896 MainThread INFO nova.compute.manager [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: 832a0158-f115-480e-a24e-78506e51b9f6] Took 1.14 seconds to deallocate network for instance. 2021-09-10 16:59:13.564 4088 3038342147592 MainThread DEBUG oslo_concurrency.processutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000003c\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmppyaej3az" returned: 0 in 0.312s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:59:13.659 4088 3038342255896 MainThread INFO nova.scheduler.client.report [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Deleted allocations for instance 832a0158-f115-480e-a24e-78506e51b9f6 2021-09-10 16:59:13.690 4088 3038342258184 MainThread DEBUG os_win.utils.jobutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': 'E6151DF4-1204-4F22-A41D-9F7DF566DBF7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15776), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:13.705 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-8da4dc52-4693-4bdc-ba36-0aa8f3570d94 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "832a0158-f115-480e-a24e-78506e51b9f6" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 35.281s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:13.832 4088 3038342258184 MainThread ERROR os_win.utils.jobutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000038\' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)instance-000000381A6B31D5-A2B7-4B68-863A-CF166AEC149412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)instance-000000381A6B31D5-A2B7-4B68-863A-CF166AEC149410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000038\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)instance-000000381A6B31D5-A2B7-4B68-863A-CF166AEC1494%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E6151DF4-1204-4F22-A41D-9F7DF566DBF7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121105), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 13), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 13), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000038' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)\n\nNot enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)\n\n'instance-00000038' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)", 'ErrorSummaryDescription': "'instance-00000038' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000038.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:13.848 4088 3038342258184 MainThread DEBUG os_win._utils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000038' failed to start. Not enough memory in the system to start the virtual machine instance-00000038. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000038' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Not enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) 'instance-00000038' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.560910701751709 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:13.959 4088 3038342255896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:13.959 4088 3038342255896 MainThread INFO nova.compute.manager [-] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] VM Stopped (Lifecycle Event) 2021-09-10 16:59:13.959 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000038" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:13.959 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000038" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:13.986 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-4734b33b-baf8-4a82-a523-06ea6bf5fa80 - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:13.986 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.vmops [req-4734b33b-baf8-4a82-a523-06ea6bf5fa80 - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:14.129 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.vmops [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Setting boot order for instance: instance-0000003c: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:59:14.161 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-4734b33b-baf8-4a82-a523-06ea6bf5fa80 - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:14.161 4088 3038342144424 MainThread DEBUG os_win.utils.jobutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': 'D098509E-7242-49C7-8ACD-34FB000D4A24', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16737), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:14.176 4088 3038342255896 MainThread INFO nova.compute.manager [req-4734b33b-baf8-4a82-a523-06ea6bf5fa80 - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:14.235 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.vmops [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:59:14.269 4088 3038342147592 MainThread DEBUG os_win.utils.jobutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Waiting for WMI job: {'InstanceID': '540A9C20-32C9-4BFB-8DE5-10C7F63ECFC1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17276), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:14.300 4088 3038342144424 MainThread ERROR os_win.utils.jobutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003a\' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)instance-0000003aA7307675-77FE-4948-AF2F-8BFBA80F445912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)instance-0000003aA7307675-77FE-4948-AF2F-8BFBA80F445910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)instance-0000003aA7307675-77FE-4948-AF2F-8BFBA80F4459%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D098509E-7242-49C7-8ACD-34FB000D4A24', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115463), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 14), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 14), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003a' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)\n\nNot enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)\n\n'instance-0000003a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459)", 'ErrorSummaryDescription': "'instance-0000003a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:14.300 4088 3038342144424 MainThread ERROR nova.virt.hyperv.vmops [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Failed to change vm state of instance-0000003a to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000003a' failed to start. 2021-09-10 16:59:14.300 4088 3038342144424 MainThread INFO nova.virt.hyperv.vmops [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Got request to destroy instance 2021-09-10 16:59:14.330 4088 3038342255896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:14.330 4088 3038342255896 MainThread INFO nova.compute.manager [-] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] VM Stopped (Lifecycle Event) 2021-09-10 16:59:14.330 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:14.330 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:14.361 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-a19ecb70-36f3-406f-9147-173ae22fa718 - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:14.361 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.vmops [req-a19ecb70-36f3-406f-9147-173ae22fa718 - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:14.411 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-a19ecb70-36f3-406f-9147-173ae22fa718 - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:14.411 4088 3038342147592 MainThread ERROR os_win.utils.jobutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003c\' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)instance-0000003cD291AC0D-4E7A-419A-B8FB-7ADD59AC251612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)instance-0000003cD291AC0D-4E7A-419A-B8FB-7ADD59AC251610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)instance-0000003cD291AC0D-4E7A-419A-B8FB-7ADD59AC2516%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '540A9C20-32C9-4BFB-8DE5-10C7F63ECFC1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=124606), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 14), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 14), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003c' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)\n\nNot enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)\n\n'instance-0000003c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)", 'ErrorSummaryDescription': "'instance-0000003c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:14.411 4088 3038342147592 MainThread DEBUG os_win._utils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003c' failed to start. Not enough memory in the system to start the virtual machine instance-0000003c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003c' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Not enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) 'instance-0000003c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.17589926719665527 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:14.439 4088 3038342255896 MainThread INFO nova.compute.manager [req-a19ecb70-36f3-406f-9147-173ae22fa718 - - - - -] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:14.454 4088 3038342255896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:14.454 4088 3038342255896 MainThread INFO nova.compute.manager [-] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] VM Stopped (Lifecycle Event) 2021-09-10 16:59:14.470 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:14.470 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:14.486 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-fab10918-b259-482e-934f-522b5a161d14 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:14.486 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.vmops [req-fab10918-b259-482e-934f-522b5a161d14 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:14.532 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-fab10918-b259-482e-934f-522b5a161d14 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:14.532 4088 3038342255896 MainThread INFO nova.compute.manager [req-fab10918-b259-482e-934f-522b5a161d14 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:14.865 4088 3038342258184 MainThread DEBUG os_win.utils.jobutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': 'E1E71EC4-D127-49EE-8CF8-44A2062D0468', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17289), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:15.014 4088 3038342258184 MainThread ERROR os_win.utils.jobutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000038\' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)instance-000000381A6B31D5-A2B7-4B68-863A-CF166AEC149412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)instance-000000381A6B31D5-A2B7-4B68-863A-CF166AEC149410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000038\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)instance-000000381A6B31D5-A2B7-4B68-863A-CF166AEC1494%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E1E71EC4-D127-49EE-8CF8-44A2062D0468', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116394), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 14), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 14), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000038' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)\n\nNot enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)\n\n'instance-00000038' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)", 'ErrorSummaryDescription': "'instance-00000038' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000038.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:15.016 4088 3038342258184 MainThread DEBUG os_win._utils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000038' failed to start. Not enough memory in the system to start the virtual machine instance-00000038. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000038' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Not enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) 'instance-00000038' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7290453910827637 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:15.032 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000038" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:15.032 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000038" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:15.032 4088 3038342255896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:15.032 4088 3038342255896 MainThread INFO nova.compute.manager [-] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] VM Stopped (Lifecycle Event) 2021-09-10 16:59:15.072 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-c7359c3f-1264-4da8-8f75-794e0d37d04f - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:15.072 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.vmops [req-c7359c3f-1264-4da8-8f75-794e0d37d04f - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:15.126 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-c7359c3f-1264-4da8-8f75-794e0d37d04f - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:15.175 4088 3038342255896 MainThread INFO nova.compute.manager [req-c7359c3f-1264-4da8-8f75-794e0d37d04f - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:15.439 4088 3038342147592 MainThread DEBUG os_win.utils.jobutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Waiting for WMI job: {'InstanceID': '7104D12D-2B0E-436A-AD4C-796703102CA2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15342), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:15.626 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:15.626 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:15.626 4088 3038342255896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:15.626 4088 3038342255896 MainThread INFO nova.compute.manager [-] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] VM Stopped (Lifecycle Event) 2021-09-10 16:59:15.658 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-e2b55564-378e-49cd-bc89-9ac4c4c95b03 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:15.658 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.vmops [req-e2b55564-378e-49cd-bc89-9ac4c4c95b03 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:15.689 4088 3038342147592 MainThread ERROR os_win.utils.jobutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003c\' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)instance-0000003cD291AC0D-4E7A-419A-B8FB-7ADD59AC251612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)instance-0000003cD291AC0D-4E7A-419A-B8FB-7ADD59AC251610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)instance-0000003cD291AC0D-4E7A-419A-B8FB-7ADD59AC2516%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7104D12D-2B0E-436A-AD4C-796703102CA2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=123460), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 15), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 15), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003c' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)\n\nNot enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)\n\n'instance-0000003c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)", 'ErrorSummaryDescription': "'instance-0000003c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:15.689 4088 3038342147592 MainThread DEBUG os_win._utils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003c' failed to start. Not enough memory in the system to start the virtual machine instance-0000003c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003c' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Not enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) 'instance-0000003c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4536750316619873 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:15.703 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-e2b55564-378e-49cd-bc89-9ac4c4c95b03 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:15.737 4088 3038342255896 MainThread INFO nova.compute.manager [req-e2b55564-378e-49cd-bc89-9ac4c4c95b03 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:16.039 4088 3038342258184 MainThread DEBUG os_win.utils.jobutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': '803C8A53-867C-4C23-89F1-C1C30BAB8FF7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17541), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:16.172 4088 3038296677544 GreenThread-51 DEBUG nova.network.neutron [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Successfully updated port: 889d1613-638f-45b3-8590-8ba5211a3c23 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:59:16.172 4088 3038342258184 MainThread ERROR os_win.utils.jobutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000038\' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)instance-000000381A6B31D5-A2B7-4B68-863A-CF166AEC149412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)instance-000000381A6B31D5-A2B7-4B68-863A-CF166AEC149410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000038\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)instance-000000381A6B31D5-A2B7-4B68-863A-CF166AEC1494%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '803C8A53-867C-4C23-89F1-C1C30BAB8FF7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115966), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 16), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 16), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000038' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)\n\nNot enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)\n\n'instance-00000038' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)", 'ErrorSummaryDescription': "'instance-00000038' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000038.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:16.172 4088 3038342258184 MainThread DEBUG os_win._utils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000038' failed to start. Not enough memory in the system to start the virtual machine instance-00000038. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000038' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Not enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) 'instance-00000038' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.885770797729492 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:16.172 4088 3038296677544 GreenThread-51 DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Acquired lock "refresh_cache-aa775114-9ae9-476f-b4ed-2b6e1846f3bc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:59:16.203 4088 3038296677544 GreenThread-51 DEBUG nova.network.neutron [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:59:16.224 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000038" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:16.224 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000038" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:16.224 4088 3038342146712 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:16.224 4088 3038342146712 MainThread INFO nova.compute.manager [-] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] VM Stopped (Lifecycle Event) 2021-09-10 16:59:16.255 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-3694b1b2-0676-422d-a212-e210c0822a96 - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:16.255 4088 3038342146712 MainThread DEBUG nova.virt.hyperv.vmops [req-3694b1b2-0676-422d-a212-e210c0822a96 - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:16.282 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.vmops [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:59:16.299 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-0000003a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:16.299 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-0000003a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:16.299 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-3694b1b2-0676-422d-a212-e210c0822a96 - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:16.315 4088 3038342144424 MainThread DEBUG os_win.utils.compute.vmutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Successfully changed vm state of instance-0000003a to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:59:16.315 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.vmops [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Successfully changed state of VM instance-0000003a to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:59:16.329 4088 3038342146712 MainThread INFO nova.compute.manager [req-3694b1b2-0676-422d-a212-e210c0822a96 - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:16.361 4088 3038342144424 MainThread DEBUG os_win.utils.jobutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': '773B38C2-95C1-4232-8C78-8E92A6CBA46C', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14787), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:16.486 4088 3038342144424 MainThread DEBUG os_win.utils.jobutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job succeeded: {'InstanceID': '773B38C2-95C1-4232-8C78-8E92A6CBA46C', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=103941), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:59:16.486 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-0000003a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:16.486 4088 3038342144424 MainThread DEBUG os_win.utils.pathutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Removing directory: C:\openstack\instances\instance-0000003a check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:59:16.486 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-0000003a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:16.486 4088 3038342144424 MainThread ERROR nova.compute.manager [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003a' failed to start. Not enough memory in the system to start the virtual machine instance-0000003a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003a' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Not enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) 'instance-0000003a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Error code: 32778. 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Traceback (most recent call last): 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] return function(*args, **kwargs) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] admin_password, network_info, block_device_info) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] return function(self, *args, **kwds) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self.force_reraise() 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] raise self.value 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] should_plug_vifs=False) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 'req_state': req_state}) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self.force_reraise() 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] raise self.value 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] time.sleep(sleep_time) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self.force_reraise() 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] raise self.value 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] return f(*args, **kwargs) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] return self._wait_for_job(job_path) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] error_desc=err_desc) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000003a' failed to start. 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Not enough memory in the system to start the virtual machine instance-0000003a. 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003a' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Not enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 'instance-0000003a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Error code: 32778. 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] During handling of the above exception, another exception occurred: 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Traceback (most recent call last): 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] yield resources 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] accel_info=accel_info) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] return function(*args, **kwargs) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] admin_password, network_info, block_device_info) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] return function(self, *args, **kwds) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self.force_reraise() 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] raise self.value 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] should_plug_vifs=False) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 'req_state': req_state}) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self.force_reraise() 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] raise self.value 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] time.sleep(sleep_time) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self.force_reraise() 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] raise self.value 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] return f(*args, **kwargs) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] return self._wait_for_job(job_path) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] error_desc=err_desc) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003a' failed to start. 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Not enough memory in the system to start the virtual machine instance-0000003a. 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003a' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Not enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 'instance-0000003a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Error code: 32778. 2021-09-10 16:59:16.486 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.486 4088 3038342144424 MainThread INFO nova.compute.manager [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Terminating instance 2021-09-10 16:59:16.486 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:59:16.486 4088 3038342144424 MainThread INFO nova.virt.hyperv.vmops [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Got request to destroy instance 2021-09-10 16:59:16.502 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.vmops [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:59:16.502 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-0000003a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:16.502 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-0000003a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:16.517 4088 3038342144424 MainThread INFO nova.compute.manager [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 16:59:16.517 4088 3038342144424 MainThread DEBUG nova.compute.claims [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:59:16.517 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:16.611 4088 3038296677544 GreenThread-51 DEBUG nova.network.neutron [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:59:16.674 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.hostops [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:59:16.690 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.hostops [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:59:16.721 4088 3038342147592 MainThread DEBUG os_win.utils.jobutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Waiting for WMI job: {'InstanceID': 'DDF3CFDD-A06F-4EDC-B728-A40986D3FCF4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15910), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:16.860 4088 3038342147592 MainThread ERROR os_win.utils.jobutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003c\' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)instance-0000003cD291AC0D-4E7A-419A-B8FB-7ADD59AC251612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)instance-0000003cD291AC0D-4E7A-419A-B8FB-7ADD59AC251610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)instance-0000003cD291AC0D-4E7A-419A-B8FB-7ADD59AC2516%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'DDF3CFDD-A06F-4EDC-B728-A40986D3FCF4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115532), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 16), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 16), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003c' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)\n\nNot enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)\n\n'instance-0000003c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)", 'ErrorSummaryDescription': "'instance-0000003c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:16.860 4088 3038342147592 MainThread DEBUG os_win._utils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003c' failed to start. Not enough memory in the system to start the virtual machine instance-0000003c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003c' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Not enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) 'instance-0000003c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.6246042251586914 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:16.911 4088 3038342255192 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:16.911 4088 3038342255192 MainThread INFO nova.compute.manager [-] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] VM Stopped (Lifecycle Event) 2021-09-10 16:59:16.911 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:16.911 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:16.923 4088 3038342144424 MainThread DEBUG nova.compute.provider_tree [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:59:16.940 4088 3038342144424 MainThread DEBUG nova.scheduler.client.report [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:59:16.940 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:16.940 4088 3038342144424 MainThread ERROR nova.compute.manager [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003a' failed to start. Not enough memory in the system to start the virtual machine instance-0000003a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003a' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Not enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) 'instance-0000003a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Error code: 32778. 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Traceback (most recent call last): 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] return function(*args, **kwargs) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] admin_password, network_info, block_device_info) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] return function(self, *args, **kwds) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self.force_reraise() 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] raise self.value 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] should_plug_vifs=False) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 'req_state': req_state}) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self.force_reraise() 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] raise self.value 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] time.sleep(sleep_time) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self.force_reraise() 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] raise self.value 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] return f(*args, **kwargs) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] return self._wait_for_job(job_path) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] error_desc=err_desc) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000003a' failed to start. 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Not enough memory in the system to start the virtual machine instance-0000003a. 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003a' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Not enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 'instance-0000003a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Error code: 32778. 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] During handling of the above exception, another exception occurred: 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Traceback (most recent call last): 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] accel_info=accel_info) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] return function(*args, **kwargs) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] admin_password, network_info, block_device_info) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] return function(self, *args, **kwds) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self.force_reraise() 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] raise self.value 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] should_plug_vifs=False) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 'req_state': req_state}) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self.force_reraise() 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] raise self.value 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] time.sleep(sleep_time) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self.force_reraise() 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] raise self.value 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] return f(*args, **kwargs) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] return self._wait_for_job(job_path) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] error_desc=err_desc) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003a' failed to start. 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Not enough memory in the system to start the virtual machine instance-0000003a. 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003a' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Not enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 'instance-0000003a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Error code: 32778. 2021-09-10 16:59:16.940 4088 3038342144424 MainThread TRACE nova.compute.manager [instance: 1f6d373b-5624-411c-9545-511d98e94f86] 2021-09-10 16:59:16.940 4088 3038342144424 MainThread DEBUG nova.compute.utils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] WMI job failed with status 10. Error summary description: 'instance-0000003a' failed to start. Not enough memory in the system to start the virtual machine instance-0000003a. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:59:16.940 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Build of instance 1f6d373b-5624-411c-9545-511d98e94f86 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000003a' failed to start. Not enough memory in the system to start the virtual machine instance-0000003a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003a' failed to start. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Not enough memory in the system to start the virtual machine instance-0000003a with ram size 1024 megabytes. (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) 'instance-0000003a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A7307675-77FE-4948-AF2F-8BFBA80F4459) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:59:16.940 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:59:16.940 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:59:16.940 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:59:16.940 4088 3038342144424 MainThread DEBUG nova.network.neutron [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:59:16.959 4088 3038342255192 MainThread DEBUG nova.compute.manager [req-4a9743cc-9c6a-453f-b051-089f10465ec4 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:16.959 4088 3038342255192 MainThread DEBUG nova.virt.hyperv.vmops [req-4a9743cc-9c6a-453f-b051-089f10465ec4 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:17.017 4088 3038342255192 MainThread DEBUG nova.compute.manager [req-4a9743cc-9c6a-453f-b051-089f10465ec4 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:17.049 4088 3038342255192 MainThread INFO nova.compute.manager [req-4a9743cc-9c6a-453f-b051-089f10465ec4 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:17.066 4088 3038342255192 MainThread DEBUG nova.compute.manager [req-50b39452-2db2-4800-9ad6-dc8a886e67c6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Received event network-changed-889d1613-638f-45b3-8590-8ba5211a3c23 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:59:17.066 4088 3038342255192 MainThread DEBUG nova.compute.manager [req-50b39452-2db2-4800-9ad6-dc8a886e67c6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Refreshing instance network info cache due to event network-changed-889d1613-638f-45b3-8590-8ba5211a3c23. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:59:17.205 4088 3038342258184 MainThread DEBUG os_win.utils.jobutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': 'D6ED34CC-7A61-49DC-A1A2-F8C623F502C4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14854), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:17.346 4088 3038342258184 MainThread ERROR os_win.utils.jobutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000038\' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)instance-000000381A6B31D5-A2B7-4B68-863A-CF166AEC149412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)instance-000000381A6B31D5-A2B7-4B68-863A-CF166AEC149410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000038\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)instance-000000381A6B31D5-A2B7-4B68-863A-CF166AEC1494%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D6ED34CC-7A61-49DC-A1A2-F8C623F502C4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112173), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 17), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 17), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000038' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)\n\nNot enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)\n\n'instance-00000038' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494)", 'ErrorSummaryDescription': "'instance-00000038' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000038.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:17.346 4088 3038342258184 MainThread ERROR nova.virt.hyperv.vmops [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Failed to change vm state of instance-00000038 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000038' failed to start. 2021-09-10 16:59:17.346 4088 3038342258184 MainThread INFO nova.virt.hyperv.vmops [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Got request to destroy instance 2021-09-10 16:59:17.377 4088 3038337401256 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000038" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:17.377 4088 3038337401256 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000038" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:17.377 4088 3038340492104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:17.377 4088 3038340492104 MainThread INFO nova.compute.manager [-] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] VM Stopped (Lifecycle Event) 2021-09-10 16:59:17.391 4088 3038340492104 MainThread DEBUG nova.compute.manager [req-458cd55c-2f1f-437a-be80-b9ed6cc3073e - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:17.391 4088 3038340492104 MainThread DEBUG nova.virt.hyperv.vmops [req-458cd55c-2f1f-437a-be80-b9ed6cc3073e - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:17.455 4088 3038340492104 MainThread DEBUG nova.compute.manager [req-458cd55c-2f1f-437a-be80-b9ed6cc3073e - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:17.470 4088 3038340492104 MainThread INFO nova.compute.manager [req-458cd55c-2f1f-437a-be80-b9ed6cc3073e - - - - -] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:17.547 4088 3038296677544 GreenThread-51 DEBUG nova.network.neutron [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Updating instance_info_cache with network_info: [{"id": "889d1613-638f-45b3-8590-8ba5211a3c23", "address": "fa:16:3e:3f:62:78", "network": {"id": "9cad4abd-c7da-438a-bf2a-8b127ecf1997", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1013471033-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "912aa6945f734abbbd12a58348a3bbbb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap889d1613-63", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:59:17.565 4088 3038296677544 GreenThread-51 DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Releasing lock "refresh_cache-aa775114-9ae9-476f-b4ed-2b6e1846f3bc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:59:17.565 4088 3038296677544 GreenThread-51 DEBUG nova.compute.manager [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Instance network_info: |[{"id": "889d1613-638f-45b3-8590-8ba5211a3c23", "address": "fa:16:3e:3f:62:78", "network": {"id": "9cad4abd-c7da-438a-bf2a-8b127ecf1997", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1013471033-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "912aa6945f734abbbd12a58348a3bbbb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap889d1613-63", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:59:17.565 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [req-50b39452-2db2-4800-9ad6-dc8a886e67c6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-aa775114-9ae9-476f-b4ed-2b6e1846f3bc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:59:17.565 4088 3038342255192 MainThread DEBUG nova.network.neutron [req-50b39452-2db2-4800-9ad6-dc8a886e67c6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Refreshing network info cache for port 889d1613-638f-45b3-8590-8ba5211a3c23 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:59:17.565 4088 3038342144248 MainThread DEBUG nova.compute.manager [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Preparing to wait for external event network-vif-plugged-889d1613-638f-45b3-8590-8ba5211a3c23 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:59:17.565 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Lock "aa775114-9ae9-476f-b4ed-2b6e1846f3bc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:17.565 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Lock "aa775114-9ae9-476f-b4ed-2b6e1846f3bc-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:17.565 4088 3038342144248 MainThread DEBUG os_win.utils.compute.vmutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Creating VM instance-0000003e create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:59:17.971 4088 3038342147592 MainThread DEBUG os_win.utils.jobutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Waiting for WMI job: {'InstanceID': '661ECCF8-4AA1-4B49-9306-467228C6AFF9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18775), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:18.020 4088 3038342144424 MainThread DEBUG nova.network.neutron [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:59:18.051 4088 3038342144424 MainThread INFO nova.compute.manager [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 1f6d373b-5624-411c-9545-511d98e94f86] Took 1.11 seconds to deallocate network for instance. 2021-09-10 16:59:18.114 4088 3038342147592 MainThread ERROR os_win.utils.jobutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003c\' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)instance-0000003cD291AC0D-4E7A-419A-B8FB-7ADD59AC251612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)instance-0000003cD291AC0D-4E7A-419A-B8FB-7ADD59AC251610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)instance-0000003cD291AC0D-4E7A-419A-B8FB-7ADD59AC2516%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '661ECCF8-4AA1-4B49-9306-467228C6AFF9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=122934), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 17), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 18), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003c' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)\n\nNot enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)\n\n'instance-0000003c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)", 'ErrorSummaryDescription': "'instance-0000003c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:18.114 4088 3038342147592 MainThread DEBUG os_win._utils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003c' failed to start. Not enough memory in the system to start the virtual machine instance-0000003c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003c' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Not enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) 'instance-0000003c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.8784167766571045 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:18.225 4088 3038340492456 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:18.225 4088 3038340492456 MainThread INFO nova.compute.manager [-] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] VM Stopped (Lifecycle Event) 2021-09-10 16:59:18.225 4088 3038337401256 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:18.239 4088 3038337401256 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:18.239 4088 3038340492456 MainThread DEBUG nova.compute.manager [req-69c3cbf2-fe16-40ff-9a2f-4d0519fb43ea - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:18.262 4088 3038340492456 MainThread DEBUG nova.virt.hyperv.vmops [req-69c3cbf2-fe16-40ff-9a2f-4d0519fb43ea - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:18.285 4088 3038342144424 MainThread INFO nova.scheduler.client.report [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Deleted allocations for instance 1f6d373b-5624-411c-9545-511d98e94f86 2021-09-10 16:59:18.333 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [req-eb17a63f-9b92-413f-b335-2d1340f57f27 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "1f6d373b-5624-411c-9545-511d98e94f86" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 27.969s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:18.347 4088 3038340492456 MainThread DEBUG nova.compute.manager [req-69c3cbf2-fe16-40ff-9a2f-4d0519fb43ea - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:18.410 4088 3038340492456 MainThread INFO nova.compute.manager [req-69c3cbf2-fe16-40ff-9a2f-4d0519fb43ea - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:19.148 4088 3038342147592 MainThread DEBUG os_win.utils.jobutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Waiting for WMI job: {'InstanceID': '798F20E9-EA42-4D95-AAB5-50AD004B354F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16172), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:19.313 4088 3038342147592 MainThread ERROR os_win.utils.jobutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003c\' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)instance-0000003cD291AC0D-4E7A-419A-B8FB-7ADD59AC251612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)instance-0000003cD291AC0D-4E7A-419A-B8FB-7ADD59AC251610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)instance-0000003cD291AC0D-4E7A-419A-B8FB-7ADD59AC2516%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '798F20E9-EA42-4D95-AAB5-50AD004B354F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113715), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 19), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 19), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003c' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)\n\nNot enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)\n\n'instance-0000003c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)", 'ErrorSummaryDescription': "'instance-0000003c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:19.313 4088 3038342147592 MainThread DEBUG os_win._utils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003c' failed to start. Not enough memory in the system to start the virtual machine instance-0000003c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003c' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Not enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) 'instance-0000003c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.07708477973938 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:19.313 4088 3038342255896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:19.313 4088 3038342255896 MainThread INFO nova.compute.manager [-] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] VM Stopped (Lifecycle Event) 2021-09-10 16:59:19.332 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:19.332 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:19.345 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-c33c03f8-f5c8-46da-8370-12f7b103cd24 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:19.345 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.vmops [req-c33c03f8-f5c8-46da-8370-12f7b103cd24 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:19.377 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.vmops [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:59:19.377 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000038" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:19.377 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000038" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:19.396 4088 3038342144248 MainThread DEBUG nova.virt.hyperv.vmops [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:59:19.420 4088 3038342258184 MainThread DEBUG os_win.utils.compute.vmutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Successfully changed vm state of instance-00000038 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:59:19.420 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.vmops [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Successfully changed state of VM instance-00000038 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:59:19.453 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-c33c03f8-f5c8-46da-8370-12f7b103cd24 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:19.474 4088 3038342258184 MainThread DEBUG os_win.utils.jobutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Waiting for WMI job: {'InstanceID': '470453DC-A9A4-48CC-9F77-5D3F68B8211E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19257), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:19.503 4088 3038342255896 MainThread INFO nova.compute.manager [req-c33c03f8-f5c8-46da-8370-12f7b103cd24 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:19.595 4088 3038342258184 MainThread DEBUG os_win.utils.jobutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] WMI job succeeded: {'InstanceID': '470453DC-A9A4-48CC-9F77-5D3F68B8211E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=119813), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:59:19.595 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000038" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:19.595 4088 3038342258184 MainThread DEBUG os_win.utils.pathutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Removing directory: C:\openstack\instances\instance-00000038 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:59:19.595 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000038" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:19.595 4088 3038342258184 MainThread ERROR nova.compute.manager [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000038' failed to start. Not enough memory in the system to start the virtual machine instance-00000038. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000038' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Not enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) 'instance-00000038' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Error code: 32778. 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Traceback (most recent call last): 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] return function(*args, **kwargs) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] admin_password, network_info, block_device_info) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] return function(self, *args, **kwds) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self.force_reraise() 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] raise self.value 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] should_plug_vifs=False) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 'req_state': req_state}) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self.force_reraise() 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] raise self.value 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] time.sleep(sleep_time) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self.force_reraise() 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] raise self.value 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] return f(*args, **kwargs) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] return self._wait_for_job(job_path) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] error_desc=err_desc) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000038' failed to start. 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Not enough memory in the system to start the virtual machine instance-00000038. 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000038' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Not enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 'instance-00000038' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Error code: 32778. 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] During handling of the above exception, another exception occurred: 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Traceback (most recent call last): 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] yield resources 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] accel_info=accel_info) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] return function(*args, **kwargs) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] admin_password, network_info, block_device_info) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] return function(self, *args, **kwds) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self.force_reraise() 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] raise self.value 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] should_plug_vifs=False) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 'req_state': req_state}) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self.force_reraise() 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] raise self.value 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] time.sleep(sleep_time) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self.force_reraise() 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] raise self.value 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] return f(*args, **kwargs) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] return self._wait_for_job(job_path) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] error_desc=err_desc) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000038' failed to start. 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Not enough memory in the system to start the virtual machine instance-00000038. 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000038' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Not enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 'instance-00000038' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Error code: 32778. 2021-09-10 16:59:19.595 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:19.595 4088 3038342258184 MainThread INFO nova.compute.manager [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Terminating instance 2021-09-10 16:59:19.595 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:59:19.595 4088 3038342258184 MainThread INFO nova.virt.hyperv.vmops [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Got request to destroy instance 2021-09-10 16:59:19.651 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.vmops [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:59:19.651 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000038" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:19.651 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "instance-00000038" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:19.651 4088 3038342258184 MainThread INFO nova.compute.manager [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Took 0.06 seconds to destroy the instance on the hypervisor. 2021-09-10 16:59:19.660 4088 3038342258184 MainThread DEBUG nova.compute.claims [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:59:19.660 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:19.800 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.hostops [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:59:19.813 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.hostops [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:59:19.924 4088 3038342255192 MainThread DEBUG nova.network.neutron [req-50b39452-2db2-4800-9ad6-dc8a886e67c6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Updated VIF entry in instance network info cache for port 889d1613-638f-45b3-8590-8ba5211a3c23. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:59:19.924 4088 3038342255192 MainThread DEBUG nova.network.neutron [req-50b39452-2db2-4800-9ad6-dc8a886e67c6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Updating instance_info_cache with network_info: [{"id": "889d1613-638f-45b3-8590-8ba5211a3c23", "address": "fa:16:3e:3f:62:78", "network": {"id": "9cad4abd-c7da-438a-bf2a-8b127ecf1997", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1013471033-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "912aa6945f734abbbd12a58348a3bbbb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap889d1613-63", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:59:19.954 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [req-50b39452-2db2-4800-9ad6-dc8a886e67c6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-aa775114-9ae9-476f-b4ed-2b6e1846f3bc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:59:20.032 4088 3038342258184 MainThread DEBUG nova.compute.provider_tree [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:59:20.032 4088 3038342258184 MainThread DEBUG nova.scheduler.client.report [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:59:20.032 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.375s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:20.032 4088 3038342258184 MainThread ERROR nova.compute.manager [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000038' failed to start. Not enough memory in the system to start the virtual machine instance-00000038. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000038' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Not enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) 'instance-00000038' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Error code: 32778. 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Traceback (most recent call last): 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] return function(*args, **kwargs) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] admin_password, network_info, block_device_info) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] return function(self, *args, **kwds) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self.force_reraise() 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] raise self.value 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] should_plug_vifs=False) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 'req_state': req_state}) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self.force_reraise() 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] raise self.value 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] time.sleep(sleep_time) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self.force_reraise() 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] raise self.value 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] return f(*args, **kwargs) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] return self._wait_for_job(job_path) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] error_desc=err_desc) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000038' failed to start. 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Not enough memory in the system to start the virtual machine instance-00000038. 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000038' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Not enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 'instance-00000038' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Error code: 32778. 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] During handling of the above exception, another exception occurred: 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Traceback (most recent call last): 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] accel_info=accel_info) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] return function(*args, **kwargs) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] admin_password, network_info, block_device_info) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] return function(self, *args, **kwds) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self.force_reraise() 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] raise self.value 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] should_plug_vifs=False) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 'req_state': req_state}) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self.force_reraise() 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] raise self.value 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] time.sleep(sleep_time) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self.force_reraise() 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] raise self.value 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] return f(*args, **kwargs) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] return self._wait_for_job(job_path) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] error_desc=err_desc) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000038' failed to start. 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Not enough memory in the system to start the virtual machine instance-00000038. 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000038' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Not enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 'instance-00000038' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Error code: 32778. 2021-09-10 16:59:20.032 4088 3038342258184 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:20.032 4088 3038342258184 MainThread DEBUG nova.compute.utils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] WMI job failed with status 10. Error summary description: 'instance-00000038' failed to start. Not enough memory in the system to start the virtual machine instance-00000038. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:59:20.032 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Build of instance c7fdc9fc-d133-4f12-ab12-ff417c249240 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000038' failed to start. Not enough memory in the system to start the virtual machine instance-00000038. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000038' failed to start. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Not enough memory in the system to start the virtual machine instance-00000038 with ram size 1024 megabytes. (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) 'instance-00000038' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A6B31D5-A2B7-4B68-863A-CF166AEC1494) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:59:20.032 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:59:20.032 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:59:20.063 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:59:20.063 4088 3038342258184 MainThread DEBUG nova.network.neutron [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:59:20.365 4088 3038342147592 MainThread DEBUG os_win.utils.jobutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Waiting for WMI job: {'InstanceID': 'DF4CCD11-80A8-4BB4-BB27-A50F0834C43A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15766), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:20.504 4088 3038342147592 MainThread ERROR os_win.utils.jobutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003c\' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)instance-0000003cD291AC0D-4E7A-419A-B8FB-7ADD59AC251612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)instance-0000003cD291AC0D-4E7A-419A-B8FB-7ADD59AC251610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)instance-0000003cD291AC0D-4E7A-419A-B8FB-7ADD59AC2516%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'DF4CCD11-80A8-4BB4-BB27-A50F0834C43A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112924), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 20), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 20), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003c' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)\n\nNot enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)\n\n'instance-0000003c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516)", 'ErrorSummaryDescription': "'instance-0000003c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:20.504 4088 3038342147592 MainThread ERROR nova.virt.hyperv.vmops [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Failed to change vm state of instance-0000003c to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000003c' failed to start. 2021-09-10 16:59:20.504 4088 3038342147592 MainThread INFO nova.virt.hyperv.vmops [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Got request to destroy instance 2021-09-10 16:59:20.527 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:20.527 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:20.527 4088 3038340492104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:20.527 4088 3038340492104 MainThread INFO nova.compute.manager [-] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] VM Stopped (Lifecycle Event) 2021-09-10 16:59:20.563 4088 3038340492104 MainThread DEBUG nova.compute.manager [req-ec0df34a-3b30-45bc-81ed-a7f873e59359 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:20.563 4088 3038340492104 MainThread DEBUG nova.virt.hyperv.vmops [req-ec0df34a-3b30-45bc-81ed-a7f873e59359 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:20.610 4088 3038340492104 MainThread DEBUG nova.compute.manager [req-ec0df34a-3b30-45bc-81ed-a7f873e59359 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:20.641 4088 3038340492104 MainThread INFO nova.compute.manager [req-ec0df34a-3b30-45bc-81ed-a7f873e59359 - - - - -] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:22.423 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.vmops [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:59:22.423 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Lock "instance-0000003c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:22.423 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Lock "instance-0000003c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:22.444 4088 3038342147592 MainThread DEBUG os_win.utils.compute.vmutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Successfully changed vm state of instance-0000003c to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:59:22.444 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.vmops [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Successfully changed state of VM instance-0000003c to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:59:22.462 4088 3038342258184 MainThread DEBUG nova.network.neutron [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:59:22.483 4088 3038342258184 MainThread INFO nova.compute.manager [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Took 2.42 seconds to deallocate network for instance. 2021-09-10 16:59:22.505 4088 3038342147592 MainThread DEBUG os_win.utils.jobutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Waiting for WMI job: {'InstanceID': '84E91871-7B3C-4527-B6DD-34416AAB946D', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16374), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:22.616 4088 3038342147592 MainThread DEBUG os_win.utils.jobutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] WMI job succeeded: {'InstanceID': '84E91871-7B3C-4527-B6DD-34416AAB946D', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=123445), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:59:22.616 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Lock "instance-0000003c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:22.628 4088 3038342147592 MainThread DEBUG os_win.utils.pathutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Removing directory: C:\openstack\instances\instance-0000003c check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:59:22.628 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Lock "instance-0000003c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:22.628 4088 3038342147592 MainThread ERROR nova.compute.manager [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003c' failed to start. Not enough memory in the system to start the virtual machine instance-0000003c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003c' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Not enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) 'instance-0000003c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Error code: 32778. 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Traceback (most recent call last): 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] return function(*args, **kwargs) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] admin_password, network_info, block_device_info) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] return function(self, *args, **kwds) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self.force_reraise() 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] raise self.value 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] should_plug_vifs=False) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 'req_state': req_state}) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self.force_reraise() 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] raise self.value 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] time.sleep(sleep_time) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self.force_reraise() 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] raise self.value 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] return f(*args, **kwargs) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] return self._wait_for_job(job_path) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] error_desc=err_desc) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000003c' failed to start. 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Not enough memory in the system to start the virtual machine instance-0000003c. 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003c' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Not enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 'instance-0000003c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Error code: 32778. 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] During handling of the above exception, another exception occurred: 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Traceback (most recent call last): 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] yield resources 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] accel_info=accel_info) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] return function(*args, **kwargs) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] admin_password, network_info, block_device_info) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] return function(self, *args, **kwds) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self.force_reraise() 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] raise self.value 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] should_plug_vifs=False) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 'req_state': req_state}) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self.force_reraise() 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] raise self.value 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] time.sleep(sleep_time) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self.force_reraise() 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] raise self.value 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] return f(*args, **kwargs) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] return self._wait_for_job(job_path) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] error_desc=err_desc) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003c' failed to start. 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Not enough memory in the system to start the virtual machine instance-0000003c. 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003c' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Not enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 'instance-0000003c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Error code: 32778. 2021-09-10 16:59:22.628 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:22.628 4088 3038342147592 MainThread INFO nova.compute.manager [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Terminating instance 2021-09-10 16:59:22.628 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:59:22.628 4088 3038342147592 MainThread INFO nova.virt.hyperv.vmops [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Got request to destroy instance 2021-09-10 16:59:22.646 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.vmops [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:59:22.656 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Lock "instance-0000003c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:22.656 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Lock "instance-0000003c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:22.656 4088 3038342147592 MainThread INFO nova.compute.manager [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 16:59:22.656 4088 3038342147592 MainThread DEBUG nova.compute.claims [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:59:22.656 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:22.703 4088 3038342258184 MainThread INFO nova.scheduler.client.report [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Deleted allocations for instance c7fdc9fc-d133-4f12-ab12-ff417c249240 2021-09-10 16:59:22.828 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [req-63c3c131-0966-429d-b576-33bfc4986f37 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "c7fdc9fc-d133-4f12-ab12-ff417c249240" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 40.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:22.828 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-a9a46e75-6138-443e-b204-91f27691cbc2 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "c7fdc9fc-d133-4f12-ab12-ff417c249240" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 4.250s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:22.828 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-a9a46e75-6138-443e-b204-91f27691cbc2 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "c7fdc9fc-d133-4f12-ab12-ff417c249240-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:22.828 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-a9a46e75-6138-443e-b204-91f27691cbc2 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "c7fdc9fc-d133-4f12-ab12-ff417c249240-events" released by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:22.828 4088 3038340492456 MainThread ERROR nova.compute.manager [req-a9a46e75-6138-443e-b204-91f27691cbc2 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Setting instance vm_state to ERROR: NameError: name 'instant' is not defined 2021-09-10 16:59:22.828 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Traceback (most recent call last): 2021-09-10 16:59:22.828 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:59:22.828 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self._delete_instance(context, instance, bdms) 2021-09-10 16:59:22.828 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:59:22.828 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:59:22.828 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] NameError: name 'instant' is not defined 2021-09-10 16:59:22.828 4088 3038340492456 MainThread TRACE nova.compute.manager [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] 2021-09-10 16:59:22.845 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.hostops [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:59:22.866 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.hostops [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:59:22.891 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [req-a9a46e75-6138-443e-b204-91f27691cbc2 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Lock "c7fdc9fc-d133-4f12-ab12-ff417c249240" released by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 0.062s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:23.005 4088 3038340492456 MainThread INFO nova.compute.manager [req-a9a46e75-6138-443e-b204-91f27691cbc2 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] [instance: c7fdc9fc-d133-4f12-ab12-ff417c249240] Successfully reverted task state from None on failure for instance. 2021-09-10 16:59:23.005 4088 3038340492456 MainThread ERROR oslo_messaging.rpc.server [req-a9a46e75-6138-443e-b204-91f27691cbc2 e9b8fdd82fe341dc8eeee9f6dea5f66f cc8daf6ce3114d6aa694f16669c8ed20 - default default] Exception during message handling: NameError: name 'instant' is not defined 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server Traceback (most recent call last): 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 72, in wrapped 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server context, exc, binary) 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server return f(self, context, *args, **kw) 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 184, in decorated_function 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server "Error: %s", e, instance=instance) 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 154, in decorated_function 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\utils.py", line 1433, in decorated_function 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 200, in decorated_function 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3106, in terminate_instance 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server do_terminate_instance(instance, bdms) 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_concurrency\lockutils.py", line 360, in inner 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server return f(*args, **kwargs) 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3104, in do_terminate_instance 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server self._set_instance_obj_error_state(instance) 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server self.force_reraise() 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server raise self.value 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3094, in do_terminate_instance 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server self._delete_instance(context, instance, bdms) 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server File "c:\openstack\build\nova\nova\compute\manager.py", line 3028, in _delete_instance 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server self._power_off_instance(instant, clean_shutdown=True) 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server NameError: name 'instant' is not defined 2021-09-10 16:59:23.005 4088 3038340492456 MainThread TRACE oslo_messaging.rpc.server 2021-09-10 16:59:23.095 4088 3038342147592 MainThread DEBUG nova.compute.provider_tree [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:59:23.131 4088 3038342147592 MainThread DEBUG nova.scheduler.client.report [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:59:23.131 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:23.131 4088 3038342147592 MainThread ERROR nova.compute.manager [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003c' failed to start. Not enough memory in the system to start the virtual machine instance-0000003c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003c' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Not enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) 'instance-0000003c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Error code: 32778. 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Traceback (most recent call last): 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] return function(*args, **kwargs) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] admin_password, network_info, block_device_info) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] return function(self, *args, **kwds) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self.force_reraise() 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] raise self.value 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] should_plug_vifs=False) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 'req_state': req_state}) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self.force_reraise() 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] raise self.value 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] time.sleep(sleep_time) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self.force_reraise() 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] raise self.value 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] return f(*args, **kwargs) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] return self._wait_for_job(job_path) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] error_desc=err_desc) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000003c' failed to start. 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Not enough memory in the system to start the virtual machine instance-0000003c. 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003c' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Not enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 'instance-0000003c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Error code: 32778. 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] During handling of the above exception, another exception occurred: 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Traceback (most recent call last): 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] accel_info=accel_info) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] return function(*args, **kwargs) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] admin_password, network_info, block_device_info) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] return function(self, *args, **kwds) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self.force_reraise() 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] raise self.value 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] should_plug_vifs=False) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 'req_state': req_state}) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self.force_reraise() 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] raise self.value 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] time.sleep(sleep_time) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self.force_reraise() 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] raise self.value 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] return f(*args, **kwargs) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] return self._wait_for_job(job_path) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] error_desc=err_desc) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003c' failed to start. 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Not enough memory in the system to start the virtual machine instance-0000003c. 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003c' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Not enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 'instance-0000003c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Error code: 32778. 2021-09-10 16:59:23.131 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] 2021-09-10 16:59:23.131 4088 3038342147592 MainThread DEBUG nova.compute.utils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] WMI job failed with status 10. Error summary description: 'instance-0000003c' failed to start. Not enough memory in the system to start the virtual machine instance-0000003c. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:59:23.131 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Build of instance 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000003c' failed to start. Not enough memory in the system to start the virtual machine instance-0000003c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003c' failed to start. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Not enough memory in the system to start the virtual machine instance-0000003c with ram size 1024 megabytes. (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) 'instance-0000003c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D291AC0D-4E7A-419A-B8FB-7ADD59AC2516) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:59:23.131 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:59:23.131 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:59:23.131 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:59:23.131 4088 3038342147592 MainThread DEBUG nova.network.neutron [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:59:24.938 4088 3038342147592 MainThread DEBUG nova.network.neutron [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:59:24.991 4088 3038342147592 MainThread INFO nova.compute.manager [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] [instance: 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9] Took 1.86 seconds to deallocate network for instance. 2021-09-10 16:59:25.254 4088 3038342147592 MainThread INFO nova.scheduler.client.report [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Deleted allocations for instance 04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9 2021-09-10 16:59:25.317 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-0fea709c-999a-4a82-886b-cd8493e0165b d62454119feb46319b4a349e02ddd6df a13940e712fe464c8a1b2c3732982edb - default default] Lock "04d0ca72-cd7c-4dce-a0e7-e59dcd94caa9" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 36.265s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:28.328 4088 3038340493160 MainThread DEBUG nova.compute.manager [req-e7ed6363-d79a-4442-a1e1-e35d7b19a5fc 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Received event network-vif-plugged-889d1613-638f-45b3-8590-8ba5211a3c23 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:59:28.328 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-e7ed6363-d79a-4442-a1e1-e35d7b19a5fc 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "aa775114-9ae9-476f-b4ed-2b6e1846f3bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:28.328 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-e7ed6363-d79a-4442-a1e1-e35d7b19a5fc 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "aa775114-9ae9-476f-b4ed-2b6e1846f3bc-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:28.328 4088 3038340493160 MainThread DEBUG nova.compute.manager [req-e7ed6363-d79a-4442-a1e1-e35d7b19a5fc 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Processing event network-vif-plugged-889d1613-638f-45b3-8590-8ba5211a3c23 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:59:28.368 4088 3038342144248 MainThread INFO nova.virt.hyperv.vmops [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Using config drive for instance 2021-09-10 16:59:28.859 4088 3038342144248 MainThread INFO nova.virt.hyperv.vmops [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Creating config drive at C:\openstack\instances\instance-0000003e\configdrive.iso 2021-09-10 16:59:28.953 4088 3038342144248 MainThread DEBUG oslo_concurrency.processutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000003e\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp5t7vb5er execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:59:29.265 4088 3038342144248 MainThread DEBUG oslo_concurrency.processutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000003e\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp5t7vb5er" returned: 0 in 0.312s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:59:29.784 4088 3038342144248 MainThread DEBUG nova.virt.hyperv.vmops [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Setting boot order for instance: instance-0000003e: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:59:29.874 4088 3038342144248 MainThread DEBUG nova.virt.hyperv.vmops [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:59:29.930 4088 3038342144248 MainThread DEBUG os_win.utils.jobutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Waiting for WMI job: {'InstanceID': '24252AC0-27F0-4410-ACBD-1A5B64B5F2ED', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19615), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:30.078 4088 3038342144248 MainThread ERROR os_win.utils.jobutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003e\' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)instance-0000003e262FAB85-1F59-48B3-890E-65174BBD233512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)instance-0000003e262FAB85-1F59-48B3-890E-65174BBD233510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)instance-0000003e262FAB85-1F59-48B3-890E-65174BBD2335%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '24252AC0-27F0-4410-ACBD-1A5B64B5F2ED', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115514), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 29), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 30), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003e' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)\n\nNot enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)\n\n'instance-0000003e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)", 'ErrorSummaryDescription': "'instance-0000003e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:30.078 4088 3038342144248 MainThread DEBUG os_win._utils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003e' failed to start. Not enough memory in the system to start the virtual machine instance-0000003e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003e' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Not enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) 'instance-0000003e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.2035822868347168 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:30.109 4088 3038338906600 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:30.109 4088 3038338906600 MainThread INFO nova.compute.manager [-] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] VM Stopped (Lifecycle Event) 2021-09-10 16:59:30.112 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:30.112 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:30.112 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-5973713a-9c40-4ff4-9845-6473948900d2 - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:30.132 4088 3038338906600 MainThread DEBUG nova.virt.hyperv.vmops [req-5973713a-9c40-4ff4-9845-6473948900d2 - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:30.176 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-5973713a-9c40-4ff4-9845-6473948900d2 - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:30.188 4088 3038338906600 MainThread INFO nova.compute.manager [req-5973713a-9c40-4ff4-9845-6473948900d2 - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:31.111 4088 3038342144248 MainThread DEBUG os_win.utils.jobutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Waiting for WMI job: {'InstanceID': 'FDB2C05C-1AE5-4EB8-85DD-07F0EDE8EEF4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15709), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:31.204 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "44c45ac4-0d0a-4a8e-8398-7da035a852aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:31.222 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:59:31.254 4088 3038342144248 MainThread ERROR os_win.utils.jobutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003e\' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)instance-0000003e262FAB85-1F59-48B3-890E-65174BBD233512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)instance-0000003e262FAB85-1F59-48B3-890E-65174BBD233510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)instance-0000003e262FAB85-1F59-48B3-890E-65174BBD2335%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'FDB2C05C-1AE5-4EB8-85DD-07F0EDE8EEF4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114277), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 31), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 31), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003e' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)\n\nNot enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)\n\n'instance-0000003e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)", 'ErrorSummaryDescription': "'instance-0000003e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:31.254 4088 3038342144248 MainThread DEBUG os_win._utils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003e' failed to start. Not enough memory in the system to start the virtual machine instance-0000003e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003e' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Not enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) 'instance-0000003e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3796546459197998 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:31.300 4088 3038342146536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:31.300 4088 3038342146536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:31.300 4088 3038342146184 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:31.300 4088 3038342146184 MainThread INFO nova.compute.manager [-] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] VM Stopped (Lifecycle Event) 2021-09-10 16:59:31.331 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-2b396c0e-3c95-413a-bada-95ede32af2c8 - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:31.331 4088 3038342146184 MainThread DEBUG nova.virt.hyperv.vmops [req-2b396c0e-3c95-413a-bada-95ede32af2c8 - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:31.344 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:31.344 4088 3038342147416 MainThread DEBUG nova.virt.hardware [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:59:31.344 4088 3038342147416 MainThread INFO nova.compute.claims [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Claim successful on node n-h2-808474-1 2021-09-10 16:59:31.378 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-2b396c0e-3c95-413a-bada-95ede32af2c8 - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:31.421 4088 3038342146184 MainThread INFO nova.compute.manager [req-2b396c0e-3c95-413a-bada-95ede32af2c8 - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:31.547 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.hostops [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:59:31.562 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.hostops [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:59:31.754 4088 3038342147416 MainThread DEBUG nova.compute.provider_tree [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:59:31.781 4088 3038342147416 MainThread DEBUG nova.scheduler.client.report [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:59:31.781 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:31.781 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:59:31.931 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:59:31.948 4088 3038342146184 GreenThread-52 DEBUG nova.compute.manager [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:59:31.948 4088 3038342146184 GreenThread-52 DEBUG nova.network.neutron [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:59:32.144 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:59:32.171 4088 3038342147416 MainThread INFO nova.virt.hyperv.vmops [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Spawning new instance 2021-09-10 16:59:32.171 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-0000003d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:32.171 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-0000003d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:32.171 4088 3038342147416 MainThread DEBUG nova.block_device [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:59:32.171 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:32.171 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:32.171 4088 3038342147416 MainThread DEBUG os_win.utils.pathutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Creating directory: C:\openstack\instances\instance-0000003d check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:59:32.171 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000003d\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:59:32.272 4088 3038342144248 MainThread DEBUG os_win.utils.jobutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Waiting for WMI job: {'InstanceID': '73C30885-6A0F-489E-AE9F-D784238E5CB7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16064), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:32.412 4088 3038342144248 MainThread ERROR os_win.utils.jobutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003e\' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)instance-0000003e262FAB85-1F59-48B3-890E-65174BBD233512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)instance-0000003e262FAB85-1F59-48B3-890E-65174BBD233510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)instance-0000003e262FAB85-1F59-48B3-890E-65174BBD2335%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '73C30885-6A0F-489E-AE9F-D784238E5CB7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114100), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 32), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 32), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003e' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)\n\nNot enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)\n\n'instance-0000003e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)", 'ErrorSummaryDescription': "'instance-0000003e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:32.412 4088 3038342144248 MainThread DEBUG os_win._utils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003e' failed to start. Not enough memory in the system to start the virtual machine instance-0000003e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003e' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Not enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) 'instance-0000003e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5380218029022217 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:32.452 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Resizing VHD C:\openstack\instances\instance-0000003d\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:59:32.452 4088 3038342258184 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:32.452 4088 3038342258184 MainThread INFO nova.compute.manager [-] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] VM Stopped (Lifecycle Event) 2021-09-10 16:59:32.452 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:32.452 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:32.473 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-74de17e1-8723-4890-9ed5-086064276128 - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:32.473 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.vmops [req-74de17e1-8723-4890-9ed5-086064276128 - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:32.523 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-74de17e1-8723-4890-9ed5-086064276128 - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:32.546 4088 3038342258184 MainThread INFO nova.compute.manager [req-74de17e1-8723-4890-9ed5-086064276128 - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:32.790 4088 3038342146184 GreenThread-52 DEBUG nova.policy [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42267190de3648eea52604e6b2444d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca07d9dc99a4581a698a232ffa065db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:59:33.454 4088 3038342144248 MainThread DEBUG os_win.utils.jobutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Waiting for WMI job: {'InstanceID': '7EEC6627-AF92-45D1-8740-080B628CB6F8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14794), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:33.578 4088 3038342144248 MainThread ERROR os_win.utils.jobutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003e\' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)instance-0000003e262FAB85-1F59-48B3-890E-65174BBD233512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)instance-0000003e262FAB85-1F59-48B3-890E-65174BBD233510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)instance-0000003e262FAB85-1F59-48B3-890E-65174BBD2335%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7EEC6627-AF92-45D1-8740-080B628CB6F8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110060), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 33), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 33), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003e' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)\n\nNot enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)\n\n'instance-0000003e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)", 'ErrorSummaryDescription': "'instance-0000003e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:33.578 4088 3038342144248 MainThread DEBUG os_win._utils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003e' failed to start. Not enough memory in the system to start the virtual machine instance-0000003e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003e' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Not enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) 'instance-0000003e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7033095359802246 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:33.624 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:33.624 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:33.624 4088 3038342258184 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:33.624 4088 3038342258184 MainThread INFO nova.compute.manager [-] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] VM Stopped (Lifecycle Event) 2021-09-10 16:59:33.644 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-8b8784d8-2fe2-4451-b27a-62d66cbb087d - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:33.644 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.vmops [req-8b8784d8-2fe2-4451-b27a-62d66cbb087d - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:33.688 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-8b8784d8-2fe2-4451-b27a-62d66cbb087d - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:33.806 4088 3038342258184 MainThread INFO nova.compute.manager [req-8b8784d8-2fe2-4451-b27a-62d66cbb087d - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:34.624 4088 3038342144248 MainThread DEBUG os_win.utils.jobutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Waiting for WMI job: {'InstanceID': '3FEF9B60-30AE-4EE9-8DF9-115668B5EA9A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15867), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:34.765 4088 3038342144248 MainThread ERROR os_win.utils.jobutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003e\' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)instance-0000003e262FAB85-1F59-48B3-890E-65174BBD233512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)instance-0000003e262FAB85-1F59-48B3-890E-65174BBD233510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)instance-0000003e262FAB85-1F59-48B3-890E-65174BBD2335%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3FEF9B60-30AE-4EE9-8DF9-115668B5EA9A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116541), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 34), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 34), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003e' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)\n\nNot enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)\n\n'instance-0000003e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)", 'ErrorSummaryDescription': "'instance-0000003e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:34.765 4088 3038342144248 MainThread DEBUG os_win._utils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003e' failed to start. Not enough memory in the system to start the virtual machine instance-0000003e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003e' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Not enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) 'instance-0000003e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.890745162963867 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:34.805 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:34.805 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:34.805 4088 3038342258184 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:34.805 4088 3038342258184 MainThread INFO nova.compute.manager [-] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] VM Stopped (Lifecycle Event) 2021-09-10 16:59:34.827 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-fd814349-54af-4aaf-8b35-abeb0449091b - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:34.827 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.vmops [req-fd814349-54af-4aaf-8b35-abeb0449091b - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:34.879 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-fd814349-54af-4aaf-8b35-abeb0449091b - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:34.921 4088 3038342258184 MainThread INFO nova.compute.manager [req-fd814349-54af-4aaf-8b35-abeb0449091b - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:35.796 4088 3038342144248 MainThread DEBUG os_win.utils.jobutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Waiting for WMI job: {'InstanceID': '1023C40A-2902-4287-852E-A351B91CC1DC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15500), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:35.939 4088 3038342144248 MainThread ERROR os_win.utils.jobutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003e\' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)instance-0000003e262FAB85-1F59-48B3-890E-65174BBD233512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)instance-0000003e262FAB85-1F59-48B3-890E-65174BBD233510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)instance-0000003e262FAB85-1F59-48B3-890E-65174BBD2335%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1023C40A-2902-4287-852E-A351B91CC1DC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116831), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 35), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 35), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003e' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)\n\nNot enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)\n\n'instance-0000003e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335)", 'ErrorSummaryDescription': "'instance-0000003e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:35.939 4088 3038342144248 MainThread ERROR nova.virt.hyperv.vmops [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Failed to change vm state of instance-0000003e to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000003e' failed to start. 2021-09-10 16:59:35.939 4088 3038342144248 MainThread INFO nova.virt.hyperv.vmops [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Got request to destroy instance 2021-09-10 16:59:35.969 4088 3038342258184 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:35.969 4088 3038342258184 MainThread INFO nova.compute.manager [-] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] VM Stopped (Lifecycle Event) 2021-09-10 16:59:35.990 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:35.990 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:36.039 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-9b573c97-d018-4ce1-8024-a91862763fc6 - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:36.039 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.vmops [req-9b573c97-d018-4ce1-8024-a91862763fc6 - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:36.093 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-9b573c97-d018-4ce1-8024-a91862763fc6 - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:36.125 4088 3038342258184 MainThread INFO nova.compute.manager [req-9b573c97-d018-4ce1-8024-a91862763fc6 - - - - -] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:36.255 4088 3038342146184 GreenThread-52 DEBUG nova.network.neutron [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Successfully created port: 4502af80-454c-419b-9010-14638dff4c4a _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:59:37.499 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:59:37.499 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 16:59:37.827 4088 3038342144248 MainThread DEBUG nova.virt.hyperv.vmops [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 16:59:37.827 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Lock "instance-0000003e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:37.827 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Lock "instance-0000003e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:37.859 4088 3038342144248 MainThread DEBUG os_win.utils.compute.vmutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Successfully changed vm state of instance-0000003e to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 16:59:37.859 4088 3038342144248 MainThread DEBUG nova.virt.hyperv.vmops [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Successfully changed state of VM instance-0000003e to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 16:59:37.909 4088 3038342144248 MainThread DEBUG os_win.utils.jobutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Waiting for WMI job: {'InstanceID': '01AAF90B-41CD-4D86-BCE1-47F4D0D70D05', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14861), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:38.034 4088 3038342144248 MainThread DEBUG os_win.utils.jobutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] WMI job succeeded: {'InstanceID': '01AAF90B-41CD-4D86-BCE1-47F4D0D70D05', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=101796), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 16:59:38.034 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Lock "instance-0000003e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:38.034 4088 3038342144248 MainThread DEBUG os_win.utils.pathutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Removing directory: C:\openstack\instances\instance-0000003e check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 16:59:38.047 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Lock "instance-0000003e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:38.047 4088 3038342144248 MainThread ERROR nova.compute.manager [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003e' failed to start. Not enough memory in the system to start the virtual machine instance-0000003e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003e' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Not enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) 'instance-0000003e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Error code: 32778. 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Traceback (most recent call last): 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] return function(*args, **kwargs) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] admin_password, network_info, block_device_info) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] return function(self, *args, **kwds) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self.force_reraise() 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] raise self.value 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] should_plug_vifs=False) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 'req_state': req_state}) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self.force_reraise() 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] raise self.value 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] time.sleep(sleep_time) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self.force_reraise() 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] raise self.value 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] return f(*args, **kwargs) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] return self._wait_for_job(job_path) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] error_desc=err_desc) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000003e' failed to start. 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Not enough memory in the system to start the virtual machine instance-0000003e. 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003e' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Not enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 'instance-0000003e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Error code: 32778. 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] During handling of the above exception, another exception occurred: 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Traceback (most recent call last): 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] yield resources 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] accel_info=accel_info) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] return function(*args, **kwargs) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] admin_password, network_info, block_device_info) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] return function(self, *args, **kwds) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self.force_reraise() 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] raise self.value 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] should_plug_vifs=False) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 'req_state': req_state}) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self.force_reraise() 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] raise self.value 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] time.sleep(sleep_time) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self.force_reraise() 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] raise self.value 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] return f(*args, **kwargs) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] return self._wait_for_job(job_path) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] error_desc=err_desc) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003e' failed to start. 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Not enough memory in the system to start the virtual machine instance-0000003e. 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003e' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Not enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 'instance-0000003e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Error code: 32778. 2021-09-10 16:59:38.047 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.047 4088 3038342144248 MainThread INFO nova.compute.manager [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Terminating instance 2021-09-10 16:59:38.047 4088 3038342144248 MainThread DEBUG nova.compute.manager [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 16:59:38.047 4088 3038342144248 MainThread INFO nova.virt.hyperv.vmops [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Got request to destroy instance 2021-09-10 16:59:38.047 4088 3038342144248 MainThread DEBUG nova.virt.hyperv.vmops [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 16:59:38.047 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Lock "instance-0000003e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:38.047 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Lock "instance-0000003e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:38.047 4088 3038342144248 MainThread INFO nova.compute.manager [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Took 0.00 seconds to destroy the instance on the hypervisor. 2021-09-10 16:59:38.047 4088 3038342144248 MainThread DEBUG nova.compute.claims [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 16:59:38.076 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:38.158 4088 3038342144248 MainThread DEBUG nova.virt.hyperv.hostops [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:59:38.187 4088 3038342144248 MainThread DEBUG nova.virt.hyperv.hostops [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:59:38.411 4088 3038342144248 MainThread DEBUG nova.compute.provider_tree [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:59:38.422 4088 3038342144248 MainThread DEBUG nova.scheduler.client.report [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:59:38.422 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.344s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:38.422 4088 3038342144248 MainThread ERROR nova.compute.manager [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003e' failed to start. Not enough memory in the system to start the virtual machine instance-0000003e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003e' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Not enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) 'instance-0000003e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Error code: 32778. 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Traceback (most recent call last): 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] return function(*args, **kwargs) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] admin_password, network_info, block_device_info) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] return function(self, *args, **kwds) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self.force_reraise() 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] raise self.value 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] should_plug_vifs=False) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 'req_state': req_state}) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self.force_reraise() 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] raise self.value 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] time.sleep(sleep_time) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self.force_reraise() 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] raise self.value 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] return f(*args, **kwargs) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] return self._wait_for_job(job_path) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] error_desc=err_desc) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000003e' failed to start. 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Not enough memory in the system to start the virtual machine instance-0000003e. 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003e' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Not enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 'instance-0000003e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Error code: 32778. 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] During handling of the above exception, another exception occurred: 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Traceback (most recent call last): 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] accel_info=accel_info) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] raise exc.with_traceback(exc_info[2]) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] return function(*args, **kwargs) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] admin_password, network_info, block_device_info) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] return function(self, *args, **kwds) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self.destroy(instance, network_info, block_device_info) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self.force_reraise() 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] raise self.value 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] should_plug_vifs=False) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 'req_state': req_state}) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self.force_reraise() 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] raise self.value 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] time.sleep(sleep_time) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self.force_reraise() 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] raise self.value 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] return f(*args, **kwargs) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] return self._wait_for_job(job_path) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] error_desc=err_desc) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003e' failed to start. 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Not enough memory in the system to start the virtual machine instance-0000003e. 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003e' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Not enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 'instance-0000003e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Error code: 32778. 2021-09-10 16:59:38.422 4088 3038342144248 MainThread TRACE nova.compute.manager [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] 2021-09-10 16:59:38.422 4088 3038342144248 MainThread DEBUG nova.compute.utils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] WMI job failed with status 10. Error summary description: 'instance-0000003e' failed to start. Not enough memory in the system to start the virtual machine instance-0000003e. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 16:59:38.422 4088 3038342144248 MainThread DEBUG nova.compute.manager [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Build of instance aa775114-9ae9-476f-b4ed-2b6e1846f3bc was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000003e' failed to start. Not enough memory in the system to start the virtual machine instance-0000003e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003e' failed to start. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Not enough memory in the system to start the virtual machine instance-0000003e with ram size 1024 megabytes. (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) 'instance-0000003e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 262FAB85-1F59-48B3-890E-65174BBD2335) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 16:59:38.422 4088 3038342144248 MainThread DEBUG nova.compute.manager [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 16:59:38.422 4088 3038342144248 MainThread DEBUG nova.compute.manager [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 16:59:38.422 4088 3038342144248 MainThread DEBUG nova.compute.manager [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 16:59:38.445 4088 3038342144248 MainThread DEBUG nova.network.neutron [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 16:59:38.562 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:59:38.562 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:59:38.562 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 16:59:39.198 4088 3038342144248 MainThread DEBUG nova.network.neutron [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:59:39.208 4088 3038342144248 MainThread INFO nova.compute.manager [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] [instance: aa775114-9ae9-476f-b4ed-2b6e1846f3bc] Took 0.77 seconds to deallocate network for instance. 2021-09-10 16:59:39.329 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:59:39.329 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 16:59:39.458 4088 3038342144248 MainThread INFO nova.scheduler.client.report [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Deleted allocations for instance aa775114-9ae9-476f-b4ed-2b6e1846f3bc 2021-09-10 16:59:39.499 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [req-8cb1f46a-0d56-49c9-86a8-a862fc93390a 0db4ede2f101460f9ab63db4d0d76a9a 912aa6945f734abbbd12a58348a3bbbb - default default] Lock "aa775114-9ae9-476f-b4ed-2b6e1846f3bc" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 31.203s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:40.073 4088 3038342146184 GreenThread-52 DEBUG nova.network.neutron [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Successfully updated port: 4502af80-454c-419b-9010-14638dff4c4a _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:59:40.108 4088 3038342146184 GreenThread-52 DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Acquired lock "refresh_cache-44c45ac4-0d0a-4a8e-8398-7da035a852aa" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:59:40.108 4088 3038342146184 GreenThread-52 DEBUG nova.network.neutron [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:59:40.417 4088 3038342146184 GreenThread-52 DEBUG nova.network.neutron [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:59:41.963 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Updating instance_info_cache with network_info: [{"id": "83b451dc-a198-4ccd-9f65-c8fe6343aea3", "address": "fa:16:3e:44:7f:92", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap83b451dc-a1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:59:41.981 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:59:41.981 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 16:59:41.992 4088 3038342146184 GreenThread-52 DEBUG nova.network.neutron [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Updating instance_info_cache with network_info: [{"id": "4502af80-454c-419b-9010-14638dff4c4a", "address": "fa:16:3e:b5:33:f1", "network": {"id": "dcfd5ed7-c94f-4b68-b56f-95b52ddf921f", "bridge": null, "label": "tempest-ImagesTestJSON-1170675645-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6ca07d9dc99a4581a698a232ffa065db", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4502af80-45", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:59:41.992 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:59:41.992 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:59:41.992 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:59:42.001 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:59:42.022 4088 3038342146184 GreenThread-52 DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Releasing lock "refresh_cache-44c45ac4-0d0a-4a8e-8398-7da035a852aa" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:59:42.022 4088 3038342146184 GreenThread-52 DEBUG nova.compute.manager [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Instance network_info: |[{"id": "4502af80-454c-419b-9010-14638dff4c4a", "address": "fa:16:3e:b5:33:f1", "network": {"id": "dcfd5ed7-c94f-4b68-b56f-95b52ddf921f", "bridge": null, "label": "tempest-ImagesTestJSON-1170675645-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6ca07d9dc99a4581a698a232ffa065db", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4502af80-45", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:59:42.022 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Preparing to wait for external event network-vif-plugged-4502af80-454c-419b-9010-14638dff4c4a prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:59:42.022 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "44c45ac4-0d0a-4a8e-8398-7da035a852aa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:42.022 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "44c45ac4-0d0a-4a8e-8398-7da035a852aa-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:42.022 4088 3038342147416 MainThread DEBUG os_win.utils.compute.vmutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Creating VM instance-0000003d create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:59:42.142 4088 3038342254840 MainThread DEBUG nova.compute.manager [req-5ce544bc-7a69-4596-8953-5f0a1a898b5b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Received event network-changed-4502af80-454c-419b-9010-14638dff4c4a external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:59:42.142 4088 3038342254840 MainThread DEBUG nova.compute.manager [req-5ce544bc-7a69-4596-8953-5f0a1a898b5b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Refreshing instance network info cache due to event network-changed-4502af80-454c-419b-9010-14638dff4c4a. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:59:42.142 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [req-5ce544bc-7a69-4596-8953-5f0a1a898b5b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-44c45ac4-0d0a-4a8e-8398-7da035a852aa" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:59:42.142 4088 3038342254840 MainThread DEBUG nova.network.neutron [req-5ce544bc-7a69-4596-8953-5f0a1a898b5b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Refreshing network info cache for port 4502af80-454c-419b-9010-14638dff4c4a _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:59:43.561 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:59:43.675 4088 3038342254840 MainThread DEBUG nova.network.neutron [req-5ce544bc-7a69-4596-8953-5f0a1a898b5b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Updated VIF entry in instance network info cache for port 4502af80-454c-419b-9010-14638dff4c4a. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:59:43.675 4088 3038342254840 MainThread DEBUG nova.network.neutron [req-5ce544bc-7a69-4596-8953-5f0a1a898b5b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Updating instance_info_cache with network_info: [{"id": "4502af80-454c-419b-9010-14638dff4c4a", "address": "fa:16:3e:b5:33:f1", "network": {"id": "dcfd5ed7-c94f-4b68-b56f-95b52ddf921f", "bridge": null, "label": "tempest-ImagesTestJSON-1170675645-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6ca07d9dc99a4581a698a232ffa065db", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4502af80-45", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:59:43.700 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [req-5ce544bc-7a69-4596-8953-5f0a1a898b5b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-44c45ac4-0d0a-4a8e-8398-7da035a852aa" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:59:43.727 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:59:47.546 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 16:59:47.560 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:47.560 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:47.560 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 16:59:47.560 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:59:47.574 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:59:47.803 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2222MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 16:59:47.803 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:48.024 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:59:48.024 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:59:48.024 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:59:48.024 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:59:48.024 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:59:48.024 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:59:48.024 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:59:48.024 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:59:48.024 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:59:48.024 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:59:48.024 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:59:48.024 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:59:48.024 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:59:48.040 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 44c45ac4-0d0a-4a8e-8398-7da035a852aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 16:59:48.040 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 16:59:48.040 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=14GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 16:59:48.077 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:59:48.093 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:59:48.311 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:59:48.313 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:59:48.313 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 16:59:48.313 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:51.799 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "3b8ed741-f00d-4e2b-bac4-95e4f3380c89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:51.842 4088 3038337402136 MainThread DEBUG nova.compute.manager [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 16:59:52.016 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:52.030 4088 3038337402136 MainThread DEBUG nova.virt.hardware [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 16:59:52.030 4088 3038337402136 MainThread INFO nova.compute.claims [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Claim successful on node n-h2-808474-1 2021-09-10 16:59:52.156 4088 3038337402136 MainThread DEBUG nova.virt.hyperv.hostops [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 16:59:52.187 4088 3038337402136 MainThread DEBUG nova.virt.hyperv.hostops [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 16:59:52.285 4088 3038337401960 MainThread DEBUG nova.compute.manager [req-407d5085-c91b-441c-989d-fa72363e5dbf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Received event network-vif-plugged-4502af80-454c-419b-9010-14638dff4c4a external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:59:52.285 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-407d5085-c91b-441c-989d-fa72363e5dbf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "44c45ac4-0d0a-4a8e-8398-7da035a852aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:52.285 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-407d5085-c91b-441c-989d-fa72363e5dbf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "44c45ac4-0d0a-4a8e-8398-7da035a852aa-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:52.285 4088 3038337401960 MainThread DEBUG nova.compute.manager [req-407d5085-c91b-441c-989d-fa72363e5dbf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Processing event network-vif-plugged-4502af80-454c-419b-9010-14638dff4c4a _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 16:59:52.332 4088 3038342147416 MainThread INFO nova.virt.hyperv.vmops [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Using config drive for instance 2021-09-10 16:59:52.437 4088 3038337402136 MainThread DEBUG nova.compute.provider_tree [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 16:59:52.457 4088 3038337402136 MainThread DEBUG nova.scheduler.client.report [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 16:59:52.457 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:52.457 4088 3038337402136 MainThread DEBUG nova.compute.manager [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 16:59:52.530 4088 3038337402136 MainThread DEBUG nova.compute.manager [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 16:59:52.544 4088 3038337402312 GreenThread-53 DEBUG nova.compute.manager [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 16:59:52.544 4088 3038337402312 GreenThread-53 DEBUG nova.network.neutron [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 16:59:52.640 4088 3038342147416 MainThread INFO nova.virt.hyperv.vmops [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Creating config drive at C:\openstack\instances\instance-0000003d\configdrive.iso 2021-09-10 16:59:52.752 4088 3038342147416 MainThread DEBUG oslo_concurrency.processutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000003d\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp4i8hkkbl execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 16:59:52.929 4088 3038337402136 MainThread DEBUG nova.compute.manager [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 16:59:52.944 4088 3038337402136 MainThread INFO nova.virt.hyperv.vmops [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Spawning new instance 2021-09-10 16:59:52.953 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-00000040" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:52.953 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-00000040" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:52.953 4088 3038337402136 MainThread DEBUG nova.block_device [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 16:59:52.953 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:52.953 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:52.953 4088 3038337402136 MainThread DEBUG os_win.utils.pathutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Creating directory: C:\openstack\instances\instance-00000040 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 16:59:52.953 4088 3038337402136 MainThread DEBUG nova.virt.hyperv.vmops [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000040\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 16:59:53.081 4088 3038337403016 MainThread DEBUG nova.compute.manager [req-0cfe6058-7fb7-4e8e-86b6-052a0de84d2a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Received event network-vif-deleted-4d2eb961-863f-4159-93af-5a4180653916 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:59:53.081 4088 3038337402312 GreenThread-53 DEBUG nova.policy [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1711a7b02c2433dacfb4017cd0a812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b9dfa46b614e449b6aff88db2cfd6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 16:59:53.141 4088 3038342147416 MainThread DEBUG oslo_concurrency.processutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000003d\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp4i8hkkbl" returned: 0 in 0.390s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 16:59:53.265 4088 3038337402136 MainThread DEBUG nova.virt.hyperv.vmops [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Resizing VHD C:\openstack\instances\instance-00000040\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 16:59:53.624 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Setting boot order for instance: instance-0000003d: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 16:59:53.730 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 16:59:53.750 4088 3038342147416 MainThread DEBUG os_win.utils.jobutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': '0FF04767-82D9-4A64-BA8A-ED9070FE885D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14834), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:53.890 4088 3038342147416 MainThread ERROR os_win.utils.jobutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003d\' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)instance-0000003d918C9F42-48D0-425E-B742-D4589243CB3912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)instance-0000003d918C9F42-48D0-425E-B742-D4589243CB3910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)instance-0000003d918C9F42-48D0-425E-B742-D4589243CB39%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0FF04767-82D9-4A64-BA8A-ED9070FE885D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111059), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 53), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 53), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003d' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)\n\nNot enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)\n\n'instance-0000003d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)", 'ErrorSummaryDescription': "'instance-0000003d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:53.890 4088 3038342147416 MainThread DEBUG os_win._utils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003d' failed to start. Not enough memory in the system to start the virtual machine instance-0000003d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003d' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Not enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) 'instance-0000003d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.16019678115844727 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:53.936 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:53.950 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:53.950 4088 3038337402840 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:53.950 4088 3038337402840 MainThread INFO nova.compute.manager [-] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] VM Stopped (Lifecycle Event) 2021-09-10 16:59:53.985 4088 3038337402840 MainThread DEBUG nova.compute.manager [req-29ad5226-1889-4318-a6cf-5ad4e5abd5b1 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:53.985 4088 3038337402840 MainThread DEBUG nova.virt.hyperv.vmops [req-29ad5226-1889-4318-a6cf-5ad4e5abd5b1 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:54.033 4088 3038337402840 MainThread DEBUG nova.compute.manager [req-29ad5226-1889-4318-a6cf-5ad4e5abd5b1 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:54.056 4088 3038337402840 MainThread INFO nova.compute.manager [req-29ad5226-1889-4318-a6cf-5ad4e5abd5b1 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:54.122 4088 3038337402312 GreenThread-53 DEBUG nova.network.neutron [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Successfully created port: ff8ed049-7ab2-45c6-a3da-501d081e486a _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 16:59:54.925 4088 3038342147416 MainThread DEBUG os_win.utils.jobutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': 'FA6026F2-6851-433A-9A95-5F1020A0027F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15004), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:55.077 4088 3038342147416 MainThread ERROR os_win.utils.jobutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003d\' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)instance-0000003d918C9F42-48D0-425E-B742-D4589243CB3912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)instance-0000003d918C9F42-48D0-425E-B742-D4589243CB3910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)instance-0000003d918C9F42-48D0-425E-B742-D4589243CB39%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'FA6026F2-6851-433A-9A95-5F1020A0027F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115517), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 54), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 55), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003d' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)\n\nNot enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)\n\n'instance-0000003d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)", 'ErrorSummaryDescription': "'instance-0000003d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:55.077 4088 3038342147416 MainThread DEBUG os_win._utils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003d' failed to start. Not enough memory in the system to start the virtual machine instance-0000003d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003d' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Not enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) 'instance-0000003d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3468799591064453 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:55.093 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:55.093 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:55.093 4088 3038337402840 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:55.093 4088 3038337402840 MainThread INFO nova.compute.manager [-] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] VM Stopped (Lifecycle Event) 2021-09-10 16:59:55.137 4088 3038337402840 MainThread DEBUG nova.compute.manager [req-7bb8bed8-ebed-4fc3-a722-e245de86fcc9 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:55.137 4088 3038337402840 MainThread DEBUG nova.virt.hyperv.vmops [req-7bb8bed8-ebed-4fc3-a722-e245de86fcc9 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:55.185 4088 3038337402840 MainThread DEBUG nova.compute.manager [req-7bb8bed8-ebed-4fc3-a722-e245de86fcc9 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:55.201 4088 3038337402840 MainThread INFO nova.compute.manager [req-7bb8bed8-ebed-4fc3-a722-e245de86fcc9 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:55.282 4088 3038337402312 GreenThread-53 DEBUG nova.network.neutron [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Successfully updated port: ff8ed049-7ab2-45c6-a3da-501d081e486a _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 16:59:55.282 4088 3038337402312 GreenThread-53 DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Acquired lock "refresh_cache-3b8ed741-f00d-4e2b-bac4-95e4f3380c89" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:59:55.282 4088 3038337402312 GreenThread-53 DEBUG nova.network.neutron [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 16:59:55.481 4088 3038337402312 GreenThread-53 DEBUG nova.network.neutron [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 16:59:55.514 4088 3038337402840 MainThread DEBUG nova.compute.manager [req-d8d0eb14-0fc3-4a21-9bb7-2f8f88d3716b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Received event network-changed-ff8ed049-7ab2-45c6-a3da-501d081e486a external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 16:59:55.514 4088 3038337402840 MainThread DEBUG nova.compute.manager [req-d8d0eb14-0fc3-4a21-9bb7-2f8f88d3716b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Refreshing instance network info cache due to event network-changed-ff8ed049-7ab2-45c6-a3da-501d081e486a. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 16:59:56.077 4088 3038337402312 GreenThread-53 DEBUG nova.network.neutron [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Updating instance_info_cache with network_info: [{"id": "ff8ed049-7ab2-45c6-a3da-501d081e486a", "address": "fa:16:3e:f6:38:d6", "network": {"id": "3eb3df69-b47c-4acb-8098-7e28b146140d", "bridge": null, "label": "tempest-ServerDiskConfigTestJSON-1037400376-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e0b9dfa46b614e449b6aff88db2cfd6b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapff8ed049-7a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:59:56.104 4088 3038342147416 MainThread DEBUG os_win.utils.jobutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': 'BE872426-DE8D-413D-80FA-890FCC8197BF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17657), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:56.104 4088 3038337402312 GreenThread-53 DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Releasing lock "refresh_cache-3b8ed741-f00d-4e2b-bac4-95e4f3380c89" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:59:56.104 4088 3038337402312 GreenThread-53 DEBUG nova.compute.manager [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Instance network_info: |[{"id": "ff8ed049-7ab2-45c6-a3da-501d081e486a", "address": "fa:16:3e:f6:38:d6", "network": {"id": "3eb3df69-b47c-4acb-8098-7e28b146140d", "bridge": null, "label": "tempest-ServerDiskConfigTestJSON-1037400376-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e0b9dfa46b614e449b6aff88db2cfd6b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapff8ed049-7a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 16:59:56.104 4088 3038337402136 MainThread DEBUG nova.compute.manager [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Preparing to wait for external event network-vif-plugged-ff8ed049-7ab2-45c6-a3da-501d081e486a prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 16:59:56.104 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "3b8ed741-f00d-4e2b-bac4-95e4f3380c89-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:56.104 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "3b8ed741-f00d-4e2b-bac4-95e4f3380c89-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:56.104 4088 3038337402136 MainThread DEBUG os_win.utils.compute.vmutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Creating VM instance-00000040 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 16:59:56.119 4088 3038337402840 MainThread DEBUG oslo_concurrency.lockutils [req-d8d0eb14-0fc3-4a21-9bb7-2f8f88d3716b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-3b8ed741-f00d-4e2b-bac4-95e4f3380c89" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 16:59:56.119 4088 3038337402840 MainThread DEBUG nova.network.neutron [req-d8d0eb14-0fc3-4a21-9bb7-2f8f88d3716b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Refreshing network info cache for port ff8ed049-7ab2-45c6-a3da-501d081e486a _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 16:59:56.253 4088 3038342147416 MainThread ERROR os_win.utils.jobutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003d\' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)instance-0000003d918C9F42-48D0-425E-B742-D4589243CB3912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)instance-0000003d918C9F42-48D0-425E-B742-D4589243CB3910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)instance-0000003d918C9F42-48D0-425E-B742-D4589243CB39%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BE872426-DE8D-413D-80FA-890FCC8197BF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112676), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 56), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 56), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003d' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)\n\nNot enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)\n\n'instance-0000003d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)", 'ErrorSummaryDescription': "'instance-0000003d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:56.253 4088 3038342147416 MainThread DEBUG os_win._utils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003d' failed to start. Not enough memory in the system to start the virtual machine instance-0000003d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003d' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Not enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) 'instance-0000003d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5233583450317383 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:56.271 4088 3038337402312 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:56.271 4088 3038337402312 MainThread INFO nova.compute.manager [-] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] VM Stopped (Lifecycle Event) 2021-09-10 16:59:56.271 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:56.271 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:56.288 4088 3038337402312 MainThread DEBUG nova.compute.manager [req-5a708d66-b86b-49b0-ba8d-dcde29a8ccf0 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:56.288 4088 3038337402312 MainThread DEBUG nova.virt.hyperv.vmops [req-5a708d66-b86b-49b0-ba8d-dcde29a8ccf0 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:56.528 4088 3038337402312 MainThread DEBUG nova.compute.manager [req-5a708d66-b86b-49b0-ba8d-dcde29a8ccf0 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:56.547 4088 3038337402312 MainThread INFO nova.compute.manager [req-5a708d66-b86b-49b0-ba8d-dcde29a8ccf0 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:56.921 4088 3038337402840 MainThread DEBUG nova.network.neutron [req-d8d0eb14-0fc3-4a21-9bb7-2f8f88d3716b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Updated VIF entry in instance network info cache for port ff8ed049-7ab2-45c6-a3da-501d081e486a. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 16:59:56.921 4088 3038337402840 MainThread DEBUG nova.network.neutron [req-d8d0eb14-0fc3-4a21-9bb7-2f8f88d3716b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Updating instance_info_cache with network_info: [{"id": "ff8ed049-7ab2-45c6-a3da-501d081e486a", "address": "fa:16:3e:f6:38:d6", "network": {"id": "3eb3df69-b47c-4acb-8098-7e28b146140d", "bridge": null, "label": "tempest-ServerDiskConfigTestJSON-1037400376-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e0b9dfa46b614e449b6aff88db2cfd6b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapff8ed049-7a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 16:59:56.921 4088 3038337402840 MainThread DEBUG oslo_concurrency.lockutils [req-d8d0eb14-0fc3-4a21-9bb7-2f8f88d3716b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-3b8ed741-f00d-4e2b-bac4-95e4f3380c89" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 16:59:57.281 4088 3038342147416 MainThread DEBUG os_win.utils.jobutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': 'B5903871-CD2F-4A28-B754-54685CBD693B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16765), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:57.423 4088 3038342147416 MainThread ERROR os_win.utils.jobutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003d\' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)instance-0000003d918C9F42-48D0-425E-B742-D4589243CB3912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)instance-0000003d918C9F42-48D0-425E-B742-D4589243CB3910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)instance-0000003d918C9F42-48D0-425E-B742-D4589243CB39%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B5903871-CD2F-4A28-B754-54685CBD693B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121357), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 57), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 57), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003d' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)\n\nNot enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)\n\n'instance-0000003d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)", 'ErrorSummaryDescription': "'instance-0000003d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:57.437 4088 3038342147416 MainThread DEBUG os_win._utils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003d' failed to start. Not enough memory in the system to start the virtual machine instance-0000003d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003d' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Not enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) 'instance-0000003d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.706653356552124 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:57.453 4088 3038337402840 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:57.453 4088 3038337402840 MainThread INFO nova.compute.manager [-] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] VM Stopped (Lifecycle Event) 2021-09-10 16:59:57.453 4088 3038337402664 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:57.453 4088 3038337402664 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:57.467 4088 3038337402840 MainThread DEBUG nova.compute.manager [req-5ccac70f-77e1-4628-a09e-dadab90dafe2 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:57.467 4088 3038337402840 MainThread DEBUG nova.virt.hyperv.vmops [req-5ccac70f-77e1-4628-a09e-dadab90dafe2 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:57.575 4088 3038337402840 MainThread DEBUG nova.compute.manager [req-5ccac70f-77e1-4628-a09e-dadab90dafe2 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:57.591 4088 3038337402840 MainThread INFO nova.compute.manager [req-5ccac70f-77e1-4628-a09e-dadab90dafe2 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:57.920 4088 3038337402136 MainThread DEBUG nova.virt.hyperv.vmops [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 16:59:58.469 4088 3038342147416 MainThread DEBUG os_win.utils.jobutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': '52406611-D91A-4C38-8221-BB57E570D684', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16276), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:58.619 4088 3038342147416 MainThread ERROR os_win.utils.jobutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003d\' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)instance-0000003d918C9F42-48D0-425E-B742-D4589243CB3912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)instance-0000003d918C9F42-48D0-425E-B742-D4589243CB3910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)instance-0000003d918C9F42-48D0-425E-B742-D4589243CB39%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '52406611-D91A-4C38-8221-BB57E570D684', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114501), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 58), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 58), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003d' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)\n\nNot enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)\n\n'instance-0000003d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)", 'ErrorSummaryDescription': "'instance-0000003d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:58.619 4088 3038342147416 MainThread DEBUG os_win._utils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003d' failed to start. Not enough memory in the system to start the virtual machine instance-0000003d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003d' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Not enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) 'instance-0000003d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.888847589492798 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 16:59:58.655 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:58.655 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:58.655 4088 3038337402312 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:58.655 4088 3038337402312 MainThread INFO nova.compute.manager [-] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] VM Stopped (Lifecycle Event) 2021-09-10 16:59:58.682 4088 3038337402312 MainThread DEBUG nova.compute.manager [req-1f69114c-4f02-4595-95ad-1e5b5c45abb4 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:58.682 4088 3038337402312 MainThread DEBUG nova.virt.hyperv.vmops [req-1f69114c-4f02-4595-95ad-1e5b5c45abb4 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:58.719 4088 3038337402312 MainThread DEBUG nova.compute.manager [req-1f69114c-4f02-4595-95ad-1e5b5c45abb4 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:58.750 4088 3038337402312 MainThread INFO nova.compute.manager [req-1f69114c-4f02-4595-95ad-1e5b5c45abb4 - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 16:59:59.656 4088 3038342147416 MainThread DEBUG os_win.utils.jobutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': '69DAFED7-BCFC-4567-A338-569165E03E0E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15784), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 16:59:59.809 4088 3038342147416 MainThread ERROR os_win.utils.jobutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003d\' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)instance-0000003d918C9F42-48D0-425E-B742-D4589243CB3912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)instance-0000003d918C9F42-48D0-425E-B742-D4589243CB3910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)instance-0000003d918C9F42-48D0-425E-B742-D4589243CB39%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '69DAFED7-BCFC-4567-A338-569165E03E0E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110510), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 16, 59, 59), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 16, 59, 59), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003d' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)\n\nNot enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)\n\n'instance-0000003d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39)", 'ErrorSummaryDescription': "'instance-0000003d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 16:59:59.809 4088 3038342147416 MainThread ERROR nova.virt.hyperv.vmops [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Failed to change vm state of instance-0000003d to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000003d' failed to start. 2021-09-10 16:59:59.813 4088 3038342147416 MainThread INFO nova.virt.hyperv.vmops [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Got request to destroy instance 2021-09-10 16:59:59.813 4088 3038337402312 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 16:59:59.813 4088 3038337402312 MainThread INFO nova.compute.manager [-] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] VM Stopped (Lifecycle Event) 2021-09-10 16:59:59.813 4088 3038337402664 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 16:59:59.813 4088 3038337402664 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 16:59:59.848 4088 3038337402312 MainThread DEBUG nova.compute.manager [req-6189131d-4eaf-4b45-81e3-cf212b5a9d2b - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 16:59:59.848 4088 3038337402312 MainThread DEBUG nova.virt.hyperv.vmops [req-6189131d-4eaf-4b45-81e3-cf212b5a9d2b - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 16:59:59.899 4088 3038337402312 MainThread DEBUG nova.compute.manager [req-6189131d-4eaf-4b45-81e3-cf212b5a9d2b - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 16:59:59.919 4088 3038337402312 MainThread INFO nova.compute.manager [req-6189131d-4eaf-4b45-81e3-cf212b5a9d2b - - - - -] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:01.749 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:00:01.749 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-0000003d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:01.749 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-0000003d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:01.780 4088 3038342147416 MainThread DEBUG os_win.utils.compute.vmutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Successfully changed vm state of instance-0000003d to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:00:01.780 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Successfully changed state of VM instance-0000003d to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:00:01.828 4088 3038342147416 MainThread DEBUG os_win.utils.jobutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': '4069E400-2F01-411E-888F-096AACFAB25C', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14558), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:01.953 4088 3038342147416 MainThread DEBUG os_win.utils.jobutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job succeeded: {'InstanceID': '4069E400-2F01-411E-888F-096AACFAB25C', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=121090), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:00:01.953 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-0000003d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:01.953 4088 3038342147416 MainThread DEBUG os_win.utils.pathutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Removing directory: C:\openstack\instances\instance-0000003d check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:00:01.953 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-0000003d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:01.953 4088 3038342147416 MainThread ERROR nova.compute.manager [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003d' failed to start. Not enough memory in the system to start the virtual machine instance-0000003d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003d' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Not enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) 'instance-0000003d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Error code: 32778. 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Traceback (most recent call last): 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] return function(*args, **kwargs) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] admin_password, network_info, block_device_info) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] return function(self, *args, **kwds) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self.force_reraise() 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] raise self.value 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] should_plug_vifs=False) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 'req_state': req_state}) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self.force_reraise() 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] raise self.value 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] time.sleep(sleep_time) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self.force_reraise() 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] raise self.value 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] return f(*args, **kwargs) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] return self._wait_for_job(job_path) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] error_desc=err_desc) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000003d' failed to start. 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Not enough memory in the system to start the virtual machine instance-0000003d. 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003d' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Not enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 'instance-0000003d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Error code: 32778. 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] During handling of the above exception, another exception occurred: 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Traceback (most recent call last): 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] yield resources 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] accel_info=accel_info) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] return function(*args, **kwargs) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] admin_password, network_info, block_device_info) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] return function(self, *args, **kwds) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self.force_reraise() 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] raise self.value 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] should_plug_vifs=False) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 'req_state': req_state}) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self.force_reraise() 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] raise self.value 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] time.sleep(sleep_time) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self.force_reraise() 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] raise self.value 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] return f(*args, **kwargs) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] return self._wait_for_job(job_path) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] error_desc=err_desc) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003d' failed to start. 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Not enough memory in the system to start the virtual machine instance-0000003d. 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003d' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Not enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 'instance-0000003d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Error code: 32778. 2021-09-10 17:00:01.953 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:01.953 4088 3038342147416 MainThread INFO nova.compute.manager [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Terminating instance 2021-09-10 17:00:01.953 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:00:01.969 4088 3038342147416 MainThread INFO nova.virt.hyperv.vmops [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Got request to destroy instance 2021-09-10 17:00:01.983 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:00:01.983 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-0000003d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:01.983 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-0000003d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:01.983 4088 3038342147416 MainThread INFO nova.compute.manager [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Took 0.01 seconds to destroy the instance on the hypervisor. 2021-09-10 17:00:01.983 4088 3038342147416 MainThread DEBUG nova.compute.claims [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:00:01.983 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:02.076 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.hostops [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:00:02.089 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.hostops [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:00:02.295 4088 3038342147416 MainThread DEBUG nova.compute.provider_tree [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:00:02.311 4088 3038342147416 MainThread DEBUG nova.scheduler.client.report [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:00:02.311 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:02.311 4088 3038342147416 MainThread ERROR nova.compute.manager [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003d' failed to start. Not enough memory in the system to start the virtual machine instance-0000003d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003d' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Not enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) 'instance-0000003d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Error code: 32778. 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Traceback (most recent call last): 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] return function(*args, **kwargs) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] admin_password, network_info, block_device_info) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] return function(self, *args, **kwds) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self.force_reraise() 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] raise self.value 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] should_plug_vifs=False) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 'req_state': req_state}) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self.force_reraise() 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] raise self.value 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] time.sleep(sleep_time) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self.force_reraise() 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] raise self.value 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] return f(*args, **kwargs) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] return self._wait_for_job(job_path) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] error_desc=err_desc) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000003d' failed to start. 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Not enough memory in the system to start the virtual machine instance-0000003d. 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003d' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Not enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 'instance-0000003d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Error code: 32778. 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] During handling of the above exception, another exception occurred: 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Traceback (most recent call last): 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] accel_info=accel_info) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] return function(*args, **kwargs) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] admin_password, network_info, block_device_info) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] return function(self, *args, **kwds) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self.force_reraise() 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] raise self.value 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] should_plug_vifs=False) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 'req_state': req_state}) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self.force_reraise() 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] raise self.value 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] time.sleep(sleep_time) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self.force_reraise() 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] raise self.value 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] return f(*args, **kwargs) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] return self._wait_for_job(job_path) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] error_desc=err_desc) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003d' failed to start. 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Not enough memory in the system to start the virtual machine instance-0000003d. 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003d' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Not enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 'instance-0000003d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Error code: 32778. 2021-09-10 17:00:02.311 4088 3038342147416 MainThread TRACE nova.compute.manager [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] 2021-09-10 17:00:02.326 4088 3038342147416 MainThread DEBUG nova.compute.utils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] WMI job failed with status 10. Error summary description: 'instance-0000003d' failed to start. Not enough memory in the system to start the virtual machine instance-0000003d. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:00:02.326 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Build of instance 44c45ac4-0d0a-4a8e-8398-7da035a852aa was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000003d' failed to start. Not enough memory in the system to start the virtual machine instance-0000003d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003d' failed to start. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Not enough memory in the system to start the virtual machine instance-0000003d with ram size 1024 megabytes. (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) 'instance-0000003d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 918C9F42-48D0-425E-B742-D4589243CB39) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:00:02.330 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:00:02.330 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:00:02.330 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:00:02.330 4088 3038342147416 MainThread DEBUG nova.network.neutron [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:00:03.254 4088 3038342147416 MainThread DEBUG nova.network.neutron [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:03.281 4088 3038342147416 MainThread INFO nova.compute.manager [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 44c45ac4-0d0a-4a8e-8398-7da035a852aa] Took 0.95 seconds to deallocate network for instance. 2021-09-10 17:00:03.482 4088 3038342147416 MainThread INFO nova.scheduler.client.report [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Deleted allocations for instance 44c45ac4-0d0a-4a8e-8398-7da035a852aa 2021-09-10 17:00:03.522 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-56081686-788f-483a-8081-2b43e77477aa 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "44c45ac4-0d0a-4a8e-8398-7da035a852aa" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 32.312s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:06.438 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-169ecebc-6f5b-49fd-a015-c7003560d059 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Received event network-vif-plugged-ff8ed049-7ab2-45c6-a3da-501d081e486a external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:06.438 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-169ecebc-6f5b-49fd-a015-c7003560d059 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "3b8ed741-f00d-4e2b-bac4-95e4f3380c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:06.438 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-169ecebc-6f5b-49fd-a015-c7003560d059 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "3b8ed741-f00d-4e2b-bac4-95e4f3380c89-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:06.438 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-169ecebc-6f5b-49fd-a015-c7003560d059 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Processing event network-vif-plugged-ff8ed049-7ab2-45c6-a3da-501d081e486a _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:00:06.516 4088 3038337402136 MainThread INFO nova.virt.hyperv.vmops [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Using config drive for instance 2021-09-10 17:00:06.844 4088 3038337402136 MainThread INFO nova.virt.hyperv.vmops [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Creating config drive at C:\openstack\instances\instance-00000040\configdrive.iso 2021-09-10 17:00:06.920 4088 3038337402136 MainThread DEBUG oslo_concurrency.processutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000040\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpy7kgnjou execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:00:07.280 4088 3038337402136 MainThread DEBUG oslo_concurrency.processutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000040\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpy7kgnjou" returned: 0 in 0.359s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:00:07.779 4088 3038337402136 MainThread DEBUG nova.virt.hyperv.vmops [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Setting boot order for instance: instance-00000040: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:00:07.876 4088 3038337402136 MainThread DEBUG nova.virt.hyperv.vmops [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:00:07.896 4088 3038337402136 MainThread DEBUG os_win.utils.jobutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': '8BE931BA-6F70-4AD1-9450-EA46D0545584', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14859), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:08.061 4088 3038337402136 MainThread ERROR os_win.utils.jobutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000040\' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)instance-00000040467DCDC3-9A27-4079-8C6C-BC1670BB0FEA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)instance-00000040467DCDC3-9A27-4079-8C6C-BC1670BB0FEA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000040\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)instance-00000040467DCDC3-9A27-4079-8C6C-BC1670BB0FEA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '8BE931BA-6F70-4AD1-9450-EA46D0545584', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115940), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 8), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000040' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)\n\nNot enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)\n\n'instance-00000040' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)", 'ErrorSummaryDescription': "'instance-00000040' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000040.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:08.061 4088 3038337402136 MainThread DEBUG os_win._utils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000040' failed to start. Not enough memory in the system to start the virtual machine instance-00000040. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000040' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Not enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) 'instance-00000040' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18576455116271973 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:08.078 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000040" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:08.078 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000040" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:08.078 4088 3038342147416 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:08.078 4088 3038342147416 MainThread INFO nova.compute.manager [-] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] VM Stopped (Lifecycle Event) 2021-09-10 17:00:08.126 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-a2135ec9-e2c1-4ba1-a85e-a1949cb8cc83 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:08.126 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-a2135ec9-e2c1-4ba1-a85e-a1949cb8cc83 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:08.165 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-a2135ec9-e2c1-4ba1-a85e-a1949cb8cc83 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:08.201 4088 3038342147416 MainThread INFO nova.compute.manager [req-a2135ec9-e2c1-4ba1-a85e-a1949cb8cc83 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:09.076 4088 3038337402136 MainThread DEBUG os_win.utils.jobutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': '0F9A18C4-030E-466C-BCAF-3A65851CDA55', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15506), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:09.217 4088 3038337402136 MainThread ERROR os_win.utils.jobutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000040\' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)instance-00000040467DCDC3-9A27-4079-8C6C-BC1670BB0FEA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)instance-00000040467DCDC3-9A27-4079-8C6C-BC1670BB0FEA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000040\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)instance-00000040467DCDC3-9A27-4079-8C6C-BC1670BB0FEA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0F9A18C4-030E-466C-BCAF-3A65851CDA55', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112729), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 9), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 9), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000040' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)\n\nNot enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)\n\n'instance-00000040' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)", 'ErrorSummaryDescription': "'instance-00000040' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000040.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:09.234 4088 3038337402136 MainThread DEBUG os_win._utils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000040' failed to start. Not enough memory in the system to start the virtual machine instance-00000040. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000040' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Not enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) 'instance-00000040' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.358870506286621 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:09.280 4088 3038342147416 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:09.280 4088 3038342147416 MainThread INFO nova.compute.manager [-] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] VM Stopped (Lifecycle Event) 2021-09-10 17:00:09.280 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000040" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:09.280 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000040" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:09.296 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-3729799a-c403-400b-b289-0b67dc598dd9 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:09.296 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-3729799a-c403-400b-b289-0b67dc598dd9 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:09.342 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-3729799a-c403-400b-b289-0b67dc598dd9 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:09.374 4088 3038342147416 MainThread INFO nova.compute.manager [req-3729799a-c403-400b-b289-0b67dc598dd9 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:10.264 4088 3038337402136 MainThread DEBUG os_win.utils.jobutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': '977893B6-173C-4298-A1FA-8DA00BF35C33', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15537), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:10.420 4088 3038337402136 MainThread ERROR os_win.utils.jobutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000040\' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)instance-00000040467DCDC3-9A27-4079-8C6C-BC1670BB0FEA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)instance-00000040467DCDC3-9A27-4079-8C6C-BC1670BB0FEA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000040\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)instance-00000040467DCDC3-9A27-4079-8C6C-BC1670BB0FEA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '977893B6-173C-4298-A1FA-8DA00BF35C33', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113014), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 10), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 10), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000040' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)\n\nNot enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)\n\n'instance-00000040' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)", 'ErrorSummaryDescription': "'instance-00000040' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000040.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:10.420 4088 3038337402136 MainThread DEBUG os_win._utils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000040' failed to start. Not enough memory in the system to start the virtual machine instance-00000040. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000040' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Not enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) 'instance-00000040' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5444834232330322 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:10.457 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000040" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:10.457 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000040" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:10.457 4088 3038342147416 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:10.457 4088 3038342147416 MainThread INFO nova.compute.manager [-] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] VM Stopped (Lifecycle Event) 2021-09-10 17:00:10.482 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-8c1db466-05ef-4ff4-a22a-4eadf6e73c81 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:10.482 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-8c1db466-05ef-4ff4-a22a-4eadf6e73c81 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:10.530 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-8c1db466-05ef-4ff4-a22a-4eadf6e73c81 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:10.561 4088 3038342147416 MainThread INFO nova.compute.manager [req-8c1db466-05ef-4ff4-a22a-4eadf6e73c81 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:11.462 4088 3038337402136 MainThread DEBUG os_win.utils.jobutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': '155148BD-B863-4D77-8870-071D3B9918BF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17340), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:11.618 4088 3038337402136 MainThread ERROR os_win.utils.jobutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000040\' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)instance-00000040467DCDC3-9A27-4079-8C6C-BC1670BB0FEA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)instance-00000040467DCDC3-9A27-4079-8C6C-BC1670BB0FEA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000040\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)instance-00000040467DCDC3-9A27-4079-8C6C-BC1670BB0FEA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '155148BD-B863-4D77-8870-071D3B9918BF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113706), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 11), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 11), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000040' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)\n\nNot enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)\n\n'instance-00000040' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)", 'ErrorSummaryDescription': "'instance-00000040' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000040.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:11.618 4088 3038337402136 MainThread DEBUG os_win._utils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000040' failed to start. Not enough memory in the system to start the virtual machine instance-00000040. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000040' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Not enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) 'instance-00000040' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7427878379821777 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:11.631 4088 3038337402312 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000040" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:11.631 4088 3038337402312 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000040" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:11.631 4088 3038342147416 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:11.631 4088 3038342147416 MainThread INFO nova.compute.manager [-] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] VM Stopped (Lifecycle Event) 2021-09-10 17:00:11.659 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-76f18a8a-0b2e-447b-ade6-36fe2cc97866 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:11.659 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-76f18a8a-0b2e-447b-ade6-36fe2cc97866 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:11.701 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-76f18a8a-0b2e-447b-ade6-36fe2cc97866 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:11.733 4088 3038342147416 MainThread INFO nova.compute.manager [req-76f18a8a-0b2e-447b-ade6-36fe2cc97866 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:12.658 4088 3038337402136 MainThread DEBUG os_win.utils.jobutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': 'D2E74D02-35A7-4805-B76E-7EDB894F2F0D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19495), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:12.805 4088 3038337402136 MainThread ERROR os_win.utils.jobutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000040\' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)instance-00000040467DCDC3-9A27-4079-8C6C-BC1670BB0FEA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)instance-00000040467DCDC3-9A27-4079-8C6C-BC1670BB0FEA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000040\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)instance-00000040467DCDC3-9A27-4079-8C6C-BC1670BB0FEA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D2E74D02-35A7-4805-B76E-7EDB894F2F0D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117949), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 12), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 12), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000040' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)\n\nNot enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)\n\n'instance-00000040' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)", 'ErrorSummaryDescription': "'instance-00000040' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000040.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:12.805 4088 3038337402136 MainThread DEBUG os_win._utils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000040' failed to start. Not enough memory in the system to start the virtual machine instance-00000040. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000040' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Not enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) 'instance-00000040' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.929131746292114 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:12.826 4088 3038342147416 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:12.826 4088 3038342147416 MainThread INFO nova.compute.manager [-] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] VM Stopped (Lifecycle Event) 2021-09-10 17:00:12.842 4088 3038337402312 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000040" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:12.842 4088 3038337402312 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000040" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:12.858 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-e5b96094-a4b7-4eef-9888-a91ad7937d84 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:12.858 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-e5b96094-a4b7-4eef-9888-a91ad7937d84 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:12.890 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-e5b96094-a4b7-4eef-9888-a91ad7937d84 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:12.937 4088 3038342147416 MainThread INFO nova.compute.manager [req-e5b96094-a4b7-4eef-9888-a91ad7937d84 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:13.830 4088 3038337402136 MainThread DEBUG os_win.utils.jobutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': '4304671B-BFEB-4B1D-8C4D-CB59E274449B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15381), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:13.969 4088 3038337402136 MainThread ERROR os_win.utils.jobutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000040\' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)instance-00000040467DCDC3-9A27-4079-8C6C-BC1670BB0FEA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)instance-00000040467DCDC3-9A27-4079-8C6C-BC1670BB0FEA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000040\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)instance-00000040467DCDC3-9A27-4079-8C6C-BC1670BB0FEA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4304671B-BFEB-4B1D-8C4D-CB59E274449B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111931), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 13), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 13), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000040' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)\n\nNot enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)\n\n'instance-00000040' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA)", 'ErrorSummaryDescription': "'instance-00000040' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000040.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:13.969 4088 3038337402136 MainThread ERROR nova.virt.hyperv.vmops [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Failed to change vm state of instance-00000040 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000040' failed to start. 2021-09-10 17:00:13.969 4088 3038337402136 MainThread INFO nova.virt.hyperv.vmops [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Got request to destroy instance 2021-09-10 17:00:14.014 4088 3038337402312 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000040" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:14.014 4088 3038337402312 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000040" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:14.014 4088 3038342147416 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:14.014 4088 3038342147416 MainThread INFO nova.compute.manager [-] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] VM Stopped (Lifecycle Event) 2021-09-10 17:00:14.034 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-ddb4917d-dc45-47a7-8ec2-4f87aed72469 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:14.034 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-ddb4917d-dc45-47a7-8ec2-4f87aed72469 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:14.093 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-ddb4917d-dc45-47a7-8ec2-4f87aed72469 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:14.110 4088 3038342147416 MainThread INFO nova.compute.manager [req-ddb4917d-dc45-47a7-8ec2-4f87aed72469 - - - - -] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:15.873 4088 3038337402136 MainThread DEBUG nova.virt.hyperv.vmops [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:00:15.873 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-00000040" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:15.873 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-00000040" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:15.873 4088 3038337402136 MainThread DEBUG os_win.utils.compute.vmutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Successfully changed vm state of instance-00000040 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:00:15.873 4088 3038337402136 MainThread DEBUG nova.virt.hyperv.vmops [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Successfully changed state of VM instance-00000040 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:00:15.935 4088 3038337402136 MainThread DEBUG os_win.utils.jobutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': 'B755C9E1-8A29-4042-8F44-26C02912254C', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15384), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:16.050 4088 3038337402136 MainThread DEBUG os_win.utils.jobutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job succeeded: {'InstanceID': 'B755C9E1-8A29-4042-8F44-26C02912254C', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=105550), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:00:16.050 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-00000040" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:16.050 4088 3038337402136 MainThread DEBUG os_win.utils.pathutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Removing directory: C:\openstack\instances\instance-00000040 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:00:16.050 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-00000040" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:16.050 4088 3038337402136 MainThread ERROR nova.compute.manager [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000040' failed to start. Not enough memory in the system to start the virtual machine instance-00000040. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000040' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Not enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) 'instance-00000040' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Error code: 32778. 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Traceback (most recent call last): 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] return function(*args, **kwargs) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] admin_password, network_info, block_device_info) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] return function(self, *args, **kwds) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self.force_reraise() 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] raise self.value 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] should_plug_vifs=False) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 'req_state': req_state}) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self.force_reraise() 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] raise self.value 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] time.sleep(sleep_time) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self.force_reraise() 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] raise self.value 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] return f(*args, **kwargs) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] return self._wait_for_job(job_path) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] error_desc=err_desc) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000040' failed to start. 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Not enough memory in the system to start the virtual machine instance-00000040. 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000040' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Not enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 'instance-00000040' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Error code: 32778. 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] During handling of the above exception, another exception occurred: 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Traceback (most recent call last): 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] yield resources 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] accel_info=accel_info) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] return function(*args, **kwargs) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] admin_password, network_info, block_device_info) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] return function(self, *args, **kwds) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self.force_reraise() 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] raise self.value 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] should_plug_vifs=False) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 'req_state': req_state}) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self.force_reraise() 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] raise self.value 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] time.sleep(sleep_time) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self.force_reraise() 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] raise self.value 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] return f(*args, **kwargs) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] return self._wait_for_job(job_path) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] error_desc=err_desc) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000040' failed to start. 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Not enough memory in the system to start the virtual machine instance-00000040. 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000040' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Not enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 'instance-00000040' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Error code: 32778. 2021-09-10 17:00:16.050 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.076 4088 3038337402136 MainThread INFO nova.compute.manager [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Terminating instance 2021-09-10 17:00:16.078 4088 3038337402136 MainThread DEBUG nova.compute.manager [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:00:16.078 4088 3038337402136 MainThread INFO nova.virt.hyperv.vmops [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Got request to destroy instance 2021-09-10 17:00:16.095 4088 3038337402136 MainThread DEBUG nova.virt.hyperv.vmops [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:00:16.095 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-00000040" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:16.095 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-00000040" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:16.095 4088 3038337402136 MainThread INFO nova.compute.manager [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:00:16.095 4088 3038337402136 MainThread DEBUG nova.compute.claims [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:00:16.095 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:16.201 4088 3038337402136 MainThread DEBUG nova.virt.hyperv.hostops [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:00:16.218 4088 3038337402136 MainThread DEBUG nova.virt.hyperv.hostops [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:00:16.422 4088 3038337402136 MainThread DEBUG nova.compute.provider_tree [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:00:16.452 4088 3038337402136 MainThread DEBUG nova.scheduler.client.report [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:00:16.452 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.359s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:16.452 4088 3038337402136 MainThread ERROR nova.compute.manager [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000040' failed to start. Not enough memory in the system to start the virtual machine instance-00000040. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000040' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Not enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) 'instance-00000040' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Error code: 32778. 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Traceback (most recent call last): 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] return function(*args, **kwargs) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] admin_password, network_info, block_device_info) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] return function(self, *args, **kwds) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self.force_reraise() 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] raise self.value 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] should_plug_vifs=False) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 'req_state': req_state}) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self.force_reraise() 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] raise self.value 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] time.sleep(sleep_time) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self.force_reraise() 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] raise self.value 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] return f(*args, **kwargs) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] return self._wait_for_job(job_path) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] error_desc=err_desc) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000040' failed to start. 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Not enough memory in the system to start the virtual machine instance-00000040. 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000040' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Not enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 'instance-00000040' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Error code: 32778. 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] During handling of the above exception, another exception occurred: 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Traceback (most recent call last): 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] accel_info=accel_info) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] return function(*args, **kwargs) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] admin_password, network_info, block_device_info) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] return function(self, *args, **kwds) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self.force_reraise() 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] raise self.value 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] should_plug_vifs=False) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 'req_state': req_state}) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self.force_reraise() 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] raise self.value 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] time.sleep(sleep_time) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self.force_reraise() 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] raise self.value 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] return f(*args, **kwargs) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] return self._wait_for_job(job_path) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] error_desc=err_desc) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000040' failed to start. 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Not enough memory in the system to start the virtual machine instance-00000040. 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000040' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Not enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 'instance-00000040' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Error code: 32778. 2021-09-10 17:00:16.452 4088 3038337402136 MainThread TRACE nova.compute.manager [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] 2021-09-10 17:00:16.452 4088 3038337402136 MainThread DEBUG nova.compute.utils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] WMI job failed with status 10. Error summary description: 'instance-00000040' failed to start. Not enough memory in the system to start the virtual machine instance-00000040. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:00:16.452 4088 3038337402136 MainThread DEBUG nova.compute.manager [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Build of instance 3b8ed741-f00d-4e2b-bac4-95e4f3380c89 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000040' failed to start. Not enough memory in the system to start the virtual machine instance-00000040. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000040' failed to start. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Not enough memory in the system to start the virtual machine instance-00000040 with ram size 1024 megabytes. (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) 'instance-00000040' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 467DCDC3-9A27-4079-8C6C-BC1670BB0FEA) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:00:16.452 4088 3038337402136 MainThread DEBUG nova.compute.manager [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:00:16.452 4088 3038337402136 MainThread DEBUG nova.compute.manager [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:00:16.452 4088 3038337402136 MainThread DEBUG nova.compute.manager [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:00:16.452 4088 3038337402136 MainThread DEBUG nova.network.neutron [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:00:19.092 4088 3038337402136 MainThread DEBUG nova.network.neutron [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:19.124 4088 3038337402136 MainThread INFO nova.compute.manager [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: 3b8ed741-f00d-4e2b-bac4-95e4f3380c89] Took 2.67 seconds to deallocate network for instance. 2021-09-10 17:00:19.294 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Lock "5b7f9971-39c8-4512-b873-8d2e09fd6941" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:19.305 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:00:19.342 4088 3038337402136 MainThread INFO nova.scheduler.client.report [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Deleted allocations for instance 3b8ed741-f00d-4e2b-bac4-95e4f3380c89 2021-09-10 17:00:19.451 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-9cb72150-302b-4045-8b23-52854b8d14b5 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "3b8ed741-f00d-4e2b-bac4-95e4f3380c89" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 27.656s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:19.451 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:19.451 4088 3038337403368 MainThread DEBUG nova.virt.hardware [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:00:19.451 4088 3038337403368 MainThread INFO nova.compute.claims [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Claim successful on node n-h2-808474-1 2021-09-10 17:00:19.600 4088 3038337403368 MainThread DEBUG nova.virt.hyperv.hostops [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:00:19.600 4088 3038337403368 MainThread DEBUG nova.virt.hyperv.hostops [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:00:19.811 4088 3038337403368 MainThread DEBUG nova.compute.provider_tree [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:00:19.841 4088 3038337403368 MainThread DEBUG nova.scheduler.client.report [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:00:19.841 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:19.841 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:00:19.920 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:00:19.936 4088 3038342255016 GreenThread-54 DEBUG nova.compute.manager [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:00:19.936 4088 3038342255016 GreenThread-54 DEBUG nova.network.neutron [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:00:20.108 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:00:20.123 4088 3038337403368 MainThread INFO nova.virt.hyperv.vmops [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Spawning new instance 2021-09-10 17:00:20.123 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Lock "instance-00000041" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:20.123 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Lock "instance-00000041" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:20.123 4088 3038337403368 MainThread DEBUG nova.block_device [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:00:20.123 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:20.123 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:20.144 4088 3038337403368 MainThread DEBUG os_win.utils.pathutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Creating directory: C:\openstack\instances\instance-00000041 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:00:20.144 4088 3038337403368 MainThread DEBUG nova.virt.hyperv.vmops [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000041\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:00:20.218 4088 3038342255016 GreenThread-54 DEBUG nova.policy [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bab205b0b6fc4ec2b4ffc7f2fdf0a14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966c4d4813584979a85cc2a7055682b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:00:20.381 4088 3038337403368 MainThread DEBUG nova.virt.hyperv.vmops [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Resizing VHD C:\openstack\instances\instance-00000041\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:00:20.919 4088 3038337402136 MainThread DEBUG nova.compute.manager [req-1b6f1328-9f9b-44ae-9339-d6d40806faa7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Received event network-vif-unplugged-88725264-1291-47ff-9cc0-13502b9a8801 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:20.919 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-1b6f1328-9f9b-44ae-9339-d6d40806faa7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "5b7f9971-39c8-4512-b873-8d2e09fd6941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:20.919 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [req-1b6f1328-9f9b-44ae-9339-d6d40806faa7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "5b7f9971-39c8-4512-b873-8d2e09fd6941-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:20.919 4088 3038337402136 MainThread DEBUG nova.compute.manager [req-1b6f1328-9f9b-44ae-9339-d6d40806faa7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] No waiting events found dispatching network-vif-unplugged-88725264-1291-47ff-9cc0-13502b9a8801 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:00:20.919 4088 3038337402136 MainThread WARNING nova.compute.manager [req-1b6f1328-9f9b-44ae-9339-d6d40806faa7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Received unexpected event network-vif-unplugged-88725264-1291-47ff-9cc0-13502b9a8801 for instance with vm_state building and task_state spawning. 2021-09-10 17:00:22.029 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "b1382ef7-107d-4113-a901-1877f9724cd1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:22.060 4088 3038337401960 MainThread DEBUG nova.compute.manager [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:00:22.185 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:22.185 4088 3038337401960 MainThread DEBUG nova.virt.hardware [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:00:22.185 4088 3038337401960 MainThread INFO nova.compute.claims [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Claim successful on node n-h2-808474-1 2021-09-10 17:00:22.389 4088 3038337401960 MainThread DEBUG nova.virt.hyperv.hostops [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:00:22.404 4088 3038337401960 MainThread DEBUG nova.virt.hyperv.hostops [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:00:22.530 4088 3038337403544 MainThread DEBUG nova.compute.manager [req-b1f0728e-4695-4981-8cbe-3a6961cb606e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Received event network-vif-deleted-e54ef2bd-544c-413d-8411-9b83ad7fc56c external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:22.602 4088 3038337401960 MainThread DEBUG nova.compute.provider_tree [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:00:22.638 4088 3038337401960 MainThread DEBUG nova.scheduler.client.report [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:00:22.638 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:22.638 4088 3038337401960 MainThread DEBUG nova.compute.manager [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:00:22.747 4088 3038337401960 MainThread DEBUG nova.compute.manager [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:00:22.747 4088 3038337403544 GreenThread-55 DEBUG nova.compute.manager [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:00:22.747 4088 3038337403544 GreenThread-55 DEBUG nova.network.neutron [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:00:22.795 4088 3038342255016 GreenThread-54 DEBUG nova.network.neutron [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Successfully created port: 50ef1330-cfc1-45aa-a3af-d988dd38849a _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:00:22.951 4088 3038337401960 MainThread DEBUG nova.compute.manager [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:00:22.951 4088 3038337401960 MainThread INFO nova.virt.hyperv.vmops [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Spawning new instance 2021-09-10 17:00:22.967 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000042" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:22.967 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000042" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:22.967 4088 3038337401960 MainThread DEBUG nova.block_device [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:00:22.967 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:22.967 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:22.983 4088 3038337401960 MainThread DEBUG os_win.utils.pathutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Creating directory: C:\openstack\instances\instance-00000042 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:00:22.983 4088 3038337401960 MainThread DEBUG nova.virt.hyperv.vmops [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000042\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:00:23.076 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Lock "0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:23.107 4088 3038340567288 MainThread DEBUG nova.compute.manager [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:00:23.170 4088 3038337403544 GreenThread-55 DEBUG nova.policy [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f286737f0e6452bbe04f42184b6d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df662acac0f043bb8be9c87490878d93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:00:23.207 4088 3038337401960 MainThread DEBUG nova.virt.hyperv.vmops [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Resizing VHD C:\openstack\instances\instance-00000042\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:00:23.207 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:23.232 4088 3038340567288 MainThread DEBUG nova.virt.hardware [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:00:23.232 4088 3038340567288 MainThread INFO nova.compute.claims [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Claim successful on node n-h2-808474-1 2021-09-10 17:00:23.451 4088 3038340567288 MainThread DEBUG nova.virt.hyperv.hostops [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:00:23.467 4088 3038340567288 MainThread DEBUG nova.virt.hyperv.hostops [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:00:23.655 4088 3038340567288 MainThread DEBUG nova.compute.provider_tree [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:00:23.686 4088 3038340567288 MainThread DEBUG nova.scheduler.client.report [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:00:23.686 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:23.686 4088 3038340567288 MainThread DEBUG nova.compute.manager [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:00:23.764 4088 3038340567288 MainThread DEBUG nova.compute.manager [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:00:23.764 4088 3038340567112 GreenThread-56 DEBUG nova.compute.manager [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:00:23.764 4088 3038340567112 GreenThread-56 DEBUG nova.network.neutron [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:00:23.904 4088 3038340567288 MainThread DEBUG nova.compute.manager [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:00:23.920 4088 3038340567288 MainThread INFO nova.virt.hyperv.vmops [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Spawning new instance 2021-09-10 17:00:23.920 4088 3038340567112 GreenThread-56 DEBUG nova.policy [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07d38d374c614cedbb4fed9d7dc73f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1e8ca5b70b4088b2d52a886b333d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:00:23.920 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Lock "instance-00000043" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:23.936 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Lock "instance-00000043" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:23.936 4088 3038340567288 MainThread DEBUG nova.block_device [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:00:23.936 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:23.936 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:23.936 4088 3038340567288 MainThread DEBUG os_win.utils.pathutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Creating directory: C:\openstack\instances\instance-00000043 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:00:23.936 4088 3038340567288 MainThread DEBUG nova.virt.hyperv.vmops [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000043\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:00:24.249 4088 3038340567288 MainThread DEBUG nova.virt.hyperv.vmops [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Resizing VHD C:\openstack\instances\instance-00000043\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:00:24.562 4088 3038340567112 GreenThread-56 DEBUG nova.network.neutron [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Successfully created port: f25712d8-cf20-4b99-9a06-5504137fe07c _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:00:25.295 4088 3038340567112 GreenThread-56 DEBUG nova.network.neutron [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Successfully updated port: f25712d8-cf20-4b99-9a06-5504137fe07c _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:00:25.327 4088 3038340567112 GreenThread-56 DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Acquired lock "refresh_cache-0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:25.327 4088 3038340567112 GreenThread-56 DEBUG nova.network.neutron [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:00:25.466 4088 3038340567112 GreenThread-56 DEBUG nova.network.neutron [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:00:26.169 4088 3038340567640 MainThread DEBUG nova.compute.manager [req-e85c711c-9e87-4417-a0f5-0ad945a74e3a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Received event network-vif-deleted-14fcfe75-bd5b-4648-81e1-e5b0a8862bd7 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:26.202 4088 3038342255016 GreenThread-54 DEBUG nova.network.neutron [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Successfully updated port: 50ef1330-cfc1-45aa-a3af-d988dd38849a _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:00:26.217 4088 3038342255016 GreenThread-54 DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Acquired lock "refresh_cache-5b7f9971-39c8-4512-b873-8d2e09fd6941" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:26.217 4088 3038342255016 GreenThread-54 DEBUG nova.network.neutron [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:00:26.240 4088 3038337403544 GreenThread-55 DEBUG nova.network.neutron [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Successfully created port: 80728b51-8dc8-4c59-900c-a8ca981f59b4 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:00:26.317 4088 3038340567112 GreenThread-56 DEBUG nova.network.neutron [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Updating instance_info_cache with network_info: [{"id": "f25712d8-cf20-4b99-9a06-5504137fe07c", "address": "fa:16:3e:5f:09:8e", "network": {"id": "3a45771a-2941-4756-b943-dca54c4cf7be", "bridge": null, "label": "tempest-InstanceActionsV221TestJSON-397585230-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b1e8ca5b70b4088b2d52a886b333d20", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf25712d8-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:26.357 4088 3038340567112 GreenThread-56 DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Releasing lock "refresh_cache-0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:26.358 4088 3038340567112 GreenThread-56 DEBUG nova.compute.manager [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Instance network_info: |[{"id": "f25712d8-cf20-4b99-9a06-5504137fe07c", "address": "fa:16:3e:5f:09:8e", "network": {"id": "3a45771a-2941-4756-b943-dca54c4cf7be", "bridge": null, "label": "tempest-InstanceActionsV221TestJSON-397585230-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b1e8ca5b70b4088b2d52a886b333d20", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf25712d8-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:00:26.358 4088 3038340567288 MainThread DEBUG nova.compute.manager [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Preparing to wait for external event network-vif-plugged-f25712d8-cf20-4b99-9a06-5504137fe07c prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:00:26.358 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Lock "0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:26.358 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Lock "0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:26.358 4088 3038340567288 MainThread DEBUG os_win.utils.compute.vmutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Creating VM instance-00000043 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:00:26.592 4088 3038342255016 GreenThread-54 DEBUG nova.network.neutron [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:00:27.282 4088 3038340567816 MainThread DEBUG nova.compute.manager [req-7a84fd53-9205-4363-8b00-753f8ac72c23 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Received event network-changed-f25712d8-cf20-4b99-9a06-5504137fe07c external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:27.282 4088 3038340567816 MainThread DEBUG nova.compute.manager [req-7a84fd53-9205-4363-8b00-753f8ac72c23 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Refreshing instance network info cache due to event network-changed-f25712d8-cf20-4b99-9a06-5504137fe07c. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:00:27.282 4088 3038340567816 MainThread DEBUG oslo_concurrency.lockutils [req-7a84fd53-9205-4363-8b00-753f8ac72c23 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:27.282 4088 3038340567816 MainThread DEBUG nova.network.neutron [req-7a84fd53-9205-4363-8b00-753f8ac72c23 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Refreshing network info cache for port f25712d8-cf20-4b99-9a06-5504137fe07c _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:00:27.985 4088 3038340567816 MainThread DEBUG nova.network.neutron [req-7a84fd53-9205-4363-8b00-753f8ac72c23 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Updated VIF entry in instance network info cache for port f25712d8-cf20-4b99-9a06-5504137fe07c. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:00:27.985 4088 3038340567816 MainThread DEBUG nova.network.neutron [req-7a84fd53-9205-4363-8b00-753f8ac72c23 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Updating instance_info_cache with network_info: [{"id": "f25712d8-cf20-4b99-9a06-5504137fe07c", "address": "fa:16:3e:5f:09:8e", "network": {"id": "3a45771a-2941-4756-b943-dca54c4cf7be", "bridge": null, "label": "tempest-InstanceActionsV221TestJSON-397585230-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b1e8ca5b70b4088b2d52a886b333d20", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf25712d8-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:27.999 4088 3038340567816 MainThread DEBUG oslo_concurrency.lockutils [req-7a84fd53-9205-4363-8b00-753f8ac72c23 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:28.125 4088 3038340567288 MainThread DEBUG nova.virt.hyperv.vmops [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:00:28.497 4088 3038342255016 GreenThread-54 DEBUG nova.network.neutron [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Updating instance_info_cache with network_info: [{"id": "50ef1330-cfc1-45aa-a3af-d988dd38849a", "address": "fa:16:3e:58:10:e9", "network": {"id": "96edf7ac-f423-4067-abd8-1b3f2098a058", "bridge": null, "label": "tempest-ServerActionsTestJSON-421244876-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "966c4d4813584979a85cc2a7055682b3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap50ef1330-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:28.531 4088 3038342255016 GreenThread-54 DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Releasing lock "refresh_cache-5b7f9971-39c8-4512-b873-8d2e09fd6941" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:28.531 4088 3038342255016 GreenThread-54 DEBUG nova.compute.manager [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Instance network_info: |[{"id": "50ef1330-cfc1-45aa-a3af-d988dd38849a", "address": "fa:16:3e:58:10:e9", "network": {"id": "96edf7ac-f423-4067-abd8-1b3f2098a058", "bridge": null, "label": "tempest-ServerActionsTestJSON-421244876-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "966c4d4813584979a85cc2a7055682b3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap50ef1330-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:00:28.531 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Preparing to wait for external event network-vif-plugged-50ef1330-cfc1-45aa-a3af-d988dd38849a prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:00:28.531 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Lock "5b7f9971-39c8-4512-b873-8d2e09fd6941-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:28.531 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Lock "5b7f9971-39c8-4512-b873-8d2e09fd6941-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:28.531 4088 3038337403368 MainThread DEBUG os_win.utils.compute.vmutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Creating VM instance-00000041 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:00:28.812 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:28.858 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:00:28.890 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-804aeff0-3790-437c-9336-06da263359ad 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Received event network-changed-50ef1330-cfc1-45aa-a3af-d988dd38849a external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:28.890 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-804aeff0-3790-437c-9336-06da263359ad 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Refreshing instance network info cache due to event network-changed-50ef1330-cfc1-45aa-a3af-d988dd38849a. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:00:28.890 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-804aeff0-3790-437c-9336-06da263359ad 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-5b7f9971-39c8-4512-b873-8d2e09fd6941" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:28.890 4088 3038342147416 MainThread DEBUG nova.network.neutron [req-804aeff0-3790-437c-9336-06da263359ad 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Refreshing network info cache for port 50ef1330-cfc1-45aa-a3af-d988dd38849a _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:00:28.985 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:28.985 4088 3038340568520 MainThread DEBUG nova.virt.hardware [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:00:28.985 4088 3038340568520 MainThread INFO nova.compute.claims [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Claim successful on node n-h2-808474-1 2021-09-10 17:00:29.123 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.hostops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:00:29.138 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.hostops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:00:29.359 4088 3038340568520 MainThread DEBUG nova.compute.provider_tree [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:00:29.373 4088 3038340568520 MainThread DEBUG nova.scheduler.client.report [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:00:29.373 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:29.389 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:00:29.466 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:00:29.466 4088 3038340568344 GreenThread-57 DEBUG nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:00:29.466 4088 3038340568344 GreenThread-57 DEBUG nova.network.neutron [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:00:29.547 4088 3038340568520 MainThread INFO nova.virt.block_device [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Booting with volume 29c54fbe-e8c1-401b-a427-b0b007cae3a7 at /dev/sda 2021-09-10 17:00:29.640 4088 3038340568520 MainThread DEBUG os_brick.utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:00:29.640 4088 3038340568520 MainThread DEBUG os_brick.utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] <== get_connector_properties: return (0ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:00:29.640 4088 3038340568520 MainThread DEBUG nova.virt.block_device [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Updating existing volume attachment record: 1e264320-e76f-4902-b55b-a57545d82beb _volume_attach c:\openstack\build\nova\nova\virt\block_device.py:556 2021-09-10 17:00:29.748 4088 3038340568344 GreenThread-57 DEBUG nova.policy [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e257d97e390840179aaf42ec0308f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00087122c344aa8a15842d2b03f9a16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:00:30.203 4088 3038337403544 GreenThread-55 DEBUG nova.network.neutron [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Successfully updated port: 80728b51-8dc8-4c59-900c-a8ca981f59b4 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:00:30.219 4088 3038337403544 GreenThread-55 DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Acquired lock "refresh_cache-b1382ef7-107d-4113-a901-1877f9724cd1" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:30.219 4088 3038337403544 GreenThread-55 DEBUG nova.network.neutron [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:00:30.316 4088 3038337403368 MainThread DEBUG nova.virt.hyperv.vmops [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:00:30.748 4088 3038340568344 GreenThread-57 DEBUG nova.network.neutron [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Successfully created port: 538c2fc9-baf4-42d7-93b3-2607925180ca _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:00:31.155 4088 3038337403544 GreenThread-55 DEBUG nova.network.neutron [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:00:31.599 4088 3038342147416 MainThread DEBUG nova.network.neutron [req-804aeff0-3790-437c-9336-06da263359ad 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Updated VIF entry in instance network info cache for port 50ef1330-cfc1-45aa-a3af-d988dd38849a. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:00:31.622 4088 3038342147416 MainThread DEBUG nova.network.neutron [req-804aeff0-3790-437c-9336-06da263359ad 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Updating instance_info_cache with network_info: [{"id": "50ef1330-cfc1-45aa-a3af-d988dd38849a", "address": "fa:16:3e:58:10:e9", "network": {"id": "96edf7ac-f423-4067-abd8-1b3f2098a058", "bridge": null, "label": "tempest-ServerActionsTestJSON-421244876-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "966c4d4813584979a85cc2a7055682b3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap50ef1330-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:31.624 4088 3038340568344 GreenThread-57 DEBUG nova.network.neutron [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Successfully created port: 0ae80e1f-4a5a-4c17-86ac-430359d3999e _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:00:31.639 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-804aeff0-3790-437c-9336-06da263359ad 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-5b7f9971-39c8-4512-b873-8d2e09fd6941" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:31.953 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "4cd8ee20-649d-4e14-8c26-085e78ef091d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:31.969 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:00:32.248 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:32.248 4088 3038340570104 MainThread DEBUG nova.virt.hardware [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:00:32.248 4088 3038340570104 MainThread INFO nova.compute.claims [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Claim successful on node n-h2-808474-1 2021-09-10 17:00:32.435 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.hostops [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:00:32.454 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.hostops [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:00:32.576 4088 3038340568344 GreenThread-57 DEBUG nova.network.neutron [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Successfully created port: f6422a3d-802b-4117-928d-1ca451d20e4b _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:00:32.678 4088 3038340570104 MainThread DEBUG nova.compute.provider_tree [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:00:32.702 4088 3038340570104 MainThread DEBUG nova.scheduler.client.report [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:00:32.702 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:32.702 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:00:32.799 4088 3038337403544 GreenThread-55 DEBUG nova.network.neutron [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Updating instance_info_cache with network_info: [{"id": "80728b51-8dc8-4c59-900c-a8ca981f59b4", "address": "fa:16:3e:40:42:2e", "network": {"id": "5b608de7-ebcb-494c-bcfe-060ce4426ed6", "bridge": null, "label": "tempest-ServersTestJSON-497725561-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "df662acac0f043bb8be9c87490878d93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap80728b51-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:32.862 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:00:32.888 4088 3038337403720 GreenThread-58 DEBUG nova.compute.manager [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:00:32.888 4088 3038337403720 GreenThread-58 DEBUG nova.network.neutron [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:00:32.888 4088 3038337403544 GreenThread-55 DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Releasing lock "refresh_cache-b1382ef7-107d-4113-a901-1877f9724cd1" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:32.888 4088 3038337403544 GreenThread-55 DEBUG nova.compute.manager [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Instance network_info: |[{"id": "80728b51-8dc8-4c59-900c-a8ca981f59b4", "address": "fa:16:3e:40:42:2e", "network": {"id": "5b608de7-ebcb-494c-bcfe-060ce4426ed6", "bridge": null, "label": "tempest-ServersTestJSON-497725561-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "df662acac0f043bb8be9c87490878d93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap80728b51-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:00:32.888 4088 3038337401960 MainThread DEBUG nova.compute.manager [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Preparing to wait for external event network-vif-plugged-80728b51-8dc8-4c59-900c-a8ca981f59b4 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:00:32.888 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "b1382ef7-107d-4113-a901-1877f9724cd1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:32.888 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "b1382ef7-107d-4113-a901-1877f9724cd1-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:32.888 4088 3038337401960 MainThread DEBUG os_win.utils.compute.vmutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Creating VM instance-00000042 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:00:32.906 4088 3038337403544 MainThread DEBUG nova.compute.manager [req-86475826-90f9-4682-a31f-4ed4cb2fd62a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Received event network-changed-80728b51-8dc8-4c59-900c-a8ca981f59b4 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:32.906 4088 3038337403544 MainThread DEBUG nova.compute.manager [req-86475826-90f9-4682-a31f-4ed4cb2fd62a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Refreshing instance network info cache due to event network-changed-80728b51-8dc8-4c59-900c-a8ca981f59b4. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:00:32.906 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [req-86475826-90f9-4682-a31f-4ed4cb2fd62a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-b1382ef7-107d-4113-a901-1877f9724cd1" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:32.906 4088 3038337403544 MainThread DEBUG nova.network.neutron [req-86475826-90f9-4682-a31f-4ed4cb2fd62a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Refreshing network info cache for port 80728b51-8dc8-4c59-900c-a8ca981f59b4 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:00:33.049 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:00:33.072 4088 3038340570104 MainThread INFO nova.virt.hyperv.vmops [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Spawning new instance 2021-09-10 17:00:33.310 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000044" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:33.310 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000044" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:33.310 4088 3038340570104 MainThread DEBUG nova.block_device [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:00:33.310 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:33.310 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:33.326 4088 3038340570104 MainThread DEBUG os_win.utils.pathutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Creating directory: C:\openstack\instances\instance-00000044 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:00:33.326 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000044\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:00:33.343 4088 3038337403720 GreenThread-58 DEBUG nova.policy [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42267190de3648eea52604e6b2444d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca07d9dc99a4581a698a232ffa065db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:00:33.548 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Resizing VHD C:\openstack\instances\instance-00000044\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:00:33.752 4088 3038340568344 GreenThread-57 DEBUG nova.network.neutron [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Successfully created port: c2d9bf38-2b6d-4a34-b975-f3967b383e21 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:00:34.793 4088 3038340568344 GreenThread-57 DEBUG nova.network.neutron [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Successfully created port: 6709b293-b51f-4901-9ca4-bef117b27521 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:00:34.973 4088 3038337401960 MainThread DEBUG nova.virt.hyperv.vmops [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:00:35.002 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Lock "6d2c0c79-952c-46e8-9d1f-e8c9891d61d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:35.021 4088 3038359392856 MainThread DEBUG nova.compute.manager [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:00:35.185 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:35.185 4088 3038359392856 MainThread DEBUG nova.virt.hardware [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:00:35.185 4088 3038359392856 MainThread INFO nova.compute.claims [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Claim successful on node n-h2-808474-1 2021-09-10 17:00:35.393 4088 3038359392856 MainThread DEBUG nova.virt.hyperv.hostops [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:00:35.393 4088 3038359392856 MainThread DEBUG nova.virt.hyperv.hostops [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:00:35.453 4088 3038340569928 MainThread DEBUG nova.compute.manager [req-3d9eb7f5-11a6-412c-afbb-bbc996f31f18 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Received event network-vif-plugged-f25712d8-cf20-4b99-9a06-5504137fe07c external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:35.453 4088 3038340569928 MainThread DEBUG oslo_concurrency.lockutils [req-3d9eb7f5-11a6-412c-afbb-bbc996f31f18 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:35.453 4088 3038340569928 MainThread DEBUG oslo_concurrency.lockutils [req-3d9eb7f5-11a6-412c-afbb-bbc996f31f18 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:35.453 4088 3038340569928 MainThread DEBUG nova.compute.manager [req-3d9eb7f5-11a6-412c-afbb-bbc996f31f18 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Processing event network-vif-plugged-f25712d8-cf20-4b99-9a06-5504137fe07c _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:00:35.487 4088 3038340567288 MainThread INFO nova.virt.hyperv.vmops [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Using config drive for instance 2021-09-10 17:00:35.623 4088 3038340568344 GreenThread-57 DEBUG nova.network.neutron [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Successfully updated port: 538c2fc9-baf4-42d7-93b3-2607925180ca _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:00:35.644 4088 3038359392856 MainThread DEBUG nova.compute.provider_tree [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:00:35.657 4088 3038359392856 MainThread DEBUG nova.scheduler.client.report [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:00:35.657 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:35.657 4088 3038359392856 MainThread DEBUG nova.compute.manager [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:00:35.759 4088 3038359392856 MainThread DEBUG nova.compute.manager [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:00:35.759 4088 3038359393032 GreenThread-59 DEBUG nova.compute.manager [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Not allocating networking since 'none' was specified. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1752 2021-09-10 17:00:36.201 4088 3038359392856 MainThread DEBUG nova.compute.manager [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:00:36.201 4088 3038359392856 MainThread INFO nova.virt.hyperv.vmops [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Spawning new instance 2021-09-10 17:00:36.221 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Lock "instance-00000045" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:36.221 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Lock "instance-00000045" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:36.221 4088 3038359392856 MainThread DEBUG nova.block_device [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:00:36.221 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:36.221 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:36.221 4088 3038337403544 MainThread DEBUG nova.network.neutron [req-86475826-90f9-4682-a31f-4ed4cb2fd62a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Updated VIF entry in instance network info cache for port 80728b51-8dc8-4c59-900c-a8ca981f59b4. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:00:36.221 4088 3038337403544 MainThread DEBUG nova.network.neutron [req-86475826-90f9-4682-a31f-4ed4cb2fd62a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Updating instance_info_cache with network_info: [{"id": "80728b51-8dc8-4c59-900c-a8ca981f59b4", "address": "fa:16:3e:40:42:2e", "network": {"id": "5b608de7-ebcb-494c-bcfe-060ce4426ed6", "bridge": null, "label": "tempest-ServersTestJSON-497725561-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "df662acac0f043bb8be9c87490878d93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap80728b51-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:36.221 4088 3038359392856 MainThread DEBUG os_win.utils.pathutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Creating directory: C:\openstack\instances\instance-00000045 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:00:36.221 4088 3038359392856 MainThread DEBUG nova.virt.hyperv.vmops [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000045\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:00:36.247 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [req-86475826-90f9-4682-a31f-4ed4cb2fd62a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-b1382ef7-107d-4113-a901-1877f9724cd1" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:36.481 4088 3038359392856 MainThread DEBUG nova.virt.hyperv.vmops [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Resizing VHD C:\openstack\instances\instance-00000045\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:00:36.518 4088 3038340567288 MainThread INFO nova.virt.hyperv.vmops [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Creating config drive at C:\openstack\instances\instance-00000043\configdrive.iso 2021-09-10 17:00:36.607 4088 3038340567288 MainThread DEBUG oslo_concurrency.processutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000043\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp1fhnttkm execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:00:36.736 4088 3038337403720 GreenThread-58 DEBUG nova.network.neutron [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Successfully created port: d5da25c9-248e-40c0-86df-338b851250b2 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:00:36.764 4088 3038340568344 GreenThread-57 DEBUG nova.network.neutron [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Successfully updated port: b922a519-3efc-4024-abfb-de5c20d9d578 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:00:36.832 4088 3038359392856 MainThread DEBUG os_win.utils.compute.vmutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Creating VM instance-00000045 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:00:36.832 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-97e6c739-95b7-48f9-92d2-a1a68840d9c3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Received event network-vif-deleted-f9c6f4bd-5e92-4933-9603-748e36371cfe external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:36.919 4088 3038340567288 MainThread DEBUG oslo_concurrency.processutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000043\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp1fhnttkm" returned: 0 in 0.313s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:00:37.053 4088 3038340570456 MainThread DEBUG nova.compute.manager [req-00b43298-f73f-449b-b8ce-244e61e8ac7e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-changed-538c2fc9-baf4-42d7-93b3-2607925180ca external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:37.053 4088 3038340570456 MainThread DEBUG nova.compute.manager [req-00b43298-f73f-449b-b8ce-244e61e8ac7e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Refreshing instance network info cache due to event network-changed-538c2fc9-baf4-42d7-93b3-2607925180ca. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:00:37.053 4088 3038340570456 MainThread DEBUG oslo_concurrency.lockutils [req-00b43298-f73f-449b-b8ce-244e61e8ac7e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-b0745679-4000-4aff-bd0a-29ded4711f24" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:37.053 4088 3038340570456 MainThread DEBUG nova.network.neutron [req-00b43298-f73f-449b-b8ce-244e61e8ac7e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Refreshing network info cache for port 538c2fc9-baf4-42d7-93b3-2607925180ca _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:00:37.328 4088 3038340570456 MainThread DEBUG nova.network.neutron [req-00b43298-f73f-449b-b8ce-244e61e8ac7e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:00:37.643 4088 3038340568344 GreenThread-57 DEBUG nova.network.neutron [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Successfully updated port: 46dd9dca-3150-45cc-9a35-bc1230d1380e _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:00:37.717 4088 3038340567288 MainThread DEBUG nova.virt.hyperv.vmops [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Setting boot order for instance: instance-00000043: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:00:37.874 4088 3038340567288 MainThread DEBUG nova.virt.hyperv.vmops [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:00:37.919 4088 3038340567288 MainThread DEBUG os_win.utils.jobutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Waiting for WMI job: {'InstanceID': '6F0606D1-1D82-45DD-B8E3-433C4895B395', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19423), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:38.075 4088 3038340567288 MainThread ERROR os_win.utils.jobutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000043\' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)instance-00000043A1475BF6-7780-4245-9767-7C927CF2EDA712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)instance-00000043A1475BF6-7780-4245-9767-7C927CF2EDA710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000043\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)instance-00000043A1475BF6-7780-4245-9767-7C927CF2EDA7%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6F0606D1-1D82-45DD-B8E3-433C4895B395', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117880), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 37), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 38), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000043' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)\n\nNot enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)\n\n'instance-00000043' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)", 'ErrorSummaryDescription': "'instance-00000043' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000043.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:38.075 4088 3038340567288 MainThread DEBUG os_win._utils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000043' failed to start. Not enough memory in the system to start the virtual machine instance-00000043. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000043' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Not enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) 'instance-00000043' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.2017073631286621 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:38.178 4088 3038337403544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:38.178 4088 3038337403544 MainThread INFO nova.compute.manager [-] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] VM Stopped (Lifecycle Event) 2021-09-10 17:00:38.178 4088 3038359393032 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000043" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:38.178 4088 3038359393032 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000043" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:38.216 4088 3038359393032 MainThread DEBUG nova.compute.manager [req-09e01a61-afee-491a-88c1-f7b4cb329db1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Received event network-vif-plugged-50ef1330-cfc1-45aa-a3af-d988dd38849a external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:38.216 4088 3038359393032 MainThread DEBUG oslo_concurrency.lockutils [req-09e01a61-afee-491a-88c1-f7b4cb329db1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "5b7f9971-39c8-4512-b873-8d2e09fd6941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:38.216 4088 3038359393032 MainThread DEBUG oslo_concurrency.lockutils [req-09e01a61-afee-491a-88c1-f7b4cb329db1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "5b7f9971-39c8-4512-b873-8d2e09fd6941-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:38.216 4088 3038359393032 MainThread DEBUG nova.compute.manager [req-09e01a61-afee-491a-88c1-f7b4cb329db1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Processing event network-vif-plugged-50ef1330-cfc1-45aa-a3af-d988dd38849a _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:00:38.231 4088 3038337403544 MainThread DEBUG nova.compute.manager [req-77e2def3-5d8f-459c-ba84-69ddbd189797 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:38.231 4088 3038337403544 MainThread DEBUG nova.virt.hyperv.vmops [req-77e2def3-5d8f-459c-ba84-69ddbd189797 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:38.278 4088 3038337403368 MainThread INFO nova.virt.hyperv.vmops [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Using config drive for instance 2021-09-10 17:00:38.278 4088 3038337403544 MainThread DEBUG nova.compute.manager [req-77e2def3-5d8f-459c-ba84-69ddbd189797 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:38.309 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:00:38.309 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:00:38.345 4088 3038337403544 MainThread INFO nova.compute.manager [req-77e2def3-5d8f-459c-ba84-69ddbd189797 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:38.544 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:00:38.544 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:00:38.544 4088 3038340568344 GreenThread-57 DEBUG nova.network.neutron [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Successfully updated port: 0ae80e1f-4a5a-4c17-86ac-430359d3999e _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:00:38.749 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-9db39d70-5120-4de4-bb87-480a6efb8a3a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:38.749 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:00:38.980 4088 3038340570456 MainThread DEBUG nova.network.neutron [req-00b43298-f73f-449b-b8ce-244e61e8ac7e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:39.000 4088 3038340570456 MainThread DEBUG oslo_concurrency.lockutils [req-00b43298-f73f-449b-b8ce-244e61e8ac7e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-b0745679-4000-4aff-bd0a-29ded4711f24" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:39.062 4088 3038337403368 MainThread INFO nova.virt.hyperv.vmops [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Creating config drive at C:\openstack\instances\instance-00000041\configdrive.iso 2021-09-10 17:00:39.173 4088 3038337403368 MainThread DEBUG oslo_concurrency.processutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000041\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp8fwqnuru execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:00:39.346 4088 3038340567288 MainThread DEBUG os_win.utils.jobutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Waiting for WMI job: {'InstanceID': '9A36BAB8-F607-4E58-AB30-91D43379BDA0', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15006), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:39.490 4088 3038340567288 MainThread ERROR os_win.utils.jobutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000043\' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)instance-00000043A1475BF6-7780-4245-9767-7C927CF2EDA712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)instance-00000043A1475BF6-7780-4245-9767-7C927CF2EDA710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000043\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)instance-00000043A1475BF6-7780-4245-9767-7C927CF2EDA7%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9A36BAB8-F607-4E58-AB30-91D43379BDA0', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118403), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 39), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 39), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000043' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)\n\nNot enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)\n\n'instance-00000043' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)", 'ErrorSummaryDescription': "'instance-00000043' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000043.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:39.498 4088 3038340567288 MainThread DEBUG os_win._utils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000043' failed to start. Not enough memory in the system to start the virtual machine instance-00000043. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000043' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Not enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) 'instance-00000043' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.6245720386505127 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:39.533 4088 3038337403368 MainThread DEBUG oslo_concurrency.processutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000041\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp8fwqnuru" returned: 0 in 0.359s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:00:39.622 4088 3038340570456 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:39.641 4088 3038340570456 MainThread INFO nova.compute.manager [-] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] VM Stopped (Lifecycle Event) 2021-09-10 17:00:39.641 4088 3038340569224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000043" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:39.641 4088 3038340569224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000043" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:39.669 4088 3038340570456 MainThread DEBUG nova.compute.manager [req-ac383a61-d4e8-4d4f-b8fe-40487aff5921 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:39.669 4088 3038340570456 MainThread DEBUG nova.virt.hyperv.vmops [req-ac383a61-d4e8-4d4f-b8fe-40487aff5921 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:39.732 4088 3038340570456 MainThread DEBUG nova.compute.manager [req-ac383a61-d4e8-4d4f-b8fe-40487aff5921 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:39.764 4088 3038340570456 MainThread INFO nova.compute.manager [req-ac383a61-d4e8-4d4f-b8fe-40487aff5921 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:39.764 4088 3038337403720 GreenThread-58 DEBUG nova.network.neutron [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Successfully updated port: d5da25c9-248e-40c0-86df-338b851250b2 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:00:39.794 4088 3038337403720 GreenThread-58 DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Acquired lock "refresh_cache-4cd8ee20-649d-4e14-8c26-085e78ef091d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:39.794 4088 3038337403720 GreenThread-58 DEBUG nova.network.neutron [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:00:39.865 4088 3038359392856 MainThread INFO nova.virt.hyperv.vmops [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Using config drive for instance 2021-09-10 17:00:40.010 4088 3038359392856 MainThread INFO nova.virt.hyperv.vmops [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Creating config drive at C:\openstack\instances\instance-00000045\configdrive.iso 2021-09-10 17:00:40.107 4088 3038359392856 MainThread DEBUG oslo_concurrency.processutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000045\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpqf8iyw1b execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:00:40.248 4088 3038340568344 GreenThread-57 DEBUG nova.network.neutron [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Successfully updated port: f6422a3d-802b-4117-928d-1ca451d20e4b _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:00:40.263 4088 3038337403720 GreenThread-58 DEBUG nova.network.neutron [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:00:40.281 4088 3038340569928 MainThread DEBUG nova.compute.manager [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-changed-b922a519-3efc-4024-abfb-de5c20d9d578 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:40.281 4088 3038340569928 MainThread DEBUG nova.compute.manager [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Refreshing instance network info cache due to event network-changed-b922a519-3efc-4024-abfb-de5c20d9d578. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:00:40.281 4088 3038340569928 MainThread DEBUG oslo_concurrency.lockutils [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-b0745679-4000-4aff-bd0a-29ded4711f24" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:40.281 4088 3038340569928 MainThread DEBUG nova.network.neutron [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Refreshing network info cache for port b922a519-3efc-4024-abfb-de5c20d9d578 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:00:40.379 4088 3038340568520 MainThread INFO nova.virt.block_device [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Booting with volume 11b5cce0-1a22-4820-b4b0-bcc0b921fc84 at /dev/sdb 2021-09-10 17:00:40.424 4088 3038359392856 MainThread DEBUG oslo_concurrency.processutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000045\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpqf8iyw1b" returned: 0 in 0.313s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:00:40.472 4088 3038337403368 MainThread DEBUG nova.virt.hyperv.vmops [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Setting boot order for instance: instance-00000041: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:00:40.472 4088 3038340568520 MainThread DEBUG os_brick.utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:00:40.472 4088 3038340568520 MainThread DEBUG os_brick.utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] <== get_connector_properties: return (0ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:00:40.472 4088 3038340568520 MainThread DEBUG nova.virt.block_device [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Updating existing volume attachment record: 53879feb-6dd6-4d52-90fb-25547de8d109 _volume_attach c:\openstack\build\nova\nova\virt\block_device.py:556 2021-09-10 17:00:40.544 4088 3038340567288 MainThread DEBUG os_win.utils.jobutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Waiting for WMI job: {'InstanceID': '7AACD814-BE73-47F8-A599-A4DA09D8A1A9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18304), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:40.577 4088 3038337403368 MainThread DEBUG nova.virt.hyperv.vmops [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:00:40.615 4088 3038337403368 MainThread DEBUG os_win.utils.jobutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Waiting for WMI job: {'InstanceID': 'D0006BA5-6F0F-4D1F-B5A7-A59549CED17F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17078), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:40.669 4088 3038340569928 MainThread DEBUG nova.network.neutron [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:00:40.694 4088 3038340567288 MainThread ERROR os_win.utils.jobutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000043\' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)instance-00000043A1475BF6-7780-4245-9767-7C927CF2EDA712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)instance-00000043A1475BF6-7780-4245-9767-7C927CF2EDA710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000043\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)instance-00000043A1475BF6-7780-4245-9767-7C927CF2EDA7%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7AACD814-BE73-47F8-A599-A4DA09D8A1A9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121572), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 40), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 40), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000043' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)\n\nNot enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)\n\n'instance-00000043' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)", 'ErrorSummaryDescription': "'instance-00000043' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000043.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:40.708 4088 3038340567288 MainThread DEBUG os_win._utils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000043' failed to start. Not enough memory in the system to start the virtual machine instance-00000043. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000043' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Not enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) 'instance-00000043' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.8199589252471924 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:40.708 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Updating instance_info_cache with network_info: [{"id": "66953b8a-00d2-4045-8dae-abe4c015822d", "address": "fa:16:3e:7a:90:37", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap66953b8a-00", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:40.733 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-9db39d70-5120-4de4-bb87-480a6efb8a3a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:40.733 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:00:40.733 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:00:40.733 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:00:40.733 4088 3038342255016 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:40.733 4088 3038342255016 MainThread INFO nova.compute.manager [-] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] VM Stopped (Lifecycle Event) 2021-09-10 17:00:40.733 4088 3038359393208 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000043" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:40.733 4088 3038359393208 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000043" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:40.762 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-c47798ac-3e34-4535-adce-899dd6c617b9 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:40.762 4088 3038342255016 MainThread DEBUG nova.virt.hyperv.vmops [req-c47798ac-3e34-4535-adce-899dd6c617b9 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:40.879 4088 3038337403368 MainThread ERROR os_win.utils.jobutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000041\' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)instance-00000041947E8625-959B-4E4D-8C88-F064D586758812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)instance-00000041947E8625-959B-4E4D-8C88-F064D586758810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000041\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)instance-00000041947E8625-959B-4E4D-8C88-F064D5867588%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D0006BA5-6F0F-4D1F-B5A7-A59549CED17F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=202863), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 40), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 40), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000041' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)\n\nNot enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)\n\n'instance-00000041' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)", 'ErrorSummaryDescription': "'instance-00000041' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000041.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:40.892 4088 3038337403368 MainThread DEBUG os_win._utils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000041' failed to start. Not enough memory in the system to start the virtual machine instance-00000041. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000041' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Not enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) 'instance-00000041' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.3145558834075928 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:40.926 4088 3038359393208 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:40.926 4088 3038359393208 MainThread INFO nova.compute.manager [-] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] VM Stopped (Lifecycle Event) 2021-09-10 17:00:40.926 4088 3038359393560 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000041" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:40.926 4088 3038359393560 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000041" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:40.926 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-c47798ac-3e34-4535-adce-899dd6c617b9 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:40.952 4088 3038359393208 MainThread DEBUG nova.compute.manager [req-aa9c606a-a33c-463f-be70-10144b1b8b99 - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:40.952 4088 3038359393208 MainThread DEBUG nova.virt.hyperv.vmops [req-aa9c606a-a33c-463f-be70-10144b1b8b99 - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:40.972 4088 3038342255016 MainThread INFO nova.compute.manager [req-c47798ac-3e34-4535-adce-899dd6c617b9 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:41.014 4088 3038359393208 MainThread DEBUG nova.compute.manager [req-aa9c606a-a33c-463f-be70-10144b1b8b99 - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:41.033 4088 3038359393208 MainThread INFO nova.compute.manager [req-aa9c606a-a33c-463f-be70-10144b1b8b99 - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:41.081 4088 3038359392856 MainThread DEBUG nova.virt.hyperv.vmops [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Setting boot order for instance: instance-00000045: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:00:41.174 4088 3038340568344 GreenThread-57 DEBUG nova.network.neutron [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Successfully updated port: c2d9bf38-2b6d-4a34-b975-f3967b383e21 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:00:41.204 4088 3038359392856 MainThread DEBUG nova.virt.hyperv.vmops [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:00:41.264 4088 3038359392856 MainThread DEBUG os_win.utils.jobutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Waiting for WMI job: {'InstanceID': 'A08C4978-5E18-45A7-A09E-7570C9C342DF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=28695), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:41.420 4088 3038359392856 MainThread ERROR os_win.utils.jobutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000045\' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)instance-00000045435C237B-4D58-4CB8-AFD7-007D88B13FC012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)instance-00000045435C237B-4D58-4CB8-AFD7-007D88B13FC010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000045\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)instance-00000045435C237B-4D58-4CB8-AFD7-007D88B13FC0%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A08C4978-5E18-45A7-A09E-7570C9C342DF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111503), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 41), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 41), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000045' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)\n\nNot enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)\n\n'instance-00000045' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)", 'ErrorSummaryDescription': "'instance-00000045' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000045.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:41.420 4088 3038359392856 MainThread DEBUG os_win._utils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000045' failed to start. Not enough memory in the system to start the virtual machine instance-00000045. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000045' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Not enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) 'instance-00000045' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.21683835983276367 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:41.420 4088 3038342255016 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:41.420 4088 3038342255016 MainThread INFO nova.compute.manager [-] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] VM Stopped (Lifecycle Event) 2021-09-10 17:00:41.450 4088 3038359393736 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000045" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:41.450 4088 3038359393736 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000045" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:41.467 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-e3523ecc-eb71-489c-bd89-9fc3f5e858f7 - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:41.467 4088 3038342255016 MainThread DEBUG nova.virt.hyperv.vmops [req-e3523ecc-eb71-489c-bd89-9fc3f5e858f7 - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:41.528 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-e3523ecc-eb71-489c-bd89-9fc3f5e858f7 - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:41.544 4088 3038342255016 MainThread INFO nova.compute.manager [req-e3523ecc-eb71-489c-bd89-9fc3f5e858f7 - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:41.734 4088 3038340567288 MainThread DEBUG os_win.utils.jobutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Waiting for WMI job: {'InstanceID': 'E1810685-85DD-4B62-BDA2-6A9B94965318', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21252), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:41.750 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:00:41.893 4088 3038340567288 MainThread ERROR os_win.utils.jobutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000043\' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)instance-00000043A1475BF6-7780-4245-9767-7C927CF2EDA712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)instance-00000043A1475BF6-7780-4245-9767-7C927CF2EDA710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000043\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)instance-00000043A1475BF6-7780-4245-9767-7C927CF2EDA7%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E1810685-85DD-4B62-BDA2-6A9B94965318', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=129490), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 41), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 41), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000043' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)\n\nNot enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)\n\n'instance-00000043' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)", 'ErrorSummaryDescription': "'instance-00000043' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000043.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:41.893 4088 3038340567288 MainThread DEBUG os_win._utils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000043' failed to start. Not enough memory in the system to start the virtual machine instance-00000043. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000043' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Not enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) 'instance-00000043' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 4.019644498825073 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:41.951 4088 3038342255016 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:41.951 4088 3038342255016 MainThread INFO nova.compute.manager [-] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] VM Stopped (Lifecycle Event) 2021-09-10 17:00:41.971 4088 3038359393736 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000043" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:41.971 4088 3038359393736 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000043" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:41.971 4088 3038337403368 MainThread DEBUG os_win.utils.jobutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Waiting for WMI job: {'InstanceID': '0E065C93-6EE9-4739-BA86-CFFC51B2D9B2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20359), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:41.991 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-7af82e0c-9361-4d56-ba0a-8a3af4893c15 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:41.991 4088 3038342255016 MainThread DEBUG nova.virt.hyperv.vmops [req-7af82e0c-9361-4d56-ba0a-8a3af4893c15 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:42.045 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-7af82e0c-9361-4d56-ba0a-8a3af4893c15 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:42.066 4088 3038340568344 GreenThread-57 DEBUG nova.network.neutron [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Successfully updated port: 6709b293-b51f-4901-9ca4-bef117b27521 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:00:42.112 4088 3038342255016 MainThread INFO nova.compute.manager [req-7af82e0c-9361-4d56-ba0a-8a3af4893c15 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:42.187 4088 3038342255016 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:42.187 4088 3038342255016 MainThread INFO nova.compute.manager [-] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] VM Stopped (Lifecycle Event) 2021-09-10 17:00:42.187 4088 3038340568872 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000041" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:42.187 4088 3038340568872 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000041" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:42.221 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-a93de4c0-5fe1-4de1-ad4d-75e30ec2bae0 - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:42.221 4088 3038342255016 MainThread DEBUG nova.virt.hyperv.vmops [req-a93de4c0-5fe1-4de1-ad4d-75e30ec2bae0 - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:42.264 4088 3038337403368 MainThread ERROR os_win.utils.jobutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000041\' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)instance-00000041947E8625-959B-4E4D-8C88-F064D586758812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)instance-00000041947E8625-959B-4E4D-8C88-F064D586758810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000041\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)instance-00000041947E8625-959B-4E4D-8C88-F064D5867588%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0E065C93-6EE9-4739-BA86-CFFC51B2D9B2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=152901), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 41), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 42), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000041' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)\n\nNot enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)\n\n'instance-00000041' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)", 'ErrorSummaryDescription': "'instance-00000041' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000041.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:42.264 4088 3038337403368 MainThread DEBUG os_win._utils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000041' failed to start. Not enough memory in the system to start the virtual machine instance-00000041. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000041' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Not enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) 'instance-00000041' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.6866822242736816 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:42.264 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-a93de4c0-5fe1-4de1-ad4d-75e30ec2bae0 - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:42.316 4088 3038342255016 MainThread INFO nova.compute.manager [req-a93de4c0-5fe1-4de1-ad4d-75e30ec2bae0 - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:42.422 4088 3038340569928 MainThread DEBUG nova.network.neutron [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:42.422 4088 3038340569928 MainThread DEBUG oslo_concurrency.lockutils [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-b0745679-4000-4aff-bd0a-29ded4711f24" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:42.422 4088 3038340569928 MainThread DEBUG nova.compute.manager [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-changed-46dd9dca-3150-45cc-9a35-bc1230d1380e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:42.442 4088 3038340569928 MainThread DEBUG nova.compute.manager [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Refreshing instance network info cache due to event network-changed-46dd9dca-3150-45cc-9a35-bc1230d1380e. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:00:42.442 4088 3038340569928 MainThread DEBUG oslo_concurrency.lockutils [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-b0745679-4000-4aff-bd0a-29ded4711f24" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:42.442 4088 3038340569928 MainThread DEBUG nova.network.neutron [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Refreshing network info cache for port 46dd9dca-3150-45cc-9a35-bc1230d1380e _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:00:42.466 4088 3038359392856 MainThread DEBUG os_win.utils.jobutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Waiting for WMI job: {'InstanceID': 'AA6A8BCD-9BD9-4DC7-9E12-9E2DE619FA86', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=28843), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:42.550 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:00:42.608 4088 3038359392856 MainThread ERROR os_win.utils.jobutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000045\' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)instance-00000045435C237B-4D58-4CB8-AFD7-007D88B13FC012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)instance-00000045435C237B-4D58-4CB8-AFD7-007D88B13FC010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000045\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)instance-00000045435C237B-4D58-4CB8-AFD7-007D88B13FC0%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'AA6A8BCD-9BD9-4DC7-9E12-9E2DE619FA86', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117134), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 42), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 42), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000045' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)\n\nNot enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)\n\n'instance-00000045' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)", 'ErrorSummaryDescription': "'instance-00000045' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000045.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:42.608 4088 3038359392856 MainThread DEBUG os_win._utils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000045' failed to start. Not enough memory in the system to start the virtual machine instance-00000045. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000045' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Not enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) 'instance-00000045' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.404792070388794 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:42.628 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:00:42.659 4088 3038359393208 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000045" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:42.659 4088 3038359393208 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000045" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:42.675 4088 3038359393736 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:42.675 4088 3038359393736 MainThread INFO nova.compute.manager [-] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] VM Stopped (Lifecycle Event) 2021-09-10 17:00:42.675 4088 3038359393736 MainThread DEBUG nova.compute.manager [req-a012012c-68db-4be8-a3fe-db765e6139e0 - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:42.675 4088 3038359393736 MainThread DEBUG nova.virt.hyperv.vmops [req-a012012c-68db-4be8-a3fe-db765e6139e0 - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:42.705 4088 3038340569928 MainThread DEBUG nova.network.neutron [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:00:42.762 4088 3038359393736 MainThread DEBUG nova.compute.manager [req-a012012c-68db-4be8-a3fe-db765e6139e0 - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:42.778 4088 3038337403720 GreenThread-58 DEBUG nova.network.neutron [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Updating instance_info_cache with network_info: [{"id": "d5da25c9-248e-40c0-86df-338b851250b2", "address": "fa:16:3e:42:b8:c6", "network": {"id": "dcfd5ed7-c94f-4b68-b56f-95b52ddf921f", "bridge": null, "label": "tempest-ImagesTestJSON-1170675645-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6ca07d9dc99a4581a698a232ffa065db", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd5da25c9-24", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:42.797 4088 3038337403720 GreenThread-58 DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Releasing lock "refresh_cache-4cd8ee20-649d-4e14-8c26-085e78ef091d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:42.797 4088 3038337403720 GreenThread-58 DEBUG nova.compute.manager [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Instance network_info: |[{"id": "d5da25c9-248e-40c0-86df-338b851250b2", "address": "fa:16:3e:42:b8:c6", "network": {"id": "dcfd5ed7-c94f-4b68-b56f-95b52ddf921f", "bridge": null, "label": "tempest-ImagesTestJSON-1170675645-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6ca07d9dc99a4581a698a232ffa065db", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd5da25c9-24", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:00:42.797 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Preparing to wait for external event network-vif-plugged-d5da25c9-248e-40c0-86df-338b851250b2 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:00:42.797 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "4cd8ee20-649d-4e14-8c26-085e78ef091d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:42.797 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "4cd8ee20-649d-4e14-8c26-085e78ef091d-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:42.797 4088 3038340570104 MainThread DEBUG os_win.utils.compute.vmutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Creating VM instance-00000044 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:00:42.797 4088 3038359393736 MainThread INFO nova.compute.manager [req-a012012c-68db-4be8-a3fe-db765e6139e0 - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:42.919 4088 3038340567288 MainThread DEBUG os_win.utils.jobutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Waiting for WMI job: {'InstanceID': 'CF0EA324-5160-4756-A13E-7290A651F370', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20481), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:43.169 4088 3038340567288 MainThread ERROR os_win.utils.jobutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000043\' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)instance-00000043A1475BF6-7780-4245-9767-7C927CF2EDA712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)instance-00000043A1475BF6-7780-4245-9767-7C927CF2EDA710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000043\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)instance-00000043A1475BF6-7780-4245-9767-7C927CF2EDA7%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'CF0EA324-5160-4756-A13E-7290A651F370', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=139840), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 42), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 43), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000043' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)\n\nNot enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)\n\n'instance-00000043' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)", 'ErrorSummaryDescription': "'instance-00000043' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000043.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:43.190 4088 3038340567288 MainThread DEBUG os_win._utils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000043' failed to start. Not enough memory in the system to start the virtual machine instance-00000043. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000043' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Not enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) 'instance-00000043' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.31660795211792 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:43.222 4088 3038337403720 MainThread DEBUG nova.compute.manager [req-de11b336-29b5-42a1-8de3-71896556db84 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Received event network-changed-d5da25c9-248e-40c0-86df-338b851250b2 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:43.222 4088 3038337403720 MainThread DEBUG nova.compute.manager [req-de11b336-29b5-42a1-8de3-71896556db84 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Refreshing instance network info cache due to event network-changed-d5da25c9-248e-40c0-86df-338b851250b2. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:00:43.222 4088 3038337403720 MainThread DEBUG oslo_concurrency.lockutils [req-de11b336-29b5-42a1-8de3-71896556db84 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-4cd8ee20-649d-4e14-8c26-085e78ef091d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:43.222 4088 3038337403720 MainThread DEBUG nova.network.neutron [req-de11b336-29b5-42a1-8de3-71896556db84 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Refreshing network info cache for port d5da25c9-248e-40c0-86df-338b851250b2 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:00:43.222 4088 3038340569928 MainThread DEBUG nova.network.neutron [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:43.266 4088 3038337403544 MainThread DEBUG nova.compute.manager [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-changed-f6422a3d-802b-4117-928d-1ca451d20e4b external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:43.266 4088 3038337403544 MainThread DEBUG nova.compute.manager [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Refreshing instance network info cache due to event network-changed-f6422a3d-802b-4117-928d-1ca451d20e4b. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:00:43.266 4088 3038340569928 MainThread DEBUG oslo_concurrency.lockutils [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-b0745679-4000-4aff-bd0a-29ded4711f24" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:43.266 4088 3038340569928 MainThread DEBUG nova.compute.manager [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-changed-0ae80e1f-4a5a-4c17-86ac-430359d3999e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:43.266 4088 3038340569928 MainThread DEBUG nova.compute.manager [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Refreshing instance network info cache due to event network-changed-0ae80e1f-4a5a-4c17-86ac-430359d3999e. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:00:43.266 4088 3038340569928 MainThread DEBUG oslo_concurrency.lockutils [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-b0745679-4000-4aff-bd0a-29ded4711f24" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:43.266 4088 3038340569928 MainThread DEBUG nova.network.neutron [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Refreshing network info cache for port 0ae80e1f-4a5a-4c17-86ac-430359d3999e _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:00:43.284 4088 3038359393560 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000043" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:43.284 4088 3038359393560 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000043" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:43.284 4088 3038359393208 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:43.284 4088 3038359393208 MainThread INFO nova.compute.manager [-] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] VM Stopped (Lifecycle Event) 2021-09-10 17:00:43.315 4088 3038359393208 MainThread DEBUG nova.compute.manager [req-0c6aa5e8-3dee-4fcd-9c2e-0904273c206e - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:43.315 4088 3038359393208 MainThread DEBUG nova.virt.hyperv.vmops [req-0c6aa5e8-3dee-4fcd-9c2e-0904273c206e - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:43.315 4088 3038337403368 MainThread DEBUG os_win.utils.jobutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Waiting for WMI job: {'InstanceID': '87FE8060-5C3A-4DA3-B61A-D27942AF82E7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=32680), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:43.372 4088 3038359393208 MainThread DEBUG nova.compute.manager [req-0c6aa5e8-3dee-4fcd-9c2e-0904273c206e - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:43.409 4088 3038359393208 MainThread INFO nova.compute.manager [req-0c6aa5e8-3dee-4fcd-9c2e-0904273c206e - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:43.482 4088 3038337403368 MainThread ERROR os_win.utils.jobutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000041\' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)instance-00000041947E8625-959B-4E4D-8C88-F064D586758812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)instance-00000041947E8625-959B-4E4D-8C88-F064D586758810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000041\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)instance-00000041947E8625-959B-4E4D-8C88-F064D5867588%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '87FE8060-5C3A-4DA3-B61A-D27942AF82E7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=157194), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 43), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 43), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000041' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)\n\nNot enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)\n\n'instance-00000041' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)", 'ErrorSummaryDescription': "'instance-00000041' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000041.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:43.482 4088 3038337403368 MainThread DEBUG os_win._utils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000041' failed to start. Not enough memory in the system to start the virtual machine instance-00000041. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000041' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Not enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) 'instance-00000041' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.905136823654175 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:43.528 4088 3038359393736 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:43.528 4088 3038359393736 MainThread INFO nova.compute.manager [-] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] VM Stopped (Lifecycle Event) 2021-09-10 17:00:43.528 4088 3038359393208 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000041" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:43.528 4088 3038359393208 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000041" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:43.552 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:00:43.561 4088 3038359393736 MainThread DEBUG nova.compute.manager [req-f0becace-aee5-440a-b758-c484f22e70cc - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:43.561 4088 3038359393736 MainThread DEBUG nova.virt.hyperv.vmops [req-f0becace-aee5-440a-b758-c484f22e70cc - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:43.594 4088 3038340569928 MainThread DEBUG nova.network.neutron [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:00:43.669 4088 3038359392856 MainThread DEBUG os_win.utils.jobutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Waiting for WMI job: {'InstanceID': 'A63C0F04-CC76-43AE-8F74-853FA21A0B17', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=22043), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:43.669 4088 3038359393736 MainThread DEBUG nova.compute.manager [req-f0becace-aee5-440a-b758-c484f22e70cc - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:43.711 4088 3038359393736 MainThread INFO nova.compute.manager [req-f0becace-aee5-440a-b758-c484f22e70cc - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:43.829 4088 3038359392856 MainThread ERROR os_win.utils.jobutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000045\' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)instance-00000045435C237B-4D58-4CB8-AFD7-007D88B13FC012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)instance-00000045435C237B-4D58-4CB8-AFD7-007D88B13FC010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000045\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)instance-00000045435C237B-4D58-4CB8-AFD7-007D88B13FC0%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A63C0F04-CC76-43AE-8F74-853FA21A0B17', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=108736), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 43), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 43), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000045' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)\n\nNot enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)\n\n'instance-00000045' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)", 'ErrorSummaryDescription': "'instance-00000045' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000045.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:43.829 4088 3038359392856 MainThread DEBUG os_win._utils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000045' failed to start. Not enough memory in the system to start the virtual machine instance-00000045. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000045' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Not enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) 'instance-00000045' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.62565541267395 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:44.283 4088 3038340567288 MainThread DEBUG os_win.utils.jobutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Waiting for WMI job: {'InstanceID': '0EB13B8B-1670-438D-B160-33888C951FA4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=31253), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:44.451 4088 3038340567288 MainThread ERROR os_win.utils.jobutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000043\' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)instance-00000043A1475BF6-7780-4245-9767-7C927CF2EDA712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)instance-00000043A1475BF6-7780-4245-9767-7C927CF2EDA710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000043\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)instance-00000043A1475BF6-7780-4245-9767-7C927CF2EDA7%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0EB13B8B-1670-438D-B160-33888C951FA4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=147978), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 44), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 44), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000043' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)\n\nNot enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)\n\n'instance-00000043' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7)", 'ErrorSummaryDescription': "'instance-00000043' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000043.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:44.451 4088 3038340567288 MainThread ERROR nova.virt.hyperv.vmops [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Failed to change vm state of instance-00000043 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000043' failed to start. 2021-09-10 17:00:44.451 4088 3038340567288 MainThread INFO nova.virt.hyperv.vmops [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Got request to destroy instance 2021-09-10 17:00:44.502 4088 3038359393736 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:44.502 4088 3038359393736 MainThread INFO nova.compute.manager [-] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] VM Stopped (Lifecycle Event) 2021-09-10 17:00:44.502 4088 3038359393560 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000043" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:44.502 4088 3038359393560 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000043" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:44.530 4088 3038359393736 MainThread DEBUG nova.compute.manager [req-acabda27-01f6-4f57-99f5-6fafb1994a92 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:44.530 4088 3038359393736 MainThread DEBUG nova.virt.hyperv.vmops [req-acabda27-01f6-4f57-99f5-6fafb1994a92 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:44.530 4088 3038337403368 MainThread DEBUG os_win.utils.jobutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Waiting for WMI job: {'InstanceID': '1844FECB-F863-410B-96D2-95A9A35C5CF6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=26624), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:44.550 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:00:44.614 4088 3038359393736 MainThread DEBUG nova.compute.manager [req-acabda27-01f6-4f57-99f5-6fafb1994a92 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:44.658 4088 3038359393736 MainThread INFO nova.compute.manager [req-acabda27-01f6-4f57-99f5-6fafb1994a92 - - - - -] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:44.690 4088 3038296676664 GreenThread-2 INFO nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running instance usage audit for host n-h2-808474-1 from 2021-09-10 16:00:00 to 2021-09-10 17:00:00. 13 instances. 2021-09-10 17:00:44.690 4088 3038340569928 MainThread DEBUG nova.network.neutron [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:44.753 4088 3038340569928 MainThread DEBUG oslo_concurrency.lockutils [req-3d49262c-f525-44c3-8443-c61473344da5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-b0745679-4000-4aff-bd0a-29ded4711f24" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:44.753 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-b0745679-4000-4aff-bd0a-29ded4711f24" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:44.753 4088 3038337403544 MainThread DEBUG nova.network.neutron [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Refreshing network info cache for port f6422a3d-802b-4117-928d-1ca451d20e4b _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:00:44.753 4088 3038337403368 MainThread ERROR os_win.utils.jobutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000041\' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)instance-00000041947E8625-959B-4E4D-8C88-F064D586758812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)instance-00000041947E8625-959B-4E4D-8C88-F064D586758810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000041\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)instance-00000041947E8625-959B-4E4D-8C88-F064D5867588%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1844FECB-F863-410B-96D2-95A9A35C5CF6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=160220), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 44), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 44), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000041' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)\n\nNot enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)\n\n'instance-00000041' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)", 'ErrorSummaryDescription': "'instance-00000041' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000041.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:44.753 4088 3038337403368 MainThread DEBUG os_win._utils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000041' failed to start. Not enough memory in the system to start the virtual machine instance-00000041. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000041' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Not enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) 'instance-00000041' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 4.175893545150757 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:44.882 4088 3038359392680 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000041" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:44.882 4088 3038359392680 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000041" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:44.882 4088 3038359393736 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:44.882 4088 3038359393736 MainThread INFO nova.compute.manager [-] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] VM Stopped (Lifecycle Event) 2021-09-10 17:00:44.890 4088 3038359392856 MainThread DEBUG os_win.utils.jobutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Waiting for WMI job: {'InstanceID': 'E47F2097-F955-43BD-9932-C2D94EE0302D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=22229), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:44.919 4088 3038359393736 MainThread DEBUG nova.compute.manager [req-26c2a7ca-8c3e-4d30-b509-9e8126de7713 - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:44.919 4088 3038359393736 MainThread DEBUG nova.virt.hyperv.vmops [req-26c2a7ca-8c3e-4d30-b509-9e8126de7713 - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:44.989 4088 3038359393736 MainThread DEBUG nova.compute.manager [req-26c2a7ca-8c3e-4d30-b509-9e8126de7713 - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:45.015 4088 3038359393736 MainThread INFO nova.compute.manager [req-26c2a7ca-8c3e-4d30-b509-9e8126de7713 - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:45.041 4088 3038337403544 MainThread DEBUG nova.network.neutron [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:00:45.054 4088 3038359392856 MainThread ERROR os_win.utils.jobutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000045\' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)instance-00000045435C237B-4D58-4CB8-AFD7-007D88B13FC012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)instance-00000045435C237B-4D58-4CB8-AFD7-007D88B13FC010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000045\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)instance-00000045435C237B-4D58-4CB8-AFD7-007D88B13FC0%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E47F2097-F955-43BD-9932-C2D94EE0302D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=132262), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 44), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 45), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000045' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)\n\nNot enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)\n\n'instance-00000045' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)", 'ErrorSummaryDescription': "'instance-00000045' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000045.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:45.075 4088 3038359392856 MainThread DEBUG os_win._utils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000045' failed to start. Not enough memory in the system to start the virtual machine instance-00000045. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000045' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Not enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) 'instance-00000045' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.8711159229278564 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:45.140 4088 3038340568520 MainThread INFO nova.virt.block_device [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Booting with volume f0f70f22-4412-4d14-80e3-17ea362502a8 at /dev/sdc 2021-09-10 17:00:45.190 4088 3038359393736 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000045" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:45.190 4088 3038359393736 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000045" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:45.190 4088 3038340569224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:45.190 4088 3038340569224 MainThread INFO nova.compute.manager [-] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] VM Stopped (Lifecycle Event) 2021-09-10 17:00:45.215 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-954dfc46-35f8-4e8d-8077-15be31ba680c - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:45.215 4088 3038340569224 MainThread DEBUG nova.virt.hyperv.vmops [req-954dfc46-35f8-4e8d-8077-15be31ba680c - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:45.247 4088 3038340568520 MainThread DEBUG os_brick.utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:00:45.247 4088 3038340568520 MainThread DEBUG os_brick.utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] <== get_connector_properties: return (0ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:00:45.247 4088 3038340568520 MainThread DEBUG nova.virt.block_device [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Updating existing volume attachment record: 675f37d4-0edd-4872-9734-f24fce4f646c _volume_attach c:\openstack\build\nova\nova\virt\block_device.py:556 2021-09-10 17:00:45.285 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-954dfc46-35f8-4e8d-8077-15be31ba680c - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:45.310 4088 3038340569224 MainThread INFO nova.compute.manager [req-954dfc46-35f8-4e8d-8077-15be31ba680c - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:45.356 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:00:45.425 4088 3038337403720 MainThread DEBUG nova.network.neutron [req-de11b336-29b5-42a1-8de3-71896556db84 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Updated VIF entry in instance network info cache for port d5da25c9-248e-40c0-86df-338b851250b2. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:00:45.425 4088 3038337403720 MainThread DEBUG nova.network.neutron [req-de11b336-29b5-42a1-8de3-71896556db84 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Updating instance_info_cache with network_info: [{"id": "d5da25c9-248e-40c0-86df-338b851250b2", "address": "fa:16:3e:42:b8:c6", "network": {"id": "dcfd5ed7-c94f-4b68-b56f-95b52ddf921f", "bridge": null, "label": "tempest-ImagesTestJSON-1170675645-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6ca07d9dc99a4581a698a232ffa065db", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd5da25c9-24", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:45.450 4088 3038337403720 MainThread DEBUG oslo_concurrency.lockutils [req-de11b336-29b5-42a1-8de3-71896556db84 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-4cd8ee20-649d-4e14-8c26-085e78ef091d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:45.528 4088 3038337403720 MainThread DEBUG nova.compute.manager [req-173cf1c1-1e5a-46d8-8cf0-c65cd903aeed 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Received event network-vif-plugged-80728b51-8dc8-4c59-900c-a8ca981f59b4 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:45.528 4088 3038337403720 MainThread DEBUG oslo_concurrency.lockutils [req-173cf1c1-1e5a-46d8-8cf0-c65cd903aeed 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b1382ef7-107d-4113-a901-1877f9724cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:45.528 4088 3038337403720 MainThread DEBUG oslo_concurrency.lockutils [req-173cf1c1-1e5a-46d8-8cf0-c65cd903aeed 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b1382ef7-107d-4113-a901-1877f9724cd1-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:45.528 4088 3038337403720 MainThread DEBUG nova.compute.manager [req-173cf1c1-1e5a-46d8-8cf0-c65cd903aeed 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Processing event network-vif-plugged-80728b51-8dc8-4c59-900c-a8ca981f59b4 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:00:45.575 4088 3038337401960 MainThread INFO nova.virt.hyperv.vmops [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Using config drive for instance 2021-09-10 17:00:45.742 4088 3038337403544 MainThread DEBUG nova.network.neutron [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:45.771 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-b0745679-4000-4aff-bd0a-29ded4711f24" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:45.771 4088 3038337403544 MainThread DEBUG nova.compute.manager [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-changed-c2d9bf38-2b6d-4a34-b975-f3967b383e21 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:45.785 4088 3038337403544 MainThread DEBUG nova.compute.manager [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Refreshing instance network info cache due to event network-changed-c2d9bf38-2b6d-4a34-b975-f3967b383e21. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:00:45.785 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-b0745679-4000-4aff-bd0a-29ded4711f24" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:45.785 4088 3038337403544 MainThread DEBUG nova.network.neutron [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Refreshing network info cache for port c2d9bf38-2b6d-4a34-b975-f3967b383e21 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:00:45.811 4088 3038337403368 MainThread DEBUG os_win.utils.jobutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Waiting for WMI job: {'InstanceID': '5C2344C8-BF9C-4185-ADFB-DBFDD9273A4B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=24706), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:46.045 4088 3038337403544 MainThread DEBUG nova.network.neutron [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:00:46.065 4088 3038337401960 MainThread INFO nova.virt.hyperv.vmops [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Creating config drive at C:\openstack\instances\instance-00000042\configdrive.iso 2021-09-10 17:00:46.160 4088 3038337401960 MainThread DEBUG oslo_concurrency.processutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000042\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp59jft186 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:00:46.323 4088 3038359393384 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000041" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:46.323 4088 3038359393384 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000041" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:46.323 4088 3038359393560 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:46.323 4088 3038359393560 MainThread INFO nova.compute.manager [-] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] VM Stopped (Lifecycle Event) 2021-09-10 17:00:46.342 4088 3038337403368 MainThread ERROR os_win.utils.jobutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000041\' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)instance-00000041947E8625-959B-4E4D-8C88-F064D586758812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)instance-00000041947E8625-959B-4E4D-8C88-F064D586758810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000041\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)instance-00000041947E8625-959B-4E4D-8C88-F064D5867588%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5C2344C8-BF9C-4185-ADFB-DBFDD9273A4B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=166383), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 45), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 45), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000041' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)\n\nNot enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)\n\n'instance-00000041' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)", 'ErrorSummaryDescription': "'instance-00000041' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000041.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:46.342 4088 3038337403368 MainThread DEBUG os_win._utils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000041' failed to start. Not enough memory in the system to start the virtual machine instance-00000041. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000041' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Not enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) 'instance-00000041' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.764477729797363 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:46.361 4088 3038359393560 MainThread DEBUG nova.compute.manager [req-df8cde16-f171-487c-b11f-d079d49fa33a - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:46.373 4088 3038359393560 MainThread DEBUG nova.virt.hyperv.vmops [req-df8cde16-f171-487c-b11f-d079d49fa33a - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:46.390 4088 3038359392856 MainThread DEBUG os_win.utils.jobutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Waiting for WMI job: {'InstanceID': '78E09181-5232-4C67-8C8B-270DB07F941B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=26143), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:46.451 4088 3038359393560 MainThread DEBUG nova.compute.manager [req-df8cde16-f171-487c-b11f-d079d49fa33a - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:46.487 4088 3038359393560 MainThread INFO nova.compute.manager [req-df8cde16-f171-487c-b11f-d079d49fa33a - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:46.568 4088 3038359392856 MainThread ERROR os_win.utils.jobutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000045\' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)instance-00000045435C237B-4D58-4CB8-AFD7-007D88B13FC012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)instance-00000045435C237B-4D58-4CB8-AFD7-007D88B13FC010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000045\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)instance-00000045435C237B-4D58-4CB8-AFD7-007D88B13FC0%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '78E09181-5232-4C67-8C8B-270DB07F941B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=168580), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 46), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 46), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000045' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)\n\nNot enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)\n\n'instance-00000045' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)", 'ErrorSummaryDescription': "'instance-00000045' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000045.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:46.568 4088 3038359392856 MainThread DEBUG os_win._utils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000045' failed to start. Not enough memory in the system to start the virtual machine instance-00000045. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000045' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Not enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) 'instance-00000045' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.364361524581909 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:46.592 4088 3038359393736 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000045" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:46.592 4088 3038359393736 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000045" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:46.592 4088 3038359392680 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:46.592 4088 3038359392680 MainThread INFO nova.compute.manager [-] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] VM Stopped (Lifecycle Event) 2021-09-10 17:00:46.620 4088 3038337401960 MainThread DEBUG oslo_concurrency.processutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000042\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp59jft186" returned: 0 in 0.469s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:00:46.629 4088 3038359392680 MainThread DEBUG nova.compute.manager [req-383cb7c2-7eea-4657-bbbc-122b3206b4a0 - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:46.629 4088 3038359392680 MainThread DEBUG nova.virt.hyperv.vmops [req-383cb7c2-7eea-4657-bbbc-122b3206b4a0 - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:46.704 4088 3038359392680 MainThread DEBUG nova.compute.manager [req-383cb7c2-7eea-4657-bbbc-122b3206b4a0 - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:46.720 4088 3038359392680 MainThread INFO nova.compute.manager [req-383cb7c2-7eea-4657-bbbc-122b3206b4a0 - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:47.153 4088 3038337403544 MainThread DEBUG nova.network.neutron [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:47.174 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-b0745679-4000-4aff-bd0a-29ded4711f24" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:47.174 4088 3038337403544 MainThread DEBUG nova.compute.manager [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-changed-6709b293-b51f-4901-9ca4-bef117b27521 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:47.174 4088 3038337403544 MainThread DEBUG nova.compute.manager [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Refreshing instance network info cache due to event network-changed-6709b293-b51f-4901-9ca4-bef117b27521. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:00:47.174 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-b0745679-4000-4aff-bd0a-29ded4711f24" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:47.174 4088 3038337403544 MainThread DEBUG nova.network.neutron [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Refreshing network info cache for port 6709b293-b51f-4901-9ca4-bef117b27521 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:00:47.374 4088 3038337403368 MainThread DEBUG os_win.utils.jobutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Waiting for WMI job: {'InstanceID': 'F00A34E4-1F64-405A-8E65-A057A11103F5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=23342), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:47.406 4088 3038337403544 MainThread DEBUG nova.network.neutron [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:00:47.450 4088 3038340567288 MainThread DEBUG nova.virt.hyperv.vmops [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:00:47.450 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Lock "instance-00000043" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:47.450 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Lock "instance-00000043" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:47.487 4088 3038337401960 MainThread DEBUG nova.virt.hyperv.vmops [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Setting boot order for instance: instance-00000042: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:00:47.501 4088 3038340567288 MainThread DEBUG os_win.utils.compute.vmutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Successfully changed vm state of instance-00000043 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:00:47.501 4088 3038340567288 MainThread DEBUG nova.virt.hyperv.vmops [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Successfully changed state of VM instance-00000043 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:00:47.548 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:00:47.565 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:47.565 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:47.565 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:00:47.565 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:00:47.593 4088 3038340567288 MainThread DEBUG os_win.utils.jobutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Waiting for WMI job: {'InstanceID': '1F9A32BB-E8E9-426B-9AF4-C22C33C84E9F', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=26722), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:47.593 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:00:47.669 4088 3038337403368 MainThread ERROR os_win.utils.jobutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000041\' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)instance-00000041947E8625-959B-4E4D-8C88-F064D586758812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)instance-00000041947E8625-959B-4E4D-8C88-F064D586758810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000041\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)instance-00000041947E8625-959B-4E4D-8C88-F064D5867588%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'F00A34E4-1F64-405A-8E65-A057A11103F5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=161099), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 47), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 47), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000041' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)\n\nNot enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)\n\n'instance-00000041' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588)", 'ErrorSummaryDescription': "'instance-00000041' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000041.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:47.669 4088 3038337403368 MainThread ERROR nova.virt.hyperv.vmops [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Failed to change vm state of instance-00000041 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000041' failed to start. 2021-09-10 17:00:47.669 4088 3038337403368 MainThread INFO nova.virt.hyperv.vmops [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Got request to destroy instance 2021-09-10 17:00:47.692 4088 3038340570456 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:47.692 4088 3038340570456 MainThread INFO nova.compute.manager [-] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] VM Stopped (Lifecycle Event) 2021-09-10 17:00:47.692 4088 3038340569928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000041" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:47.692 4088 3038340569928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000041" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:47.701 4088 3038340570456 MainThread DEBUG nova.compute.manager [req-cce5fc58-6cb1-442b-8dc6-d9835bcf7a99 - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:47.701 4088 3038340570456 MainThread DEBUG nova.virt.hyperv.vmops [req-cce5fc58-6cb1-442b-8dc6-d9835bcf7a99 - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:47.701 4088 3038359392856 MainThread DEBUG os_win.utils.jobutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Waiting for WMI job: {'InstanceID': '9CD4A1C0-8D47-4637-B6D2-C9208CACD861', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=30470), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:47.722 4088 3038340567288 MainThread DEBUG os_win.utils.jobutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] WMI job succeeded: {'InstanceID': '1F9A32BB-E8E9-426B-9AF4-C22C33C84E9F', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=122572), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:00:47.722 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Lock "instance-00000043" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:47.738 4088 3038340567288 MainThread DEBUG os_win.utils.pathutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Removing directory: C:\openstack\instances\instance-00000043 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:00:47.738 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Lock "instance-00000043" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:47.738 4088 3038340567288 MainThread ERROR nova.compute.manager [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000043' failed to start. Not enough memory in the system to start the virtual machine instance-00000043. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000043' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Not enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) 'instance-00000043' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Error code: 32778. 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Traceback (most recent call last): 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] return function(*args, **kwargs) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] admin_password, network_info, block_device_info) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] return function(self, *args, **kwds) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self.force_reraise() 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] raise self.value 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] should_plug_vifs=False) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 'req_state': req_state}) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self.force_reraise() 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] raise self.value 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] time.sleep(sleep_time) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self.force_reraise() 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] raise self.value 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] return f(*args, **kwargs) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] return self._wait_for_job(job_path) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] error_desc=err_desc) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000043' failed to start. 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Not enough memory in the system to start the virtual machine instance-00000043. 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000043' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Not enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 'instance-00000043' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Error code: 32778. 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] During handling of the above exception, another exception occurred: 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Traceback (most recent call last): 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] yield resources 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] accel_info=accel_info) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] return function(*args, **kwargs) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] admin_password, network_info, block_device_info) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] return function(self, *args, **kwds) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self.force_reraise() 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] raise self.value 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] should_plug_vifs=False) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 'req_state': req_state}) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self.force_reraise() 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] raise self.value 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] time.sleep(sleep_time) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self.force_reraise() 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] raise self.value 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] return f(*args, **kwargs) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] return self._wait_for_job(job_path) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] error_desc=err_desc) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000043' failed to start. 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Not enough memory in the system to start the virtual machine instance-00000043. 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000043' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Not enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 'instance-00000043' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Error code: 32778. 2021-09-10 17:00:47.738 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:47.747 4088 3038340567288 MainThread INFO nova.compute.manager [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Terminating instance 2021-09-10 17:00:47.747 4088 3038340567288 MainThread DEBUG nova.compute.manager [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:00:47.747 4088 3038340567288 MainThread INFO nova.virt.hyperv.vmops [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Got request to destroy instance 2021-09-10 17:00:47.747 4088 3038337401960 MainThread DEBUG nova.virt.hyperv.vmops [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:00:47.763 4088 3038340567288 MainThread DEBUG nova.virt.hyperv.vmops [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:00:47.785 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Lock "instance-00000043" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:47.785 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Lock "instance-00000043" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:47.785 4088 3038340567288 MainThread INFO nova.compute.manager [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:00:47.785 4088 3038340567288 MainThread DEBUG nova.compute.claims [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:00:47.785 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:47.814 4088 3038337401960 MainThread DEBUG os_win.utils.jobutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '34FB8A7F-6F0B-486B-8702-B97B7B499466', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=40579), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:47.827 4088 3038340570456 MainThread DEBUG nova.compute.manager [req-cce5fc58-6cb1-442b-8dc6-d9835bcf7a99 - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:47.865 4088 3038340570456 MainThread INFO nova.compute.manager [req-cce5fc58-6cb1-442b-8dc6-d9835bcf7a99 - - - - -] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:47.875 4088 3038359392856 MainThread ERROR os_win.utils.jobutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000045\' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)instance-00000045435C237B-4D58-4CB8-AFD7-007D88B13FC012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)instance-00000045435C237B-4D58-4CB8-AFD7-007D88B13FC010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000045\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)instance-00000045435C237B-4D58-4CB8-AFD7-007D88B13FC0%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9CD4A1C0-8D47-4637-B6D2-C9208CACD861', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=141201), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 47), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 47), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000045' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)\n\nNot enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)\n\n'instance-00000045' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0)", 'ErrorSummaryDescription': "'instance-00000045' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000045.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:47.875 4088 3038359392856 MainThread ERROR nova.virt.hyperv.vmops [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Failed to change vm state of instance-00000045 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000045' failed to start. 2021-09-10 17:00:47.875 4088 3038359392856 MainThread INFO nova.virt.hyperv.vmops [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Got request to destroy instance 2021-09-10 17:00:47.937 4088 3038340570456 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:47.937 4088 3038340570456 MainThread INFO nova.compute.manager [-] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] VM Stopped (Lifecycle Event) 2021-09-10 17:00:47.937 4088 3038340569928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000045" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:47.937 4088 3038340569928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000045" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:47.966 4088 3038340570456 MainThread DEBUG nova.compute.manager [req-0115734d-37e5-4997-89df-fc02721d3654 - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:47.966 4088 3038340570456 MainThread DEBUG nova.virt.hyperv.vmops [req-0115734d-37e5-4997-89df-fc02721d3654 - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:47.966 4088 3038340567288 MainThread DEBUG nova.virt.hyperv.hostops [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:00:47.966 4088 3038337403544 MainThread DEBUG nova.network.neutron [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:47.982 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [req-859b4692-e910-4fd7-901d-396c243713e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-b0745679-4000-4aff-bd0a-29ded4711f24" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:47.982 4088 3038340568344 GreenThread-57 DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Acquired lock "refresh_cache-b0745679-4000-4aff-bd0a-29ded4711f24" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:47.982 4088 3038340568344 GreenThread-57 DEBUG nova.network.neutron [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:00:48.003 4088 3038340567288 MainThread DEBUG nova.virt.hyperv.hostops [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:00:48.091 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2211MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:00:48.124 4088 3038359393736 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000042" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:48.124 4088 3038359393736 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000042" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:48.124 4088 3038359392680 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:48.124 4088 3038359392680 MainThread INFO nova.compute.manager [-] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] VM Stopped (Lifecycle Event) 2021-09-10 17:00:48.124 4088 3038340570456 MainThread DEBUG nova.compute.manager [req-0115734d-37e5-4997-89df-fc02721d3654 - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:48.141 4088 3038337401960 MainThread ERROR os_win.utils.jobutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000042\' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)instance-000000421B4F49AA-671B-4E76-BD0A-284ABA3AAB4612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)instance-000000421B4F49AA-671B-4E76-BD0A-284ABA3AAB4610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000042\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)instance-000000421B4F49AA-671B-4E76-BD0A-284ABA3AAB46%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '34FB8A7F-6F0B-486B-8702-B97B7B499466', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=228846), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 47), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 48), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000042' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)\n\nNot enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)\n\n'instance-00000042' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)", 'ErrorSummaryDescription': "'instance-00000042' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000042.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:48.141 4088 3038337401960 MainThread DEBUG os_win._utils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000042' failed to start. Not enough memory in the system to start the virtual machine instance-00000042. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000042' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Not enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) 'instance-00000042' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.3938004970550537 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:48.167 4088 3038359392680 MainThread DEBUG nova.compute.manager [req-c283297d-3116-4841-a827-b040890bfb41 - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:48.167 4088 3038359392680 MainThread DEBUG nova.virt.hyperv.vmops [req-c283297d-3116-4841-a827-b040890bfb41 - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:48.167 4088 3038340570456 MainThread INFO nova.compute.manager [req-0115734d-37e5-4997-89df-fc02721d3654 - - - - -] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:48.186 4088 3038340568344 GreenThread-57 DEBUG nova.network.neutron [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:00:48.241 4088 3038359392680 MainThread DEBUG nova.compute.manager [req-c283297d-3116-4841-a827-b040890bfb41 - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:48.265 4088 3038359392680 MainThread INFO nova.compute.manager [req-c283297d-3116-4841-a827-b040890bfb41 - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:48.478 4088 3038340567288 MainThread DEBUG nova.compute.provider_tree [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:00:48.497 4088 3038340567288 MainThread DEBUG nova.scheduler.client.report [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:00:48.497 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.719s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:48.497 4088 3038340567288 MainThread ERROR nova.compute.manager [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000043' failed to start. Not enough memory in the system to start the virtual machine instance-00000043. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000043' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Not enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) 'instance-00000043' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Error code: 32778. 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Traceback (most recent call last): 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] return function(*args, **kwargs) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] admin_password, network_info, block_device_info) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] return function(self, *args, **kwds) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self.force_reraise() 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] raise self.value 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] should_plug_vifs=False) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 'req_state': req_state}) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self.force_reraise() 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] raise self.value 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] time.sleep(sleep_time) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self.force_reraise() 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] raise self.value 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] return f(*args, **kwargs) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] return self._wait_for_job(job_path) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] error_desc=err_desc) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000043' failed to start. 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Not enough memory in the system to start the virtual machine instance-00000043. 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000043' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Not enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 'instance-00000043' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Error code: 32778. 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] During handling of the above exception, another exception occurred: 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Traceback (most recent call last): 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] accel_info=accel_info) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] return function(*args, **kwargs) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] admin_password, network_info, block_device_info) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] return function(self, *args, **kwds) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self.force_reraise() 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] raise self.value 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] should_plug_vifs=False) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 'req_state': req_state}) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self.force_reraise() 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] raise self.value 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] time.sleep(sleep_time) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self.force_reraise() 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] raise self.value 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] return f(*args, **kwargs) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] return self._wait_for_job(job_path) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] error_desc=err_desc) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000043' failed to start. 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Not enough memory in the system to start the virtual machine instance-00000043. 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000043' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Not enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 'instance-00000043' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Error code: 32778. 2021-09-10 17:00:48.497 4088 3038340567288 MainThread TRACE nova.compute.manager [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] 2021-09-10 17:00:48.497 4088 3038340567288 MainThread DEBUG nova.compute.utils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] WMI job failed with status 10. Error summary description: 'instance-00000043' failed to start. Not enough memory in the system to start the virtual machine instance-00000043. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:00:48.497 4088 3038340567288 MainThread DEBUG nova.compute.manager [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Build of instance 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000043' failed to start. Not enough memory in the system to start the virtual machine instance-00000043. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000043' failed to start. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Not enough memory in the system to start the virtual machine instance-00000043 with ram size 1024 megabytes. (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) 'instance-00000043' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A1475BF6-7780-4245-9767-7C927CF2EDA7) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:00:48.497 4088 3038340567288 MainThread DEBUG nova.compute.manager [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:00:48.497 4088 3038340567288 MainThread DEBUG nova.compute.manager [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:00:48.497 4088 3038340567288 MainThread DEBUG nova.compute.manager [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:00:48.497 4088 3038340567288 MainThread DEBUG nova.network.neutron [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:00:48.517 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.421s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:48.721 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:00:48.721 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:00:48.721 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:00:48.721 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:00:48.721 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:00:48.721 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:00:48.721 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:00:48.721 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:00:48.721 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:00:48.737 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:00:48.737 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:00:48.737 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:00:48.737 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:00:48.737 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 5b7f9971-39c8-4512-b873-8d2e09fd6941 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:00:48.737 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance b1382ef7-107d-4113-a901-1877f9724cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:00:48.765 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1591 2021-09-10 17:00:48.765 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance b0745679-4000-4aff-bd0a-29ded4711f24 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:00:48.765 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 4cd8ee20-649d-4e14-8c26-085e78ef091d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:00:48.765 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:00:48.765 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 18 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:00:48.765 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=18944MB phys_disk=79GB used_disk=17GB total_vcpus=6 used_vcpus=18 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:00:48.801 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:00:48.829 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:00:49.145 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:00:49.158 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:00:49.158 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:00:49.174 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:49.185 4088 3038337401960 MainThread DEBUG os_win.utils.jobutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'E2E5A062-CD44-48A3-A779-64DD5F9E7DBA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=28561), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:49.403 4088 3038337403896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:49.403 4088 3038337403896 MainThread INFO nova.compute.manager [-] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] VM Stopped (Lifecycle Event) 2021-09-10 17:00:49.420 4088 3038337404072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000042" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:49.420 4088 3038337404072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000042" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:49.451 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-c3e48f43-03e8-4563-9c25-a5ba8f24b82f - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:49.451 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.vmops [req-c3e48f43-03e8-4563-9c25-a5ba8f24b82f - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:49.466 4088 3038337401960 MainThread ERROR os_win.utils.jobutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000042\' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)instance-000000421B4F49AA-671B-4E76-BD0A-284ABA3AAB4612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)instance-000000421B4F49AA-671B-4E76-BD0A-284ABA3AAB4610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000042\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)instance-000000421B4F49AA-671B-4E76-BD0A-284ABA3AAB46%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E2E5A062-CD44-48A3-A779-64DD5F9E7DBA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=151744), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 49), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 49), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000042' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)\n\nNot enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)\n\n'instance-00000042' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)", 'ErrorSummaryDescription': "'instance-00000042' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000042.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:49.466 4088 3038337401960 MainThread DEBUG os_win._utils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000042' failed to start. Not enough memory in the system to start the virtual machine instance-00000042. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000042' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Not enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) 'instance-00000042' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.7182929515838623 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:49.549 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-c3e48f43-03e8-4563-9c25-a5ba8f24b82f - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:49.591 4088 3038337403896 MainThread INFO nova.compute.manager [req-c3e48f43-03e8-4563-9c25-a5ba8f24b82f - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:49.812 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:00:49.841 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:00:49.841 4088 3038340568520 MainThread INFO nova.virt.hyperv.vmops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Spawning new instance 2021-09-10 17:00:49.856 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "instance-0000003b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:49.856 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "instance-0000003b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:49.856 4088 3038340568520 MainThread DEBUG nova.block_device [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] block_device_list ['sda', 'sdb', 'sdc'] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:00:50.544 4088 3038337403368 MainThread DEBUG nova.virt.hyperv.vmops [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:00:50.627 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Lock "instance-00000041" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:50.627 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Lock "instance-00000041" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:50.656 4088 3038359392856 MainThread DEBUG nova.virt.hyperv.vmops [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:00:50.656 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Lock "instance-00000045" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:50.656 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Lock "instance-00000045" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:50.733 4088 3038359392856 MainThread DEBUG os_win.utils.compute.vmutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Successfully changed vm state of instance-00000045 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:00:50.733 4088 3038359392856 MainThread DEBUG nova.virt.hyperv.vmops [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Successfully changed state of VM instance-00000045 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:00:50.733 4088 3038337403368 MainThread DEBUG os_win.utils.compute.vmutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Successfully changed vm state of instance-00000041 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:00:50.733 4088 3038337403368 MainThread DEBUG nova.virt.hyperv.vmops [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Successfully changed state of VM instance-00000041 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:00:50.755 4088 3038340567288 MainThread DEBUG nova.network.neutron [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:50.764 4088 3038337401960 MainThread DEBUG os_win.utils.jobutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '681831E5-B261-4A44-8157-1267B0CC3BB7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=24934), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:50.764 4088 3038340567288 MainThread INFO nova.compute.manager [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] [instance: 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f] Took 2.27 seconds to deallocate network for instance. 2021-09-10 17:00:50.810 4088 3038359392856 MainThread DEBUG os_win.utils.jobutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Waiting for WMI job: {'InstanceID': '7D4B73B7-9471-4AD0-BFBD-7AA738618B11', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21173), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:50.810 4088 3038337403368 MainThread DEBUG os_win.utils.jobutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Waiting for WMI job: {'InstanceID': '48F2E1BA-C9CE-45B5-BA6E-6599F357E4E8', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=29197), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:50.918 4088 3038340567288 MainThread INFO nova.scheduler.client.report [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Deleted allocations for instance 0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f 2021-09-10 17:00:50.950 4088 3038359392856 MainThread DEBUG os_win.utils.jobutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] WMI job succeeded: {'InstanceID': '7D4B73B7-9471-4AD0-BFBD-7AA738618B11', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=155904), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:00:50.950 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Lock "instance-00000045" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:50.950 4088 3038359392856 MainThread DEBUG os_win.utils.pathutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Removing directory: C:\openstack\instances\instance-00000045 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:00:50.950 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Lock "instance-00000045" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:50.973 4088 3038359392856 MainThread ERROR nova.compute.manager [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000045' failed to start. Not enough memory in the system to start the virtual machine instance-00000045. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000045' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Not enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) 'instance-00000045' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Error code: 32778. 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Traceback (most recent call last): 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] return function(*args, **kwargs) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] admin_password, network_info, block_device_info) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] return function(self, *args, **kwds) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self.force_reraise() 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] raise self.value 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] should_plug_vifs=False) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 'req_state': req_state}) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self.force_reraise() 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] raise self.value 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] time.sleep(sleep_time) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self.force_reraise() 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] raise self.value 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] return f(*args, **kwargs) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] return self._wait_for_job(job_path) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] error_desc=err_desc) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000045' failed to start. 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Not enough memory in the system to start the virtual machine instance-00000045. 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000045' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Not enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 'instance-00000045' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Error code: 32778. 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] During handling of the above exception, another exception occurred: 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Traceback (most recent call last): 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] yield resources 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] accel_info=accel_info) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] return function(*args, **kwargs) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] admin_password, network_info, block_device_info) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] return function(self, *args, **kwds) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self.force_reraise() 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] raise self.value 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] should_plug_vifs=False) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 'req_state': req_state}) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self.force_reraise() 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] raise self.value 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] time.sleep(sleep_time) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self.force_reraise() 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] raise self.value 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] return f(*args, **kwargs) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] return self._wait_for_job(job_path) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] error_desc=err_desc) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000045' failed to start. 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Not enough memory in the system to start the virtual machine instance-00000045. 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000045' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Not enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 'instance-00000045' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Error code: 32778. 2021-09-10 17:00:50.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:50.973 4088 3038359392856 MainThread INFO nova.compute.manager [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Terminating instance 2021-09-10 17:00:50.973 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Acquired lock "refresh_cache-6d2c0c79-952c-46e8-9d1f-e8c9891d61d5" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:50.973 4088 3038359392856 MainThread DEBUG nova.network.neutron [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:00:50.999 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [req-e09e66eb-bf79-4bdc-bb1b-99253820b6db 07d38d374c614cedbb4fed9d7dc73f45 4b1e8ca5b70b4088b2d52a886b333d20 - default default] Lock "0cccf6bf-6ec9-4777-ac92-f5c40f0d6f7f" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 27.922s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:51.060 4088 3038337403368 MainThread DEBUG os_win.utils.jobutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] WMI job succeeded: {'InstanceID': '48F2E1BA-C9CE-45B5-BA6E-6599F357E4E8', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=229948), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:00:51.081 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Lock "instance-00000041" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:51.081 4088 3038337403368 MainThread DEBUG os_win.utils.pathutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Removing directory: C:\openstack\instances\instance-00000041 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:00:51.081 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Lock "instance-00000041" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:51.081 4088 3038337403368 MainThread ERROR nova.compute.manager [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000041' failed to start. Not enough memory in the system to start the virtual machine instance-00000041. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000041' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Not enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) 'instance-00000041' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Error code: 32778. 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Traceback (most recent call last): 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] return function(*args, **kwargs) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] admin_password, network_info, block_device_info) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] return function(self, *args, **kwds) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self.force_reraise() 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] raise self.value 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] should_plug_vifs=False) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 'req_state': req_state}) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self.force_reraise() 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] raise self.value 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] time.sleep(sleep_time) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self.force_reraise() 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] raise self.value 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] return f(*args, **kwargs) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] return self._wait_for_job(job_path) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] error_desc=err_desc) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000041' failed to start. 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Not enough memory in the system to start the virtual machine instance-00000041. 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000041' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Not enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 'instance-00000041' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Error code: 32778. 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] During handling of the above exception, another exception occurred: 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Traceback (most recent call last): 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] yield resources 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] accel_info=accel_info) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] return function(*args, **kwargs) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] admin_password, network_info, block_device_info) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] return function(self, *args, **kwds) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self.force_reraise() 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] raise self.value 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] should_plug_vifs=False) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 'req_state': req_state}) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self.force_reraise() 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] raise self.value 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] time.sleep(sleep_time) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self.force_reraise() 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] raise self.value 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] return f(*args, **kwargs) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] return self._wait_for_job(job_path) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] error_desc=err_desc) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000041' failed to start. 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Not enough memory in the system to start the virtual machine instance-00000041. 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000041' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Not enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 'instance-00000041' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Error code: 32778. 2021-09-10 17:00:51.081 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.081 4088 3038337403368 MainThread INFO nova.compute.manager [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Terminating instance 2021-09-10 17:00:51.092 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:00:51.092 4088 3038337403368 MainThread INFO nova.virt.hyperv.vmops [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Got request to destroy instance 2021-09-10 17:00:51.092 4088 3038359392856 MainThread DEBUG nova.network.neutron [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:00:51.153 4088 3038337401960 MainThread ERROR os_win.utils.jobutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000042\' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)instance-000000421B4F49AA-671B-4E76-BD0A-284ABA3AAB4612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)instance-000000421B4F49AA-671B-4E76-BD0A-284ABA3AAB4610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000042\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)instance-000000421B4F49AA-671B-4E76-BD0A-284ABA3AAB46%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '681831E5-B261-4A44-8157-1267B0CC3BB7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=296512), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 50), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 51), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000042' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)\n\nNot enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)\n\n'instance-00000042' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)", 'ErrorSummaryDescription': "'instance-00000042' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000042.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:51.153 4088 3038337401960 MainThread DEBUG os_win._utils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000042' failed to start. Not enough memory in the system to start the virtual machine instance-00000042. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000042' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Not enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) 'instance-00000042' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 3.405759572982788 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:51.177 4088 3038340568872 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000042" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:51.177 4088 3038340568872 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000042" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:51.177 4088 3038340567288 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:51.177 4088 3038340567288 MainThread INFO nova.compute.manager [-] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] VM Stopped (Lifecycle Event) 2021-09-10 17:00:51.186 4088 3038337403368 MainThread DEBUG nova.virt.hyperv.vmops [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:00:51.186 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Lock "instance-00000041" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:51.186 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Lock "instance-00000041" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:51.186 4088 3038337403368 MainThread INFO nova.compute.manager [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Took 0.09 seconds to destroy the instance on the hypervisor. 2021-09-10 17:00:51.186 4088 3038337403368 MainThread DEBUG nova.compute.claims [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:00:51.186 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:51.205 4088 3038340567288 MainThread DEBUG nova.compute.manager [req-ded19bf0-753e-410d-abc0-1cb086816d42 - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:51.205 4088 3038340567288 MainThread DEBUG nova.virt.hyperv.vmops [req-ded19bf0-753e-410d-abc0-1cb086816d42 - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:51.266 4088 3038340567288 MainThread DEBUG nova.compute.manager [req-ded19bf0-753e-410d-abc0-1cb086816d42 - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:51.279 4088 3038337403368 MainThread DEBUG nova.virt.hyperv.hostops [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:00:51.279 4088 3038340567288 MainThread INFO nova.compute.manager [req-ded19bf0-753e-410d-abc0-1cb086816d42 - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:51.303 4088 3038337403368 MainThread DEBUG nova.virt.hyperv.hostops [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:00:51.532 4088 3038359392856 MainThread DEBUG nova.network.neutron [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:51.553 4088 3038337403368 MainThread DEBUG nova.compute.provider_tree [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:00:51.553 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Releasing lock "refresh_cache-6d2c0c79-952c-46e8-9d1f-e8c9891d61d5" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:51.553 4088 3038359392856 MainThread DEBUG nova.compute.manager [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:00:51.565 4088 3038359392856 MainThread INFO nova.virt.hyperv.vmops [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Got request to destroy instance 2021-09-10 17:00:51.565 4088 3038337403368 MainThread DEBUG nova.scheduler.client.report [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:00:51.565 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.375s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:51.565 4088 3038337403368 MainThread ERROR nova.compute.manager [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000041' failed to start. Not enough memory in the system to start the virtual machine instance-00000041. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000041' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Not enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) 'instance-00000041' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Error code: 32778. 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Traceback (most recent call last): 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] return function(*args, **kwargs) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] admin_password, network_info, block_device_info) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] return function(self, *args, **kwds) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self.force_reraise() 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] raise self.value 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] should_plug_vifs=False) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 'req_state': req_state}) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self.force_reraise() 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] raise self.value 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] time.sleep(sleep_time) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self.force_reraise() 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] raise self.value 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] return f(*args, **kwargs) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] return self._wait_for_job(job_path) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] error_desc=err_desc) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000041' failed to start. 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Not enough memory in the system to start the virtual machine instance-00000041. 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000041' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Not enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 'instance-00000041' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Error code: 32778. 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] During handling of the above exception, another exception occurred: 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Traceback (most recent call last): 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] accel_info=accel_info) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] return function(*args, **kwargs) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] admin_password, network_info, block_device_info) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] return function(self, *args, **kwds) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self.force_reraise() 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] raise self.value 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] should_plug_vifs=False) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 'req_state': req_state}) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self.force_reraise() 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] raise self.value 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] time.sleep(sleep_time) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self.force_reraise() 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] raise self.value 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] return f(*args, **kwargs) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] return self._wait_for_job(job_path) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] error_desc=err_desc) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000041' failed to start. 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Not enough memory in the system to start the virtual machine instance-00000041. 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000041' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Not enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 'instance-00000041' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Error code: 32778. 2021-09-10 17:00:51.565 4088 3038337403368 MainThread TRACE nova.compute.manager [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] 2021-09-10 17:00:51.565 4088 3038337403368 MainThread DEBUG nova.compute.utils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] WMI job failed with status 10. Error summary description: 'instance-00000041' failed to start. Not enough memory in the system to start the virtual machine instance-00000041. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:00:51.565 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Build of instance 5b7f9971-39c8-4512-b873-8d2e09fd6941 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000041' failed to start. Not enough memory in the system to start the virtual machine instance-00000041. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000041' failed to start. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Not enough memory in the system to start the virtual machine instance-00000041 with ram size 1024 megabytes. (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) 'instance-00000041' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 947E8625-959B-4E4D-8C88-F064D5867588) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:00:51.565 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:00:51.565 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:00:51.565 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:00:51.565 4088 3038337403368 MainThread DEBUG nova.network.neutron [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:00:51.592 4088 3038359392856 MainThread DEBUG nova.virt.hyperv.vmops [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:00:51.592 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Lock "instance-00000045" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:51.592 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Lock "instance-00000045" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:51.592 4088 3038359392856 MainThread INFO nova.compute.manager [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:00:51.592 4088 3038359392856 MainThread DEBUG oslo.service.loopingcall [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. func c:\python37\lib\site-packages\oslo_service\loopingcall.py:435 2021-09-10 17:00:51.592 4088 3038337404776 GreenThread-60 DEBUG nova.compute.manager [-] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Skipping network deallocation for instance since networking was not requested. _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2054 2021-09-10 17:00:51.592 4088 3038359392856 MainThread DEBUG nova.compute.claims [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:00:51.606 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:51.705 4088 3038359392856 MainThread DEBUG nova.virt.hyperv.hostops [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:00:51.721 4088 3038359392856 MainThread DEBUG nova.virt.hyperv.hostops [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:00:51.952 4088 3038359392856 MainThread DEBUG nova.compute.provider_tree [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:00:51.973 4088 3038359392856 MainThread DEBUG nova.scheduler.client.report [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:00:51.973 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.360s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:51.973 4088 3038359392856 MainThread ERROR nova.compute.manager [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000045' failed to start. Not enough memory in the system to start the virtual machine instance-00000045. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000045' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Not enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) 'instance-00000045' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Error code: 32778. 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Traceback (most recent call last): 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] return function(*args, **kwargs) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] admin_password, network_info, block_device_info) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] return function(self, *args, **kwds) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self.force_reraise() 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] raise self.value 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] should_plug_vifs=False) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 'req_state': req_state}) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self.force_reraise() 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] raise self.value 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] time.sleep(sleep_time) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self.force_reraise() 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] raise self.value 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] return f(*args, **kwargs) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] return self._wait_for_job(job_path) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] error_desc=err_desc) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000045' failed to start. 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Not enough memory in the system to start the virtual machine instance-00000045. 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000045' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Not enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 'instance-00000045' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Error code: 32778. 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] During handling of the above exception, another exception occurred: 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Traceback (most recent call last): 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] accel_info=accel_info) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] return function(*args, **kwargs) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] admin_password, network_info, block_device_info) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] return function(self, *args, **kwds) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self.force_reraise() 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] raise self.value 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] should_plug_vifs=False) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 'req_state': req_state}) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self.force_reraise() 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] raise self.value 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] time.sleep(sleep_time) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self.force_reraise() 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] raise self.value 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] return f(*args, **kwargs) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] return self._wait_for_job(job_path) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] error_desc=err_desc) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000045' failed to start. 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Not enough memory in the system to start the virtual machine instance-00000045. 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000045' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Not enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 'instance-00000045' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Error code: 32778. 2021-09-10 17:00:51.973 4088 3038359392856 MainThread TRACE nova.compute.manager [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] 2021-09-10 17:00:51.981 4088 3038359392856 MainThread DEBUG nova.compute.utils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] WMI job failed with status 10. Error summary description: 'instance-00000045' failed to start. Not enough memory in the system to start the virtual machine instance-00000045. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:00:51.981 4088 3038359392856 MainThread DEBUG nova.compute.manager [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Build of instance 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000045' failed to start. Not enough memory in the system to start the virtual machine instance-00000045. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000045' failed to start. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Not enough memory in the system to start the virtual machine instance-00000045 with ram size 1024 megabytes. (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) 'instance-00000045' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 435C237B-4D58-4CB8-AFD7-007D88B13FC0) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:00:51.981 4088 3038359392856 MainThread DEBUG nova.compute.manager [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:00:51.981 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Acquired lock "refresh_cache-6d2c0c79-952c-46e8-9d1f-e8c9891d61d5" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:00:51.981 4088 3038359392856 MainThread DEBUG nova.network.neutron [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:00:52.035 4088 3038359392856 MainThread DEBUG nova.network.neutron [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:00:52.171 4088 3038337401960 MainThread DEBUG os_win.utils.jobutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '371A2DD7-D3B4-4591-A370-5835F5A3E527', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19361), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:52.278 4088 3038359392856 MainThread DEBUG nova.network.neutron [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:52.286 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Releasing lock "refresh_cache-6d2c0c79-952c-46e8-9d1f-e8c9891d61d5" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:52.286 4088 3038359392856 MainThread DEBUG nova.compute.manager [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:00:52.309 4088 3038359392856 MainThread DEBUG nova.compute.manager [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] [instance: 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5] Skipping network deallocation for instance since networking was not requested. _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2054 2021-09-10 17:00:52.325 4088 3038337401960 MainThread ERROR os_win.utils.jobutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000042\' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)instance-000000421B4F49AA-671B-4E76-BD0A-284ABA3AAB4612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)instance-000000421B4F49AA-671B-4E76-BD0A-284ABA3AAB4610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000042\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)instance-000000421B4F49AA-671B-4E76-BD0A-284ABA3AAB46%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '371A2DD7-D3B4-4591-A370-5835F5A3E527', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118926), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 52), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 52), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000042' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)\n\nNot enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)\n\n'instance-00000042' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)", 'ErrorSummaryDescription': "'instance-00000042' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000042.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:52.325 4088 3038337401960 MainThread DEBUG os_win._utils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000042' failed to start. Not enough memory in the system to start the virtual machine instance-00000042. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000042' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Not enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) 'instance-00000042' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 4.577158212661743 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:52.361 4088 3038359394616 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000042" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:52.361 4088 3038359394616 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000042" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:52.361 4088 3038340569224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:52.361 4088 3038340569224 MainThread INFO nova.compute.manager [-] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] VM Stopped (Lifecycle Event) 2021-09-10 17:00:52.393 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-5c926c10-89e8-4207-9b6b-42a13c525a8f - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:52.393 4088 3038340569224 MainThread DEBUG nova.virt.hyperv.vmops [req-5c926c10-89e8-4207-9b6b-42a13c525a8f - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:52.452 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-5c926c10-89e8-4207-9b6b-42a13c525a8f - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:52.496 4088 3038340569224 MainThread INFO nova.compute.manager [req-5c926c10-89e8-4207-9b6b-42a13c525a8f - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:52.519 4088 3038359392856 MainThread INFO nova.scheduler.client.report [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Deleted allocations for instance 6d2c0c79-952c-46e8-9d1f-e8c9891d61d5 2021-09-10 17:00:52.571 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36b84dc7-537c-4ab8-b96d-3162388faeca b650955abba04294b2c6b5e7f0734423 69b5dbd9fc104f8aa8e9386ba8229ec1 - default default] Lock "6d2c0c79-952c-46e8-9d1f-e8c9891d61d5" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.578s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:52.902 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-eb96a6d2-aa01-4ba6-8c89-dff37ee5638d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Received event network-vif-plugged-d5da25c9-248e-40c0-86df-338b851250b2 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:52.904 4088 3038340569224 MainThread DEBUG oslo_concurrency.lockutils [req-eb96a6d2-aa01-4ba6-8c89-dff37ee5638d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "4cd8ee20-649d-4e14-8c26-085e78ef091d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:52.904 4088 3038340569224 MainThread DEBUG oslo_concurrency.lockutils [req-eb96a6d2-aa01-4ba6-8c89-dff37ee5638d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "4cd8ee20-649d-4e14-8c26-085e78ef091d-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:52.904 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-eb96a6d2-aa01-4ba6-8c89-dff37ee5638d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Processing event network-vif-plugged-d5da25c9-248e-40c0-86df-338b851250b2 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:00:52.945 4088 3038340570104 MainThread INFO nova.virt.hyperv.vmops [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Using config drive for instance 2021-09-10 17:00:53.196 4088 3038340570104 MainThread INFO nova.virt.hyperv.vmops [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Creating config drive at C:\openstack\instances\instance-00000044\configdrive.iso 2021-09-10 17:00:53.348 4088 3038340570104 MainThread DEBUG oslo_concurrency.processutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000044\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpk45al4zk execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:00:53.503 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:53.512 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:00:53.533 4088 3038337401960 MainThread DEBUG os_win.utils.jobutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '595007F4-B267-4344-977D-99694F6BC78F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15451), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:53.639 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:53.639 4088 3038337403896 MainThread DEBUG nova.virt.hardware [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:00:53.655 4088 3038337403896 MainThread INFO nova.compute.claims [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Claim successful on node n-h2-808474-1 2021-09-10 17:00:53.655 4088 3038337403368 MainThread DEBUG nova.network.neutron [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:53.684 4088 3038340570104 MainThread DEBUG oslo_concurrency.processutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000044\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpk45al4zk" returned: 0 in 0.343s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:00:53.699 4088 3038337401960 MainThread ERROR os_win.utils.jobutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000042\' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)instance-000000421B4F49AA-671B-4E76-BD0A-284ABA3AAB4612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)instance-000000421B4F49AA-671B-4E76-BD0A-284ABA3AAB4610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000042\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)instance-000000421B4F49AA-671B-4E76-BD0A-284ABA3AAB46%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '595007F4-B267-4344-977D-99694F6BC78F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117845), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 53), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 53), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000042' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)\n\nNot enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)\n\n'instance-00000042' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)", 'ErrorSummaryDescription': "'instance-00000042' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000042.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:53.699 4088 3038337401960 MainThread DEBUG os_win._utils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000042' failed to start. Not enough memory in the system to start the virtual machine instance-00000042. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000042' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Not enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) 'instance-00000042' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.951992511749268 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:53.699 4088 3038337403368 MainThread INFO nova.compute.manager [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] [instance: 5b7f9971-39c8-4512-b873-8d2e09fd6941] Took 2.14 seconds to deallocate network for instance. 2021-09-10 17:00:53.736 4088 3038340569224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:53.736 4088 3038340569224 MainThread INFO nova.compute.manager [-] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] VM Stopped (Lifecycle Event) 2021-09-10 17:00:53.736 4088 3038359394616 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000042" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:53.736 4088 3038359394616 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000042" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:53.750 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-4435098c-854a-4efc-a922-3dd6d24d3082 - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:53.750 4088 3038340569224 MainThread DEBUG nova.virt.hyperv.vmops [req-4435098c-854a-4efc-a922-3dd6d24d3082 - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:53.800 4088 3038359394616 MainThread DEBUG nova.compute.manager [req-a01b94d7-1e5e-43f5-9567-803883c349a3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-vif-deleted-9f4f550b-e4d6-4c6b-9ae8-78b11fd5034c external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:53.810 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.hostops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:00:53.810 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-4435098c-854a-4efc-a922-3dd6d24d3082 - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:53.832 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.hostops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:00:53.858 4088 3038340569224 MainThread INFO nova.compute.manager [req-4435098c-854a-4efc-a922-3dd6d24d3082 - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:53.888 4088 3038337403368 MainThread INFO nova.scheduler.client.report [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Deleted allocations for instance 5b7f9971-39c8-4512-b873-8d2e09fd6941 2021-09-10 17:00:53.949 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-774d124b-6a08-4af6-8bfd-31c18ba97fb9 bab205b0b6fc4ec2b4ffc7f2fdf0a14e 966c4d4813584979a85cc2a7055682b3 - default default] Lock "5b7f9971-39c8-4512-b873-8d2e09fd6941" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 34.656s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:54.074 4088 3038337403896 MainThread DEBUG nova.compute.provider_tree [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:00:54.097 4088 3038337403896 MainThread DEBUG nova.scheduler.client.report [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:00:54.097 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:54.097 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:00:54.190 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:00:54.190 4088 3038337403368 GreenThread-61 DEBUG nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:00:54.190 4088 3038337403368 GreenThread-61 DEBUG nova.network.neutron [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:00:54.222 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Setting boot order for instance: instance-00000044: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:00:54.265 4088 3038337403896 MainThread INFO nova.virt.block_device [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Booting with volume 36413d8d-e561-4803-ae3b-516b90e60d05 at /dev/sda 2021-09-10 17:00:54.329 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:00:54.359 4088 3038340570104 MainThread DEBUG os_win.utils.jobutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': '60F5E503-AD08-4D8B-96CB-CD6610A383AF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17693), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:54.379 4088 3038337403896 MainThread DEBUG os_brick.utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:00:54.379 4088 3038337403896 MainThread DEBUG os_brick.utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] <== get_connector_properties: return (0ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:00:54.379 4088 3038337403896 MainThread DEBUG nova.virt.block_device [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Updating existing volume attachment record: dfa718f1-065c-498c-bc22-a53adbef5f13 _volume_attach c:\openstack\build\nova\nova\virt\block_device.py:556 2021-09-10 17:00:54.591 4088 3038359394616 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:54.591 4088 3038359394616 MainThread INFO nova.compute.manager [-] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] VM Stopped (Lifecycle Event) 2021-09-10 17:00:54.591 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000044" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:54.591 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000044" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:54.607 4088 3038359394616 MainThread DEBUG nova.compute.manager [req-e39ad8c2-53b1-469e-9035-2b0a30d91b88 - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:54.607 4088 3038359394616 MainThread DEBUG nova.virt.hyperv.vmops [req-e39ad8c2-53b1-469e-9035-2b0a30d91b88 - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:54.639 4088 3038340570104 MainThread ERROR os_win.utils.jobutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-00000044\' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)instance-0000004441E7412B-4E76-46C2-BD92-2C94BFB1EF6F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)instance-0000004441E7412B-4E76-46C2-BD92-2C94BFB1EF6F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000044\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)instance-0000004441E7412B-4E76-46C2-BD92-2C94BFB1EF6F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '60F5E503-AD08-4D8B-96CB-CD6610A383AF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=139714), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 54), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 54), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000044' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)\n\nNot enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)\n\n'instance-00000044' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)", 'ErrorSummaryDescription': "'instance-00000044' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000044.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:54.639 4088 3038340570104 MainThread DEBUG os_win._utils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000044' failed to start. Not enough memory in the system to start the virtual machine instance-00000044. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000044' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Not enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) 'instance-00000044' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.31000852584838867 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:54.670 4088 3038359394616 MainThread DEBUG nova.compute.manager [req-e39ad8c2-53b1-469e-9035-2b0a30d91b88 - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:54.686 4088 3038359394616 MainThread INFO nova.compute.manager [req-e39ad8c2-53b1-469e-9035-2b0a30d91b88 - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:54.731 4088 3038337401960 MainThread DEBUG os_win.utils.jobutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '0B7DDCF6-9D70-4F7E-9BB7-B6C4F1BC461E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16884), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:54.887 4088 3038337403368 GreenThread-61 DEBUG nova.policy [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b736354cedde4200845a6c18d167eda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5b53ea59bd43bf84431d6daec45a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:00:54.936 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000042" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:54.936 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000042" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:54.936 4088 3038359394616 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:54.936 4088 3038359394616 MainThread INFO nova.compute.manager [-] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] VM Stopped (Lifecycle Event) 2021-09-10 17:00:54.981 4088 3038359394616 MainThread DEBUG nova.compute.manager [req-0d0694e5-a2a5-4259-99b2-f9260533fa15 - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:54.981 4088 3038359394616 MainThread DEBUG nova.virt.hyperv.vmops [req-0d0694e5-a2a5-4259-99b2-f9260533fa15 - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:55.000 4088 3038337401960 MainThread ERROR os_win.utils.jobutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000042\' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)instance-000000421B4F49AA-671B-4E76-BD0A-284ABA3AAB4612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)instance-000000421B4F49AA-671B-4E76-BD0A-284ABA3AAB4610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000042\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)instance-000000421B4F49AA-671B-4E76-BD0A-284ABA3AAB46%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0B7DDCF6-9D70-4F7E-9BB7-B6C4F1BC461E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=145741), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 54), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 54), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000042' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)\n\nNot enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)\n\n'instance-00000042' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46)", 'ErrorSummaryDescription': "'instance-00000042' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000042.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:55.012 4088 3038337401960 MainThread ERROR nova.virt.hyperv.vmops [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Failed to change vm state of instance-00000042 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000042' failed to start. 2021-09-10 17:00:55.012 4088 3038337401960 MainThread INFO nova.virt.hyperv.vmops [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Got request to destroy instance 2021-09-10 17:00:55.044 4088 3038359394616 MainThread DEBUG nova.compute.manager [req-0d0694e5-a2a5-4259-99b2-f9260533fa15 - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:55.101 4088 3038359394616 MainThread INFO nova.compute.manager [req-0d0694e5-a2a5-4259-99b2-f9260533fa15 - - - - -] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:55.669 4088 3038340570104 MainThread DEBUG os_win.utils.jobutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': 'C6750EA0-E913-438A-94F5-6A793726FABE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17272), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:55.811 4088 3038340570104 MainThread ERROR os_win.utils.jobutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-00000044\' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)instance-0000004441E7412B-4E76-46C2-BD92-2C94BFB1EF6F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)instance-0000004441E7412B-4E76-46C2-BD92-2C94BFB1EF6F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000044\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)instance-0000004441E7412B-4E76-46C2-BD92-2C94BFB1EF6F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C6750EA0-E913-438A-94F5-6A793726FABE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119112), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 55), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 55), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000044' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)\n\nNot enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)\n\n'instance-00000044' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)", 'ErrorSummaryDescription': "'instance-00000044' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000044.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:55.811 4088 3038340570104 MainThread DEBUG os_win._utils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000044' failed to start. Not enough memory in the system to start the virtual machine instance-00000044. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000044' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Not enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) 'instance-00000044' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.481416940689087 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:55.873 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000044" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:55.873 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000044" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:55.873 4088 3038359394616 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:55.873 4088 3038359394616 MainThread INFO nova.compute.manager [-] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] VM Stopped (Lifecycle Event) 2021-09-10 17:00:55.909 4088 3038359394616 MainThread DEBUG nova.compute.manager [req-232c0da1-6caa-49e5-9594-df656480e1ee - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:55.909 4088 3038359394616 MainThread DEBUG nova.virt.hyperv.vmops [req-232c0da1-6caa-49e5-9594-df656480e1ee - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:55.966 4088 3038359394616 MainThread DEBUG nova.compute.manager [req-232c0da1-6caa-49e5-9594-df656480e1ee - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:55.996 4088 3038359394616 MainThread INFO nova.compute.manager [req-232c0da1-6caa-49e5-9594-df656480e1ee - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:56.548 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "d5135b07-1b25-46d3-8c64-016de11558e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:56.622 4088 3038340735048 MainThread DEBUG nova.compute.manager [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:00:56.780 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:56.780 4088 3038340735048 MainThread DEBUG nova.virt.hardware [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:00:56.780 4088 3038340735048 MainThread INFO nova.compute.claims [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Claim successful on node n-h2-808474-1 2021-09-10 17:00:56.848 4088 3038340570104 MainThread DEBUG os_win.utils.jobutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': 'C03571DC-7B7B-432A-857B-2FB1ED29C569', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21184), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:56.988 4088 3038340570104 MainThread ERROR os_win.utils.jobutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-00000044\' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)instance-0000004441E7412B-4E76-46C2-BD92-2C94BFB1EF6F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)instance-0000004441E7412B-4E76-46C2-BD92-2C94BFB1EF6F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000044\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)instance-0000004441E7412B-4E76-46C2-BD92-2C94BFB1EF6F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C03571DC-7B7B-432A-857B-2FB1ED29C569', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=122278), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 56), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 56), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000044' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)\n\nNot enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)\n\n'instance-00000044' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)", 'ErrorSummaryDescription': "'instance-00000044' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000044.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:56.988 4088 3038340570104 MainThread DEBUG os_win._utils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000044' failed to start. Not enough memory in the system to start the virtual machine instance-00000044. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000044' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Not enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) 'instance-00000044' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.658503293991089 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:57.024 4088 3038340735048 MainThread DEBUG nova.virt.hyperv.hostops [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:00:57.024 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000044" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:57.024 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000044" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:57.024 4088 3038340735224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:57.024 4088 3038340735224 MainThread INFO nova.compute.manager [-] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] VM Stopped (Lifecycle Event) 2021-09-10 17:00:57.043 4088 3038340735048 MainThread DEBUG nova.virt.hyperv.hostops [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:00:57.066 4088 3038340735224 MainThread DEBUG nova.compute.manager [req-1f384992-c79a-4675-a234-d99155e21cf7 - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:57.066 4088 3038340735224 MainThread DEBUG nova.virt.hyperv.vmops [req-1f384992-c79a-4675-a234-d99155e21cf7 - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:57.107 4088 3038340735224 MainThread DEBUG nova.compute.manager [req-1f384992-c79a-4675-a234-d99155e21cf7 - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:57.154 4088 3038340735224 MainThread INFO nova.compute.manager [req-1f384992-c79a-4675-a234-d99155e21cf7 - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:57.154 4088 3038337401960 MainThread DEBUG nova.virt.hyperv.vmops [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:00:57.154 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000042" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:57.183 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000042" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:57.184 4088 3038337401960 MainThread DEBUG os_win.utils.compute.vmutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Successfully changed vm state of instance-00000042 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:00:57.200 4088 3038337401960 MainThread DEBUG nova.virt.hyperv.vmops [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Successfully changed state of VM instance-00000042 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:00:57.247 4088 3038337401960 MainThread DEBUG os_win.utils.jobutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '4CE918D2-505D-44C2-B5FA-C1375893873F', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17373), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:57.347 4088 3038340735048 MainThread DEBUG nova.compute.provider_tree [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:00:57.373 4088 3038340735048 MainThread DEBUG nova.scheduler.client.report [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:00:57.373 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.594s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:57.373 4088 3038340735048 MainThread DEBUG nova.compute.manager [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:00:57.373 4088 3038337401960 MainThread DEBUG os_win.utils.jobutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job succeeded: {'InstanceID': '4CE918D2-505D-44C2-B5FA-C1375893873F', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=117546), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:00:57.373 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000042" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:57.373 4088 3038337401960 MainThread DEBUG os_win.utils.pathutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Removing directory: C:\openstack\instances\instance-00000042 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:00:57.389 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000042" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:57.389 4088 3038337401960 MainThread ERROR nova.compute.manager [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000042' failed to start. Not enough memory in the system to start the virtual machine instance-00000042. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000042' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Not enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) 'instance-00000042' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Error code: 32778. 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Traceback (most recent call last): 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] return function(*args, **kwargs) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] admin_password, network_info, block_device_info) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] return function(self, *args, **kwds) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self.force_reraise() 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] raise self.value 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] should_plug_vifs=False) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 'req_state': req_state}) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self.force_reraise() 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] raise self.value 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] time.sleep(sleep_time) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self.force_reraise() 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] raise self.value 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] return f(*args, **kwargs) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] return self._wait_for_job(job_path) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] error_desc=err_desc) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000042' failed to start. 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Not enough memory in the system to start the virtual machine instance-00000042. 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000042' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Not enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 'instance-00000042' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Error code: 32778. 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] During handling of the above exception, another exception occurred: 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Traceback (most recent call last): 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] yield resources 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] accel_info=accel_info) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] return function(*args, **kwargs) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] admin_password, network_info, block_device_info) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] return function(self, *args, **kwds) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self.force_reraise() 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] raise self.value 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] should_plug_vifs=False) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 'req_state': req_state}) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self.force_reraise() 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] raise self.value 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] time.sleep(sleep_time) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self.force_reraise() 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] raise self.value 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] return f(*args, **kwargs) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] return self._wait_for_job(job_path) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] error_desc=err_desc) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000042' failed to start. 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Not enough memory in the system to start the virtual machine instance-00000042. 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000042' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Not enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 'instance-00000042' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Error code: 32778. 2021-09-10 17:00:57.389 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.389 4088 3038337401960 MainThread INFO nova.compute.manager [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Terminating instance 2021-09-10 17:00:57.389 4088 3038337401960 MainThread DEBUG nova.compute.manager [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:00:57.389 4088 3038337401960 MainThread INFO nova.virt.hyperv.vmops [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Got request to destroy instance 2021-09-10 17:00:57.410 4088 3038337401960 MainThread DEBUG nova.virt.hyperv.vmops [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:00:57.410 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000042" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:57.410 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000042" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:57.410 4088 3038337401960 MainThread INFO nova.compute.manager [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:00:57.410 4088 3038337401960 MainThread DEBUG nova.compute.claims [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:00:57.410 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:57.484 4088 3038340735048 MainThread DEBUG nova.compute.manager [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:00:57.484 4088 3038340735224 GreenThread-62 DEBUG nova.compute.manager [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:00:57.484 4088 3038340735224 GreenThread-62 DEBUG nova.network.neutron [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:00:57.590 4088 3038337401960 MainThread DEBUG nova.virt.hyperv.hostops [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:00:57.611 4088 3038337401960 MainThread DEBUG nova.virt.hyperv.hostops [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:00:57.716 4088 3038340735048 MainThread DEBUG nova.compute.manager [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:00:57.748 4088 3038340735048 MainThread INFO nova.virt.hyperv.vmops [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Spawning new instance 2021-09-10 17:00:57.748 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-00000046" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:57.748 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-00000046" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:57.748 4088 3038340735048 MainThread DEBUG nova.block_device [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:00:57.764 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:57.764 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:57.779 4088 3038340735048 MainThread DEBUG os_win.utils.pathutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Creating directory: C:\openstack\instances\instance-00000046 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:00:57.779 4088 3038340735048 MainThread DEBUG nova.virt.hyperv.vmops [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000046\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:00:57.840 4088 3038337401960 MainThread DEBUG nova.compute.provider_tree [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:00:57.878 4088 3038337401960 MainThread DEBUG nova.scheduler.client.report [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:00:57.878 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:57.878 4088 3038337401960 MainThread ERROR nova.compute.manager [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000042' failed to start. Not enough memory in the system to start the virtual machine instance-00000042. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000042' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Not enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) 'instance-00000042' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Error code: 32778. 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Traceback (most recent call last): 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] return function(*args, **kwargs) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] admin_password, network_info, block_device_info) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] return function(self, *args, **kwds) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self.force_reraise() 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] raise self.value 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] should_plug_vifs=False) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 'req_state': req_state}) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self.force_reraise() 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] raise self.value 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] time.sleep(sleep_time) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self.force_reraise() 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] raise self.value 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] return f(*args, **kwargs) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] return self._wait_for_job(job_path) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] error_desc=err_desc) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000042' failed to start. 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Not enough memory in the system to start the virtual machine instance-00000042. 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000042' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Not enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 'instance-00000042' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Error code: 32778. 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] During handling of the above exception, another exception occurred: 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Traceback (most recent call last): 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] accel_info=accel_info) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] return function(*args, **kwargs) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] admin_password, network_info, block_device_info) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] return function(self, *args, **kwds) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self.force_reraise() 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] raise self.value 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] should_plug_vifs=False) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 'req_state': req_state}) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self.force_reraise() 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] raise self.value 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] time.sleep(sleep_time) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self.force_reraise() 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] raise self.value 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] return f(*args, **kwargs) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] return self._wait_for_job(job_path) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] error_desc=err_desc) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000042' failed to start. 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Not enough memory in the system to start the virtual machine instance-00000042. 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000042' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Not enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 'instance-00000042' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Error code: 32778. 2021-09-10 17:00:57.878 4088 3038337401960 MainThread TRACE nova.compute.manager [instance: b1382ef7-107d-4113-a901-1877f9724cd1] 2021-09-10 17:00:57.887 4088 3038337401960 MainThread DEBUG nova.compute.utils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] WMI job failed with status 10. Error summary description: 'instance-00000042' failed to start. Not enough memory in the system to start the virtual machine instance-00000042. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:00:57.887 4088 3038337401960 MainThread DEBUG nova.compute.manager [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Build of instance b1382ef7-107d-4113-a901-1877f9724cd1 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000042' failed to start. Not enough memory in the system to start the virtual machine instance-00000042. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000042' failed to start. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Not enough memory in the system to start the virtual machine instance-00000042 with ram size 1024 megabytes. (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) 'instance-00000042' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1B4F49AA-671B-4E76-BD0A-284ABA3AAB46) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:00:57.887 4088 3038337401960 MainThread DEBUG nova.compute.manager [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:00:57.887 4088 3038337401960 MainThread DEBUG nova.compute.manager [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:00:57.887 4088 3038337401960 MainThread DEBUG nova.compute.manager [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:00:57.887 4088 3038337401960 MainThread DEBUG nova.network.neutron [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:00:58.014 4088 3038340735048 MainThread DEBUG nova.virt.hyperv.vmops [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Resizing VHD C:\openstack\instances\instance-00000046\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:00:58.052 4088 3038340570104 MainThread DEBUG os_win.utils.jobutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': 'B397E042-E1AA-4224-AE71-7EE4A246BE1D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18141), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:58.097 4088 3038340568344 GreenThread-57 DEBUG nova.network.neutron [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Updating instance_info_cache with network_info: [{"id": "538c2fc9-baf4-42d7-93b3-2607925180ca", "address": "fa:16:3e:7a:09:14", "network": {"id": "0ea42bde-2b84-433b-b8cc-45cd597feea2", "bridge": null, "label": "tempest-TaggedBootDevicesTest-481914895-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f00087122c344aa8a15842d2b03f9a16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap538c2fc9-ba", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b922a519-3efc-4024-abfb-de5c20d9d578", "address": "fa:16:3e:52:ed:ea", "network": {"id": "4ec0c006-6906-4edf-ab6c-82a39302b7c1", "bridge": null, "label": "tempest-device-tagging-net1-1870902891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "f00087122c344aa8a15842d2b03f9a16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapb922a519-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "46dd9dca-3150-45cc-9a35-bc1230d1380e", "address": "fa:16:3e:7d:39:9e", "network": {"id": "4ec0c006-6906-4edf-ab6c-82a39302b7c1", "bridge": null, "label": "tempest-device-tagging-net1-1870902891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "f00087122c344aa8a15842d2b03f9a16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap46dd9dca-31", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ae80e1f-4a5a-4c17-86ac-430359d3999e", "address": "fa:16:3e:4f:e0:94", "network": {"id": "4ec0c006-6906-4edf-ab6c-82a39302b7c1", "bridge": null, "label": "tempest-device-tagging-net1-1870902891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "f00087122c344aa8a15842d2b03f9a16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap0ae80e1f-4a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6422a3d-802b-4117-928d-1ca451d20e4b", "address": "fa:16:3e:e4:40:bd", "network": {"id": "4ec0c006-6906-4edf-ab6c-82a39302b7c1", "bridge": null, "label": "tempest-device-tagging-net1-1870902891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "f00087122c344aa8a15842d2b03f9a16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf6422a3d-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2d9bf38-2b6d-4a34-b975-f3967b383e21", "address": "fa:16:3e:79:99:30", "network": {"id": "4a8716e2-ae76-4874-9712-4b5d242ecfec", "bridge": null, "label": "tempest-device-tagging-net2-1694500291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.2"}}], "meta": {"injected": false, "tenant_id": "f00087122c344aa8a15842d2b03f9a16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapc2d9bf38-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6709b293-b51f-4901-9ca4-bef117b27521", "address": "fa:16:3e:33:6d:d1", "network": {"id": "4a8716e2-ae76-4874-9712-4b5d242ecfec", "bridge": null, "label": "tempest-device-tagging-net2-1694500291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.2"}}], "meta": {"injected": false, "tenant_id": "f00087122c344aa8a15842d2b03f9a16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap6709b293-b5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:00:58.128 4088 3038359396200 MainThread DEBUG nova.compute.manager [req-e0df6a7d-ca2f-4401-8d96-a10671687562 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Received event network-vif-deleted-c28da0b6-d5f9-4629-b9db-9907a00d8173 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:00:58.154 4088 3038340568344 GreenThread-57 DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Releasing lock "refresh_cache-b0745679-4000-4aff-bd0a-29ded4711f24" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:00:58.154 4088 3038340568344 GreenThread-57 DEBUG nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Instance network_info: |[{"id": "538c2fc9-baf4-42d7-93b3-2607925180ca", "address": "fa:16:3e:7a:09:14", "network": {"id": "0ea42bde-2b84-433b-b8cc-45cd597feea2", "bridge": null, "label": "tempest-TaggedBootDevicesTest-481914895-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f00087122c344aa8a15842d2b03f9a16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap538c2fc9-ba", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b922a519-3efc-4024-abfb-de5c20d9d578", "address": "fa:16:3e:52:ed:ea", "network": {"id": "4ec0c006-6906-4edf-ab6c-82a39302b7c1", "bridge": null, "label": "tempest-device-tagging-net1-1870902891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "f00087122c344aa8a15842d2b03f9a16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapb922a519-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "46dd9dca-3150-45cc-9a35-bc1230d1380e", "address": "fa:16:3e:7d:39:9e", "network": {"id": "4ec0c006-6906-4edf-ab6c-82a39302b7c1", "bridge": null, "label": "tempest-device-tagging-net1-1870902891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "f00087122c344aa8a15842d2b03f9a16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap46dd9dca-31", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ae80e1f-4a5a-4c17-86ac-430359d3999e", "address": "fa:16:3e:4f:e0:94", "network": {"id": "4ec0c006-6906-4edf-ab6c-82a39302b7c1", "bridge": null, "label": "tempest-device-tagging-net1-1870902891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "f00087122c344aa8a15842d2b03f9a16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap0ae80e1f-4a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6422a3d-802b-4117-928d-1ca451d20e4b", "address": "fa:16:3e:e4:40:bd", "network": {"id": "4ec0c006-6906-4edf-ab6c-82a39302b7c1", "bridge": null, "label": "tempest-device-tagging-net1-1870902891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "f00087122c344aa8a15842d2b03f9a16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf6422a3d-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2d9bf38-2b6d-4a34-b975-f3967b383e21", "address": "fa:16:3e:79:99:30", "network": {"id": "4a8716e2-ae76-4874-9712-4b5d242ecfec", "bridge": null, "label": "tempest-device-tagging-net2-1694500291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.2"}}], "meta": {"injected": false, "tenant_id": "f00087122c344aa8a15842d2b03f9a16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapc2d9bf38-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6709b293-b51f-4901-9ca4-bef117b27521", "address": "fa:16:3e:33:6d:d1", "network": {"id": "4a8716e2-ae76-4874-9712-4b5d242ecfec", "bridge": null, "label": "tempest-device-tagging-net2-1694500291", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.2"}}], "meta": {"injected": false, "tenant_id": "f00087122c344aa8a15842d2b03f9a16", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap6709b293-b5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:00:58.168 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Preparing to wait for external event network-vif-plugged-538c2fc9-baf4-42d7-93b3-2607925180ca prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:00:58.168 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:58.168 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:58.168 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Preparing to wait for external event network-vif-plugged-b922a519-3efc-4024-abfb-de5c20d9d578 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:00:58.168 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:58.168 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:58.168 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Preparing to wait for external event network-vif-plugged-46dd9dca-3150-45cc-9a35-bc1230d1380e prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:00:58.168 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:58.168 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:58.168 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Preparing to wait for external event network-vif-plugged-0ae80e1f-4a5a-4c17-86ac-430359d3999e prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:00:58.168 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:58.168 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:58.168 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Preparing to wait for external event network-vif-plugged-f6422a3d-802b-4117-928d-1ca451d20e4b prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:00:58.168 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:58.168 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:58.168 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Preparing to wait for external event network-vif-plugged-c2d9bf38-2b6d-4a34-b975-f3967b383e21 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:00:58.168 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:58.168 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:58.188 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Preparing to wait for external event network-vif-plugged-6709b293-b51f-4901-9ca4-bef117b27521 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:00:58.188 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:58.188 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:58.188 4088 3038340568520 MainThread DEBUG os_win.utils.compute.vmutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Creating VM instance-0000003b create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:00:58.252 4088 3038337403368 GreenThread-61 DEBUG nova.network.neutron [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Successfully created port: 2cb3a3ea-c0a3-46c3-851e-9241bf8661f1 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:00:58.274 4088 3038340735224 GreenThread-62 DEBUG nova.policy [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1711a7b02c2433dacfb4017cd0a812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b9dfa46b614e449b6aff88db2cfd6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:00:58.300 4088 3038340570104 MainThread ERROR os_win.utils.jobutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-00000044\' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)instance-0000004441E7412B-4E76-46C2-BD92-2C94BFB1EF6F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)instance-0000004441E7412B-4E76-46C2-BD92-2C94BFB1EF6F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000044\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)instance-0000004441E7412B-4E76-46C2-BD92-2C94BFB1EF6F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B397E042-E1AA-4224-AE71-7EE4A246BE1D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=133038), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 58), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 58), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000044' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)\n\nNot enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)\n\n'instance-00000044' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)", 'ErrorSummaryDescription': "'instance-00000044' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000044.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:58.300 4088 3038340570104 MainThread DEBUG os_win._utils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000044' failed to start. Not enough memory in the system to start the virtual machine instance-00000044. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000044' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Not enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) 'instance-00000044' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.971147060394287 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:58.300 4088 3038337402312 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000044" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:58.300 4088 3038337402312 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000044" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:58.300 4088 3038337404600 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:58.300 4088 3038337404600 MainThread INFO nova.compute.manager [-] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] VM Stopped (Lifecycle Event) 2021-09-10 17:00:58.340 4088 3038337404600 MainThread DEBUG nova.compute.manager [req-6da8a70f-87ea-4841-a3ce-fd8aa93f102d - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:58.340 4088 3038337404600 MainThread DEBUG nova.virt.hyperv.vmops [req-6da8a70f-87ea-4841-a3ce-fd8aa93f102d - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:58.389 4088 3038337404600 MainThread DEBUG nova.compute.manager [req-6da8a70f-87ea-4841-a3ce-fd8aa93f102d - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:58.425 4088 3038337404600 MainThread INFO nova.compute.manager [req-6da8a70f-87ea-4841-a3ce-fd8aa93f102d - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:59.384 4088 3038340570104 MainThread DEBUG os_win.utils.jobutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': '492DB246-0623-46B9-9CBB-B89071D9F300', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18463), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:00:59.440 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.volumeops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Attaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-29c54fbe-e8c1-401b-a427-b0b007cae3a7', 'target_lun': 0, 'volume_id': '29c54fbe-e8c1-401b-a427-b0b007cae3a7', 'auth_method': 'CHAP', 'auth_username': 'rBnpxR9o56RqMYWmjN3D', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'reserved', 'instance': 'b0745679-4000-4aff-bd0a-29ded4711f24', 'attached_at': '', 'detached_at': '', 'volume_id': '29c54fbe-e8c1-401b-a427-b0b007cae3a7', 'serial': '29c54fbe-e8c1-401b-a427-b0b007cae3a7'} to instance-0000003b _attach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:108 2021-09-10 17:00:59.450 4088 3038340568520 MainThread DEBUG os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-29c54fbe-e8c1-401b-a427-b0b007cae3a7', 'target_lun': 0, 'volume_id': '29c54fbe-e8c1-401b-a427-b0b007cae3a7', 'auth_method': 'CHAP', 'auth_username': 'rBnpxR9o56RqMYWmjN3D', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:00:59.450 4088 3038340568520 MainThread INFO os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Attempting to establish an iSCSI session to target iqn.2010-10.org.openstack:volume-29c54fbe-e8c1-401b-a427-b0b007cae3a7 on portal 10.222.0.55:3260 accessing LUN 0 using initiator None. 2021-09-10 17:00:59.450 4088 3038340568520 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Logging in iSCSI target iqn.2010-10.org.openstack:volume-29c54fbe-e8c1-401b-a427-b0b007cae3a7 login_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:401 2021-09-10 17:00:59.545 4088 3038340570104 MainThread ERROR os_win.utils.jobutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-00000044\' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)instance-0000004441E7412B-4E76-46C2-BD92-2C94BFB1EF6F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)instance-0000004441E7412B-4E76-46C2-BD92-2C94BFB1EF6F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000044\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)instance-0000004441E7412B-4E76-46C2-BD92-2C94BFB1EF6F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '492DB246-0623-46B9-9CBB-B89071D9F300', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=131363), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 0, 59), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 0, 59), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000044' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)\n\nNot enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)\n\n'instance-00000044' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)", 'ErrorSummaryDescription': "'instance-00000044' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000044.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:00:59.545 4088 3038340570104 MainThread DEBUG os_win._utils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000044' failed to start. Not enough memory in the system to start the virtual machine instance-00000044. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000044' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Not enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) 'instance-00000044' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.2160115242004395 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:00:59.545 4088 3038337404600 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:00:59.545 4088 3038337404600 MainThread INFO nova.compute.manager [-] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] VM Stopped (Lifecycle Event) 2021-09-10 17:00:59.575 4088 3038337402312 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000044" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:00:59.575 4088 3038337402312 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000044" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:00:59.592 4088 3038337404600 MainThread DEBUG nova.compute.manager [req-17ff7c35-9ec9-4ea5-8c89-0a63e1d4ec4f - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:00:59.592 4088 3038337404600 MainThread DEBUG nova.virt.hyperv.vmops [req-17ff7c35-9ec9-4ea5-8c89-0a63e1d4ec4f - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:00:59.653 4088 3038337404600 MainThread DEBUG nova.compute.manager [req-17ff7c35-9ec9-4ea5-8c89-0a63e1d4ec4f - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:00:59.707 4088 3038337404600 MainThread INFO nova.compute.manager [req-17ff7c35-9ec9-4ea5-8c89-0a63e1d4ec4f - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:00:59.793 4088 3038337403368 GreenThread-61 DEBUG nova.network.neutron [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Successfully created port: 86609ec1-a690-46a4-8ef9-4623364e23fe _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:01:00.356 4088 3038337401960 MainThread DEBUG nova.network.neutron [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:00.449 4088 3038337401960 MainThread INFO nova.compute.manager [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: b1382ef7-107d-4113-a901-1877f9724cd1] Took 2.56 seconds to deallocate network for instance. 2021-09-10 17:01:00.496 4088 3038337403896 MainThread INFO nova.virt.block_device [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Booting with volume 174960b8-7aa2-43c8-aff0-31d5f7de9324 at /dev/sdb 2021-09-10 17:01:00.559 4088 3038340570104 MainThread DEBUG os_win.utils.jobutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': '84B0AA96-A96B-43FA-A1E1-DAAB1A63EB7D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18197), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:00.642 4088 3038337403896 MainThread DEBUG os_brick.utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:01:00.642 4088 3038337403896 MainThread DEBUG os_brick.utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] <== get_connector_properties: return (0ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:01:00.642 4088 3038337403896 MainThread DEBUG nova.virt.block_device [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Updating existing volume attachment record: 5c4715a6-514b-4867-9c64-75d97f6a582e _volume_attach c:\openstack\build\nova\nova\virt\block_device.py:556 2021-09-10 17:01:00.642 4088 3038340735224 GreenThread-62 DEBUG nova.network.neutron [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Successfully created port: 8400be29-8cd5-4f21-92a4-fadfc731ccd5 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:01:00.668 4088 3038337401960 MainThread INFO nova.scheduler.client.report [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Deleted allocations for instance b1382ef7-107d-4113-a901-1877f9724cd1 2021-09-10 17:01:00.716 4088 3038337401960 MainThread DEBUG oslo_concurrency.lockutils [req-a2b70c9f-d640-4816-a7e5-589b74d397ad 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "b1382ef7-107d-4113-a901-1877f9724cd1" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 38.688s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:00.731 4088 3038340570104 MainThread ERROR os_win.utils.jobutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job failed: {'RawErrors': (('124\'instance-00000044\' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)instance-0000004441E7412B-4E76-46C2-BD92-2C94BFB1EF6F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)instance-0000004441E7412B-4E76-46C2-BD92-2C94BFB1EF6F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000044\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)instance-0000004441E7412B-4E76-46C2-BD92-2C94BFB1EF6F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '84B0AA96-A96B-43FA-A1E1-DAAB1A63EB7D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=131333), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000044' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)\n\nNot enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)\n\n'instance-00000044' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F)", 'ErrorSummaryDescription': "'instance-00000044' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000044.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:00.731 4088 3038340570104 MainThread ERROR nova.virt.hyperv.vmops [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Failed to change vm state of instance-00000044 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000044' failed to start. 2021-09-10 17:01:00.731 4088 3038340570104 MainThread INFO nova.virt.hyperv.vmops [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Got request to destroy instance 2021-09-10 17:01:00.784 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000044" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:00.784 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000044" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:00.784 4088 3038337401960 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:00.784 4088 3038337401960 MainThread INFO nova.compute.manager [-] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] VM Stopped (Lifecycle Event) 2021-09-10 17:01:00.807 4088 3038337401960 MainThread DEBUG nova.compute.manager [req-3324a4fb-8da7-413d-b8fa-6e843677093a - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:00.807 4088 3038337401960 MainThread DEBUG nova.virt.hyperv.vmops [req-3324a4fb-8da7-413d-b8fa-6e843677093a - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:00.871 4088 3038337401960 MainThread DEBUG nova.compute.manager [req-3324a4fb-8da7-413d-b8fa-6e843677093a - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:00.904 4088 3038337401960 MainThread INFO nova.compute.manager [req-3324a4fb-8da7-413d-b8fa-6e843677093a - - - - -] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:01.827 4088 3038337403368 GreenThread-61 DEBUG nova.network.neutron [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Successfully created port: 94855bc3-5116-4b2f-ac7b-9de0d4d7ab82 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:01:02.402 4088 3038340735224 GreenThread-62 DEBUG nova.network.neutron [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Successfully updated port: 8400be29-8cd5-4f21-92a4-fadfc731ccd5 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:01:02.425 4088 3038340735224 GreenThread-62 DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Acquired lock "refresh_cache-d5135b07-1b25-46d3-8c64-016de11558e4" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:02.425 4088 3038340735224 GreenThread-62 DEBUG nova.network.neutron [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:01:02.558 4088 3038340735224 GreenThread-62 DEBUG nova.network.neutron [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:01:02.861 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:01:02.861 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000044" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:02.861 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000044" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:02.883 4088 3038340570104 MainThread DEBUG os_win.utils.compute.vmutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Successfully changed vm state of instance-00000044 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:01:02.883 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Successfully changed state of VM instance-00000044 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:01:02.941 4088 3038340570104 MainThread DEBUG os_win.utils.jobutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Waiting for WMI job: {'InstanceID': 'EECAECCB-AAF6-4D1D-AF08-B583FD1EC903', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21896), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:03.192 4088 3038340570104 MainThread DEBUG os_win.utils.jobutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] WMI job succeeded: {'InstanceID': 'EECAECCB-AAF6-4D1D-AF08-B583FD1EC903', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=150388), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:01:03.192 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000044" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:03.192 4088 3038340570104 MainThread DEBUG os_win.utils.pathutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Removing directory: C:\openstack\instances\instance-00000044 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:01:03.192 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000044" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:03.192 4088 3038340570104 MainThread ERROR nova.compute.manager [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000044' failed to start. Not enough memory in the system to start the virtual machine instance-00000044. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000044' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Not enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) 'instance-00000044' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Error code: 32778. 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Traceback (most recent call last): 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] return function(*args, **kwargs) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] admin_password, network_info, block_device_info) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] return function(self, *args, **kwds) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self.force_reraise() 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] raise self.value 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] should_plug_vifs=False) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 'req_state': req_state}) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self.force_reraise() 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] raise self.value 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] time.sleep(sleep_time) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self.force_reraise() 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] raise self.value 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] return f(*args, **kwargs) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] return self._wait_for_job(job_path) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] error_desc=err_desc) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000044' failed to start. 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Not enough memory in the system to start the virtual machine instance-00000044. 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000044' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Not enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 'instance-00000044' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Error code: 32778. 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] During handling of the above exception, another exception occurred: 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Traceback (most recent call last): 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] yield resources 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] accel_info=accel_info) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] return function(*args, **kwargs) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] admin_password, network_info, block_device_info) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] return function(self, *args, **kwds) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self.force_reraise() 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] raise self.value 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] should_plug_vifs=False) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 'req_state': req_state}) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self.force_reraise() 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] raise self.value 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] time.sleep(sleep_time) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self.force_reraise() 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] raise self.value 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] return f(*args, **kwargs) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] return self._wait_for_job(job_path) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] error_desc=err_desc) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000044' failed to start. 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Not enough memory in the system to start the virtual machine instance-00000044. 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000044' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Not enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 'instance-00000044' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Error code: 32778. 2021-09-10 17:01:03.192 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.192 4088 3038340570104 MainThread INFO nova.compute.manager [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Terminating instance 2021-09-10 17:01:03.192 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:01:03.215 4088 3038340570104 MainThread INFO nova.virt.hyperv.vmops [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Got request to destroy instance 2021-09-10 17:01:03.215 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:01:03.215 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000044" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:03.215 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "instance-00000044" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:03.215 4088 3038340570104 MainThread INFO nova.compute.manager [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Took 0.00 seconds to destroy the instance on the hypervisor. 2021-09-10 17:01:03.215 4088 3038340570104 MainThread DEBUG nova.compute.claims [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:01:03.215 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:03.439 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.hostops [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:01:03.439 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.hostops [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:01:03.695 4088 3038340570104 MainThread DEBUG nova.compute.provider_tree [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:01:03.713 4088 3038340570104 MainThread DEBUG nova.scheduler.client.report [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:01:03.713 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.500s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:03.713 4088 3038340570104 MainThread ERROR nova.compute.manager [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000044' failed to start. Not enough memory in the system to start the virtual machine instance-00000044. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000044' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Not enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) 'instance-00000044' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Error code: 32778. 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Traceback (most recent call last): 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] return function(*args, **kwargs) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] admin_password, network_info, block_device_info) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] return function(self, *args, **kwds) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self.force_reraise() 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] raise self.value 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] should_plug_vifs=False) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 'req_state': req_state}) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self.force_reraise() 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] raise self.value 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] time.sleep(sleep_time) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self.force_reraise() 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] raise self.value 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] return f(*args, **kwargs) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] return self._wait_for_job(job_path) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] error_desc=err_desc) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000044' failed to start. 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Not enough memory in the system to start the virtual machine instance-00000044. 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000044' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Not enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 'instance-00000044' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Error code: 32778. 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] During handling of the above exception, another exception occurred: 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Traceback (most recent call last): 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] accel_info=accel_info) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] return function(*args, **kwargs) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] admin_password, network_info, block_device_info) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] return function(self, *args, **kwds) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self.force_reraise() 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] raise self.value 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] should_plug_vifs=False) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 'req_state': req_state}) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self.force_reraise() 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] raise self.value 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] time.sleep(sleep_time) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self.force_reraise() 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] raise self.value 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] return f(*args, **kwargs) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] return self._wait_for_job(job_path) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] error_desc=err_desc) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000044' failed to start. 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Not enough memory in the system to start the virtual machine instance-00000044. 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000044' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Not enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 'instance-00000044' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Error code: 32778. 2021-09-10 17:01:03.713 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] 2021-09-10 17:01:03.713 4088 3038340570104 MainThread DEBUG nova.compute.utils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] WMI job failed with status 10. Error summary description: 'instance-00000044' failed to start. Not enough memory in the system to start the virtual machine instance-00000044. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:01:03.713 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Build of instance 4cd8ee20-649d-4e14-8c26-085e78ef091d was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000044' failed to start. Not enough memory in the system to start the virtual machine instance-00000044. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000044' failed to start. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Not enough memory in the system to start the virtual machine instance-00000044 with ram size 1024 megabytes. (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) 'instance-00000044' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 41E7412B-4E76-46C2-BD92-2C94BFB1EF6F) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:01:03.713 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:01:03.713 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:01:03.713 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:01:03.713 4088 3038340570104 MainThread DEBUG nova.network.neutron [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:01:03.730 4088 3038340735224 GreenThread-62 DEBUG nova.network.neutron [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Updating instance_info_cache with network_info: [{"id": "8400be29-8cd5-4f21-92a4-fadfc731ccd5", "address": "fa:16:3e:f8:f6:63", "network": {"id": "3eb3df69-b47c-4acb-8098-7e28b146140d", "bridge": null, "label": "tempest-ServerDiskConfigTestJSON-1037400376-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e0b9dfa46b614e449b6aff88db2cfd6b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8400be29-8c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:03.747 4088 3038340735224 GreenThread-62 DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Releasing lock "refresh_cache-d5135b07-1b25-46d3-8c64-016de11558e4" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:03.747 4088 3038340735224 GreenThread-62 DEBUG nova.compute.manager [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Instance network_info: |[{"id": "8400be29-8cd5-4f21-92a4-fadfc731ccd5", "address": "fa:16:3e:f8:f6:63", "network": {"id": "3eb3df69-b47c-4acb-8098-7e28b146140d", "bridge": null, "label": "tempest-ServerDiskConfigTestJSON-1037400376-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e0b9dfa46b614e449b6aff88db2cfd6b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8400be29-8c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:01:03.763 4088 3038340735048 MainThread DEBUG nova.compute.manager [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Preparing to wait for external event network-vif-plugged-8400be29-8cd5-4f21-92a4-fadfc731ccd5 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:01:03.763 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "d5135b07-1b25-46d3-8c64-016de11558e4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:03.763 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "d5135b07-1b25-46d3-8c64-016de11558e4-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:03.763 4088 3038340735048 MainThread DEBUG os_win.utils.compute.vmutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Creating VM instance-00000046 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:01:03.840 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Lock "9015b51e-d705-4694-8c71-5322dc51aa39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:03.865 4088 3038340568696 MainThread DEBUG nova.compute.manager [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:01:03.967 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:03.988 4088 3038340568696 MainThread DEBUG nova.virt.hardware [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:01:03.988 4088 3038340568696 MainThread INFO nova.compute.claims [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Claim successful on node n-h2-808474-1 2021-09-10 17:01:04.184 4088 3038340568696 MainThread DEBUG nova.virt.hyperv.hostops [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:01:04.184 4088 3038340568696 MainThread DEBUG nova.virt.hyperv.hostops [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:01:04.220 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-f2257654-a995-4dc8-be3b-54521581bb06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Received event network-changed-8400be29-8cd5-4f21-92a4-fadfc731ccd5 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:04.220 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-f2257654-a995-4dc8-be3b-54521581bb06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Refreshing instance network info cache due to event network-changed-8400be29-8cd5-4f21-92a4-fadfc731ccd5. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:01:04.220 4088 3038359395496 MainThread DEBUG oslo_concurrency.lockutils [req-f2257654-a995-4dc8-be3b-54521581bb06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-d5135b07-1b25-46d3-8c64-016de11558e4" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:04.220 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-f2257654-a995-4dc8-be3b-54521581bb06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Refreshing network info cache for port 8400be29-8cd5-4f21-92a4-fadfc731ccd5 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:01:04.449 4088 3038340568696 MainThread DEBUG nova.compute.provider_tree [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:01:04.465 4088 3038340568520 MainThread DEBUG os_win.utils.storage.diskutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:01:04.465 4088 3038340568696 MainThread DEBUG nova.scheduler.client.report [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:01:04.465 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:04.465 4088 3038340568696 MainThread DEBUG nova.compute.manager [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:01:04.560 4088 3038340568696 MainThread DEBUG nova.compute.utils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 17:01:04.560 4088 3038340569576 GreenThread-63 DEBUG nova.compute.manager [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:01:04.560 4088 3038340569576 GreenThread-63 DEBUG nova.network.neutron [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:01:04.591 4088 3038340568696 MainThread DEBUG nova.compute.manager [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:01:04.652 4088 3038340568520 MainThread DEBUG os_win.utils.storage.diskutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:01:04.722 4088 3038340568520 MainThread DEBUG os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] <== connect_volume: return (5272ms) {'type': 'block', 'path': '\\\\.\\PhysicalDrive1', 'number': 1, 'scsi_wwn': '360014051D5A47661C3646048CF6726B4'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:01:04.815 4088 3038340568696 MainThread DEBUG nova.compute.manager [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:01:04.840 4088 3038340568696 MainThread INFO nova.virt.hyperv.vmops [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Spawning new instance 2021-09-10 17:01:04.856 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Lock "instance-00000048" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:04.856 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Lock "instance-00000048" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:04.856 4088 3038340568696 MainThread DEBUG nova.block_device [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:01:04.856 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:04.856 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:04.856 4088 3038340568696 MainThread DEBUG os_win.utils.pathutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Creating directory: C:\openstack\instances\instance-00000048 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:01:04.856 4088 3038340568696 MainThread DEBUG nova.virt.hyperv.vmops [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000048\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:01:05.012 4088 3038340569576 GreenThread-63 DEBUG nova.policy [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0574bfa519834ae2b8ce81f3a560b957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b055dc3ac4474788971e8148bec63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:01:05.164 4088 3038340568696 MainThread DEBUG nova.virt.hyperv.vmops [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Resizing VHD C:\openstack\instances\instance-00000048\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:01:05.420 4088 3038340570104 MainThread DEBUG nova.network.neutron [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:05.472 4088 3038340570104 MainThread INFO nova.compute.manager [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] [instance: 4cd8ee20-649d-4e14-8c26-085e78ef091d] Took 1.75 seconds to deallocate network for instance. 2021-09-10 17:01:05.565 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-f2257654-a995-4dc8-be3b-54521581bb06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Updated VIF entry in instance network info cache for port 8400be29-8cd5-4f21-92a4-fadfc731ccd5. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:01:05.565 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-f2257654-a995-4dc8-be3b-54521581bb06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Updating instance_info_cache with network_info: [{"id": "8400be29-8cd5-4f21-92a4-fadfc731ccd5", "address": "fa:16:3e:f8:f6:63", "network": {"id": "3eb3df69-b47c-4acb-8098-7e28b146140d", "bridge": null, "label": "tempest-ServerDiskConfigTestJSON-1037400376-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e0b9dfa46b614e449b6aff88db2cfd6b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8400be29-8c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:05.590 4088 3038359395496 MainThread DEBUG oslo_concurrency.lockutils [req-f2257654-a995-4dc8-be3b-54521581bb06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-d5135b07-1b25-46d3-8c64-016de11558e4" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:05.675 4088 3038340570104 MainThread INFO nova.scheduler.client.report [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Deleted allocations for instance 4cd8ee20-649d-4e14-8c26-085e78ef091d 2021-09-10 17:01:05.764 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-78cb4793-49c6-427e-973e-ae43812fe37c 42267190de3648eea52604e6b2444d20 6ca07d9dc99a4581a698a232ffa065db - default default] Lock "4cd8ee20-649d-4e14-8c26-085e78ef091d" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 33.812s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:05.886 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.volumeops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Attaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-11b5cce0-1a22-4820-b4b0-bcc0b921fc84', 'target_lun': 0, 'volume_id': '11b5cce0-1a22-4820-b4b0-bcc0b921fc84', 'auth_method': 'CHAP', 'auth_username': 'oi27LCgnLkajkpFVbsVr', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'reserved', 'instance': 'b0745679-4000-4aff-bd0a-29ded4711f24', 'attached_at': '', 'detached_at': '', 'volume_id': '11b5cce0-1a22-4820-b4b0-bcc0b921fc84', 'serial': '11b5cce0-1a22-4820-b4b0-bcc0b921fc84'} to instance-0000003b _attach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:108 2021-09-10 17:01:05.886 4088 3038340568520 MainThread DEBUG os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-11b5cce0-1a22-4820-b4b0-bcc0b921fc84', 'target_lun': 0, 'volume_id': '11b5cce0-1a22-4820-b4b0-bcc0b921fc84', 'auth_method': 'CHAP', 'auth_username': 'oi27LCgnLkajkpFVbsVr', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:01:05.886 4088 3038340568520 MainThread INFO os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Attempting to establish an iSCSI session to target iqn.2010-10.org.openstack:volume-11b5cce0-1a22-4820-b4b0-bcc0b921fc84 on portal 10.222.0.55:3260 accessing LUN 0 using initiator None. 2021-09-10 17:01:05.886 4088 3038340568520 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Logging in iSCSI target iqn.2010-10.org.openstack:volume-11b5cce0-1a22-4820-b4b0-bcc0b921fc84 login_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:401 2021-09-10 17:01:06.191 4088 3038337403368 GreenThread-61 DEBUG nova.network.neutron [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Successfully created port: 960e99f9-c9fe-476e-a025-db2754fea043 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:01:06.284 4088 3038337403896 MainThread INFO nova.virt.block_device [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Booting with volume 7687f3e5-535f-43cb-92df-79afc5c86fb1 at /dev/sdc 2021-09-10 17:01:06.284 4088 3038340735048 MainThread DEBUG nova.virt.hyperv.vmops [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:06.344 4088 3038337403896 MainThread DEBUG os_brick.utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:01:06.344 4088 3038337403896 MainThread DEBUG os_brick.utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] <== get_connector_properties: return (0ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:01:06.371 4088 3038337403896 MainThread DEBUG nova.virt.block_device [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Updating existing volume attachment record: d5a05f06-26e9-4142-abdc-a6cc7008f15a _volume_attach c:\openstack\build\nova\nova\virt\block_device.py:556 2021-09-10 17:01:08.558 4088 3038337403368 GreenThread-61 DEBUG nova.network.neutron [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Successfully created port: 4179be6b-0ba7-4aaa-b9aa-0c37a0c9fab0 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:01:09.106 4088 3038340569576 GreenThread-63 DEBUG nova.network.neutron [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Successfully created port: 862ce870-f1c2-4319-8822-4e0ed618ebc8 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:01:10.902 4088 3038340568520 MainThread DEBUG os_win.utils.storage.diskutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:01:10.997 4088 3038340568520 MainThread DEBUG os_win.utils.storage.diskutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:01:11.050 4088 3038340568520 MainThread DEBUG os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] <== connect_volume: return (5164ms) {'type': 'block', 'path': '\\\\.\\PhysicalDrive2', 'number': 2, 'scsi_wwn': '3600140561E1FE69144643D9A9CE31E91'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:01:11.560 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.volumeops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Attaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-f0f70f22-4412-4d14-80e3-17ea362502a8', 'target_lun': 0, 'volume_id': 'f0f70f22-4412-4d14-80e3-17ea362502a8', 'auth_method': 'CHAP', 'auth_username': 'V3gDNm77PePMLgud3BQ5', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'reserved', 'instance': 'b0745679-4000-4aff-bd0a-29ded4711f24', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0f70f22-4412-4d14-80e3-17ea362502a8', 'serial': 'f0f70f22-4412-4d14-80e3-17ea362502a8'} to instance-0000003b _attach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:108 2021-09-10 17:01:11.560 4088 3038340568520 MainThread DEBUG os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-f0f70f22-4412-4d14-80e3-17ea362502a8', 'target_lun': 0, 'volume_id': 'f0f70f22-4412-4d14-80e3-17ea362502a8', 'auth_method': 'CHAP', 'auth_username': 'V3gDNm77PePMLgud3BQ5', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:01:11.560 4088 3038340568520 MainThread INFO os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Attempting to establish an iSCSI session to target iqn.2010-10.org.openstack:volume-f0f70f22-4412-4d14-80e3-17ea362502a8 on portal 10.222.0.55:3260 accessing LUN 0 using initiator None. 2021-09-10 17:01:11.560 4088 3038340568520 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Logging in iSCSI target iqn.2010-10.org.openstack:volume-f0f70f22-4412-4d14-80e3-17ea362502a8 login_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:401 2021-09-10 17:01:11.618 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:01:11.621 4088 3038337403896 MainThread INFO nova.virt.hyperv.vmops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Spawning new instance 2021-09-10 17:01:11.637 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "instance-0000003f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:11.637 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "instance-0000003f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:11.637 4088 3038337403896 MainThread DEBUG nova.block_device [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] block_device_list ['sda', 'sdb', 'sdc'] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:01:12.048 4088 3038337403368 GreenThread-61 DEBUG nova.network.neutron [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Successfully updated port: 2cb3a3ea-c0a3-46c3-851e-9241bf8661f1 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:01:12.917 4088 3038340569576 GreenThread-63 DEBUG nova.network.neutron [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Successfully updated port: 862ce870-f1c2-4319-8822-4e0ed618ebc8 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:01:12.935 4088 3038340569576 GreenThread-63 DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Acquired lock "refresh_cache-9015b51e-d705-4694-8c71-5322dc51aa39" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:12.935 4088 3038340569576 GreenThread-63 DEBUG nova.network.neutron [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:01:13.293 4088 3038340569576 GreenThread-63 DEBUG nova.network.neutron [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:01:13.728 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-9f30d139-0606-429f-8f0b-8349112e3c64 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-changed-2cb3a3ea-c0a3-46c3-851e-9241bf8661f1 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:13.728 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-9f30d139-0606-429f-8f0b-8349112e3c64 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Refreshing instance network info cache due to event network-changed-2cb3a3ea-c0a3-46c3-851e-9241bf8661f1. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:01:13.728 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-9f30d139-0606-429f-8f0b-8349112e3c64 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:13.728 4088 3038342147416 MainThread DEBUG nova.network.neutron [req-9f30d139-0606-429f-8f0b-8349112e3c64 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Refreshing network info cache for port 2cb3a3ea-c0a3-46c3-851e-9241bf8661f1 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:01:13.804 4088 3038342147416 MainThread DEBUG nova.network.neutron [req-9f30d139-0606-429f-8f0b-8349112e3c64 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:01:14.012 4088 3038342147416 MainThread DEBUG nova.network.neutron [req-9f30d139-0606-429f-8f0b-8349112e3c64 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:14.028 4088 3038342147416 MainThread DEBUG oslo_concurrency.lockutils [req-9f30d139-0606-429f-8f0b-8349112e3c64 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:14.302 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-15ae53c9-dca1-499b-88ec-d73f74a50179 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Received event network-vif-plugged-8400be29-8cd5-4f21-92a4-fadfc731ccd5 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:14.302 4088 3038359395496 MainThread DEBUG oslo_concurrency.lockutils [req-15ae53c9-dca1-499b-88ec-d73f74a50179 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d5135b07-1b25-46d3-8c64-016de11558e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:14.302 4088 3038359395496 MainThread DEBUG oslo_concurrency.lockutils [req-15ae53c9-dca1-499b-88ec-d73f74a50179 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d5135b07-1b25-46d3-8c64-016de11558e4-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:14.302 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-15ae53c9-dca1-499b-88ec-d73f74a50179 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Processing event network-vif-plugged-8400be29-8cd5-4f21-92a4-fadfc731ccd5 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:01:14.342 4088 3038340735048 MainThread INFO nova.virt.hyperv.vmops [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Using config drive for instance 2021-09-10 17:01:14.483 4088 3038340569576 GreenThread-63 DEBUG nova.network.neutron [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Updating instance_info_cache with network_info: [{"id": "862ce870-f1c2-4319-8822-4e0ed618ebc8", "address": "fa:16:3e:b9:0a:51", "network": {"id": "5f474ded-ff91-42f7-a10b-055b13eaa82a", "bridge": null, "label": "tempest-ServersNegativeTestJSON-2099773424-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "58b055dc3ac4474788971e8148bec63e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap862ce870-f1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:14.483 4088 3038340735048 MainThread INFO nova.virt.hyperv.vmops [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Creating config drive at C:\openstack\instances\instance-00000046\configdrive.iso 2021-09-10 17:01:14.589 4088 3038340735048 MainThread DEBUG oslo_concurrency.processutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000046\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpgznr3ba6 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:01:14.732 4088 3038340569576 GreenThread-63 DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Releasing lock "refresh_cache-9015b51e-d705-4694-8c71-5322dc51aa39" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:14.746 4088 3038340569576 GreenThread-63 DEBUG nova.compute.manager [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Instance network_info: |[{"id": "862ce870-f1c2-4319-8822-4e0ed618ebc8", "address": "fa:16:3e:b9:0a:51", "network": {"id": "5f474ded-ff91-42f7-a10b-055b13eaa82a", "bridge": null, "label": "tempest-ServersNegativeTestJSON-2099773424-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "58b055dc3ac4474788971e8148bec63e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap862ce870-f1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:01:14.746 4088 3038340568696 MainThread DEBUG nova.compute.manager [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Preparing to wait for external event network-vif-plugged-862ce870-f1c2-4319-8822-4e0ed618ebc8 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:01:14.746 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Lock "9015b51e-d705-4694-8c71-5322dc51aa39-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:14.746 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Lock "9015b51e-d705-4694-8c71-5322dc51aa39-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:14.746 4088 3038340568696 MainThread DEBUG os_win.utils.compute.vmutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Creating VM instance-00000048 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:01:14.950 4088 3038340735048 MainThread DEBUG oslo_concurrency.processutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000046\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpgznr3ba6" returned: 0 in 0.359s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:01:15.528 4088 3038337403368 GreenThread-61 DEBUG nova.network.neutron [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Successfully updated port: 2328bac5-09f9-4dd3-a3ff-1f5673edded4 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:01:15.746 4088 3038340735048 MainThread DEBUG nova.virt.hyperv.vmops [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Setting boot order for instance: instance-00000046: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:01:15.858 4088 3038340735048 MainThread DEBUG nova.virt.hyperv.vmops [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:01:15.887 4088 3038340735048 MainThread DEBUG os_win.utils.jobutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': 'AD9D78C4-5B55-496E-B8CA-B3A21A9BEDDB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16618), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:16.044 4088 3038340735048 MainThread ERROR os_win.utils.jobutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000046\' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)instance-0000004654123C57-4254-48EC-9CEE-B50DC772071212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)instance-0000004654123C57-4254-48EC-9CEE-B50DC772071210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000046\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)instance-0000004654123C57-4254-48EC-9CEE-B50DC7720712%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'AD9D78C4-5B55-496E-B8CA-B3A21A9BEDDB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=132529), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 15), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 16), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000046' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)\n\nNot enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)\n\n'instance-00000046' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)", 'ErrorSummaryDescription': "'instance-00000046' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000046.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:16.044 4088 3038340735048 MainThread DEBUG os_win._utils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000046' failed to start. Not enough memory in the system to start the virtual machine instance-00000046. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000046' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Not enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) 'instance-00000046' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1858658790588379 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:16.404 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-1aa1613f-41a4-4ccd-8213-9decb68bc3e0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Received event network-changed-862ce870-f1c2-4319-8822-4e0ed618ebc8 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:16.404 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-1aa1613f-41a4-4ccd-8213-9decb68bc3e0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Refreshing instance network info cache due to event network-changed-862ce870-f1c2-4319-8822-4e0ed618ebc8. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:01:16.404 4088 3038359395496 MainThread DEBUG oslo_concurrency.lockutils [req-1aa1613f-41a4-4ccd-8213-9decb68bc3e0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-9015b51e-d705-4694-8c71-5322dc51aa39" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:16.404 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-1aa1613f-41a4-4ccd-8213-9decb68bc3e0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Refreshing network info cache for port 862ce870-f1c2-4319-8822-4e0ed618ebc8 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:01:16.605 4088 3038340568520 MainThread DEBUG os_win.utils.storage.diskutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:01:16.715 4088 3038340568520 MainThread DEBUG os_win.utils.storage.diskutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:01:16.786 4088 3038340568520 MainThread DEBUG os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] <== connect_volume: return (5225ms) {'type': 'block', 'path': '\\\\.\\PhysicalDrive3', 'number': 3, 'scsi_wwn': '36001405E6BFF034791642D6A8730034D'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:01:16.919 4088 3038340568696 MainThread DEBUG nova.virt.hyperv.vmops [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:17.129 4088 3038340735048 MainThread DEBUG os_win.utils.jobutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': 'D925A0FA-7EF9-4C60-A825-51C378B112D7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21005), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:17.280 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-1aa1613f-41a4-4ccd-8213-9decb68bc3e0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Updated VIF entry in instance network info cache for port 862ce870-f1c2-4319-8822-4e0ed618ebc8. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:01:17.280 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-1aa1613f-41a4-4ccd-8213-9decb68bc3e0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Updating instance_info_cache with network_info: [{"id": "862ce870-f1c2-4319-8822-4e0ed618ebc8", "address": "fa:16:3e:b9:0a:51", "network": {"id": "5f474ded-ff91-42f7-a10b-055b13eaa82a", "bridge": null, "label": "tempest-ServersNegativeTestJSON-2099773424-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "58b055dc3ac4474788971e8148bec63e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap862ce870-f1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:17.314 4088 3038359395496 MainThread DEBUG oslo_concurrency.lockutils [req-1aa1613f-41a4-4ccd-8213-9decb68bc3e0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-9015b51e-d705-4694-8c71-5322dc51aa39" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:17.314 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-1aa1613f-41a4-4ccd-8213-9decb68bc3e0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-changed-2328bac5-09f9-4dd3-a3ff-1f5673edded4 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:17.314 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-1aa1613f-41a4-4ccd-8213-9decb68bc3e0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Refreshing instance network info cache due to event network-changed-2328bac5-09f9-4dd3-a3ff-1f5673edded4. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:01:17.314 4088 3038359395496 MainThread DEBUG oslo_concurrency.lockutils [req-1aa1613f-41a4-4ccd-8213-9decb68bc3e0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:17.314 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-1aa1613f-41a4-4ccd-8213-9decb68bc3e0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Refreshing network info cache for port 2328bac5-09f9-4dd3-a3ff-1f5673edded4 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:01:17.327 4088 3038340569576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000046" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:17.327 4088 3038340569576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000046" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:17.327 4088 3038342147416 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:17.327 4088 3038342147416 MainThread INFO nova.compute.manager [-] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] VM Stopped (Lifecycle Event) 2021-09-10 17:01:17.360 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-f9b9d5cd-fea8-4b63-b3c7-82717f3dfce1 - - - - -] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:17.360 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-f9b9d5cd-fea8-4b63-b3c7-82717f3dfce1 - - - - -] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:17.391 4088 3038340735048 MainThread ERROR os_win.utils.jobutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000046\' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)instance-0000004654123C57-4254-48EC-9CEE-B50DC772071212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)instance-0000004654123C57-4254-48EC-9CEE-B50DC772071210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000046\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)instance-0000004654123C57-4254-48EC-9CEE-B50DC7720712%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D925A0FA-7EF9-4C60-A825-51C378B112D7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=132177), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 17), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 17), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000046' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)\n\nNot enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)\n\n'instance-00000046' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)", 'ErrorSummaryDescription': "'instance-00000046' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000046.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:17.404 4088 3038340735048 MainThread DEBUG os_win._utils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000046' failed to start. Not enough memory in the system to start the virtual machine instance-00000046. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000046' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Not enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) 'instance-00000046' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.5457608699798584 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:17.417 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-f9b9d5cd-fea8-4b63-b3c7-82717f3dfce1 - - - - -] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:17.443 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-1aa1613f-41a4-4ccd-8213-9decb68bc3e0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:01:17.457 4088 3038342147416 MainThread INFO nova.compute.manager [req-f9b9d5cd-fea8-4b63-b3c7-82717f3dfce1 - - - - -] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:17.496 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.vmops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:17.686 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.vmops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:17.845 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-1aa1613f-41a4-4ccd-8213-9decb68bc3e0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:17.845 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.vmops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:17.861 4088 3038359395496 MainThread DEBUG oslo_concurrency.lockutils [req-1aa1613f-41a4-4ccd-8213-9decb68bc3e0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:18.012 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.vmops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:18.201 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.vmops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:18.390 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.vmops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:18.439 4088 3038340735048 MainThread DEBUG os_win.utils.jobutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': '80B17943-DCAB-4919-941D-59B6B717160E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15486), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:18.560 4088 3038340735048 MainThread ERROR os_win.utils.jobutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000046\' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)instance-0000004654123C57-4254-48EC-9CEE-B50DC772071212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)instance-0000004654123C57-4254-48EC-9CEE-B50DC772071210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000046\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)instance-0000004654123C57-4254-48EC-9CEE-B50DC7720712%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '80B17943-DCAB-4919-941D-59B6B717160E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120744), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 18), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 18), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000046' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)\n\nNot enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)\n\n'instance-00000046' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)", 'ErrorSummaryDescription': "'instance-00000046' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000046.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:18.560 4088 3038340735048 MainThread DEBUG os_win._utils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000046' failed to start. Not enough memory in the system to start the virtual machine instance-00000046. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000046' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Not enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) 'instance-00000046' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.70231294631958 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:18.614 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.vmops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:18.675 4088 3038337403368 GreenThread-61 DEBUG nova.network.neutron [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Successfully updated port: ffc6e67e-0a49-4c79-9748-12da98323372 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:01:19.597 4088 3038340735048 MainThread DEBUG os_win.utils.jobutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': '0385D065-1ACC-405D-B5A2-44E8BE6C7DA9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19198), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:19.734 4088 3038340735048 MainThread ERROR os_win.utils.jobutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000046\' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)instance-0000004654123C57-4254-48EC-9CEE-B50DC772071212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)instance-0000004654123C57-4254-48EC-9CEE-B50DC772071210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000046\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)instance-0000004654123C57-4254-48EC-9CEE-B50DC7720712%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0385D065-1ACC-405D-B5A2-44E8BE6C7DA9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117156), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 19), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 19), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000046' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)\n\nNot enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)\n\n'instance-00000046' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)", 'ErrorSummaryDescription': "'instance-00000046' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000046.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:19.734 4088 3038340735048 MainThread DEBUG os_win._utils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000046' failed to start. Not enough memory in the system to start the virtual machine instance-00000046. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000046' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Not enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) 'instance-00000046' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.8763632774353027 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:19.749 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-1cd85dba-cb48-443f-adfd-f05529eb7b25 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-changed-ffc6e67e-0a49-4c79-9748-12da98323372 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:19.749 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-1cd85dba-cb48-443f-adfd-f05529eb7b25 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Refreshing instance network info cache due to event network-changed-ffc6e67e-0a49-4c79-9748-12da98323372. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:01:19.749 4088 3038359395496 MainThread DEBUG oslo_concurrency.lockutils [req-1cd85dba-cb48-443f-adfd-f05529eb7b25 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:19.749 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-1cd85dba-cb48-443f-adfd-f05529eb7b25 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Refreshing network info cache for port ffc6e67e-0a49-4c79-9748-12da98323372 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:01:19.799 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000046" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:19.799 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000046" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:19.799 4088 3038340568344 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:19.799 4088 3038340568344 MainThread INFO nova.compute.manager [-] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] VM Stopped (Lifecycle Event) 2021-09-10 17:01:19.828 4088 3038340568344 MainThread DEBUG nova.compute.manager [req-f1206150-3bf2-4a36-8bdd-246740ba7379 - - - - -] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:19.828 4088 3038340568344 MainThread DEBUG nova.virt.hyperv.vmops [req-f1206150-3bf2-4a36-8bdd-246740ba7379 - - - - -] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:19.828 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-1cd85dba-cb48-443f-adfd-f05529eb7b25 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:01:19.935 4088 3038340568344 MainThread DEBUG nova.compute.manager [req-f1206150-3bf2-4a36-8bdd-246740ba7379 - - - - -] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:19.965 4088 3038340568344 MainThread INFO nova.compute.manager [req-f1206150-3bf2-4a36-8bdd-246740ba7379 - - - - -] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:20.066 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-1cd85dba-cb48-443f-adfd-f05529eb7b25 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:20.107 4088 3038359395496 MainThread DEBUG oslo_concurrency.lockutils [req-1cd85dba-cb48-443f-adfd-f05529eb7b25 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:20.732 4088 3038340735048 MainThread DEBUG os_win.utils.jobutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': 'DB493257-3522-4AA0-8853-9C04C2ED1C6A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16144), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:20.862 4088 3038337403368 GreenThread-61 DEBUG nova.network.neutron [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Successfully updated port: 86609ec1-a690-46a4-8ef9-4623364e23fe _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:01:20.921 4088 3038340735048 MainThread ERROR os_win.utils.jobutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000046\' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)instance-0000004654123C57-4254-48EC-9CEE-B50DC772071212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)instance-0000004654123C57-4254-48EC-9CEE-B50DC772071210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000046\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)instance-0000004654123C57-4254-48EC-9CEE-B50DC7720712%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'DB493257-3522-4AA0-8853-9C04C2ED1C6A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117288), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 20), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 20), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000046' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)\n\nNot enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)\n\n'instance-00000046' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)", 'ErrorSummaryDescription': "'instance-00000046' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000046.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:20.921 4088 3038340735048 MainThread DEBUG os_win._utils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000046' failed to start. Not enough memory in the system to start the virtual machine instance-00000046. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000046' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Not enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) 'instance-00000046' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.0633087158203125 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:20.957 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000046" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:20.957 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000046" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:20.957 4088 3038359395496 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:20.957 4088 3038359395496 MainThread INFO nova.compute.manager [-] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] VM Stopped (Lifecycle Event) 2021-09-10 17:01:20.985 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-c7dde772-4a0c-4ad5-ae98-e570448523e7 - - - - -] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:20.985 4088 3038359395496 MainThread DEBUG nova.virt.hyperv.vmops [req-c7dde772-4a0c-4ad5-ae98-e570448523e7 - - - - -] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:21.037 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-c7dde772-4a0c-4ad5-ae98-e570448523e7 - - - - -] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:21.058 4088 3038359395496 MainThread INFO nova.compute.manager [req-c7dde772-4a0c-4ad5-ae98-e570448523e7 - - - - -] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:21.952 4088 3038340735048 MainThread DEBUG os_win.utils.jobutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': 'E1DA9B69-D01F-4EEC-A6E9-3E9DC375EEE3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17104), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:22.093 4088 3038340735048 MainThread ERROR os_win.utils.jobutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000046\' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)instance-0000004654123C57-4254-48EC-9CEE-B50DC772071212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)instance-0000004654123C57-4254-48EC-9CEE-B50DC772071210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000046\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)instance-0000004654123C57-4254-48EC-9CEE-B50DC7720712%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E1DA9B69-D01F-4EEC-A6E9-3E9DC375EEE3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121443), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 21), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 22), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000046' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)\n\nNot enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)\n\n'instance-00000046' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712)", 'ErrorSummaryDescription': "'instance-00000046' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000046.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:22.093 4088 3038340735048 MainThread ERROR nova.virt.hyperv.vmops [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Failed to change vm state of instance-00000046 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000046' failed to start. 2021-09-10 17:01:22.093 4088 3038340735048 MainThread INFO nova.virt.hyperv.vmops [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Got request to destroy instance 2021-09-10 17:01:22.157 4088 3038359395496 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:22.157 4088 3038359395496 MainThread INFO nova.compute.manager [-] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] VM Stopped (Lifecycle Event) 2021-09-10 17:01:22.157 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000046" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:22.157 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000046" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:22.168 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-271acffa-6a83-476f-8b12-177308c040ce - - - - -] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:22.168 4088 3038359395496 MainThread DEBUG nova.virt.hyperv.vmops [req-271acffa-6a83-476f-8b12-177308c040ce - - - - -] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:22.230 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-271acffa-6a83-476f-8b12-177308c040ce - - - - -] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:22.255 4088 3038359395496 MainThread INFO nova.compute.manager [req-271acffa-6a83-476f-8b12-177308c040ce - - - - -] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:22.949 4088 3038337403368 GreenThread-61 DEBUG nova.network.neutron [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Successfully updated port: 94855bc3-5116-4b2f-ac7b-9de0d4d7ab82 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:01:23.246 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-a88c0d0e-cd31-4f13-97e0-53712e846c51 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-changed-86609ec1-a690-46a4-8ef9-4623364e23fe external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:23.246 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-a88c0d0e-cd31-4f13-97e0-53712e846c51 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Refreshing instance network info cache due to event network-changed-86609ec1-a690-46a4-8ef9-4623364e23fe. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:01:23.246 4088 3038359395496 MainThread DEBUG oslo_concurrency.lockutils [req-a88c0d0e-cd31-4f13-97e0-53712e846c51 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:23.246 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-a88c0d0e-cd31-4f13-97e0-53712e846c51 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Refreshing network info cache for port 86609ec1-a690-46a4-8ef9-4623364e23fe _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:01:23.294 4088 3038340569576 MainThread DEBUG nova.compute.manager [req-5422e085-c36c-4d63-b991-512e141757d6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Received event network-vif-plugged-862ce870-f1c2-4319-8822-4e0ed618ebc8 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:23.294 4088 3038340569576 MainThread DEBUG oslo_concurrency.lockutils [req-5422e085-c36c-4d63-b991-512e141757d6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9015b51e-d705-4694-8c71-5322dc51aa39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:23.294 4088 3038340569576 MainThread DEBUG oslo_concurrency.lockutils [req-5422e085-c36c-4d63-b991-512e141757d6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9015b51e-d705-4694-8c71-5322dc51aa39-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:23.294 4088 3038340569576 MainThread DEBUG nova.compute.manager [req-5422e085-c36c-4d63-b991-512e141757d6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Processing event network-vif-plugged-862ce870-f1c2-4319-8822-4e0ed618ebc8 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:01:23.333 4088 3038340568696 MainThread INFO nova.virt.hyperv.vmops [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Using config drive for instance 2021-09-10 17:01:23.370 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-a88c0d0e-cd31-4f13-97e0-53712e846c51 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:01:23.669 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-a88c0d0e-cd31-4f13-97e0-53712e846c51 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:23.669 4088 3038359395496 MainThread DEBUG oslo_concurrency.lockutils [req-a88c0d0e-cd31-4f13-97e0-53712e846c51 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:23.778 4088 3038340568696 MainThread INFO nova.virt.hyperv.vmops [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Creating config drive at C:\openstack\instances\instance-00000048\configdrive.iso 2021-09-10 17:01:23.876 4088 3038340568696 MainThread DEBUG oslo_concurrency.processutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000048\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpjr_w_jib execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:01:24.230 4088 3038340568696 MainThread DEBUG oslo_concurrency.processutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000048\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpjr_w_jib" returned: 0 in 0.359s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:01:24.417 4088 3038340735048 MainThread DEBUG nova.virt.hyperv.vmops [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:01:24.417 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-00000046" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:24.417 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-00000046" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:24.513 4088 3038340735048 MainThread DEBUG os_win.utils.compute.vmutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Successfully changed vm state of instance-00000046 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:01:24.513 4088 3038340735048 MainThread DEBUG nova.virt.hyperv.vmops [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Successfully changed state of VM instance-00000046 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:01:24.566 4088 3038340735048 MainThread DEBUG os_win.utils.jobutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Waiting for WMI job: {'InstanceID': '28D89087-68A2-4562-A885-4AAA83801826', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16232), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:24.674 4088 3038340735048 MainThread DEBUG os_win.utils.jobutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] WMI job succeeded: {'InstanceID': '28D89087-68A2-4562-A885-4AAA83801826', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=108617), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:01:24.674 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-00000046" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:24.692 4088 3038340735048 MainThread DEBUG os_win.utils.pathutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Removing directory: C:\openstack\instances\instance-00000046 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:01:24.692 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-00000046" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:24.692 4088 3038340735048 MainThread ERROR nova.compute.manager [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000046' failed to start. Not enough memory in the system to start the virtual machine instance-00000046. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000046' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Not enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) 'instance-00000046' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Error code: 32778. 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Traceback (most recent call last): 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] return function(*args, **kwargs) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] admin_password, network_info, block_device_info) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] return function(self, *args, **kwds) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self.force_reraise() 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] raise self.value 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] should_plug_vifs=False) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 'req_state': req_state}) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self.force_reraise() 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] raise self.value 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] time.sleep(sleep_time) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self.force_reraise() 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] raise self.value 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] return f(*args, **kwargs) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] return self._wait_for_job(job_path) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] error_desc=err_desc) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000046' failed to start. 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Not enough memory in the system to start the virtual machine instance-00000046. 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000046' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Not enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 'instance-00000046' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Error code: 32778. 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] During handling of the above exception, another exception occurred: 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Traceback (most recent call last): 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] yield resources 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] accel_info=accel_info) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] return function(*args, **kwargs) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] admin_password, network_info, block_device_info) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] return function(self, *args, **kwds) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self.force_reraise() 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] raise self.value 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] should_plug_vifs=False) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 'req_state': req_state}) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self.force_reraise() 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] raise self.value 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] time.sleep(sleep_time) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self.force_reraise() 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] raise self.value 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] return f(*args, **kwargs) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] return self._wait_for_job(job_path) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] error_desc=err_desc) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000046' failed to start. 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Not enough memory in the system to start the virtual machine instance-00000046. 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000046' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Not enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 'instance-00000046' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Error code: 32778. 2021-09-10 17:01:24.692 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:24.692 4088 3038340735048 MainThread INFO nova.compute.manager [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Terminating instance 2021-09-10 17:01:24.692 4088 3038340735048 MainThread DEBUG nova.compute.manager [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:01:24.692 4088 3038340735048 MainThread INFO nova.virt.hyperv.vmops [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Got request to destroy instance 2021-09-10 17:01:24.722 4088 3038340735048 MainThread DEBUG nova.virt.hyperv.vmops [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:01:24.731 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-00000046" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:24.731 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "instance-00000046" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:24.731 4088 3038340735048 MainThread INFO nova.compute.manager [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:01:24.731 4088 3038340735048 MainThread DEBUG nova.compute.claims [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:01:24.731 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:24.827 4088 3038340735048 MainThread DEBUG nova.virt.hyperv.hostops [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:01:24.839 4088 3038340735048 MainThread DEBUG nova.virt.hyperv.hostops [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:01:24.873 4088 3038340568696 MainThread DEBUG nova.virt.hyperv.vmops [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Setting boot order for instance: instance-00000048: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:01:24.983 4088 3038340568696 MainThread DEBUG nova.virt.hyperv.vmops [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:01:25.047 4088 3038340568696 MainThread DEBUG os_win.utils.jobutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Waiting for WMI job: {'InstanceID': 'E011C014-DAB6-46EA-9632-3A06BD53C773', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17269), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:25.078 4088 3038340735048 MainThread DEBUG nova.compute.provider_tree [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:01:25.106 4088 3038340735048 MainThread DEBUG nova.scheduler.client.report [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:01:25.106 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.375s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:25.106 4088 3038340735048 MainThread ERROR nova.compute.manager [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000046' failed to start. Not enough memory in the system to start the virtual machine instance-00000046. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000046' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Not enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) 'instance-00000046' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Error code: 32778. 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Traceback (most recent call last): 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] return function(*args, **kwargs) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] admin_password, network_info, block_device_info) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] return function(self, *args, **kwds) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self.force_reraise() 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] raise self.value 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] should_plug_vifs=False) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 'req_state': req_state}) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self.force_reraise() 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] raise self.value 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] time.sleep(sleep_time) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self.force_reraise() 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] raise self.value 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] return f(*args, **kwargs) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] return self._wait_for_job(job_path) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] error_desc=err_desc) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000046' failed to start. 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Not enough memory in the system to start the virtual machine instance-00000046. 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000046' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Not enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 'instance-00000046' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Error code: 32778. 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] During handling of the above exception, another exception occurred: 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Traceback (most recent call last): 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] accel_info=accel_info) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] return function(*args, **kwargs) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] admin_password, network_info, block_device_info) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] return function(self, *args, **kwds) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self.force_reraise() 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] raise self.value 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] should_plug_vifs=False) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 'req_state': req_state}) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self.force_reraise() 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] raise self.value 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] time.sleep(sleep_time) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self.force_reraise() 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] raise self.value 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] return f(*args, **kwargs) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] return self._wait_for_job(job_path) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] error_desc=err_desc) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000046' failed to start. 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Not enough memory in the system to start the virtual machine instance-00000046. 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000046' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Not enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 'instance-00000046' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Error code: 32778. 2021-09-10 17:01:25.106 4088 3038340735048 MainThread TRACE nova.compute.manager [instance: d5135b07-1b25-46d3-8c64-016de11558e4] 2021-09-10 17:01:25.106 4088 3038340735048 MainThread DEBUG nova.compute.utils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] WMI job failed with status 10. Error summary description: 'instance-00000046' failed to start. Not enough memory in the system to start the virtual machine instance-00000046. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:01:25.106 4088 3038340735048 MainThread DEBUG nova.compute.manager [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Build of instance d5135b07-1b25-46d3-8c64-016de11558e4 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000046' failed to start. Not enough memory in the system to start the virtual machine instance-00000046. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000046' failed to start. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Not enough memory in the system to start the virtual machine instance-00000046 with ram size 1024 megabytes. (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) 'instance-00000046' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 54123C57-4254-48EC-9CEE-B50DC7720712) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:01:25.106 4088 3038340735048 MainThread DEBUG nova.compute.manager [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:01:25.106 4088 3038340735048 MainThread DEBUG nova.compute.manager [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:01:25.106 4088 3038340735048 MainThread DEBUG nova.compute.manager [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:01:25.125 4088 3038340735048 MainThread DEBUG nova.network.neutron [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:01:25.184 4088 3038340568696 MainThread ERROR os_win.utils.jobutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] WMI job failed: {'RawErrors': (('124\'instance-00000048\' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)instance-0000004852567522-5342-4B53-86A4-057A935D9E2812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)instance-0000004852567522-5342-4B53-86A4-057A935D9E2810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000048\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)instance-0000004852567522-5342-4B53-86A4-057A935D9E28%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E011C014-DAB6-46EA-9632-3A06BD53C773', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=124844), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 25), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 25), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000048' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)\n\nNot enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)\n\n'instance-00000048' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)", 'ErrorSummaryDescription': "'instance-00000048' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000048.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:25.184 4088 3038340568696 MainThread DEBUG os_win._utils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000048' failed to start. Not enough memory in the system to start the virtual machine instance-00000048. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000048' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Not enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) 'instance-00000048' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.20018959045410156 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:25.233 4088 3038359392856 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:25.233 4088 3038359392856 MainThread INFO nova.compute.manager [-] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] VM Stopped (Lifecycle Event) 2021-09-10 17:01:25.233 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000048" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:25.233 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000048" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:25.246 4088 3038359392856 MainThread DEBUG nova.compute.manager [req-dbd7a56e-7083-4704-bdea-44c91cfa0bb4 - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:25.246 4088 3038359392856 MainThread DEBUG nova.virt.hyperv.vmops [req-dbd7a56e-7083-4704-bdea-44c91cfa0bb4 - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:25.296 4088 3038359392856 MainThread DEBUG nova.compute.manager [req-dbd7a56e-7083-4704-bdea-44c91cfa0bb4 - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:25.311 4088 3038359392856 MainThread INFO nova.compute.manager [req-dbd7a56e-7083-4704-bdea-44c91cfa0bb4 - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:25.624 4088 3038337403368 GreenThread-61 DEBUG nova.network.neutron [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Successfully updated port: 960e99f9-c9fe-476e-a025-db2754fea043 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:01:26.231 4088 3038340568696 MainThread DEBUG os_win.utils.jobutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Waiting for WMI job: {'InstanceID': '5B22BAB2-6847-4717-8F42-4256F19CD241', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16474), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:26.373 4088 3038340568696 MainThread ERROR os_win.utils.jobutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] WMI job failed: {'RawErrors': (('124\'instance-00000048\' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)instance-0000004852567522-5342-4B53-86A4-057A935D9E2812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)instance-0000004852567522-5342-4B53-86A4-057A935D9E2810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000048\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)instance-0000004852567522-5342-4B53-86A4-057A935D9E28%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5B22BAB2-6847-4717-8F42-4256F19CD241', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=123344), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 26), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 26), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000048' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)\n\nNot enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)\n\n'instance-00000048' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)", 'ErrorSummaryDescription': "'instance-00000048' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000048.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:26.373 4088 3038340568696 MainThread DEBUG os_win._utils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000048' failed to start. Not enough memory in the system to start the virtual machine instance-00000048. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000048' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Not enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) 'instance-00000048' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3892807960510254 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:26.404 4088 3038359392856 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:26.429 4088 3038359392856 MainThread INFO nova.compute.manager [-] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] VM Stopped (Lifecycle Event) 2021-09-10 17:01:26.429 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000048" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:26.429 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000048" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:26.435 4088 3038359392856 MainThread DEBUG nova.compute.manager [req-6ffc8cd7-069e-4fbd-b122-63045612de19 - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:26.435 4088 3038359392856 MainThread DEBUG nova.virt.hyperv.vmops [req-6ffc8cd7-069e-4fbd-b122-63045612de19 - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:26.499 4088 3038359392856 MainThread DEBUG nova.compute.manager [req-6ffc8cd7-069e-4fbd-b122-63045612de19 - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:26.536 4088 3038359392856 MainThread INFO nova.compute.manager [req-6ffc8cd7-069e-4fbd-b122-63045612de19 - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:26.841 4088 3038359392856 MainThread DEBUG nova.compute.manager [req-36e2a196-a412-439b-b5ad-ad78875a05db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-changed-94855bc3-5116-4b2f-ac7b-9de0d4d7ab82 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:26.841 4088 3038359392856 MainThread DEBUG nova.compute.manager [req-36e2a196-a412-439b-b5ad-ad78875a05db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Refreshing instance network info cache due to event network-changed-94855bc3-5116-4b2f-ac7b-9de0d4d7ab82. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:01:26.841 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36e2a196-a412-439b-b5ad-ad78875a05db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:26.841 4088 3038359392856 MainThread DEBUG nova.network.neutron [req-36e2a196-a412-439b-b5ad-ad78875a05db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Refreshing network info cache for port 94855bc3-5116-4b2f-ac7b-9de0d4d7ab82 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:01:26.949 4088 3038359392856 MainThread DEBUG nova.network.neutron [req-36e2a196-a412-439b-b5ad-ad78875a05db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:01:27.091 4088 3038340735048 MainThread DEBUG nova.network.neutron [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:27.121 4088 3038340735048 MainThread INFO nova.compute.manager [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] [instance: d5135b07-1b25-46d3-8c64-016de11558e4] Took 2.02 seconds to deallocate network for instance. 2021-09-10 17:01:27.171 4088 3038359392856 MainThread DEBUG nova.network.neutron [req-36e2a196-a412-439b-b5ad-ad78875a05db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:27.191 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [req-36e2a196-a412-439b-b5ad-ad78875a05db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:27.264 4088 3038340735048 MainThread INFO nova.scheduler.client.report [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Deleted allocations for instance d5135b07-1b25-46d3-8c64-016de11558e4 2021-09-10 17:01:27.310 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [req-b42a718c-dde8-46a1-97e9-77fbee6ea660 a1711a7b02c2433dacfb4017cd0a812c e0b9dfa46b614e449b6aff88db2cfd6b - default default] Lock "d5135b07-1b25-46d3-8c64-016de11558e4" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 30.765s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:27.472 4088 3038340568696 MainThread DEBUG os_win.utils.jobutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Waiting for WMI job: {'InstanceID': '0FE0C775-81A9-4464-B61C-642C1F71A06F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17298), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:27.638 4088 3038340568696 MainThread ERROR os_win.utils.jobutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] WMI job failed: {'RawErrors': (('124\'instance-00000048\' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)instance-0000004852567522-5342-4B53-86A4-057A935D9E2812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)instance-0000004852567522-5342-4B53-86A4-057A935D9E2810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000048\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)instance-0000004852567522-5342-4B53-86A4-057A935D9E28%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0FE0C775-81A9-4464-B61C-642C1F71A06F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117062), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 27), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 27), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000048' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)\n\nNot enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)\n\n'instance-00000048' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)", 'ErrorSummaryDescription': "'instance-00000048' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000048.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:27.638 4088 3038340568696 MainThread DEBUG os_win._utils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000048' failed to start. Not enough memory in the system to start the virtual machine instance-00000048. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000048' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Not enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) 'instance-00000048' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.6541597843170166 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:27.685 4088 3038359396024 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:27.685 4088 3038359396024 MainThread INFO nova.compute.manager [-] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] VM Stopped (Lifecycle Event) 2021-09-10 17:01:27.685 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000048" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:27.685 4088 3038359392856 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000048" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:27.707 4088 3038359396024 MainThread DEBUG nova.compute.manager [req-2539c378-d68a-4656-9c64-87597d23a1ce - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:27.707 4088 3038359396024 MainThread DEBUG nova.virt.hyperv.vmops [req-2539c378-d68a-4656-9c64-87597d23a1ce - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:27.771 4088 3038359396024 MainThread DEBUG nova.compute.manager [req-2539c378-d68a-4656-9c64-87597d23a1ce - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:27.793 4088 3038359396024 MainThread INFO nova.compute.manager [req-2539c378-d68a-4656-9c64-87597d23a1ce - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:28.233 4088 3038337403368 GreenThread-61 DEBUG nova.network.neutron [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Successfully updated port: 4179be6b-0ba7-4aaa-b9aa-0c37a0c9fab0 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:01:28.267 4088 3038337403368 GreenThread-61 DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Acquired lock "refresh_cache-d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:28.267 4088 3038337403368 GreenThread-61 DEBUG nova.network.neutron [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:01:28.575 4088 3038337403368 GreenThread-61 DEBUG nova.network.neutron [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:01:28.692 4088 3038340568696 MainThread DEBUG os_win.utils.jobutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Waiting for WMI job: {'InstanceID': 'F741ED98-2942-425A-9C52-659E620D41FA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19708), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:28.861 4088 3038340568696 MainThread ERROR os_win.utils.jobutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] WMI job failed: {'RawErrors': (('124\'instance-00000048\' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)instance-0000004852567522-5342-4B53-86A4-057A935D9E2812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)instance-0000004852567522-5342-4B53-86A4-057A935D9E2810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000048\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)instance-0000004852567522-5342-4B53-86A4-057A935D9E28%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'F741ED98-2942-425A-9C52-659E620D41FA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116791), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 28), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 28), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000048' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)\n\nNot enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)\n\n'instance-00000048' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)", 'ErrorSummaryDescription': "'instance-00000048' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000048.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:28.861 4088 3038340568696 MainThread DEBUG os_win._utils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000048' failed to start. Not enough memory in the system to start the virtual machine instance-00000048. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000048' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Not enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) 'instance-00000048' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.8778235912323 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:28.875 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000048" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:28.875 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000048" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:28.875 4088 3038359396024 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:28.875 4088 3038359396024 MainThread INFO nova.compute.manager [-] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] VM Stopped (Lifecycle Event) 2021-09-10 17:01:28.895 4088 3038359396024 MainThread DEBUG nova.compute.manager [req-5c5f46f5-27fc-4f60-9190-1bfe8de0ac9f - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:28.895 4088 3038359396024 MainThread DEBUG nova.virt.hyperv.vmops [req-5c5f46f5-27fc-4f60-9190-1bfe8de0ac9f - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:28.958 4088 3038359396024 MainThread DEBUG nova.compute.manager [req-5c5f46f5-27fc-4f60-9190-1bfe8de0ac9f - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:28.981 4088 3038359396024 MainThread INFO nova.compute.manager [req-5c5f46f5-27fc-4f60-9190-1bfe8de0ac9f - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:29.730 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Lock "219ee2c7-854a-4265-903f-5d10381fa708" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:29.764 4088 3038359396200 MainThread DEBUG nova.compute.manager [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:01:29.823 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-c3ba5d5f-bf21-4756-aa6c-29abfb5cf77e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-changed-960e99f9-c9fe-476e-a025-db2754fea043 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:29.823 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-c3ba5d5f-bf21-4756-aa6c-29abfb5cf77e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Refreshing instance network info cache due to event network-changed-960e99f9-c9fe-476e-a025-db2754fea043. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:01:29.873 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:29.873 4088 3038359396200 MainThread DEBUG nova.virt.hardware [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:01:29.873 4088 3038359396200 MainThread INFO nova.compute.claims [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Claim successful on node n-h2-808474-1 2021-09-10 17:01:29.932 4088 3038340568696 MainThread DEBUG os_win.utils.jobutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Waiting for WMI job: {'InstanceID': '99E3B9F4-F706-4856-A111-450A55A2A94D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15973), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:30.001 4088 3038359396200 MainThread DEBUG nova.virt.hyperv.hostops [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:01:30.012 4088 3038359396200 MainThread DEBUG nova.virt.hyperv.hostops [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:01:30.079 4088 3038340568696 MainThread ERROR os_win.utils.jobutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] WMI job failed: {'RawErrors': (('124\'instance-00000048\' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)instance-0000004852567522-5342-4B53-86A4-057A935D9E2812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)instance-0000004852567522-5342-4B53-86A4-057A935D9E2810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000048\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)instance-0000004852567522-5342-4B53-86A4-057A935D9E28%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '99E3B9F4-F706-4856-A111-450A55A2A94D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119439), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 29), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 30), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000048' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)\n\nNot enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)\n\n'instance-00000048' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)", 'ErrorSummaryDescription': "'instance-00000048' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000048.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:30.079 4088 3038340568696 MainThread DEBUG os_win._utils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000048' failed to start. Not enough memory in the system to start the virtual machine instance-00000048. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000048' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Not enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) 'instance-00000048' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.095287561416626 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:30.122 4088 3038340569752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000048" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:30.122 4088 3038340569752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000048" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:30.122 4088 3038342147416 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:30.122 4088 3038342147416 MainThread INFO nova.compute.manager [-] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] VM Stopped (Lifecycle Event) 2021-09-10 17:01:30.141 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-e3c76edb-b9ac-4820-a2a2-ef831e66a096 - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:30.141 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-e3c76edb-b9ac-4820-a2a2-ef831e66a096 - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:30.312 4088 3038359396200 MainThread DEBUG nova.compute.provider_tree [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:01:30.324 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-e3c76edb-b9ac-4820-a2a2-ef831e66a096 - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:30.324 4088 3038359396200 MainThread DEBUG nova.scheduler.client.report [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:01:30.324 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:30.324 4088 3038359396200 MainThread DEBUG nova.compute.manager [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:01:30.355 4088 3038342147416 MainThread INFO nova.compute.manager [req-e3c76edb-b9ac-4820-a2a2-ef831e66a096 - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:30.418 4088 3038359396200 MainThread DEBUG nova.compute.manager [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:01:30.418 4088 3038342147416 GreenThread-64 DEBUG nova.compute.manager [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:01:30.418 4088 3038342147416 GreenThread-64 DEBUG nova.network.neutron [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:01:30.573 4088 3038359396200 MainThread DEBUG nova.compute.manager [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:01:30.573 4088 3038342147416 GreenThread-64 DEBUG nova.policy [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f85143bbedf44eca37aba098b6ccb7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2d0543bdd24962be5e0dceb47ee53e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:01:30.589 4088 3038359396200 MainThread INFO nova.virt.hyperv.vmops [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Spawning new instance 2021-09-10 17:01:30.589 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Lock "instance-00000047" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:30.589 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Lock "instance-00000047" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:30.589 4088 3038359396200 MainThread DEBUG nova.block_device [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:01:30.589 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:30.614 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:30.614 4088 3038359396200 MainThread DEBUG os_win.utils.pathutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Creating directory: C:\openstack\instances\instance-00000047 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:01:30.614 4088 3038359396200 MainThread DEBUG nova.virt.hyperv.vmops [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000047\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:01:30.872 4088 3038359396200 MainThread DEBUG nova.virt.hyperv.vmops [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Resizing VHD C:\openstack\instances\instance-00000047\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:01:31.120 4088 3038340568696 MainThread DEBUG os_win.utils.jobutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Waiting for WMI job: {'InstanceID': '706A4DF6-BE89-48A2-A152-2C1EBA0D077C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16845), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:31.207 4088 3038342147416 GreenThread-64 DEBUG nova.network.neutron [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Successfully created port: fbacf90a-0d6c-4df6-81d9-a2d6ebf2775b _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:01:31.266 4088 3038340568696 MainThread ERROR os_win.utils.jobutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] WMI job failed: {'RawErrors': (('124\'instance-00000048\' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)instance-0000004852567522-5342-4B53-86A4-057A935D9E2812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)instance-0000004852567522-5342-4B53-86A4-057A935D9E2810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000048\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)instance-0000004852567522-5342-4B53-86A4-057A935D9E28%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '706A4DF6-BE89-48A2-A152-2C1EBA0D077C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114201), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 31), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 31), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000048' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)\n\nNot enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)\n\n'instance-00000048' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28)", 'ErrorSummaryDescription': "'instance-00000048' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000048.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:31.266 4088 3038340568696 MainThread ERROR nova.virt.hyperv.vmops [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Failed to change vm state of instance-00000048 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000048' failed to start. 2021-09-10 17:01:31.266 4088 3038340568696 MainThread INFO nova.virt.hyperv.vmops [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Got request to destroy instance 2021-09-10 17:01:31.301 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000048" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:31.301 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000048" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:31.301 4088 3038340569048 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:31.301 4088 3038340569048 MainThread INFO nova.compute.manager [-] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] VM Stopped (Lifecycle Event) 2021-09-10 17:01:31.325 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-d9fcb053-2a61-4073-a0d3-7ce215ce979f - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:31.325 4088 3038340569048 MainThread DEBUG nova.virt.hyperv.vmops [req-d9fcb053-2a61-4073-a0d3-7ce215ce979f - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:31.378 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-d9fcb053-2a61-4073-a0d3-7ce215ce979f - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:31.401 4088 3038340569048 MainThread INFO nova.compute.manager [req-d9fcb053-2a61-4073-a0d3-7ce215ce979f - - - - -] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:31.698 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Received event network-vif-unplugged-63104a25-8d60-4319-8d76-624a157b5f14 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "219ee2c7-854a-4265-903f-5d10381fa708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "219ee2c7-854a-4265-903f-5d10381fa708-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] No waiting events found dispatching network-vif-unplugged-63104a25-8d60-4319-8d76-624a157b5f14 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:01:31.703 4088 3038340569048 MainThread WARNING nova.compute.manager [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Received unexpected event network-vif-unplugged-63104a25-8d60-4319-8d76-624a157b5f14 for instance with vm_state building and task_state spawning. 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-vif-plugged-46dd9dca-3150-45cc-9a35-bc1230d1380e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Processing event network-vif-plugged-46dd9dca-3150-45cc-9a35-bc1230d1380e _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-vif-plugged-f6422a3d-802b-4117-928d-1ca451d20e4b external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Processing event network-vif-plugged-f6422a3d-802b-4117-928d-1ca451d20e4b _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-vif-plugged-c2d9bf38-2b6d-4a34-b975-f3967b383e21 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Processing event network-vif-plugged-c2d9bf38-2b6d-4a34-b975-f3967b383e21 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-vif-plugged-6709b293-b51f-4901-9ca4-bef117b27521 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:31.703 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-b1f0aa4a-8e87-41b4-88f5-e8e7d2876b06 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Processing event network-vif-plugged-6709b293-b51f-4901-9ca4-bef117b27521 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:01:31.856 4088 3038342147416 GreenThread-64 DEBUG nova.network.neutron [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Successfully updated port: fbacf90a-0d6c-4df6-81d9-a2d6ebf2775b _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:01:31.871 4088 3038342147416 GreenThread-64 DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Acquired lock "refresh_cache-219ee2c7-854a-4265-903f-5d10381fa708" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:31.871 4088 3038342147416 GreenThread-64 DEBUG nova.network.neutron [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:01:31.949 4088 3038342147416 GreenThread-64 DEBUG nova.network.neutron [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:01:32.496 4088 3038340569752 MainThread DEBUG nova.compute.manager [req-f7580f07-7a8e-4b9c-a84a-a894fb365da6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Received event network-vif-deleted-63104a25-8d60-4319-8d76-624a157b5f14 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:32.515 4088 3038342147416 GreenThread-64 DEBUG nova.network.neutron [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Updating instance_info_cache with network_info: [{"id": "fbacf90a-0d6c-4df6-81d9-a2d6ebf2775b", "address": "fa:16:3e:0f:68:8e", "network": {"id": "6383d5d0-f1bd-4671-89b0-0e4e06a1b5c2", "bridge": null, "label": "tempest-ServerPasswordTestJSON-1310888354-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f2d0543bdd24962be5e0dceb47ee53e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfbacf90a-0d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:32.558 4088 3038342147416 GreenThread-64 DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Releasing lock "refresh_cache-219ee2c7-854a-4265-903f-5d10381fa708" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:32.558 4088 3038342147416 GreenThread-64 DEBUG nova.compute.manager [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Instance network_info: |[{"id": "fbacf90a-0d6c-4df6-81d9-a2d6ebf2775b", "address": "fa:16:3e:0f:68:8e", "network": {"id": "6383d5d0-f1bd-4671-89b0-0e4e06a1b5c2", "bridge": null, "label": "tempest-ServerPasswordTestJSON-1310888354-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f2d0543bdd24962be5e0dceb47ee53e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfbacf90a-0d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:01:32.558 4088 3038359396200 MainThread DEBUG nova.compute.manager [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Preparing to wait for external event network-vif-plugged-fbacf90a-0d6c-4df6-81d9-a2d6ebf2775b prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:01:32.558 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Lock "219ee2c7-854a-4265-903f-5d10381fa708-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:32.558 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Lock "219ee2c7-854a-4265-903f-5d10381fa708-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:32.558 4088 3038359396200 MainThread DEBUG os_win.utils.compute.vmutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Creating VM instance-00000047 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:01:32.558 4088 3038340569400 MainThread DEBUG nova.compute.manager [req-47e17586-0413-4787-b88f-e45c8a9950b5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Received event network-changed-fbacf90a-0d6c-4df6-81d9-a2d6ebf2775b external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:32.558 4088 3038340569400 MainThread DEBUG nova.compute.manager [req-47e17586-0413-4787-b88f-e45c8a9950b5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Refreshing instance network info cache due to event network-changed-fbacf90a-0d6c-4df6-81d9-a2d6ebf2775b. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:01:32.558 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-47e17586-0413-4787-b88f-e45c8a9950b5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-219ee2c7-854a-4265-903f-5d10381fa708" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:32.558 4088 3038340569400 MainThread DEBUG nova.network.neutron [req-47e17586-0413-4787-b88f-e45c8a9950b5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Refreshing network info cache for port fbacf90a-0d6c-4df6-81d9-a2d6ebf2775b _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:01:33.333 4088 3038340568696 MainThread DEBUG nova.virt.hyperv.vmops [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:01:33.333 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Lock "instance-00000048" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:33.333 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Lock "instance-00000048" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:33.348 4088 3038340568696 MainThread DEBUG os_win.utils.compute.vmutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Successfully changed vm state of instance-00000048 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:01:33.348 4088 3038340568696 MainThread DEBUG nova.virt.hyperv.vmops [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Successfully changed state of VM instance-00000048 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:01:33.426 4088 3038340568696 MainThread DEBUG os_win.utils.jobutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Waiting for WMI job: {'InstanceID': '834A89AC-852D-4343-8894-6EBD7ECEC33A', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16297), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:33.543 4088 3038340568696 MainThread DEBUG os_win.utils.jobutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] WMI job succeeded: {'InstanceID': '834A89AC-852D-4343-8894-6EBD7ECEC33A', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=113392), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:01:33.543 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Lock "instance-00000048" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:33.543 4088 3038340568696 MainThread DEBUG os_win.utils.pathutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Removing directory: C:\openstack\instances\instance-00000048 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:01:33.543 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Lock "instance-00000048" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:33.543 4088 3038340568696 MainThread ERROR nova.compute.manager [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000048' failed to start. Not enough memory in the system to start the virtual machine instance-00000048. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000048' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Not enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) 'instance-00000048' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Error code: 32778. 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Traceback (most recent call last): 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] return function(*args, **kwargs) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] admin_password, network_info, block_device_info) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] return function(self, *args, **kwds) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self.force_reraise() 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] raise self.value 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] should_plug_vifs=False) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 'req_state': req_state}) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self.force_reraise() 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] raise self.value 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] time.sleep(sleep_time) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self.force_reraise() 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] raise self.value 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] return f(*args, **kwargs) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] return self._wait_for_job(job_path) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] error_desc=err_desc) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000048' failed to start. 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Not enough memory in the system to start the virtual machine instance-00000048. 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000048' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Not enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 'instance-00000048' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Error code: 32778. 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] During handling of the above exception, another exception occurred: 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Traceback (most recent call last): 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] yield resources 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] accel_info=accel_info) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] return function(*args, **kwargs) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] admin_password, network_info, block_device_info) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] return function(self, *args, **kwds) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self.force_reraise() 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] raise self.value 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] should_plug_vifs=False) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 'req_state': req_state}) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self.force_reraise() 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] raise self.value 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] time.sleep(sleep_time) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self.force_reraise() 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] raise self.value 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] return f(*args, **kwargs) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] return self._wait_for_job(job_path) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] error_desc=err_desc) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000048' failed to start. 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Not enough memory in the system to start the virtual machine instance-00000048. 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000048' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Not enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 'instance-00000048' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Error code: 32778. 2021-09-10 17:01:33.543 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.543 4088 3038340568696 MainThread INFO nova.compute.manager [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Terminating instance 2021-09-10 17:01:33.570 4088 3038340568696 MainThread DEBUG nova.compute.manager [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:01:33.570 4088 3038340568696 MainThread INFO nova.virt.hyperv.vmops [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Got request to destroy instance 2021-09-10 17:01:33.574 4088 3038340568696 MainThread DEBUG nova.virt.hyperv.vmops [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:01:33.574 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Lock "instance-00000048" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:33.574 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Lock "instance-00000048" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:33.574 4088 3038340568696 MainThread INFO nova.compute.manager [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Took 0.00 seconds to destroy the instance on the hypervisor. 2021-09-10 17:01:33.574 4088 3038340568696 MainThread DEBUG nova.compute.claims [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:01:33.593 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:33.730 4088 3038340568696 MainThread DEBUG nova.virt.hyperv.hostops [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:01:33.746 4088 3038340568696 MainThread DEBUG nova.virt.hyperv.hostops [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:01:33.839 4088 3038340569400 MainThread DEBUG nova.network.neutron [req-47e17586-0413-4787-b88f-e45c8a9950b5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Updated VIF entry in instance network info cache for port fbacf90a-0d6c-4df6-81d9-a2d6ebf2775b. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:01:33.839 4088 3038340569400 MainThread DEBUG nova.network.neutron [req-47e17586-0413-4787-b88f-e45c8a9950b5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Updating instance_info_cache with network_info: [{"id": "fbacf90a-0d6c-4df6-81d9-a2d6ebf2775b", "address": "fa:16:3e:0f:68:8e", "network": {"id": "6383d5d0-f1bd-4671-89b0-0e4e06a1b5c2", "bridge": null, "label": "tempest-ServerPasswordTestJSON-1310888354-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f2d0543bdd24962be5e0dceb47ee53e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfbacf90a-0d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:33.855 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-47e17586-0413-4787-b88f-e45c8a9950b5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-219ee2c7-854a-4265-903f-5d10381fa708" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:33.982 4088 3038340568696 MainThread DEBUG nova.compute.provider_tree [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:01:33.999 4088 3038340568696 MainThread DEBUG nova.scheduler.client.report [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:01:33.999 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.406s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:33.999 4088 3038340568696 MainThread ERROR nova.compute.manager [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000048' failed to start. Not enough memory in the system to start the virtual machine instance-00000048. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000048' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Not enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) 'instance-00000048' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Error code: 32778. 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Traceback (most recent call last): 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] return function(*args, **kwargs) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] admin_password, network_info, block_device_info) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] return function(self, *args, **kwds) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self.force_reraise() 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] raise self.value 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] should_plug_vifs=False) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 'req_state': req_state}) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self.force_reraise() 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] raise self.value 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] time.sleep(sleep_time) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self.force_reraise() 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] raise self.value 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] return f(*args, **kwargs) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] return self._wait_for_job(job_path) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] error_desc=err_desc) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000048' failed to start. 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Not enough memory in the system to start the virtual machine instance-00000048. 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000048' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Not enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 'instance-00000048' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Error code: 32778. 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] During handling of the above exception, another exception occurred: 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Traceback (most recent call last): 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] accel_info=accel_info) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] return function(*args, **kwargs) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] admin_password, network_info, block_device_info) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] return function(self, *args, **kwds) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self.force_reraise() 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] raise self.value 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] should_plug_vifs=False) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 'req_state': req_state}) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self.force_reraise() 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] raise self.value 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] time.sleep(sleep_time) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self.force_reraise() 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] raise self.value 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] return f(*args, **kwargs) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] return self._wait_for_job(job_path) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] error_desc=err_desc) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000048' failed to start. 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Not enough memory in the system to start the virtual machine instance-00000048. 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000048' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Not enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 'instance-00000048' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Error code: 32778. 2021-09-10 17:01:33.999 4088 3038340568696 MainThread TRACE nova.compute.manager [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] 2021-09-10 17:01:33.999 4088 3038340568696 MainThread DEBUG nova.compute.utils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] WMI job failed with status 10. Error summary description: 'instance-00000048' failed to start. Not enough memory in the system to start the virtual machine instance-00000048. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:01:33.999 4088 3038340568696 MainThread DEBUG nova.compute.manager [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Build of instance 9015b51e-d705-4694-8c71-5322dc51aa39 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000048' failed to start. Not enough memory in the system to start the virtual machine instance-00000048. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000048' failed to start. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Not enough memory in the system to start the virtual machine instance-00000048 with ram size 1024 megabytes. (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) 'instance-00000048' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52567522-5342-4B53-86A4-057A935D9E28) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:01:33.999 4088 3038340568696 MainThread DEBUG nova.compute.manager [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:01:33.999 4088 3038340568696 MainThread DEBUG nova.compute.manager [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:01:33.999 4088 3038340568696 MainThread DEBUG nova.compute.manager [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:01:33.999 4088 3038340568696 MainThread DEBUG nova.network.neutron [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:01:34.480 4088 3038359396200 MainThread DEBUG nova.virt.hyperv.vmops [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:34.776 4088 3038340568696 MainThread DEBUG nova.network.neutron [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:34.807 4088 3038340568696 MainThread INFO nova.compute.manager [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] [instance: 9015b51e-d705-4694-8c71-5322dc51aa39] Took 0.81 seconds to deallocate network for instance. 2021-09-10 17:01:35.169 4088 3038340735224 MainThread DEBUG nova.compute.manager [req-dcddcf76-090d-4918-aae3-280216abc164 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-vif-plugged-b922a519-3efc-4024-abfb-de5c20d9d578 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:35.169 4088 3038340735224 MainThread DEBUG oslo_concurrency.lockutils [req-dcddcf76-090d-4918-aae3-280216abc164 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:35.169 4088 3038340735224 MainThread DEBUG oslo_concurrency.lockutils [req-dcddcf76-090d-4918-aae3-280216abc164 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:35.169 4088 3038340735224 MainThread DEBUG nova.compute.manager [req-dcddcf76-090d-4918-aae3-280216abc164 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Processing event network-vif-plugged-b922a519-3efc-4024-abfb-de5c20d9d578 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:01:35.169 4088 3038340735224 MainThread DEBUG nova.compute.manager [req-dcddcf76-090d-4918-aae3-280216abc164 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-vif-plugged-0ae80e1f-4a5a-4c17-86ac-430359d3999e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:35.169 4088 3038340735224 MainThread DEBUG oslo_concurrency.lockutils [req-dcddcf76-090d-4918-aae3-280216abc164 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:35.169 4088 3038340735224 MainThread DEBUG oslo_concurrency.lockutils [req-dcddcf76-090d-4918-aae3-280216abc164 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:35.169 4088 3038340735224 MainThread DEBUG nova.compute.manager [req-dcddcf76-090d-4918-aae3-280216abc164 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Processing event network-vif-plugged-0ae80e1f-4a5a-4c17-86ac-430359d3999e _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:01:35.169 4088 3038340735224 MainThread DEBUG nova.compute.manager [req-dcddcf76-090d-4918-aae3-280216abc164 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-vif-plugged-538c2fc9-baf4-42d7-93b3-2607925180ca external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:35.169 4088 3038340735224 MainThread DEBUG oslo_concurrency.lockutils [req-dcddcf76-090d-4918-aae3-280216abc164 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:35.169 4088 3038340735224 MainThread DEBUG oslo_concurrency.lockutils [req-dcddcf76-090d-4918-aae3-280216abc164 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:35.169 4088 3038340735224 MainThread DEBUG nova.compute.manager [req-dcddcf76-090d-4918-aae3-280216abc164 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Processing event network-vif-plugged-538c2fc9-baf4-42d7-93b3-2607925180ca _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:01:35.229 4088 3038340568520 MainThread INFO nova.virt.hyperv.vmops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Using config drive for instance 2021-09-10 17:01:35.270 4088 3038340568696 MainThread INFO nova.scheduler.client.report [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Deleted allocations for instance 9015b51e-d705-4694-8c71-5322dc51aa39 2021-09-10 17:01:35.310 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [req-37727a18-294f-44c4-8cdc-cc3dc02a2428 0574bfa519834ae2b8ce81f3a560b957 58b055dc3ac4474788971e8148bec63e - default default] Lock "9015b51e-d705-4694-8c71-5322dc51aa39" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 31.468s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:35.421 4088 3038340568520 MainThread INFO nova.virt.hyperv.vmops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Creating config drive at C:\openstack\instances\instance-0000003b\configdrive.iso 2021-09-10 17:01:35.516 4088 3038340568520 MainThread DEBUG oslo_concurrency.processutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000003b\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpmtm_mkz3 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:01:35.673 4088 3038337403368 GreenThread-61 DEBUG nova.network.neutron [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Updating instance_info_cache with network_info: [{"id": "2cb3a3ea-c0a3-46c3-851e-9241bf8661f1", "address": "fa:16:3e:e4:8e:4b", "network": {"id": "0970e3c9-902a-4302-863e-5a8822167335", "bridge": null, "label": "tempest-TaggedBootDevicesTest_v242-2094950958-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2cb3a3ea-c0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2328bac5-09f9-4dd3-a3ff-1f5673edded4", "address": "fa:16:3e:4f:71:a9", "network": {"id": "92e4eab1-6925-43e4-9374-eabacfd179c1", "bridge": null, "label": "tempest-device-tagging-net1-2142628708", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2328bac5-09", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ffc6e67e-0a49-4c79-9748-12da98323372", "address": "fa:16:3e:18:10:c4", "network": {"id": "92e4eab1-6925-43e4-9374-eabacfd179c1", "bridge": null, "label": "tempest-device-tagging-net1-2142628708", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapffc6e67e-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "86609ec1-a690-46a4-8ef9-4623364e23fe", "address": "fa:16:3e:e7:f2:de", "network": {"id": "92e4eab1-6925-43e4-9374-eabacfd179c1", "bridge": null, "label": "tempest-device-tagging-net1-2142628708", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap86609ec1-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94855bc3-5116-4b2f-ac7b-9de0d4d7ab82", "address": "fa:16:3e:c1:9d:6e", "network": {"id": "92e4eab1-6925-43e4-9374-eabacfd179c1", "bridge": null, "label": "tempest-device-tagging-net1-2142628708", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap94855bc3-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "960e99f9-c9fe-476e-a025-db2754fea043", "address": "fa:16:3e:fb:a7:8d", "network": {"id": "b6a4b24e-05b0-4e47-95a8-02f942067acb", "bridge": null, "label": "tempest-device-tagging-net2-1280552467", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap960e99f9-c9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4179be6b-0ba7-4aaa-b9aa-0c37a0c9fab0", "address": "fa:16:3e:55:e0:74", "network": {"id": "b6a4b24e-05b0-4e47-95a8-02f942067acb", "bridge": null, "label": "tempest-device-tagging-net2-1280552467", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4179be6b-0b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:35.704 4088 3038337403368 GreenThread-61 DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Releasing lock "refresh_cache-d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:35.717 4088 3038337403368 GreenThread-61 DEBUG nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Instance network_info: |[{"id": "2cb3a3ea-c0a3-46c3-851e-9241bf8661f1", "address": "fa:16:3e:e4:8e:4b", "network": {"id": "0970e3c9-902a-4302-863e-5a8822167335", "bridge": null, "label": "tempest-TaggedBootDevicesTest_v242-2094950958-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2cb3a3ea-c0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2328bac5-09f9-4dd3-a3ff-1f5673edded4", "address": "fa:16:3e:4f:71:a9", "network": {"id": "92e4eab1-6925-43e4-9374-eabacfd179c1", "bridge": null, "label": "tempest-device-tagging-net1-2142628708", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2328bac5-09", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ffc6e67e-0a49-4c79-9748-12da98323372", "address": "fa:16:3e:18:10:c4", "network": {"id": "92e4eab1-6925-43e4-9374-eabacfd179c1", "bridge": null, "label": "tempest-device-tagging-net1-2142628708", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapffc6e67e-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "86609ec1-a690-46a4-8ef9-4623364e23fe", "address": "fa:16:3e:e7:f2:de", "network": {"id": "92e4eab1-6925-43e4-9374-eabacfd179c1", "bridge": null, "label": "tempest-device-tagging-net1-2142628708", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap86609ec1-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94855bc3-5116-4b2f-ac7b-9de0d4d7ab82", "address": "fa:16:3e:c1:9d:6e", "network": {"id": "92e4eab1-6925-43e4-9374-eabacfd179c1", "bridge": null, "label": "tempest-device-tagging-net1-2142628708", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap94855bc3-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "960e99f9-c9fe-476e-a025-db2754fea043", "address": "fa:16:3e:fb:a7:8d", "network": {"id": "b6a4b24e-05b0-4e47-95a8-02f942067acb", "bridge": null, "label": "tempest-device-tagging-net2-1280552467", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap960e99f9-c9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4179be6b-0ba7-4aaa-b9aa-0c37a0c9fab0", "address": "fa:16:3e:55:e0:74", "network": {"id": "b6a4b24e-05b0-4e47-95a8-02f942067acb", "bridge": null, "label": "tempest-device-tagging-net2-1280552467", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4179be6b-0b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:01:35.717 4088 3038359395496 MainThread DEBUG oslo_concurrency.lockutils [req-c3ba5d5f-bf21-4756-aa6c-29abfb5cf77e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:35.717 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-c3ba5d5f-bf21-4756-aa6c-29abfb5cf77e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Refreshing network info cache for port 960e99f9-c9fe-476e-a025-db2754fea043 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:01:35.717 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Preparing to wait for external event network-vif-plugged-2cb3a3ea-c0a3-46c3-851e-9241bf8661f1 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:01:35.717 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:35.717 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:35.717 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Preparing to wait for external event network-vif-plugged-2328bac5-09f9-4dd3-a3ff-1f5673edded4 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:01:35.717 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:35.717 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:35.717 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Preparing to wait for external event network-vif-plugged-ffc6e67e-0a49-4c79-9748-12da98323372 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:01:35.717 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:35.717 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:35.717 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Preparing to wait for external event network-vif-plugged-86609ec1-a690-46a4-8ef9-4623364e23fe prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:01:35.717 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:35.717 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:35.717 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Preparing to wait for external event network-vif-plugged-94855bc3-5116-4b2f-ac7b-9de0d4d7ab82 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:01:35.717 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:35.717 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:35.717 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Preparing to wait for external event network-vif-plugged-960e99f9-c9fe-476e-a025-db2754fea043 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:01:35.717 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:35.735 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:35.735 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Preparing to wait for external event network-vif-plugged-4179be6b-0ba7-4aaa-b9aa-0c37a0c9fab0 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:01:35.735 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:35.735 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:35.735 4088 3038337403896 MainThread DEBUG os_win.utils.compute.vmutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Creating VM instance-0000003f create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:01:35.918 4088 3038340568520 MainThread DEBUG oslo_concurrency.processutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000003b\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpmtm_mkz3" returned: 0 in 0.407s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:01:36.763 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.vmops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Setting boot order for instance: instance-0000003b: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:01:36.861 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-c3ba5d5f-bf21-4756-aa6c-29abfb5cf77e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Updated VIF entry in instance network info cache for port 960e99f9-c9fe-476e-a025-db2754fea043. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:01:36.861 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-c3ba5d5f-bf21-4756-aa6c-29abfb5cf77e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Updating instance_info_cache with network_info: [{"id": "2cb3a3ea-c0a3-46c3-851e-9241bf8661f1", "address": "fa:16:3e:e4:8e:4b", "network": {"id": "0970e3c9-902a-4302-863e-5a8822167335", "bridge": null, "label": "tempest-TaggedBootDevicesTest_v242-2094950958-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2cb3a3ea-c0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2328bac5-09f9-4dd3-a3ff-1f5673edded4", "address": "fa:16:3e:4f:71:a9", "network": {"id": "92e4eab1-6925-43e4-9374-eabacfd179c1", "bridge": null, "label": "tempest-device-tagging-net1-2142628708", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2328bac5-09", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ffc6e67e-0a49-4c79-9748-12da98323372", "address": "fa:16:3e:18:10:c4", "network": {"id": "92e4eab1-6925-43e4-9374-eabacfd179c1", "bridge": null, "label": "tempest-device-tagging-net1-2142628708", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapffc6e67e-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "86609ec1-a690-46a4-8ef9-4623364e23fe", "address": "fa:16:3e:e7:f2:de", "network": {"id": "92e4eab1-6925-43e4-9374-eabacfd179c1", "bridge": null, "label": "tempest-device-tagging-net1-2142628708", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap86609ec1-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94855bc3-5116-4b2f-ac7b-9de0d4d7ab82", "address": "fa:16:3e:c1:9d:6e", "network": {"id": "92e4eab1-6925-43e4-9374-eabacfd179c1", "bridge": null, "label": "tempest-device-tagging-net1-2142628708", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap94855bc3-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "960e99f9-c9fe-476e-a025-db2754fea043", "address": "fa:16:3e:fb:a7:8d", "network": {"id": "b6a4b24e-05b0-4e47-95a8-02f942067acb", "bridge": null, "label": "tempest-device-tagging-net2-1280552467", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap960e99f9-c9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4179be6b-0ba7-4aaa-b9aa-0c37a0c9fab0", "address": "fa:16:3e:55:e0:74", "network": {"id": "b6a4b24e-05b0-4e47-95a8-02f942067acb", "bridge": null, "label": "tempest-device-tagging-net2-1280552467", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4179be6b-0b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:36.871 4088 3038359395496 MainThread DEBUG oslo_concurrency.lockutils [req-c3ba5d5f-bf21-4756-aa6c-29abfb5cf77e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:36.871 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-c3ba5d5f-bf21-4756-aa6c-29abfb5cf77e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-changed-4179be6b-0ba7-4aaa-b9aa-0c37a0c9fab0 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:36.871 4088 3038359395496 MainThread DEBUG nova.compute.manager [req-c3ba5d5f-bf21-4756-aa6c-29abfb5cf77e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Refreshing instance network info cache due to event network-changed-4179be6b-0ba7-4aaa-b9aa-0c37a0c9fab0. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:01:36.871 4088 3038359395496 MainThread DEBUG oslo_concurrency.lockutils [req-c3ba5d5f-bf21-4756-aa6c-29abfb5cf77e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:36.888 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-c3ba5d5f-bf21-4756-aa6c-29abfb5cf77e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Refreshing network info cache for port 4179be6b-0ba7-4aaa-b9aa-0c37a0c9fab0 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:01:36.938 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.volumeops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Attaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-36413d8d-e561-4803-ae3b-516b90e60d05', 'target_lun': 0, 'volume_id': '36413d8d-e561-4803-ae3b-516b90e60d05', 'auth_method': 'CHAP', 'auth_username': 'r7zZCaWyvbNG2TWUNX7m', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'reserved', 'instance': 'd4b1aa5b-c1ae-4df7-afd7-15d31bbaa869', 'attached_at': '', 'detached_at': '', 'volume_id': '36413d8d-e561-4803-ae3b-516b90e60d05', 'serial': '36413d8d-e561-4803-ae3b-516b90e60d05'} to instance-0000003f _attach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:108 2021-09-10 17:01:36.938 4088 3038337403896 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-36413d8d-e561-4803-ae3b-516b90e60d05', 'target_lun': 0, 'volume_id': '36413d8d-e561-4803-ae3b-516b90e60d05', 'auth_method': 'CHAP', 'auth_username': 'r7zZCaWyvbNG2TWUNX7m', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:01:36.938 4088 3038337403896 MainThread INFO os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Attempting to establish an iSCSI session to target iqn.2010-10.org.openstack:volume-36413d8d-e561-4803-ae3b-516b90e60d05 on portal 10.222.0.55:3260 accessing LUN 0 using initiator None. 2021-09-10 17:01:36.949 4088 3038337403896 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Logging in iSCSI target iqn.2010-10.org.openstack:volume-36413d8d-e561-4803-ae3b-516b90e60d05 login_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:401 2021-09-10 17:01:36.949 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.vmops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:01:36.979 4088 3038340568520 MainThread DEBUG os_win.utils.jobutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Waiting for WMI job: {'InstanceID': 'AF505687-9946-4C71-811E-E3F833DD327C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16418), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:37.376 4088 3038340568520 MainThread ERROR os_win.utils.jobutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003b\' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)instance-0000003bF6170365-AA12-47EE-9906-FB0981574BC312030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)instance-0000003bF6170365-AA12-47EE-9906-FB0981574BC310243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)instance-0000003bF6170365-AA12-47EE-9906-FB0981574BC3%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'AF505687-9946-4C71-811E-E3F833DD327C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=332288), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 36), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 37), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003b' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)\n\nNot enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)\n\n'instance-0000003b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)", 'ErrorSummaryDescription': "'instance-0000003b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:37.390 4088 3038340568520 MainThread DEBUG os_win._utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003b' failed to start. Not enough memory in the system to start the virtual machine instance-0000003b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003b' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Not enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) 'instance-0000003b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.44178128242492676 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:37.438 4088 3038340568696 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:37.438 4088 3038340568696 MainThread INFO nova.compute.manager [-] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] VM Stopped (Lifecycle Event) 2021-09-10 17:01:37.438 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:37.438 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:37.480 4088 3038340568696 MainThread DEBUG nova.compute.manager [req-4b03ce56-6365-4ab8-9ba6-e26cddbd9790 - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:37.480 4088 3038340568696 MainThread DEBUG nova.virt.hyperv.vmops [req-4b03ce56-6365-4ab8-9ba6-e26cddbd9790 - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:37.541 4088 3038340568696 MainThread DEBUG nova.compute.manager [req-4b03ce56-6365-4ab8-9ba6-e26cddbd9790 - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:37.573 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:01:37.573 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:01:37.573 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:01:37.573 4088 3038340568696 MainThread INFO nova.compute.manager [req-4b03ce56-6365-4ab8-9ba6-e26cddbd9790 - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:37.925 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "5d609bba-4fd0-487a-973f-650fbbd599db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:37.984 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-c3ba5d5f-bf21-4756-aa6c-29abfb5cf77e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Updated VIF entry in instance network info cache for port 4179be6b-0ba7-4aaa-b9aa-0c37a0c9fab0. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:01:37.984 4088 3038359395496 MainThread DEBUG nova.network.neutron [req-c3ba5d5f-bf21-4756-aa6c-29abfb5cf77e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Updating instance_info_cache with network_info: [{"id": "2cb3a3ea-c0a3-46c3-851e-9241bf8661f1", "address": "fa:16:3e:e4:8e:4b", "network": {"id": "0970e3c9-902a-4302-863e-5a8822167335", "bridge": null, "label": "tempest-TaggedBootDevicesTest_v242-2094950958-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2cb3a3ea-c0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2328bac5-09f9-4dd3-a3ff-1f5673edded4", "address": "fa:16:3e:4f:71:a9", "network": {"id": "92e4eab1-6925-43e4-9374-eabacfd179c1", "bridge": null, "label": "tempest-device-tagging-net1-2142628708", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2328bac5-09", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ffc6e67e-0a49-4c79-9748-12da98323372", "address": "fa:16:3e:18:10:c4", "network": {"id": "92e4eab1-6925-43e4-9374-eabacfd179c1", "bridge": null, "label": "tempest-device-tagging-net1-2142628708", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapffc6e67e-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "86609ec1-a690-46a4-8ef9-4623364e23fe", "address": "fa:16:3e:e7:f2:de", "network": {"id": "92e4eab1-6925-43e4-9374-eabacfd179c1", "bridge": null, "label": "tempest-device-tagging-net1-2142628708", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap86609ec1-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94855bc3-5116-4b2f-ac7b-9de0d4d7ab82", "address": "fa:16:3e:c1:9d:6e", "network": {"id": "92e4eab1-6925-43e4-9374-eabacfd179c1", "bridge": null, "label": "tempest-device-tagging-net1-2142628708", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap94855bc3-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "960e99f9-c9fe-476e-a025-db2754fea043", "address": "fa:16:3e:fb:a7:8d", "network": {"id": "b6a4b24e-05b0-4e47-95a8-02f942067acb", "bridge": null, "label": "tempest-device-tagging-net2-1280552467", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap960e99f9-c9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4179be6b-0ba7-4aaa-b9aa-0c37a0c9fab0", "address": "fa:16:3e:55:e0:74", "network": {"id": "b6a4b24e-05b0-4e47-95a8-02f942067acb", "bridge": null, "label": "tempest-device-tagging-net2-1280552467", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.2"}}], "meta": {"injected": false, "tenant_id": "fe5b53ea59bd43bf84431d6daec45a04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4179be6b-0b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:37.994 4088 3038340569400 MainThread DEBUG nova.compute.manager [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:01:37.994 4088 3038359395496 MainThread DEBUG oslo_concurrency.lockutils [req-c3ba5d5f-bf21-4756-aa6c-29abfb5cf77e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:38.113 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:38.124 4088 3038340569400 MainThread DEBUG nova.virt.hardware [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:01:38.124 4088 3038340569400 MainThread INFO nova.compute.claims [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Claim successful on node n-h2-808474-1 2021-09-10 17:01:38.312 4088 3038340569400 MainThread DEBUG nova.scheduler.client.report [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Refreshing inventories for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:757 2021-09-10 17:01:38.355 4088 3038340569400 MainThread DEBUG nova.scheduler.client.report [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Updating ProviderTree inventory for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 from _refresh_and_get_inventory using data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} _refresh_and_get_inventory c:\openstack\build\nova\nova\scheduler\client\report.py:723 2021-09-10 17:01:38.355 4088 3038340569400 MainThread DEBUG nova.compute.provider_tree [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Updating inventory in ProviderTree for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 with inventory: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:176 2021-09-10 17:01:38.370 4088 3038340569400 MainThread DEBUG nova.scheduler.client.report [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Refreshing aggregate associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, aggregates: None _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:766 2021-09-10 17:01:38.433 4088 3038340569400 MainThread DEBUG nova.scheduler.client.report [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Refreshing trait associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_VHD,COMPUTE_IMAGE_TYPE_VHDX,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:778 2021-09-10 17:01:38.433 4088 3038340569400 MainThread DEBUG nova.virt.hyperv.hostops [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:01:38.433 4088 3038340568520 MainThread DEBUG os_win.utils.jobutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Waiting for WMI job: {'InstanceID': '4C70C1A9-9478-4C19-91A5-EBB69AA08597', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20513), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:38.450 4088 3038340569400 MainThread DEBUG nova.virt.hyperv.hostops [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:01:38.673 4088 3038340569400 MainThread DEBUG nova.compute.provider_tree [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:01:38.698 4088 3038340569400 MainThread DEBUG nova.scheduler.client.report [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:01:38.698 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.594s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:38.698 4088 3038340569400 MainThread DEBUG nova.compute.manager [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:01:38.744 4088 3038340569400 MainThread DEBUG nova.compute.utils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 17:01:38.767 4088 3038342147416 GreenThread-65 DEBUG nova.compute.manager [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:01:38.767 4088 3038342147416 GreenThread-65 DEBUG nova.network.neutron [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:01:38.792 4088 3038340569400 MainThread DEBUG nova.compute.manager [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:01:38.827 4088 3038340568520 MainThread ERROR os_win.utils.jobutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003b\' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)instance-0000003bF6170365-AA12-47EE-9906-FB0981574BC312030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)instance-0000003bF6170365-AA12-47EE-9906-FB0981574BC310243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)instance-0000003bF6170365-AA12-47EE-9906-FB0981574BC3%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4C70C1A9-9478-4C19-91A5-EBB69AA08597', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=322716), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 38), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 38), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003b' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)\n\nNot enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)\n\n'instance-0000003b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)", 'ErrorSummaryDescription': "'instance-0000003b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:38.827 4088 3038340568520 MainThread DEBUG os_win._utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003b' failed to start. Not enough memory in the system to start the virtual machine instance-0000003b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003b' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Not enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) 'instance-0000003b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.8783087730407715 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:38.870 4088 3038340569048 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:38.870 4088 3038340569048 MainThread INFO nova.compute.manager [-] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] VM Stopped (Lifecycle Event) 2021-09-10 17:01:38.870 4088 3038340569752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:38.870 4088 3038340569752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:38.894 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-05025482-f05a-4ebb-b20f-3657318fcc0f - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:38.894 4088 3038340569048 MainThread DEBUG nova.virt.hyperv.vmops [req-05025482-f05a-4ebb-b20f-3657318fcc0f - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:38.952 4088 3038340569400 MainThread DEBUG nova.compute.manager [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:01:38.952 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-05025482-f05a-4ebb-b20f-3657318fcc0f - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:38.952 4088 3038340569400 MainThread INFO nova.virt.hyperv.vmops [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Spawning new instance 2021-09-10 17:01:38.980 4088 3038340569048 MainThread INFO nova.compute.manager [req-05025482-f05a-4ebb-b20f-3657318fcc0f - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:39.012 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-0000004d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:39.012 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-0000004d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:39.012 4088 3038340569400 MainThread DEBUG nova.block_device [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:01:39.012 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:39.012 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:39.037 4088 3038340569400 MainThread DEBUG os_win.utils.pathutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Creating directory: C:\openstack\instances\instance-0000004d check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:01:39.037 4088 3038340569400 MainThread DEBUG nova.virt.hyperv.vmops [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000004d\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:01:39.047 4088 3038342147416 GreenThread-65 DEBUG nova.policy [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b207fe385eb647a4acf0331024dcf245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a75e521b5f4d89ab74f2701a36da12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:01:39.292 4088 3038340569400 MainThread DEBUG nova.virt.hyperv.vmops [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Resizing VHD C:\openstack\instances\instance-0000004d\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:01:39.839 4088 3038340568520 MainThread DEBUG os_win.utils.jobutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Waiting for WMI job: {'InstanceID': '60F45402-4734-4F4D-9D8F-C9BE202F3106', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15681), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:40.214 4088 3038340568520 MainThread ERROR os_win.utils.jobutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003b\' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)instance-0000003bF6170365-AA12-47EE-9906-FB0981574BC312030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)instance-0000003bF6170365-AA12-47EE-9906-FB0981574BC310243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)instance-0000003bF6170365-AA12-47EE-9906-FB0981574BC3%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '60F45402-4734-4F4D-9D8F-C9BE202F3106', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=313558), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 39), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 40), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003b' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)\n\nNot enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)\n\n'instance-0000003b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)", 'ErrorSummaryDescription': "'instance-0000003b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:40.214 4088 3038340568520 MainThread DEBUG os_win._utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003b' failed to start. Not enough memory in the system to start the virtual machine instance-0000003b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003b' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Not enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) 'instance-0000003b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 3.2652993202209473 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:40.277 4088 3038340569048 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:40.277 4088 3038340569048 MainThread INFO nova.compute.manager [-] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] VM Stopped (Lifecycle Event) 2021-09-10 17:01:40.277 4088 3038340569752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:40.277 4088 3038340569752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:40.316 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-42909e1a-caa4-4c57-bcf8-f74657e9a827 - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:40.323 4088 3038340569048 MainThread DEBUG nova.virt.hyperv.vmops [req-42909e1a-caa4-4c57-bcf8-f74657e9a827 - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:40.369 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-42909e1a-caa4-4c57-bcf8-f74657e9a827 - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:40.410 4088 3038340569048 MainThread INFO nova.compute.manager [req-42909e1a-caa4-4c57-bcf8-f74657e9a827 - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:40.527 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Lock "e55fb7bd-490b-4fc5-9304-262050287269" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:40.557 4088 3038337402488 MainThread DEBUG nova.compute.manager [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:01:40.574 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:01:40.574 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:01:40.574 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:01:40.660 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-0e77fafa-3f8a-4513-bb64-518c77e99029" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:40.660 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:01:40.673 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:40.673 4088 3038337402488 MainThread DEBUG nova.virt.hardware [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:01:40.673 4088 3038337402488 MainThread INFO nova.compute.claims [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Claim successful on node n-h2-808474-1 2021-09-10 17:01:40.791 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-f73e5578-f95a-4a59-8be2-0cb2a4683c86 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Received event network-vif-plugged-fbacf90a-0d6c-4df6-81d9-a2d6ebf2775b external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:40.791 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-f73e5578-f95a-4a59-8be2-0cb2a4683c86 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "219ee2c7-854a-4265-903f-5d10381fa708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:40.791 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-f73e5578-f95a-4a59-8be2-0cb2a4683c86 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "219ee2c7-854a-4265-903f-5d10381fa708-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:40.791 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-f73e5578-f95a-4a59-8be2-0cb2a4683c86 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Processing event network-vif-plugged-fbacf90a-0d6c-4df6-81d9-a2d6ebf2775b _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:01:40.807 4088 3038337402488 MainThread DEBUG nova.virt.hyperv.hostops [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:01:40.844 4088 3038359396200 MainThread INFO nova.virt.hyperv.vmops [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Using config drive for instance 2021-09-10 17:01:40.844 4088 3038337402488 MainThread DEBUG nova.virt.hyperv.hostops [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:01:41.088 4088 3038337402488 MainThread DEBUG nova.compute.provider_tree [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:01:41.104 4088 3038337402488 MainThread DEBUG nova.scheduler.client.report [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:01:41.104 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:41.104 4088 3038337402488 MainThread DEBUG nova.compute.manager [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:01:41.169 4088 3038337402488 MainThread DEBUG nova.compute.manager [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:01:41.169 4088 3038340735048 GreenThread-66 DEBUG nova.compute.manager [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:01:41.169 4088 3038340735048 GreenThread-66 DEBUG nova.network.neutron [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:01:41.245 4088 3038340568520 MainThread DEBUG os_win.utils.jobutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Waiting for WMI job: {'InstanceID': 'BFCD1B5A-8952-4FFF-91DC-269E581F0EBD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=22600), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:41.292 4088 3038337402488 MainThread DEBUG nova.compute.manager [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:01:41.307 4088 3038359396200 MainThread INFO nova.virt.hyperv.vmops [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Creating config drive at C:\openstack\instances\instance-00000047\configdrive.iso 2021-09-10 17:01:41.401 4088 3038359396200 MainThread DEBUG oslo_concurrency.processutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000047\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpkzswkdmz execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:01:41.543 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Updating instance_info_cache with network_info: [{"id": "a8d3d6fd-c535-4f42-b11d-348191f22a38", "address": "fa:16:3e:61:e8:c4", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa8d3d6fd-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:41.564 4088 3038340735048 GreenThread-66 DEBUG nova.policy [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5eaa901834b4ee885c2b6a9ce410303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42eab1e5884dc19398c04cdcea9edd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:01:41.564 4088 3038337402488 MainThread INFO nova.virt.hyperv.vmops [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Spawning new instance 2021-09-10 17:01:41.576 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-0e77fafa-3f8a-4513-bb64-518c77e99029" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:41.576 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:01:41.576 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:01:41.576 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:01:41.576 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Lock "instance-0000004a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:41.576 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Lock "instance-0000004a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:41.576 4088 3038337402488 MainThread DEBUG nova.block_device [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:01:41.576 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:41.576 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:41.576 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_incomplete_migrations run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:01:41.598 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances with incomplete migration _cleanup_incomplete_migrations c:\openstack\build\nova\nova\compute\manager.py:10640 2021-09-10 17:01:41.605 4088 3038337402488 MainThread DEBUG os_win.utils.pathutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Creating directory: C:\openstack\instances\instance-0000004a check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:01:41.605 4088 3038337402488 MainThread DEBUG nova.virt.hyperv.vmops [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000004a\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:01:41.605 4088 3038340568520 MainThread ERROR os_win.utils.jobutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003b\' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)instance-0000003bF6170365-AA12-47EE-9906-FB0981574BC312030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)instance-0000003bF6170365-AA12-47EE-9906-FB0981574BC310243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)instance-0000003bF6170365-AA12-47EE-9906-FB0981574BC3%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BFCD1B5A-8952-4FFF-91DC-269E581F0EBD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=339677), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 41), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 41), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003b' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)\n\nNot enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)\n\n'instance-0000003b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)", 'ErrorSummaryDescription': "'instance-0000003b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:41.605 4088 3038340568520 MainThread DEBUG os_win._utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003b' failed to start. Not enough memory in the system to start the virtual machine instance-0000003b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003b' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Not enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) 'instance-0000003b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 4.65648078918457 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:41.714 4088 3038340736808 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:41.714 4088 3038340736808 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:41.714 4088 3038340735224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:41.714 4088 3038340735224 MainThread INFO nova.compute.manager [-] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] VM Stopped (Lifecycle Event) 2021-09-10 17:01:41.744 4088 3038359396200 MainThread DEBUG oslo_concurrency.processutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000047\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpkzswkdmz" returned: 0 in 0.344s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:01:41.761 4088 3038340735224 MainThread DEBUG nova.compute.manager [req-dfed9d1a-2282-465f-aa7e-bf41df85a424 - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:41.761 4088 3038340735224 MainThread DEBUG nova.virt.hyperv.vmops [req-dfed9d1a-2282-465f-aa7e-bf41df85a424 - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:41.807 4088 3038340735224 MainThread DEBUG nova.compute.manager [req-dfed9d1a-2282-465f-aa7e-bf41df85a424 - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:41.838 4088 3038337402488 MainThread DEBUG nova.virt.hyperv.vmops [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Resizing VHD C:\openstack\instances\instance-0000004a\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:01:41.869 4088 3038340735224 MainThread INFO nova.compute.manager [req-dfed9d1a-2282-465f-aa7e-bf41df85a424 - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:41.901 4088 3038342147416 GreenThread-65 DEBUG nova.network.neutron [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Successfully created port: 2b157f6c-2393-4228-97bf-47d46fb70741 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:01:42.017 4088 3038337403896 MainThread DEBUG os_win.utils.storage.diskutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:01:42.104 4088 3038337403896 MainThread DEBUG os_win.utils.storage.diskutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:01:42.168 4088 3038337403896 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] <== connect_volume: return (5229ms) {'type': 'block', 'path': '\\\\.\\PhysicalDrive4', 'number': 4, 'scsi_wwn': '36001405EBD8B676B37C4411BA55CDED3'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:01:42.238 4088 3038340735048 GreenThread-66 DEBUG nova.network.neutron [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Successfully created port: da958760-870a-4ea0-ac3b-ac80e2105cd3 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:01:42.285 4088 3038359396200 MainThread DEBUG nova.virt.hyperv.vmops [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Setting boot order for instance: instance-00000047: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:01:42.387 4088 3038359396200 MainThread DEBUG nova.virt.hyperv.vmops [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:01:42.425 4088 3038359396200 MainThread DEBUG os_win.utils.jobutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Waiting for WMI job: {'InstanceID': 'B16BC809-2FD1-4EF3-AEE7-2442DC8F92C5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15693), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:42.559 4088 3038359396200 MainThread ERROR os_win.utils.jobutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] WMI job failed: {'RawErrors': (('124\'instance-00000047\' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)instance-0000004763C540C3-F18F-4138-BD7B-0855F3DE5DF512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)instance-0000004763C540C3-F18F-4138-BD7B-0855F3DE5DF510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000047\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)instance-0000004763C540C3-F18F-4138-BD7B-0855F3DE5DF5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B16BC809-2FD1-4EF3-AEE7-2442DC8F92C5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116046), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 42), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 42), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000047' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)\n\nNot enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)\n\n'instance-00000047' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)", 'ErrorSummaryDescription': "'instance-00000047' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000047.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:42.559 4088 3038359396200 MainThread DEBUG os_win._utils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000047' failed to start. Not enough memory in the system to start the virtual machine instance-00000047. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000047' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Not enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) 'instance-00000047' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1720895767211914 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:42.607 4088 3038337403368 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:42.607 4088 3038337403368 MainThread INFO nova.compute.manager [-] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] VM Stopped (Lifecycle Event) 2021-09-10 17:01:42.621 4088 3038340735224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000047" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:42.621 4088 3038340735224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000047" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:42.641 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-d5260534-6c21-480c-aa22-edebe92045e7 - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:42.641 4088 3038337403368 MainThread DEBUG nova.virt.hyperv.vmops [req-d5260534-6c21-480c-aa22-edebe92045e7 - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:42.641 4088 3038340568520 MainThread DEBUG os_win.utils.jobutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Waiting for WMI job: {'InstanceID': '31A36AD4-9A79-4B3A-A852-56B3AA1BE5B4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16828), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:42.699 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-d5260534-6c21-480c-aa22-edebe92045e7 - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:42.713 4088 3038337403368 MainThread INFO nova.compute.manager [req-d5260534-6c21-480c-aa22-edebe92045e7 - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:42.825 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.volumeops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Attaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-174960b8-7aa2-43c8-aff0-31d5f7de9324', 'target_lun': 0, 'volume_id': '174960b8-7aa2-43c8-aff0-31d5f7de9324', 'auth_method': 'CHAP', 'auth_username': 'rYi4xVp8k8gT6zEJHGPP', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'reserved', 'instance': 'd4b1aa5b-c1ae-4df7-afd7-15d31bbaa869', 'attached_at': '', 'detached_at': '', 'volume_id': '174960b8-7aa2-43c8-aff0-31d5f7de9324', 'serial': '174960b8-7aa2-43c8-aff0-31d5f7de9324'} to instance-0000003f _attach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:108 2021-09-10 17:01:42.854 4088 3038337403896 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-174960b8-7aa2-43c8-aff0-31d5f7de9324', 'target_lun': 0, 'volume_id': '174960b8-7aa2-43c8-aff0-31d5f7de9324', 'auth_method': 'CHAP', 'auth_username': 'rYi4xVp8k8gT6zEJHGPP', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:01:42.854 4088 3038337403896 MainThread INFO os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Attempting to establish an iSCSI session to target iqn.2010-10.org.openstack:volume-174960b8-7aa2-43c8-aff0-31d5f7de9324 on portal 10.222.0.55:3260 accessing LUN 0 using initiator None. 2021-09-10 17:01:42.854 4088 3038337403896 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Logging in iSCSI target iqn.2010-10.org.openstack:volume-174960b8-7aa2-43c8-aff0-31d5f7de9324 login_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:401 2021-09-10 17:01:42.887 4088 3038340735048 GreenThread-66 DEBUG nova.network.neutron [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Successfully updated port: da958760-870a-4ea0-ac3b-ac80e2105cd3 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:01:42.905 4088 3038340735048 GreenThread-66 DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Acquired lock "refresh_cache-e55fb7bd-490b-4fc5-9304-262050287269" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:42.905 4088 3038340735048 GreenThread-66 DEBUG nova.network.neutron [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:01:42.980 4088 3038340735048 GreenThread-66 DEBUG nova.network.neutron [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:01:43.044 4088 3038340568520 MainThread ERROR os_win.utils.jobutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003b\' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)instance-0000003bF6170365-AA12-47EE-9906-FB0981574BC312030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)instance-0000003bF6170365-AA12-47EE-9906-FB0981574BC310243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)instance-0000003bF6170365-AA12-47EE-9906-FB0981574BC3%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '31A36AD4-9A79-4B3A-A852-56B3AA1BE5B4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=330963), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 42), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 42), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003b' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)\n\nNot enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)\n\n'instance-0000003b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)", 'ErrorSummaryDescription': "'instance-0000003b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:43.044 4088 3038340568520 MainThread DEBUG os_win._utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003b' failed to start. Not enough memory in the system to start the virtual machine instance-0000003b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003b' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Not enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) 'instance-0000003b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 6.095034122467041 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:43.080 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:43.080 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:43.080 4088 3038337403016 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:43.080 4088 3038337403016 MainThread INFO nova.compute.manager [-] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] VM Stopped (Lifecycle Event) 2021-09-10 17:01:43.119 4088 3038337403016 MainThread DEBUG nova.compute.manager [req-d520284b-6069-4168-a001-0dd2222c0fd2 - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:43.119 4088 3038337403016 MainThread DEBUG nova.virt.hyperv.vmops [req-d520284b-6069-4168-a001-0dd2222c0fd2 - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:43.171 4088 3038337403016 MainThread DEBUG nova.compute.manager [req-d520284b-6069-4168-a001-0dd2222c0fd2 - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:43.204 4088 3038337403016 MainThread INFO nova.compute.manager [req-d520284b-6069-4168-a001-0dd2222c0fd2 - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:43.326 4088 3038340735048 GreenThread-66 DEBUG nova.network.neutron [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Updating instance_info_cache with network_info: [{"id": "da958760-870a-4ea0-ac3b-ac80e2105cd3", "address": "fa:16:3e:6a:25:a5", "network": {"id": "4ea0beb7-7806-41ea-b250-a4b20b1944e8", "bridge": null, "label": "tempest-ServerMetadataNegativeTestJSON-79328095-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0c42eab1e5884dc19398c04cdcea9edd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapda958760-87", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:43.326 4088 3038340735048 GreenThread-66 DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Releasing lock "refresh_cache-e55fb7bd-490b-4fc5-9304-262050287269" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:43.326 4088 3038340735048 GreenThread-66 DEBUG nova.compute.manager [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Instance network_info: |[{"id": "da958760-870a-4ea0-ac3b-ac80e2105cd3", "address": "fa:16:3e:6a:25:a5", "network": {"id": "4ea0beb7-7806-41ea-b250-a4b20b1944e8", "bridge": null, "label": "tempest-ServerMetadataNegativeTestJSON-79328095-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0c42eab1e5884dc19398c04cdcea9edd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapda958760-87", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:01:43.353 4088 3038337402488 MainThread DEBUG nova.compute.manager [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Preparing to wait for external event network-vif-plugged-da958760-870a-4ea0-ac3b-ac80e2105cd3 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:01:43.353 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Lock "e55fb7bd-490b-4fc5-9304-262050287269-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:43.353 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Lock "e55fb7bd-490b-4fc5-9304-262050287269-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:43.353 4088 3038337402488 MainThread DEBUG os_win.utils.compute.vmutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Creating VM instance-0000004a create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:01:43.566 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:01:43.762 4088 3038359396200 MainThread DEBUG os_win.utils.jobutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Waiting for WMI job: {'InstanceID': '4F6D1037-9700-42A9-888F-88F3C4FC29F3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16002), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:43.900 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-53cbf006-6a49-4bac-b5e4-a9aae25952af 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Received event network-changed-da958760-870a-4ea0-ac3b-ac80e2105cd3 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:43.900 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-53cbf006-6a49-4bac-b5e4-a9aae25952af 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Refreshing instance network info cache due to event network-changed-da958760-870a-4ea0-ac3b-ac80e2105cd3. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:01:43.900 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-53cbf006-6a49-4bac-b5e4-a9aae25952af 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-e55fb7bd-490b-4fc5-9304-262050287269" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:43.900 4088 3038337403368 MainThread DEBUG nova.network.neutron [req-53cbf006-6a49-4bac-b5e4-a9aae25952af 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Refreshing network info cache for port da958760-870a-4ea0-ac3b-ac80e2105cd3 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:01:43.900 4088 3038359396200 MainThread ERROR os_win.utils.jobutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] WMI job failed: {'RawErrors': (('124\'instance-00000047\' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)instance-0000004763C540C3-F18F-4138-BD7B-0855F3DE5DF512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)instance-0000004763C540C3-F18F-4138-BD7B-0855F3DE5DF510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000047\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)instance-0000004763C540C3-F18F-4138-BD7B-0855F3DE5DF5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4F6D1037-9700-42A9-888F-88F3C4FC29F3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116509), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 43), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 43), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000047' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)\n\nNot enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)\n\n'instance-00000047' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)", 'ErrorSummaryDescription': "'instance-00000047' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000047.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:43.900 4088 3038359396200 MainThread DEBUG os_win._utils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000047' failed to start. Not enough memory in the system to start the virtual machine instance-00000047. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000047' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Not enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) 'instance-00000047' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.513258934020996 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:43.982 4088 3038340736632 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:43.982 4088 3038340736632 MainThread INFO nova.compute.manager [-] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] VM Stopped (Lifecycle Event) 2021-09-10 17:01:43.982 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000047" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:43.995 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000047" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:43.995 4088 3038340736632 MainThread DEBUG nova.compute.manager [req-7b26141d-130a-4244-b680-f122442521db - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:43.995 4088 3038340736632 MainThread DEBUG nova.virt.hyperv.vmops [req-7b26141d-130a-4244-b680-f122442521db - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:44.068 4088 3038342147416 GreenThread-65 DEBUG nova.network.neutron [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Successfully updated port: 2b157f6c-2393-4228-97bf-47d46fb70741 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:01:44.073 4088 3038342147416 GreenThread-65 DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Acquired lock "refresh_cache-5d609bba-4fd0-487a-973f-650fbbd599db" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:44.073 4088 3038342147416 GreenThread-65 DEBUG nova.network.neutron [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:01:44.073 4088 3038340568520 MainThread DEBUG os_win.utils.jobutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Waiting for WMI job: {'InstanceID': 'D13D0463-3C95-4604-90C4-306EE5649AC5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17941), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:44.113 4088 3038340736632 MainThread DEBUG nova.compute.manager [req-7b26141d-130a-4244-b680-f122442521db - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:44.137 4088 3038340736632 MainThread INFO nova.compute.manager [req-7b26141d-130a-4244-b680-f122442521db - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:44.339 4088 3038342147416 GreenThread-65 DEBUG nova.network.neutron [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:01:44.463 4088 3038340568520 MainThread ERROR os_win.utils.jobutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003b\' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)instance-0000003bF6170365-AA12-47EE-9906-FB0981574BC312030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)instance-0000003bF6170365-AA12-47EE-9906-FB0981574BC310243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)instance-0000003bF6170365-AA12-47EE-9906-FB0981574BC3%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D13D0463-3C95-4604-90C4-306EE5649AC5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=328734), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 44), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 44), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003b' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)\n\nNot enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)\n\n'instance-0000003b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3)", 'ErrorSummaryDescription': "'instance-0000003b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:44.463 4088 3038340568520 MainThread ERROR nova.virt.hyperv.vmops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Failed to change vm state of instance-0000003b to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000003b' failed to start. 2021-09-10 17:01:44.463 4088 3038340568520 MainThread INFO nova.virt.hyperv.vmops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Got request to destroy instance 2021-09-10 17:01:44.528 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:44.528 4088 3038340735048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:44.528 4088 3038340736632 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:44.528 4088 3038340736632 MainThread INFO nova.compute.manager [-] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] VM Stopped (Lifecycle Event) 2021-09-10 17:01:44.543 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:01:44.543 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:01:44.543 4088 3038340736632 MainThread DEBUG nova.compute.manager [req-c5b98cd2-101b-4665-aefd-29bb77c91efa - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:44.561 4088 3038340736632 MainThread DEBUG nova.virt.hyperv.vmops [req-c5b98cd2-101b-4665-aefd-29bb77c91efa - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:44.606 4088 3038340736632 MainThread DEBUG nova.compute.manager [req-c5b98cd2-101b-4665-aefd-29bb77c91efa - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:44.636 4088 3038340736632 MainThread INFO nova.compute.manager [req-c5b98cd2-101b-4665-aefd-29bb77c91efa - - - - -] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:44.802 4088 3038337403368 MainThread DEBUG nova.network.neutron [req-53cbf006-6a49-4bac-b5e4-a9aae25952af 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Updated VIF entry in instance network info cache for port da958760-870a-4ea0-ac3b-ac80e2105cd3. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:01:44.802 4088 3038337403368 MainThread DEBUG nova.network.neutron [req-53cbf006-6a49-4bac-b5e4-a9aae25952af 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Updating instance_info_cache with network_info: [{"id": "da958760-870a-4ea0-ac3b-ac80e2105cd3", "address": "fa:16:3e:6a:25:a5", "network": {"id": "4ea0beb7-7806-41ea-b250-a4b20b1944e8", "bridge": null, "label": "tempest-ServerMetadataNegativeTestJSON-79328095-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0c42eab1e5884dc19398c04cdcea9edd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapda958760-87", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:44.812 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-53cbf006-6a49-4bac-b5e4-a9aae25952af 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-e55fb7bd-490b-4fc5-9304-262050287269" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:44.933 4088 3038359396200 MainThread DEBUG os_win.utils.jobutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Waiting for WMI job: {'InstanceID': '91C5BC1C-830B-4F00-838B-88A25869E9E4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17579), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:45.097 4088 3038342147416 GreenThread-65 DEBUG nova.network.neutron [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Updating instance_info_cache with network_info: [{"id": "2b157f6c-2393-4228-97bf-47d46fb70741", "address": "fa:16:3e:12:00:9a", "network": {"id": "c9c0a28f-d537-4eed-ab4c-79d1152a1146", "bridge": null, "label": "tempest-MultipleCreateTestJSON-430554862-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "00a75e521b5f4d89ab74f2701a36da12", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2b157f6c-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:45.125 4088 3038342147416 GreenThread-65 DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Releasing lock "refresh_cache-5d609bba-4fd0-487a-973f-650fbbd599db" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:45.125 4088 3038342147416 GreenThread-65 DEBUG nova.compute.manager [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Instance network_info: |[{"id": "2b157f6c-2393-4228-97bf-47d46fb70741", "address": "fa:16:3e:12:00:9a", "network": {"id": "c9c0a28f-d537-4eed-ab4c-79d1152a1146", "bridge": null, "label": "tempest-MultipleCreateTestJSON-430554862-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "00a75e521b5f4d89ab74f2701a36da12", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2b157f6c-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:01:45.125 4088 3038340569400 MainThread DEBUG nova.compute.manager [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Preparing to wait for external event network-vif-plugged-2b157f6c-2393-4228-97bf-47d46fb70741 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:01:45.125 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "5d609bba-4fd0-487a-973f-650fbbd599db-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:45.125 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "5d609bba-4fd0-487a-973f-650fbbd599db-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:45.125 4088 3038340569400 MainThread DEBUG os_win.utils.compute.vmutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Creating VM instance-0000004d create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:01:45.143 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000047" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:45.143 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000047" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:45.143 4088 3038342147416 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:45.143 4088 3038342147416 MainThread INFO nova.compute.manager [-] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] VM Stopped (Lifecycle Event) 2021-09-10 17:01:45.166 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-def7e931-c3bb-4a29-a1eb-b30b161e1097 - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:45.166 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-def7e931-c3bb-4a29-a1eb-b30b161e1097 - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:45.203 4088 3038359396200 MainThread ERROR os_win.utils.jobutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] WMI job failed: {'RawErrors': (('124\'instance-00000047\' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)instance-0000004763C540C3-F18F-4138-BD7B-0855F3DE5DF512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)instance-0000004763C540C3-F18F-4138-BD7B-0855F3DE5DF510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000047\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)instance-0000004763C540C3-F18F-4138-BD7B-0855F3DE5DF5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '91C5BC1C-830B-4F00-838B-88A25869E9E4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=130447), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 44), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 45), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000047' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)\n\nNot enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)\n\n'instance-00000047' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)", 'ErrorSummaryDescription': "'instance-00000047' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000047.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:45.203 4088 3038359396200 MainThread DEBUG os_win._utils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000047' failed to start. Not enough memory in the system to start the virtual machine instance-00000047. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000047' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Not enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) 'instance-00000047' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.815293550491333 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:45.230 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-def7e931-c3bb-4a29-a1eb-b30b161e1097 - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:45.248 4088 3038342147416 MainThread INFO nova.compute.manager [req-def7e931-c3bb-4a29-a1eb-b30b161e1097 - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:45.277 4088 3038337402488 MainThread DEBUG nova.virt.hyperv.vmops [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:45.542 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._run_pending_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:01:45.542 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10602 2021-09-10 17:01:45.557 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] There are 0 instances to clean _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10611 2021-09-10 17:01:46.187 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-0efad0dd-3738-4d40-8b29-967121161522 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Received event network-changed-2b157f6c-2393-4228-97bf-47d46fb70741 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:46.187 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-0efad0dd-3738-4d40-8b29-967121161522 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Refreshing instance network info cache due to event network-changed-2b157f6c-2393-4228-97bf-47d46fb70741. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:01:46.187 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-0efad0dd-3738-4d40-8b29-967121161522 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-5d609bba-4fd0-487a-973f-650fbbd599db" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:46.187 4088 3038337403368 MainThread DEBUG nova.network.neutron [req-0efad0dd-3738-4d40-8b29-967121161522 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Refreshing network info cache for port 2b157f6c-2393-4228-97bf-47d46fb70741 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:01:46.248 4088 3038359396200 MainThread DEBUG os_win.utils.jobutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Waiting for WMI job: {'InstanceID': '674586C4-535E-4CA6-8DDC-8E0B39A24D7E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18026), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:46.414 4088 3038359396200 MainThread ERROR os_win.utils.jobutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] WMI job failed: {'RawErrors': (('124\'instance-00000047\' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)instance-0000004763C540C3-F18F-4138-BD7B-0855F3DE5DF512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)instance-0000004763C540C3-F18F-4138-BD7B-0855F3DE5DF510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000047\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)instance-0000004763C540C3-F18F-4138-BD7B-0855F3DE5DF5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '674586C4-535E-4CA6-8DDC-8E0B39A24D7E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120449), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 46), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 46), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000047' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)\n\nNot enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)\n\n'instance-00000047' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)", 'ErrorSummaryDescription': "'instance-00000047' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000047.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:46.417 4088 3038359396200 MainThread DEBUG os_win._utils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000047' failed to start. Not enough memory in the system to start the virtual machine instance-00000047. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000047' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Not enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) 'instance-00000047' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 4.029602289199829 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:46.433 4088 3038342147416 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:46.433 4088 3038342147416 MainThread INFO nova.compute.manager [-] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] VM Stopped (Lifecycle Event) 2021-09-10 17:01:46.457 4088 3038340735224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000047" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:46.457 4088 3038340735224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000047" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:46.463 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-ccfa884b-37a9-4512-8478-d399b6e903ec - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:46.463 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-ccfa884b-37a9-4512-8478-d399b6e903ec - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:46.513 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-ccfa884b-37a9-4512-8478-d399b6e903ec - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:46.545 4088 3038342147416 MainThread INFO nova.compute.manager [req-ccfa884b-37a9-4512-8478-d399b6e903ec - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:47.073 4088 3038337403368 MainThread DEBUG nova.network.neutron [req-0efad0dd-3738-4d40-8b29-967121161522 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Updated VIF entry in instance network info cache for port 2b157f6c-2393-4228-97bf-47d46fb70741. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:01:47.073 4088 3038337403368 MainThread DEBUG nova.network.neutron [req-0efad0dd-3738-4d40-8b29-967121161522 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Updating instance_info_cache with network_info: [{"id": "2b157f6c-2393-4228-97bf-47d46fb70741", "address": "fa:16:3e:12:00:9a", "network": {"id": "c9c0a28f-d537-4eed-ab4c-79d1152a1146", "bridge": null, "label": "tempest-MultipleCreateTestJSON-430554862-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "00a75e521b5f4d89ab74f2701a36da12", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2b157f6c-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:47.088 4088 3038337403368 MainThread DEBUG oslo_concurrency.lockutils [req-0efad0dd-3738-4d40-8b29-967121161522 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-5d609bba-4fd0-487a-973f-650fbbd599db" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:47.185 4088 3038340569400 MainThread DEBUG nova.virt.hyperv.vmops [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:47.454 4088 3038359396200 MainThread DEBUG os_win.utils.jobutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Waiting for WMI job: {'InstanceID': '92E5D120-33B1-44E3-9D1D-72A2403A8BCC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18988), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:47.604 4088 3038359396200 MainThread ERROR os_win.utils.jobutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] WMI job failed: {'RawErrors': (('124\'instance-00000047\' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)instance-0000004763C540C3-F18F-4138-BD7B-0855F3DE5DF512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)instance-0000004763C540C3-F18F-4138-BD7B-0855F3DE5DF510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000047\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)instance-0000004763C540C3-F18F-4138-BD7B-0855F3DE5DF5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '92E5D120-33B1-44E3-9D1D-72A2403A8BCC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=122596), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 47), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 47), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000047' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)\n\nNot enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)\n\n'instance-00000047' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)", 'ErrorSummaryDescription': "'instance-00000047' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000047.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:47.604 4088 3038359396200 MainThread DEBUG os_win._utils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000047' failed to start. Not enough memory in the system to start the virtual machine instance-00000047. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000047' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Not enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) 'instance-00000047' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.217239618301392 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:47.619 4088 3038337403368 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:47.619 4088 3038337403368 MainThread INFO nova.compute.manager [-] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] VM Stopped (Lifecycle Event) 2021-09-10 17:01:47.619 4088 3038337403016 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000047" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:47.619 4088 3038337403016 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000047" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:47.659 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-fa83e9ec-3a5c-47c0-94b9-2a49a8006e41 - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:47.659 4088 3038337403368 MainThread DEBUG nova.virt.hyperv.vmops [req-fa83e9ec-3a5c-47c0-94b9-2a49a8006e41 - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:47.715 4088 3038337403368 MainThread DEBUG nova.compute.manager [req-fa83e9ec-3a5c-47c0-94b9-2a49a8006e41 - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:47.715 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.vmops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:01:47.715 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "instance-0000003b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:47.715 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "instance-0000003b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:47.733 4088 3038337403368 MainThread INFO nova.compute.manager [req-fa83e9ec-3a5c-47c0-94b9-2a49a8006e41 - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:47.733 4088 3038340568520 MainThread DEBUG os_win.utils.compute.vmutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Successfully changed vm state of instance-0000003b to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:01:47.733 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.vmops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Successfully changed state of VM instance-0000003b to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:01:47.793 4088 3038340568520 MainThread DEBUG os_win.utils.jobutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Waiting for WMI job: {'InstanceID': 'C82523C5-2DE8-4A52-8777-2B40F3288EB6', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16780), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:47.894 4088 3038337403896 MainThread DEBUG os_win.utils.storage.diskutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:01:47.995 4088 3038337403896 MainThread DEBUG os_win.utils.storage.diskutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:01:48.026 4088 3038340568520 MainThread DEBUG os_win.utils.jobutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] WMI job succeeded: {'InstanceID': 'C82523C5-2DE8-4A52-8777-2B40F3288EB6', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=158127), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:01:48.026 4088 3038340568520 MainThread DEBUG os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-11b5cce0-1a22-4820-b4b0-bcc0b921fc84', 'target_lun': 0, 'volume_id': '11b5cce0-1a22-4820-b4b0-bcc0b921fc84', 'auth_method': 'CHAP', 'auth_username': 'oi27LCgnLkajkpFVbsVr', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:01:48.026 4088 3038340568520 MainThread DEBUG os_win.utils.storage.diskutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:01:48.061 4088 3038337403896 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] <== connect_volume: return (5206ms) {'type': 'block', 'path': '\\\\.\\PhysicalDrive5', 'number': 5, 'scsi_wwn': '36001405CDF31F8120074F078BC188B17'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:01:48.183 4088 3038340568520 MainThread DEBUG os_win.utils.storage.diskutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:01:48.183 4088 3038340568520 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-11b5cce0-1a22-4820-b4b0-bcc0b921fc84 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 17:01:48.260 4088 3038340568520 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Removing iSCSI target persistent login: iqn.2010-10.org.openstack:volume-11b5cce0-1a22-4820-b4b0-bcc0b921fc84 _remove_target_persistent_logins c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:495 2021-09-10 17:01:48.279 4088 3038340568520 MainThread DEBUG os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] <== disconnect_volume: return (253ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:01:48.279 4088 3038340568520 MainThread DEBUG os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-f0f70f22-4412-4d14-80e3-17ea362502a8', 'target_lun': 0, 'volume_id': 'f0f70f22-4412-4d14-80e3-17ea362502a8', 'auth_method': 'CHAP', 'auth_username': 'V3gDNm77PePMLgud3BQ5', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:01:48.279 4088 3038340568520 MainThread DEBUG os_win.utils.storage.diskutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:01:48.417 4088 3038340568520 MainThread DEBUG os_win.utils.storage.diskutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:01:48.417 4088 3038340568520 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-f0f70f22-4412-4d14-80e3-17ea362502a8 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 17:01:48.519 4088 3038340568520 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Removing iSCSI target persistent login: iqn.2010-10.org.openstack:volume-f0f70f22-4412-4d14-80e3-17ea362502a8 _remove_target_persistent_logins c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:495 2021-09-10 17:01:48.519 4088 3038340568520 MainThread DEBUG os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] <== disconnect_volume: return (240ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:01:48.519 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "instance-0000003b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:48.528 4088 3038340568520 MainThread DEBUG os_win.utils.pathutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Removing directory: C:\openstack\instances\instance-0000003b check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:01:48.528 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "instance-0000003b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:48.528 4088 3038340568520 MainThread ERROR nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003b' failed to start. Not enough memory in the system to start the virtual machine instance-0000003b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003b' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Not enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) 'instance-0000003b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Error code: 32778. 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Traceback (most recent call last): 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] return function(*args, **kwargs) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] admin_password, network_info, block_device_info) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] return function(self, *args, **kwds) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self.force_reraise() 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] raise self.value 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] should_plug_vifs=False) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 'req_state': req_state}) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self.force_reraise() 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] raise self.value 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] time.sleep(sleep_time) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self.force_reraise() 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] raise self.value 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] return f(*args, **kwargs) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] return self._wait_for_job(job_path) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] error_desc=err_desc) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000003b' failed to start. 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Not enough memory in the system to start the virtual machine instance-0000003b. 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003b' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Not enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 'instance-0000003b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Error code: 32778. 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] During handling of the above exception, another exception occurred: 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Traceback (most recent call last): 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] yield resources 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] accel_info=accel_info) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] return function(*args, **kwargs) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] admin_password, network_info, block_device_info) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] return function(self, *args, **kwds) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self.force_reraise() 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] raise self.value 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] should_plug_vifs=False) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 'req_state': req_state}) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self.force_reraise() 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] raise self.value 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] time.sleep(sleep_time) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self.force_reraise() 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] raise self.value 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] return f(*args, **kwargs) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] return self._wait_for_job(job_path) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] error_desc=err_desc) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003b' failed to start. 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Not enough memory in the system to start the virtual machine instance-0000003b. 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003b' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Not enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 'instance-0000003b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Error code: 32778. 2021-09-10 17:01:48.528 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:01:48.528 4088 3038340568520 MainThread INFO nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Terminating instance 2021-09-10 17:01:48.541 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:01:48.541 4088 3038340568520 MainThread INFO nova.virt.hyperv.vmops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Got request to destroy instance 2021-09-10 17:01:48.561 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:01:48.561 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.vmops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:01:48.561 4088 3038340568520 MainThread DEBUG os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-29c54fbe-e8c1-401b-a427-b0b007cae3a7', 'target_lun': 0, 'volume_id': '29c54fbe-e8c1-401b-a427-b0b007cae3a7', 'auth_method': 'CHAP', 'auth_username': 'rBnpxR9o56RqMYWmjN3D', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:01:48.561 4088 3038340568520 MainThread DEBUG os_win.utils.storage.diskutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:01:48.576 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:48.576 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:48.591 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:01:48.591 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:01:48.620 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:01:48.668 4088 3038340568520 MainThread DEBUG os_win.utils.storage.diskutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:01:48.688 4088 3038340568520 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-29c54fbe-e8c1-401b-a427-b0b007cae3a7 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 17:01:48.719 4088 3038359396200 MainThread DEBUG os_win.utils.jobutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Waiting for WMI job: {'InstanceID': '90F9F385-6CD6-4FC6-9AD2-AF3BF722DF78', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=23340), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:48.760 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.volumeops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Attaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-7687f3e5-535f-43cb-92df-79afc5c86fb1', 'target_lun': 0, 'volume_id': '7687f3e5-535f-43cb-92df-79afc5c86fb1', 'auth_method': 'CHAP', 'auth_username': 'zyJxKJaxT6B3MYRsZn7s', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'reserved', 'instance': 'd4b1aa5b-c1ae-4df7-afd7-15d31bbaa869', 'attached_at': '', 'detached_at': '', 'volume_id': '7687f3e5-535f-43cb-92df-79afc5c86fb1', 'serial': '7687f3e5-535f-43cb-92df-79afc5c86fb1'} to instance-0000003f _attach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:108 2021-09-10 17:01:48.760 4088 3038337403896 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-7687f3e5-535f-43cb-92df-79afc5c86fb1', 'target_lun': 0, 'volume_id': '7687f3e5-535f-43cb-92df-79afc5c86fb1', 'auth_method': 'CHAP', 'auth_username': 'zyJxKJaxT6B3MYRsZn7s', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:01:48.760 4088 3038337403896 MainThread INFO os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Attempting to establish an iSCSI session to target iqn.2010-10.org.openstack:volume-7687f3e5-535f-43cb-92df-79afc5c86fb1 on portal 10.222.0.55:3260 accessing LUN 0 using initiator None. 2021-09-10 17:01:48.776 4088 3038340568520 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Removing iSCSI target persistent login: iqn.2010-10.org.openstack:volume-29c54fbe-e8c1-401b-a427-b0b007cae3a7 _remove_target_persistent_logins c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:495 2021-09-10 17:01:48.776 4088 3038337403896 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Logging in iSCSI target iqn.2010-10.org.openstack:volume-7687f3e5-535f-43cb-92df-79afc5c86fb1 login_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:401 2021-09-10 17:01:48.776 4088 3038340568520 MainThread DEBUG os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] <== disconnect_volume: return (214ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:01:48.776 4088 3038340568520 MainThread DEBUG os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-11b5cce0-1a22-4820-b4b0-bcc0b921fc84', 'target_lun': 0, 'volume_id': '11b5cce0-1a22-4820-b4b0-bcc0b921fc84', 'auth_method': 'CHAP', 'auth_username': 'oi27LCgnLkajkpFVbsVr', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:01:48.776 4088 3038340568520 MainThread DEBUG os_win.utils.storage.diskutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:01:48.941 4088 3038340568520 MainThread DEBUG os_win.utils.storage.diskutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:01:48.941 4088 3038340568520 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-11b5cce0-1a22-4820-b4b0-bcc0b921fc84 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 17:01:48.949 4088 3038340568520 MainThread DEBUG os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] <== disconnect_volume: return (172ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:01:48.949 4088 3038340568520 MainThread DEBUG os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-f0f70f22-4412-4d14-80e3-17ea362502a8', 'target_lun': 0, 'volume_id': 'f0f70f22-4412-4d14-80e3-17ea362502a8', 'auth_method': 'CHAP', 'auth_username': 'V3gDNm77PePMLgud3BQ5', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:01:48.949 4088 3038340568520 MainThread DEBUG os_win.utils.storage.diskutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:01:48.998 4088 3038342147416 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:48.998 4088 3038342147416 MainThread INFO nova.compute.manager [-] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] VM Stopped (Lifecycle Event) 2021-09-10 17:01:48.998 4088 3038337403016 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000047" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:48.998 4088 3038337403016 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000047" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:48.998 4088 3038359396200 MainThread ERROR os_win.utils.jobutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] WMI job failed: {'RawErrors': (('124\'instance-00000047\' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)instance-0000004763C540C3-F18F-4138-BD7B-0855F3DE5DF512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)instance-0000004763C540C3-F18F-4138-BD7B-0855F3DE5DF510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000047\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)instance-0000004763C540C3-F18F-4138-BD7B-0855F3DE5DF5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '90F9F385-6CD6-4FC6-9AD2-AF3BF722DF78', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=142899), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 48), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 48), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000047' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)\n\nNot enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)\n\n'instance-00000047' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5)", 'ErrorSummaryDescription': "'instance-00000047' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000047.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:48.998 4088 3038359396200 MainThread ERROR nova.virt.hyperv.vmops [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Failed to change vm state of instance-00000047 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000047' failed to start. 2021-09-10 17:01:48.998 4088 3038359396200 MainThread INFO nova.virt.hyperv.vmops [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Got request to destroy instance 2021-09-10 17:01:48.998 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=1472MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:01:48.998 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:49.026 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-b51faf44-6837-41e0-a281-0b0d11c3ca94 - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:49.046 4088 3038342147416 MainThread DEBUG nova.virt.hyperv.vmops [req-b51faf44-6837-41e0-a281-0b0d11c3ca94 - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:49.119 4088 3038342147416 MainThread DEBUG nova.compute.manager [req-b51faf44-6837-41e0-a281-0b0d11c3ca94 - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:49.119 4088 3038340568520 MainThread DEBUG os_win.utils.storage.diskutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:01:49.119 4088 3038340568520 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-f0f70f22-4412-4d14-80e3-17ea362502a8 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 17:01:49.144 4088 3038340568520 MainThread DEBUG os_brick.initiator.windows.iscsi [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] <== disconnect_volume: return (195ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:01:49.144 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "instance-0000003b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:49.144 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "instance-0000003b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:49.144 4088 3038340568520 MainThread INFO nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Took 0.61 seconds to destroy the instance on the hypervisor. 2021-09-10 17:01:49.183 4088 3038342147416 MainThread INFO nova.compute.manager [req-b51faf44-6837-41e0-a281-0b0d11c3ca94 - - - - -] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:49.261 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:01:49.261 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:01:49.261 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:01:49.261 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:01:49.261 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:01:49.261 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:01:49.261 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:01:49.261 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:01:49.261 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:01:49.275 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:01:49.275 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:01:49.275 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:01:49.275 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:01:49.275 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance b0745679-4000-4aff-bd0a-29ded4711f24 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:01:49.275 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:01:49.275 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 219ee2c7-854a-4265-903f-5d10381fa708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:01:49.275 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 5d609bba-4fd0-487a-973f-650fbbd599db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:01:49.275 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance e55fb7bd-490b-4fc5-9304-262050287269 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:01:49.275 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 18 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:01:49.275 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=18944MB phys_disk=79GB used_disk=16GB total_vcpus=6 used_vcpus=18 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:01:49.355 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:01:49.375 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:01:49.654 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:01:49.690 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:01:49.690 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:01:49.690 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.687s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:49.949 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "3111054c-9a20-4851-a793-42fbe94a3375" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:49.981 4088 3038340735400 MainThread DEBUG nova.compute.manager [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:01:50.182 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:50.182 4088 3038340735400 MainThread DEBUG nova.virt.hardware [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:01:50.182 4088 3038340735400 MainThread INFO nova.compute.claims [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Claim successful on node n-h2-808474-1 2021-09-10 17:01:50.389 4088 3038340735400 MainThread DEBUG nova.virt.hyperv.hostops [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:01:50.410 4088 3038340735400 MainThread DEBUG nova.virt.hyperv.hostops [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:01:50.684 4088 3038340735400 MainThread DEBUG nova.compute.provider_tree [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:01:50.697 4088 3038340735400 MainThread DEBUG nova.scheduler.client.report [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:01:50.697 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:50.697 4088 3038340735400 MainThread DEBUG nova.compute.manager [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:01:50.810 4088 3038340735400 MainThread DEBUG nova.compute.manager [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:01:50.826 4088 3038340735048 GreenThread-67 DEBUG nova.compute.manager [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:01:50.826 4088 3038340735048 GreenThread-67 DEBUG nova.network.neutron [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:01:50.968 4088 3038340735400 MainThread DEBUG nova.compute.manager [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:01:50.986 4088 3038340735400 MainThread INFO nova.virt.hyperv.vmops [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Spawning new instance 2021-09-10 17:01:51.015 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-0000004b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:51.015 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-0000004b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:51.015 4088 3038340735400 MainThread DEBUG nova.block_device [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:01:51.028 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:51.028 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:51.028 4088 3038340735400 MainThread DEBUG os_win.utils.pathutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Creating directory: C:\openstack\instances\instance-0000004b check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:01:51.028 4088 3038340735400 MainThread DEBUG nova.virt.hyperv.vmops [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000004b\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:01:51.136 4088 3038340735048 GreenThread-67 DEBUG nova.policy [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f286737f0e6452bbe04f42184b6d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df662acac0f043bb8be9c87490878d93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:01:51.307 4088 3038340735400 MainThread DEBUG nova.virt.hyperv.vmops [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Resizing VHD C:\openstack\instances\instance-0000004b\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:01:51.387 4088 3038359396200 MainThread DEBUG nova.virt.hyperv.vmops [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:01:51.387 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Lock "instance-00000047" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:51.387 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Lock "instance-00000047" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:51.403 4088 3038359396200 MainThread DEBUG os_win.utils.compute.vmutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Successfully changed vm state of instance-00000047 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:01:51.403 4088 3038359396200 MainThread DEBUG nova.virt.hyperv.vmops [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Successfully changed state of VM instance-00000047 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:01:51.512 4088 3038359396200 MainThread DEBUG os_win.utils.jobutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Waiting for WMI job: {'InstanceID': '0E64678E-C956-4B57-A22A-9C8EEB9AC5E7', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=81575), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:51.635 4088 3038359396200 MainThread DEBUG os_win.utils.jobutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] WMI job succeeded: {'InstanceID': '0E64678E-C956-4B57-A22A-9C8EEB9AC5E7', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=113882), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:01:51.635 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Lock "instance-00000047" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:51.635 4088 3038359396200 MainThread DEBUG os_win.utils.pathutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Removing directory: C:\openstack\instances\instance-00000047 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:01:51.635 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Lock "instance-00000047" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:51.635 4088 3038359396200 MainThread ERROR nova.compute.manager [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000047' failed to start. Not enough memory in the system to start the virtual machine instance-00000047. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000047' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Not enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) 'instance-00000047' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Error code: 32778. 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Traceback (most recent call last): 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] return function(*args, **kwargs) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] admin_password, network_info, block_device_info) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] return function(self, *args, **kwds) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self.force_reraise() 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] raise self.value 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] should_plug_vifs=False) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 'req_state': req_state}) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self.force_reraise() 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] raise self.value 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] time.sleep(sleep_time) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self.force_reraise() 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] raise self.value 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] return f(*args, **kwargs) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] return self._wait_for_job(job_path) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] error_desc=err_desc) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000047' failed to start. 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Not enough memory in the system to start the virtual machine instance-00000047. 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000047' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Not enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 'instance-00000047' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Error code: 32778. 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] During handling of the above exception, another exception occurred: 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Traceback (most recent call last): 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] yield resources 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] accel_info=accel_info) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] return function(*args, **kwargs) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] admin_password, network_info, block_device_info) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] return function(self, *args, **kwds) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self.force_reraise() 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] raise self.value 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] should_plug_vifs=False) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 'req_state': req_state}) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self.force_reraise() 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] raise self.value 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] time.sleep(sleep_time) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self.force_reraise() 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] raise self.value 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] return f(*args, **kwargs) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] return self._wait_for_job(job_path) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] error_desc=err_desc) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000047' failed to start. 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Not enough memory in the system to start the virtual machine instance-00000047. 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000047' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Not enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 'instance-00000047' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Error code: 32778. 2021-09-10 17:01:51.635 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:51.635 4088 3038359396200 MainThread INFO nova.compute.manager [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Terminating instance 2021-09-10 17:01:51.635 4088 3038359396200 MainThread DEBUG nova.compute.manager [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:01:51.635 4088 3038359396200 MainThread INFO nova.virt.hyperv.vmops [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Got request to destroy instance 2021-09-10 17:01:51.652 4088 3038359396200 MainThread DEBUG nova.virt.hyperv.vmops [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:01:51.652 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Lock "instance-00000047" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:51.652 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Lock "instance-00000047" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:51.652 4088 3038359396200 MainThread INFO nova.compute.manager [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:01:51.652 4088 3038359396200 MainThread DEBUG nova.compute.claims [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:01:51.652 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:51.831 4088 3038359396200 MainThread DEBUG nova.virt.hyperv.hostops [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:01:51.838 4088 3038359396200 MainThread DEBUG nova.virt.hyperv.hostops [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:01:52.079 4088 3038359396200 MainThread DEBUG nova.compute.provider_tree [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:01:52.090 4088 3038359396200 MainThread DEBUG nova.scheduler.client.report [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:01:52.090 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.438s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:52.090 4088 3038359396200 MainThread ERROR nova.compute.manager [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000047' failed to start. Not enough memory in the system to start the virtual machine instance-00000047. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000047' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Not enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) 'instance-00000047' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Error code: 32778. 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Traceback (most recent call last): 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] return function(*args, **kwargs) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] admin_password, network_info, block_device_info) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] return function(self, *args, **kwds) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self.force_reraise() 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] raise self.value 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] should_plug_vifs=False) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 'req_state': req_state}) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self.force_reraise() 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] raise self.value 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] time.sleep(sleep_time) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self.force_reraise() 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] raise self.value 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] return f(*args, **kwargs) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] return self._wait_for_job(job_path) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] error_desc=err_desc) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000047' failed to start. 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Not enough memory in the system to start the virtual machine instance-00000047. 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000047' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Not enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 'instance-00000047' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Error code: 32778. 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] During handling of the above exception, another exception occurred: 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Traceback (most recent call last): 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] accel_info=accel_info) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] return function(*args, **kwargs) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] admin_password, network_info, block_device_info) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] return function(self, *args, **kwds) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self.force_reraise() 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] raise self.value 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] should_plug_vifs=False) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 'req_state': req_state}) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self.force_reraise() 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] raise self.value 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] time.sleep(sleep_time) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self.force_reraise() 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] raise self.value 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] return f(*args, **kwargs) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] return self._wait_for_job(job_path) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] error_desc=err_desc) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000047' failed to start. 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Not enough memory in the system to start the virtual machine instance-00000047. 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000047' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Not enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 'instance-00000047' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Error code: 32778. 2021-09-10 17:01:52.090 4088 3038359396200 MainThread TRACE nova.compute.manager [instance: 219ee2c7-854a-4265-903f-5d10381fa708] 2021-09-10 17:01:52.090 4088 3038359396200 MainThread DEBUG nova.compute.utils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] WMI job failed with status 10. Error summary description: 'instance-00000047' failed to start. Not enough memory in the system to start the virtual machine instance-00000047. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:01:52.113 4088 3038359396200 MainThread DEBUG nova.compute.manager [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Build of instance 219ee2c7-854a-4265-903f-5d10381fa708 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000047' failed to start. Not enough memory in the system to start the virtual machine instance-00000047. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000047' failed to start. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Not enough memory in the system to start the virtual machine instance-00000047 with ram size 1024 megabytes. (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) 'instance-00000047' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 63C540C3-F18F-4138-BD7B-0855F3DE5DF5) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:01:52.113 4088 3038359396200 MainThread DEBUG nova.compute.manager [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:01:52.113 4088 3038359396200 MainThread DEBUG nova.compute.manager [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:01:52.113 4088 3038359396200 MainThread DEBUG nova.compute.manager [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:01:52.113 4088 3038359396200 MainThread DEBUG nova.network.neutron [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:01:52.379 4088 3038359395672 MainThread DEBUG nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Received event network-vif-plugged-da958760-870a-4ea0-ac3b-ac80e2105cd3 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:52.379 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "e55fb7bd-490b-4fc5-9304-262050287269-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:52.379 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "e55fb7bd-490b-4fc5-9304-262050287269-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:52.394 4088 3038359395672 MainThread DEBUG nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Processing event network-vif-plugged-da958760-870a-4ea0-ac3b-ac80e2105cd3 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:01:52.394 4088 3038359395672 MainThread DEBUG nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-vif-unplugged-46dd9dca-3150-45cc-9a35-bc1230d1380e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:52.394 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:52.394 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:52.394 4088 3038359395672 MainThread DEBUG nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] No waiting events found dispatching network-vif-unplugged-46dd9dca-3150-45cc-9a35-bc1230d1380e pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:01:52.394 4088 3038359395672 MainThread WARNING nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received unexpected event network-vif-unplugged-46dd9dca-3150-45cc-9a35-bc1230d1380e for instance with vm_state building and task_state spawning. 2021-09-10 17:01:52.394 4088 3038359395672 MainThread DEBUG nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-vif-unplugged-538c2fc9-baf4-42d7-93b3-2607925180ca external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:52.394 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:52.394 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:52.394 4088 3038359395672 MainThread DEBUG nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] No waiting events found dispatching network-vif-unplugged-538c2fc9-baf4-42d7-93b3-2607925180ca pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:01:52.394 4088 3038359395672 MainThread WARNING nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received unexpected event network-vif-unplugged-538c2fc9-baf4-42d7-93b3-2607925180ca for instance with vm_state building and task_state spawning. 2021-09-10 17:01:52.394 4088 3038359395672 MainThread DEBUG nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-vif-unplugged-f6422a3d-802b-4117-928d-1ca451d20e4b external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:52.403 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:52.403 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:52.403 4088 3038359395672 MainThread DEBUG nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] No waiting events found dispatching network-vif-unplugged-f6422a3d-802b-4117-928d-1ca451d20e4b pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:01:52.403 4088 3038359395672 MainThread WARNING nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received unexpected event network-vif-unplugged-f6422a3d-802b-4117-928d-1ca451d20e4b for instance with vm_state building and task_state spawning. 2021-09-10 17:01:52.403 4088 3038359395672 MainThread DEBUG nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-vif-unplugged-b922a519-3efc-4024-abfb-de5c20d9d578 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:52.403 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:52.403 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:52.403 4088 3038359395672 MainThread DEBUG nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] No waiting events found dispatching network-vif-unplugged-b922a519-3efc-4024-abfb-de5c20d9d578 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:01:52.403 4088 3038359395672 MainThread WARNING nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received unexpected event network-vif-unplugged-b922a519-3efc-4024-abfb-de5c20d9d578 for instance with vm_state building and task_state spawning. 2021-09-10 17:01:52.403 4088 3038359395672 MainThread DEBUG nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-vif-unplugged-0ae80e1f-4a5a-4c17-86ac-430359d3999e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:52.403 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:52.403 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:52.403 4088 3038359395672 MainThread DEBUG nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] No waiting events found dispatching network-vif-unplugged-0ae80e1f-4a5a-4c17-86ac-430359d3999e pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:01:52.403 4088 3038359395672 MainThread WARNING nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received unexpected event network-vif-unplugged-0ae80e1f-4a5a-4c17-86ac-430359d3999e for instance with vm_state building and task_state spawning. 2021-09-10 17:01:52.403 4088 3038359395672 MainThread DEBUG nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-vif-unplugged-c2d9bf38-2b6d-4a34-b975-f3967b383e21 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:52.403 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:52.403 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:52.403 4088 3038359395672 MainThread DEBUG nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] No waiting events found dispatching network-vif-unplugged-c2d9bf38-2b6d-4a34-b975-f3967b383e21 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:01:52.417 4088 3038359395672 MainThread WARNING nova.compute.manager [req-a9dadf5a-e005-4463-94d5-89d3c9217143 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received unexpected event network-vif-unplugged-c2d9bf38-2b6d-4a34-b975-f3967b383e21 for instance with vm_state building and task_state spawning. 2021-09-10 17:01:52.447 4088 3038337402488 MainThread INFO nova.virt.hyperv.vmops [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Using config drive for instance 2021-09-10 17:01:52.681 4088 3038337402488 MainThread INFO nova.virt.hyperv.vmops [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Creating config drive at C:\openstack\instances\instance-0000004a\configdrive.iso 2021-09-10 17:01:52.766 4088 3038337402488 MainThread DEBUG oslo_concurrency.processutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000004a\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp6iz_hh6j execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:01:52.901 4088 3038340735048 GreenThread-67 DEBUG nova.network.neutron [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Successfully created port: 3c12494a-44a8-4efb-ad4a-56060a27286e _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:01:52.981 4088 3038359396200 MainThread DEBUG nova.network.neutron [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:53.000 4088 3038359396200 MainThread INFO nova.compute.manager [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] [instance: 219ee2c7-854a-4265-903f-5d10381fa708] Took 0.88 seconds to deallocate network for instance. 2021-09-10 17:01:53.092 4088 3038337402488 MainThread DEBUG oslo_concurrency.processutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000004a\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp6iz_hh6j" returned: 0 in 0.329s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:01:53.137 4088 3038359396200 MainThread INFO nova.scheduler.client.report [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Deleted allocations for instance 219ee2c7-854a-4265-903f-5d10381fa708 2021-09-10 17:01:53.186 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-3a4689ab-d2e5-48ba-bb3b-2b15d86e5139 3f85143bbedf44eca37aba098b6ccb7d 5f2d0543bdd24962be5e0dceb47ee53e - default default] Lock "219ee2c7-854a-4265-903f-5d10381fa708" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 23.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:53.634 4088 3038337402488 MainThread DEBUG nova.virt.hyperv.vmops [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Setting boot order for instance: instance-0000004a: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:01:53.716 4088 3038337402488 MainThread DEBUG nova.virt.hyperv.vmops [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:01:53.747 4088 3038337402488 MainThread DEBUG os_win.utils.jobutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Waiting for WMI job: {'InstanceID': '44F03B46-BA86-4B80-A01F-ED1C8F5DEBE3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16567), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:53.790 4088 3038337403896 MainThread DEBUG os_win.utils.storage.diskutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:01:53.889 4088 3038337403896 MainThread DEBUG os_win.utils.storage.diskutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:01:53.904 4088 3038337402488 MainThread ERROR os_win.utils.jobutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004a\' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)instance-0000004a73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)instance-0000004a73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)instance-0000004a73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '44F03B46-BA86-4B80-A01F-ED1C8F5DEBE3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=136556), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 53), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 53), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004a' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)\n\nNot enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)\n\n'instance-0000004a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)", 'ErrorSummaryDescription': "'instance-0000004a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:53.904 4088 3038337402488 MainThread DEBUG os_win._utils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004a' failed to start. Not enough memory in the system to start the virtual machine instance-0000004a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004a' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Not enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) 'instance-0000004a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18818926811218262 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:53.949 4088 3038337403896 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] <== connect_volume: return (5189ms) {'type': 'block', 'path': '\\\\.\\PhysicalDrive1', 'number': 1, 'scsi_wwn': '36001405434703E4908C41D58AB8ACFC6'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:01:53.963 4088 3038340570104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:53.963 4088 3038340570104 MainThread INFO nova.compute.manager [-] [instance: e55fb7bd-490b-4fc5-9304-262050287269] VM Stopped (Lifecycle Event) 2021-09-10 17:01:53.963 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:53.963 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:53.994 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-18a9bb48-128c-4b26-9f4f-11f20b50c555 - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:53.994 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-18a9bb48-128c-4b26-9f4f-11f20b50c555 - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:54.041 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-18a9bb48-128c-4b26-9f4f-11f20b50c555 - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:54.072 4088 3038340570104 MainThread INFO nova.compute.manager [req-18a9bb48-128c-4b26-9f4f-11f20b50c555 - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:54.353 4088 3038340735048 GreenThread-67 DEBUG nova.network.neutron [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Successfully updated port: 3c12494a-44a8-4efb-ad4a-56060a27286e _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:01:54.369 4088 3038340735048 GreenThread-67 DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Acquired lock "refresh_cache-3111054c-9a20-4851-a793-42fbe94a3375" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:54.369 4088 3038340735048 GreenThread-67 DEBUG nova.network.neutron [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:01:54.449 4088 3038340735048 GreenThread-67 DEBUG nova.network.neutron [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:01:54.582 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.vmops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:54.731 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.vmops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:54.900 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.vmops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:54.931 4088 3038337402488 MainThread DEBUG os_win.utils.jobutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Waiting for WMI job: {'InstanceID': '5D469430-A7AE-438A-959F-BAF56E9C2B51', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16751), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:55.072 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.vmops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:55.092 4088 3038337402488 MainThread ERROR os_win.utils.jobutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004a\' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)instance-0000004a73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)instance-0000004a73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)instance-0000004a73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5D469430-A7AE-438A-959F-BAF56E9C2B51', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114049), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 54), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 55), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004a' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)\n\nNot enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)\n\n'instance-0000004a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)", 'ErrorSummaryDescription': "'instance-0000004a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:55.092 4088 3038337402488 MainThread DEBUG os_win._utils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004a' failed to start. Not enough memory in the system to start the virtual machine instance-0000004a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004a' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Not enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) 'instance-0000004a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3761727809906006 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:55.216 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-c89ddb4b-6c96-4171-8c9e-c07da85e9c28 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Received event network-changed-3c12494a-44a8-4efb-ad4a-56060a27286e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:55.216 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-c89ddb4b-6c96-4171-8c9e-c07da85e9c28 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Refreshing instance network info cache due to event network-changed-3c12494a-44a8-4efb-ad4a-56060a27286e. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:01:55.228 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.vmops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:55.259 4088 3038359396200 MainThread DEBUG nova.compute.manager [req-914eb5c8-a5f1-4b6d-a493-b05d26190939 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received event network-vif-unplugged-6709b293-b51f-4901-9ca4-bef117b27521 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:55.268 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-914eb5c8-a5f1-4b6d-a493-b05d26190939 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:55.268 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-914eb5c8-a5f1-4b6d-a493-b05d26190939 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:55.268 4088 3038359396200 MainThread DEBUG nova.compute.manager [req-914eb5c8-a5f1-4b6d-a493-b05d26190939 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] No waiting events found dispatching network-vif-unplugged-6709b293-b51f-4901-9ca4-bef117b27521 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:01:55.268 4088 3038359396200 MainThread WARNING nova.compute.manager [req-914eb5c8-a5f1-4b6d-a493-b05d26190939 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Received unexpected event network-vif-unplugged-6709b293-b51f-4901-9ca4-bef117b27521 for instance with vm_state building and task_state spawning. 2021-09-10 17:01:55.268 4088 3038359396200 MainThread DEBUG nova.compute.manager [req-914eb5c8-a5f1-4b6d-a493-b05d26190939 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Received event network-vif-plugged-2b157f6c-2393-4228-97bf-47d46fb70741 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:01:55.268 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-914eb5c8-a5f1-4b6d-a493-b05d26190939 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "5d609bba-4fd0-487a-973f-650fbbd599db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:55.268 4088 3038359396200 MainThread DEBUG oslo_concurrency.lockutils [req-914eb5c8-a5f1-4b6d-a493-b05d26190939 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "5d609bba-4fd0-487a-973f-650fbbd599db-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:55.268 4088 3038359396200 MainThread DEBUG nova.compute.manager [req-914eb5c8-a5f1-4b6d-a493-b05d26190939 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Processing event network-vif-plugged-2b157f6c-2393-4228-97bf-47d46fb70741 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:01:55.300 4088 3038340569400 MainThread INFO nova.virt.hyperv.vmops [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Using config drive for instance 2021-09-10 17:01:55.402 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.vmops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:55.484 4088 3038340569400 MainThread INFO nova.virt.hyperv.vmops [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Creating config drive at C:\openstack\instances\instance-0000004d\configdrive.iso 2021-09-10 17:01:55.589 4088 3038340569400 MainThread DEBUG oslo_concurrency.processutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000004d\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpxctx6qij execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:01:55.741 4088 3038340735048 GreenThread-67 DEBUG nova.network.neutron [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Updating instance_info_cache with network_info: [{"id": "3c12494a-44a8-4efb-ad4a-56060a27286e", "address": "fa:16:3e:11:3f:40", "network": {"id": "5b608de7-ebcb-494c-bcfe-060ce4426ed6", "bridge": null, "label": "tempest-ServersTestJSON-497725561-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "df662acac0f043bb8be9c87490878d93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap3c12494a-44", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:55.752 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.vmops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:55.772 4088 3038340735048 GreenThread-67 DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Releasing lock "refresh_cache-3111054c-9a20-4851-a793-42fbe94a3375" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:55.772 4088 3038340735048 GreenThread-67 DEBUG nova.compute.manager [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Instance network_info: |[{"id": "3c12494a-44a8-4efb-ad4a-56060a27286e", "address": "fa:16:3e:11:3f:40", "network": {"id": "5b608de7-ebcb-494c-bcfe-060ce4426ed6", "bridge": null, "label": "tempest-ServersTestJSON-497725561-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "df662acac0f043bb8be9c87490878d93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap3c12494a-44", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:01:55.772 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-c89ddb4b-6c96-4171-8c9e-c07da85e9c28 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-3111054c-9a20-4851-a793-42fbe94a3375" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:01:55.772 4088 3038340570104 MainThread DEBUG nova.network.neutron [req-c89ddb4b-6c96-4171-8c9e-c07da85e9c28 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Refreshing network info cache for port 3c12494a-44a8-4efb-ad4a-56060a27286e _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:01:55.772 4088 3038340735400 MainThread DEBUG nova.compute.manager [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Preparing to wait for external event network-vif-plugged-3c12494a-44a8-4efb-ad4a-56060a27286e prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:01:55.772 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "3111054c-9a20-4851-a793-42fbe94a3375-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:55.772 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "3111054c-9a20-4851-a793-42fbe94a3375-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:55.788 4088 3038340735400 MainThread DEBUG os_win.utils.compute.vmutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Creating VM instance-0000004b create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:01:55.947 4088 3038340569400 MainThread DEBUG oslo_concurrency.processutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000004d\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpxctx6qij" returned: 0 in 0.359s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:01:56.205 4088 3038337402488 MainThread DEBUG os_win.utils.jobutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Waiting for WMI job: {'InstanceID': 'EF6CEE74-8EE4-445F-811D-36983C257C3F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=25552), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:56.358 4088 3038337402488 MainThread ERROR os_win.utils.jobutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004a\' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)instance-0000004a73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)instance-0000004a73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)instance-0000004a73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'EF6CEE74-8EE4-445F-811D-36983C257C3F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=123549), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 56), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 56), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004a' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)\n\nNot enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)\n\n'instance-0000004a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)", 'ErrorSummaryDescription': "'instance-0000004a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:56.358 4088 3038337402488 MainThread DEBUG os_win._utils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004a' failed to start. Not enough memory in the system to start the virtual machine instance-0000004a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004a' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Not enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) 'instance-0000004a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.6424314975738525 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:56.391 4088 3038359396024 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:56.391 4088 3038359396024 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:56.391 4088 3038359395672 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:56.391 4088 3038359395672 MainThread INFO nova.compute.manager [-] [instance: e55fb7bd-490b-4fc5-9304-262050287269] VM Stopped (Lifecycle Event) 2021-09-10 17:01:56.436 4088 3038359395672 MainThread DEBUG nova.compute.manager [req-95920dec-be5c-451e-abd0-24dc3121a10b - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:56.436 4088 3038359395672 MainThread DEBUG nova.virt.hyperv.vmops [req-95920dec-be5c-451e-abd0-24dc3121a10b - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:56.527 4088 3038359395672 MainThread DEBUG nova.compute.manager [req-95920dec-be5c-451e-abd0-24dc3121a10b - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:56.557 4088 3038359395672 MainThread INFO nova.compute.manager [req-95920dec-be5c-451e-abd0-24dc3121a10b - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:56.808 4088 3038340569400 MainThread DEBUG nova.virt.hyperv.vmops [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Setting boot order for instance: instance-0000004d: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:01:56.856 4088 3038340570104 MainThread DEBUG nova.network.neutron [req-c89ddb4b-6c96-4171-8c9e-c07da85e9c28 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Updated VIF entry in instance network info cache for port 3c12494a-44a8-4efb-ad4a-56060a27286e. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:01:56.856 4088 3038340570104 MainThread DEBUG nova.network.neutron [req-c89ddb4b-6c96-4171-8c9e-c07da85e9c28 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Updating instance_info_cache with network_info: [{"id": "3c12494a-44a8-4efb-ad4a-56060a27286e", "address": "fa:16:3e:11:3f:40", "network": {"id": "5b608de7-ebcb-494c-bcfe-060ce4426ed6", "bridge": null, "label": "tempest-ServersTestJSON-497725561-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "df662acac0f043bb8be9c87490878d93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap3c12494a-44", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:01:56.903 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-c89ddb4b-6c96-4171-8c9e-c07da85e9c28 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-3111054c-9a20-4851-a793-42fbe94a3375" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:01:56.971 4088 3038340569400 MainThread DEBUG nova.virt.hyperv.vmops [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:01:57.011 4088 3038340569400 MainThread DEBUG os_win.utils.jobutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': '3F3803BA-9FA2-4C0E-8C61-9E8F31403B18', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21817), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:57.170 4088 3038340569400 MainThread ERROR os_win.utils.jobutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004d\' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)instance-0000004d05628010-7785-4F6B-B1D0-1205A035A45F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)instance-0000004d05628010-7785-4F6B-B1D0-1205A035A45F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)instance-0000004d05628010-7785-4F6B-B1D0-1205A035A45F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3F3803BA-9FA2-4C0E-8C61-9E8F31403B18', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=134560), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 56), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 57), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004d' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)\n\nNot enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)\n\n'instance-0000004d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)", 'ErrorSummaryDescription': "'instance-0000004d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:57.170 4088 3038340569400 MainThread DEBUG os_win._utils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004d' failed to start. Not enough memory in the system to start the virtual machine instance-0000004d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004d' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Not enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) 'instance-0000004d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.19910478591918945 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:57.198 4088 3038340570104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:57.198 4088 3038340570104 MainThread INFO nova.compute.manager [-] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] VM Stopped (Lifecycle Event) 2021-09-10 17:01:57.198 4088 3038340569224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:57.198 4088 3038340569224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:57.244 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-c283ff59-7de4-4fe9-b1d5-0996bb7ac747 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:57.244 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-c283ff59-7de4-4fe9-b1d5-0996bb7ac747 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:57.291 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-c283ff59-7de4-4fe9-b1d5-0996bb7ac747 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:57.341 4088 3038340570104 MainThread INFO nova.compute.manager [req-c283ff59-7de4-4fe9-b1d5-0996bb7ac747 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:57.405 4088 3038337402488 MainThread DEBUG os_win.utils.jobutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Waiting for WMI job: {'InstanceID': 'CF48D51D-B15D-4067-B8F3-DD58B231F0AD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17964), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:57.541 4088 3038337402488 MainThread ERROR os_win.utils.jobutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004a\' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)instance-0000004a73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)instance-0000004a73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)instance-0000004a73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'CF48D51D-B15D-4067-B8F3-DD58B231F0AD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=125438), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 57), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 57), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004a' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)\n\nNot enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)\n\n'instance-0000004a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)", 'ErrorSummaryDescription': "'instance-0000004a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:57.541 4088 3038337402488 MainThread DEBUG os_win._utils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004a' failed to start. Not enough memory in the system to start the virtual machine instance-0000004a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004a' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Not enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) 'instance-0000004a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.8248705863952637 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:57.603 4088 3038340570104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:57.603 4088 3038340570104 MainThread INFO nova.compute.manager [-] [instance: e55fb7bd-490b-4fc5-9304-262050287269] VM Stopped (Lifecycle Event) 2021-09-10 17:01:57.603 4088 3038340569224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:57.603 4088 3038340569224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:57.620 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-01e0d452-bd3b-4b3c-8e33-ac7eed0c8901 - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:57.620 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-01e0d452-bd3b-4b3c-8e33-ac7eed0c8901 - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:57.683 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-01e0d452-bd3b-4b3c-8e33-ac7eed0c8901 - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:57.714 4088 3038340570104 MainThread INFO nova.compute.manager [req-01e0d452-bd3b-4b3c-8e33-ac7eed0c8901 - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:57.791 4088 3038340735400 MainThread DEBUG nova.virt.hyperv.vmops [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:01:58.199 4088 3038340569400 MainThread DEBUG os_win.utils.jobutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': '50869E41-9C65-4DFE-9961-866C9340C194', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16713), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:58.345 4088 3038340569400 MainThread ERROR os_win.utils.jobutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004d\' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)instance-0000004d05628010-7785-4F6B-B1D0-1205A035A45F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)instance-0000004d05628010-7785-4F6B-B1D0-1205A035A45F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)instance-0000004d05628010-7785-4F6B-B1D0-1205A035A45F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '50869E41-9C65-4DFE-9961-866C9340C194', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117097), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 58), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 58), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004d' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)\n\nNot enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)\n\n'instance-0000004d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)", 'ErrorSummaryDescription': "'instance-0000004d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:58.345 4088 3038340569400 MainThread DEBUG os_win._utils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004d' failed to start. Not enough memory in the system to start the virtual machine instance-0000004d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004d' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Not enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) 'instance-0000004d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3740689754486084 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:58.369 4088 3038359394616 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:58.369 4088 3038359394616 MainThread INFO nova.compute.manager [-] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] VM Stopped (Lifecycle Event) 2021-09-10 17:01:58.369 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:58.369 4088 3038359395672 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:58.402 4088 3038359394616 MainThread DEBUG nova.compute.manager [req-e43f972e-b7ea-4269-974b-b29ab88a4af5 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:58.402 4088 3038359394616 MainThread DEBUG nova.virt.hyperv.vmops [req-e43f972e-b7ea-4269-974b-b29ab88a4af5 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:58.460 4088 3038359394616 MainThread DEBUG nova.compute.manager [req-e43f972e-b7ea-4269-974b-b29ab88a4af5 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:58.479 4088 3038359394616 MainThread INFO nova.compute.manager [req-e43f972e-b7ea-4269-974b-b29ab88a4af5 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:58.605 4088 3038337402488 MainThread DEBUG os_win.utils.jobutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Waiting for WMI job: {'InstanceID': 'ACEF7D9E-83CE-4E44-9701-230C40EDAB95', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16102), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:58.744 4088 3038337402488 MainThread ERROR os_win.utils.jobutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004a\' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)instance-0000004a73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)instance-0000004a73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)instance-0000004a73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'ACEF7D9E-83CE-4E44-9701-230C40EDAB95', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112931), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 58), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 58), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004a' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)\n\nNot enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)\n\n'instance-0000004a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)", 'ErrorSummaryDescription': "'instance-0000004a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:58.744 4088 3038337402488 MainThread DEBUG os_win._utils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004a' failed to start. Not enough memory in the system to start the virtual machine instance-0000004a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004a' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Not enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) 'instance-0000004a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.027890682220459 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:58.764 4088 3038340569224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:58.764 4088 3038340569224 MainThread INFO nova.compute.manager [-] [instance: e55fb7bd-490b-4fc5-9304-262050287269] VM Stopped (Lifecycle Event) 2021-09-10 17:01:58.785 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:58.785 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:58.798 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-cc34b730-f08c-4ac9-80b5-96a38cb5bb22 - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:58.798 4088 3038340569224 MainThread DEBUG nova.virt.hyperv.vmops [req-cc34b730-f08c-4ac9-80b5-96a38cb5bb22 - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:58.839 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-cc34b730-f08c-4ac9-80b5-96a38cb5bb22 - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:58.869 4088 3038340569224 MainThread INFO nova.compute.manager [req-cc34b730-f08c-4ac9-80b5-96a38cb5bb22 - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:59.362 4088 3038340569400 MainThread DEBUG os_win.utils.jobutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': '5C64FDDD-E417-4F52-8ED9-87E03E188210', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15448), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:59.499 4088 3038340569400 MainThread ERROR os_win.utils.jobutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004d\' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)instance-0000004d05628010-7785-4F6B-B1D0-1205A035A45F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)instance-0000004d05628010-7785-4F6B-B1D0-1205A035A45F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)instance-0000004d05628010-7785-4F6B-B1D0-1205A035A45F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5C64FDDD-E417-4F52-8ED9-87E03E188210', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115381), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 59), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 59), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004d' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)\n\nNot enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)\n\n'instance-0000004d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)", 'ErrorSummaryDescription': "'instance-0000004d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:59.519 4088 3038340569400 MainThread DEBUG os_win._utils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004d' failed to start. Not enough memory in the system to start the virtual machine instance-0000004d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004d' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Not enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) 'instance-0000004d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5475356578826904 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:01:59.557 4088 3038340569224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:59.557 4088 3038340569224 MainThread INFO nova.compute.manager [-] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] VM Stopped (Lifecycle Event) 2021-09-10 17:01:59.557 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:59.557 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:59.577 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-e8e372e0-9c18-4691-a585-47ac119940d9 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:59.577 4088 3038340569224 MainThread DEBUG nova.virt.hyperv.vmops [req-e8e372e0-9c18-4691-a585-47ac119940d9 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:01:59.635 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-e8e372e0-9c18-4691-a585-47ac119940d9 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:01:59.685 4088 3038340569224 MainThread INFO nova.compute.manager [req-e8e372e0-9c18-4691-a585-47ac119940d9 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:01:59.765 4088 3038337402488 MainThread DEBUG os_win.utils.jobutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Waiting for WMI job: {'InstanceID': '2DA3FAC1-6EFB-4A72-93E3-29100D333F4C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15784), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:01:59.901 4088 3038337402488 MainThread ERROR os_win.utils.jobutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004a\' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)instance-0000004a73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)instance-0000004a73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)instance-0000004a73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '2DA3FAC1-6EFB-4A72-93E3-29100D333F4C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113742), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 1, 59), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 1, 59), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004a' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)\n\nNot enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)\n\n'instance-0000004a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A)", 'ErrorSummaryDescription': "'instance-0000004a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:01:59.916 4088 3038337402488 MainThread ERROR nova.virt.hyperv.vmops [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Failed to change vm state of instance-0000004a to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000004a' failed to start. 2021-09-10 17:01:59.916 4088 3038337402488 MainThread INFO nova.virt.hyperv.vmops [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Got request to destroy instance 2021-09-10 17:01:59.963 4088 3038340569224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:01:59.963 4088 3038340569224 MainThread INFO nova.compute.manager [-] [instance: e55fb7bd-490b-4fc5-9304-262050287269] VM Stopped (Lifecycle Event) 2021-09-10 17:01:59.963 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:01:59.963 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:01:59.988 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-7f87a12a-6a2b-44ef-ad67-a87d83252afd - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:01:59.988 4088 3038340569224 MainThread DEBUG nova.virt.hyperv.vmops [req-7f87a12a-6a2b-44ef-ad67-a87d83252afd - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:00.044 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-7f87a12a-6a2b-44ef-ad67-a87d83252afd - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:00.072 4088 3038340569224 MainThread INFO nova.compute.manager [req-7f87a12a-6a2b-44ef-ad67-a87d83252afd - - - - -] [instance: e55fb7bd-490b-4fc5-9304-262050287269] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:00.542 4088 3038340569400 MainThread DEBUG os_win.utils.jobutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': 'DAA5BC4D-1C5C-41EE-B456-838DDB64B5DF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18364), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:00.697 4088 3038340569400 MainThread ERROR os_win.utils.jobutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004d\' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)instance-0000004d05628010-7785-4F6B-B1D0-1205A035A45F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)instance-0000004d05628010-7785-4F6B-B1D0-1205A035A45F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)instance-0000004d05628010-7785-4F6B-B1D0-1205A035A45F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'DAA5BC4D-1C5C-41EE-B456-838DDB64B5DF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121532), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004d' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)\n\nNot enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)\n\n'instance-0000004d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)", 'ErrorSummaryDescription': "'instance-0000004d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:00.697 4088 3038340569400 MainThread DEBUG os_win._utils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004d' failed to start. Not enough memory in the system to start the virtual machine instance-0000004d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004d' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Not enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) 'instance-0000004d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7261154651641846 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:00.731 4088 3038340569224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:00.731 4088 3038340569224 MainThread INFO nova.compute.manager [-] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] VM Stopped (Lifecycle Event) 2021-09-10 17:02:00.731 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:00.731 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:00.751 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-ae68b09d-57c3-4084-a0b4-5bb2f1a278a5 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:00.751 4088 3038340569224 MainThread DEBUG nova.virt.hyperv.vmops [req-ae68b09d-57c3-4084-a0b4-5bb2f1a278a5 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:00.810 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-ae68b09d-57c3-4084-a0b4-5bb2f1a278a5 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:00.841 4088 3038340569224 MainThread INFO nova.compute.manager [req-ae68b09d-57c3-4084-a0b4-5bb2f1a278a5 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:01.728 4088 3038340569400 MainThread DEBUG os_win.utils.jobutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': '87B10644-2F99-4ED0-AA3D-2940C7412C81', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17460), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:01.887 4088 3038340569400 MainThread ERROR os_win.utils.jobutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004d\' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)instance-0000004d05628010-7785-4F6B-B1D0-1205A035A45F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)instance-0000004d05628010-7785-4F6B-B1D0-1205A035A45F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)instance-0000004d05628010-7785-4F6B-B1D0-1205A035A45F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '87B10644-2F99-4ED0-AA3D-2940C7412C81', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=131538), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 1), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 1), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004d' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)\n\nNot enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)\n\n'instance-0000004d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)", 'ErrorSummaryDescription': "'instance-0000004d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:01.887 4088 3038340569400 MainThread DEBUG os_win._utils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004d' failed to start. Not enough memory in the system to start the virtual machine instance-0000004d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004d' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Not enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) 'instance-0000004d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.915649652481079 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:01.936 4088 3038340569224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:01.936 4088 3038340569224 MainThread INFO nova.compute.manager [-] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] VM Stopped (Lifecycle Event) 2021-09-10 17:02:01.936 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:01.936 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:01.949 4088 3038337402488 MainThread DEBUG nova.virt.hyperv.vmops [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:02:01.949 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Lock "instance-0000004a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:01.963 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Lock "instance-0000004a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:01.963 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-a6df4eec-cf2c-4264-8043-5aaf159a881f - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:01.963 4088 3038340569224 MainThread DEBUG nova.virt.hyperv.vmops [req-a6df4eec-cf2c-4264-8043-5aaf159a881f - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:01.963 4088 3038337402488 MainThread DEBUG os_win.utils.compute.vmutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Successfully changed vm state of instance-0000004a to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:02:01.963 4088 3038337402488 MainThread DEBUG nova.virt.hyperv.vmops [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Successfully changed state of VM instance-0000004a to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:02:02.012 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-a6df4eec-cf2c-4264-8043-5aaf159a881f - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:02.030 4088 3038337402488 MainThread DEBUG os_win.utils.jobutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Waiting for WMI job: {'InstanceID': '31D30BB2-FCE6-43B0-8C1D-C0D9B93E9A9D', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15610), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:02.049 4088 3038340569224 MainThread INFO nova.compute.manager [req-a6df4eec-cf2c-4264-8043-5aaf159a881f - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:02.141 4088 3038337402488 MainThread DEBUG os_win.utils.jobutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] WMI job succeeded: {'InstanceID': '31D30BB2-FCE6-43B0-8C1D-C0D9B93E9A9D', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=117648), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:02:02.141 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Lock "instance-0000004a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:02.141 4088 3038337402488 MainThread DEBUG os_win.utils.pathutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Removing directory: C:\openstack\instances\instance-0000004a check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:02:02.141 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Lock "instance-0000004a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:02.141 4088 3038337402488 MainThread ERROR nova.compute.manager [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004a' failed to start. Not enough memory in the system to start the virtual machine instance-0000004a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004a' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Not enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) 'instance-0000004a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Error code: 32778. 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] Traceback (most recent call last): 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] return function(*args, **kwargs) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] admin_password, network_info, block_device_info) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] return function(self, *args, **kwds) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self.force_reraise() 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] raise self.value 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] should_plug_vifs=False) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 'req_state': req_state}) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self.force_reraise() 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] raise self.value 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] time.sleep(sleep_time) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self.force_reraise() 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] raise self.value 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] return f(*args, **kwargs) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] return self._wait_for_job(job_path) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] error_desc=err_desc) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000004a' failed to start. 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] Not enough memory in the system to start the virtual machine instance-0000004a. 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004a' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] Not enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 'instance-0000004a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Error code: 32778. 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] During handling of the above exception, another exception occurred: 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] Traceback (most recent call last): 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] yield resources 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] accel_info=accel_info) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] return function(*args, **kwargs) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] admin_password, network_info, block_device_info) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] return function(self, *args, **kwds) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self.force_reraise() 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] raise self.value 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] should_plug_vifs=False) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 'req_state': req_state}) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self.force_reraise() 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] raise self.value 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] time.sleep(sleep_time) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self.force_reraise() 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] raise self.value 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] return f(*args, **kwargs) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] return self._wait_for_job(job_path) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] error_desc=err_desc) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004a' failed to start. 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] Not enough memory in the system to start the virtual machine instance-0000004a. 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004a' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] Not enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 'instance-0000004a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Error code: 32778. 2021-09-10 17:02:02.141 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.152 4088 3038337402488 MainThread INFO nova.compute.manager [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Terminating instance 2021-09-10 17:02:02.152 4088 3038337402488 MainThread DEBUG nova.compute.manager [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:02:02.152 4088 3038337402488 MainThread INFO nova.virt.hyperv.vmops [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Got request to destroy instance 2021-09-10 17:02:02.173 4088 3038337402488 MainThread DEBUG nova.virt.hyperv.vmops [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:02:02.173 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Lock "instance-0000004a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:02.173 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Lock "instance-0000004a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:02.173 4088 3038337402488 MainThread INFO nova.compute.manager [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:02:02.173 4088 3038337402488 MainThread DEBUG nova.compute.claims [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:02:02.173 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:02.356 4088 3038337402488 MainThread DEBUG nova.virt.hyperv.hostops [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:02:02.386 4088 3038337402488 MainThread DEBUG nova.virt.hyperv.hostops [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:02:02.665 4088 3038337402488 MainThread DEBUG nova.compute.provider_tree [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:02:02.690 4088 3038337402488 MainThread DEBUG nova.scheduler.client.report [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:02:02.690 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.531s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:02.690 4088 3038337402488 MainThread ERROR nova.compute.manager [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004a' failed to start. Not enough memory in the system to start the virtual machine instance-0000004a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004a' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Not enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) 'instance-0000004a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Error code: 32778. 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] Traceback (most recent call last): 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] return function(*args, **kwargs) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] admin_password, network_info, block_device_info) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] return function(self, *args, **kwds) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self.force_reraise() 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] raise self.value 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] should_plug_vifs=False) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 'req_state': req_state}) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self.force_reraise() 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] raise self.value 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] time.sleep(sleep_time) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self.force_reraise() 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] raise self.value 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] return f(*args, **kwargs) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] return self._wait_for_job(job_path) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] error_desc=err_desc) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000004a' failed to start. 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] Not enough memory in the system to start the virtual machine instance-0000004a. 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004a' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] Not enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 'instance-0000004a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Error code: 32778. 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] During handling of the above exception, another exception occurred: 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] Traceback (most recent call last): 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] accel_info=accel_info) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] return function(*args, **kwargs) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] admin_password, network_info, block_device_info) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] return function(self, *args, **kwds) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self.force_reraise() 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] raise self.value 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] should_plug_vifs=False) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 'req_state': req_state}) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self.force_reraise() 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] raise self.value 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] time.sleep(sleep_time) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self.force_reraise() 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] raise self.value 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] return f(*args, **kwargs) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] return self._wait_for_job(job_path) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] error_desc=err_desc) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004a' failed to start. 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] Not enough memory in the system to start the virtual machine instance-0000004a. 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004a' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] Not enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 'instance-0000004a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Error code: 32778. 2021-09-10 17:02:02.690 4088 3038337402488 MainThread TRACE nova.compute.manager [instance: e55fb7bd-490b-4fc5-9304-262050287269] 2021-09-10 17:02:02.690 4088 3038337402488 MainThread DEBUG nova.compute.utils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] WMI job failed with status 10. Error summary description: 'instance-0000004a' failed to start. Not enough memory in the system to start the virtual machine instance-0000004a. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:02:02.706 4088 3038337402488 MainThread DEBUG nova.compute.manager [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Build of instance e55fb7bd-490b-4fc5-9304-262050287269 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000004a' failed to start. Not enough memory in the system to start the virtual machine instance-0000004a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004a' failed to start. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Not enough memory in the system to start the virtual machine instance-0000004a with ram size 1024 megabytes. (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) 'instance-0000004a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73CFCAC0-EA2E-41F4-BBFB-AC9663CCB61A) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:02:02.706 4088 3038337402488 MainThread DEBUG nova.compute.manager [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:02:02.706 4088 3038337402488 MainThread DEBUG nova.compute.manager [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:02:02.706 4088 3038337402488 MainThread DEBUG nova.compute.manager [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:02:02.712 4088 3038337402488 MainThread DEBUG nova.network.neutron [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:02:02.982 4088 3038340569400 MainThread DEBUG os_win.utils.jobutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': 'BEE98C3E-770E-45EF-951F-950BF29E2E2F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16821), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:03.119 4088 3038340569400 MainThread ERROR os_win.utils.jobutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004d\' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)instance-0000004d05628010-7785-4F6B-B1D0-1205A035A45F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)instance-0000004d05628010-7785-4F6B-B1D0-1205A035A45F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)instance-0000004d05628010-7785-4F6B-B1D0-1205A035A45F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BEE98C3E-770E-45EF-951F-950BF29E2E2F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116537), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 2), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004d' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)\n\nNot enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)\n\n'instance-0000004d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F)", 'ErrorSummaryDescription': "'instance-0000004d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:03.119 4088 3038340569400 MainThread ERROR nova.virt.hyperv.vmops [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Failed to change vm state of instance-0000004d to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000004d' failed to start. 2021-09-10 17:02:03.119 4088 3038340569400 MainThread INFO nova.virt.hyperv.vmops [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Got request to destroy instance 2021-09-10 17:02:03.217 4088 3038340569752 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:03.217 4088 3038340569752 MainThread INFO nova.compute.manager [-] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] VM Stopped (Lifecycle Event) 2021-09-10 17:02:03.217 4088 3038340568344 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:03.217 4088 3038340568344 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:03.229 4088 3038340569752 MainThread DEBUG nova.compute.manager [req-a1056a94-06bb-489d-8d20-c127e3decfd9 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:03.229 4088 3038340569752 MainThread DEBUG nova.virt.hyperv.vmops [req-a1056a94-06bb-489d-8d20-c127e3decfd9 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:03.294 4088 3038340569752 MainThread DEBUG nova.compute.manager [req-a1056a94-06bb-489d-8d20-c127e3decfd9 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:03.323 4088 3038340569752 MainThread INFO nova.compute.manager [req-a1056a94-06bb-489d-8d20-c127e3decfd9 - - - - -] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:03.541 4088 3038340568520 MainThread INFO nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Took 14.39 seconds to detach 3 volumes for instance. 2021-09-10 17:02:03.541 4088 3038340568520 MainThread DEBUG nova.compute.claims [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:02:03.541 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:03.745 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.hostops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:02:03.762 4088 3038340568520 MainThread DEBUG nova.virt.hyperv.hostops [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:02:03.979 4088 3038340568520 MainThread DEBUG nova.compute.provider_tree [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:02:04.003 4088 3038340568520 MainThread DEBUG nova.scheduler.client.report [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:02:04.018 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.468s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:04.018 4088 3038340568520 MainThread ERROR nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003b' failed to start. Not enough memory in the system to start the virtual machine instance-0000003b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003b' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Not enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) 'instance-0000003b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Error code: 32778. 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Traceback (most recent call last): 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] return function(*args, **kwargs) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] admin_password, network_info, block_device_info) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] return function(self, *args, **kwds) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self.force_reraise() 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] raise self.value 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] should_plug_vifs=False) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 'req_state': req_state}) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self.force_reraise() 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] raise self.value 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] time.sleep(sleep_time) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self.force_reraise() 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] raise self.value 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] return f(*args, **kwargs) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] return self._wait_for_job(job_path) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] error_desc=err_desc) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000003b' failed to start. 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Not enough memory in the system to start the virtual machine instance-0000003b. 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003b' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Not enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 'instance-0000003b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Error code: 32778. 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] During handling of the above exception, another exception occurred: 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Traceback (most recent call last): 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] accel_info=accel_info) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] return function(*args, **kwargs) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] admin_password, network_info, block_device_info) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] return function(self, *args, **kwds) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self.force_reraise() 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] raise self.value 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] should_plug_vifs=False) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 'req_state': req_state}) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self.force_reraise() 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] raise self.value 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] time.sleep(sleep_time) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self.force_reraise() 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] raise self.value 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] return f(*args, **kwargs) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] return self._wait_for_job(job_path) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] error_desc=err_desc) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003b' failed to start. 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Not enough memory in the system to start the virtual machine instance-0000003b. 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003b' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Not enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 'instance-0000003b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Error code: 32778. 2021-09-10 17:02:04.018 4088 3038340568520 MainThread TRACE nova.compute.manager [instance: b0745679-4000-4aff-bd0a-29ded4711f24] 2021-09-10 17:02:04.018 4088 3038340568520 MainThread DEBUG nova.compute.utils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] WMI job failed with status 10. Error summary description: 'instance-0000003b' failed to start. Not enough memory in the system to start the virtual machine instance-0000003b. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:02:04.018 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Build of instance b0745679-4000-4aff-bd0a-29ded4711f24 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000003b' failed to start. Not enough memory in the system to start the virtual machine instance-0000003b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003b' failed to start. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Not enough memory in the system to start the virtual machine instance-0000003b with ram size 1024 megabytes. (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) 'instance-0000003b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F6170365-AA12-47EE-9906-FB0981574BC3) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:02:04.018 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:02:04.018 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:02:04.018 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:02:04.018 4088 3038340568520 MainThread DEBUG nova.network.neutron [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:02:04.248 4088 3038337402488 MainThread DEBUG nova.network.neutron [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:04.298 4088 3038337402488 MainThread INFO nova.compute.manager [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] [instance: e55fb7bd-490b-4fc5-9304-262050287269] Took 1.58 seconds to deallocate network for instance. 2021-09-10 17:02:04.514 4088 3038337402488 MainThread INFO nova.scheduler.client.report [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Deleted allocations for instance e55fb7bd-490b-4fc5-9304-262050287269 2021-09-10 17:02:04.576 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-e6b6c0f4-59ea-453f-ac9c-a5db67ece1b0 c5eaa901834b4ee885c2b6a9ce410303 0c42eab1e5884dc19398c04cdcea9edd - default default] Lock "e55fb7bd-490b-4fc5-9304-262050287269" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 24.047s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:05.306 4088 3038340569400 MainThread DEBUG nova.virt.hyperv.vmops [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:02:05.306 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-0000004d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:05.306 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-0000004d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:05.330 4088 3038340569400 MainThread DEBUG os_win.utils.compute.vmutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Successfully changed vm state of instance-0000004d to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:02:05.330 4088 3038340569400 MainThread DEBUG nova.virt.hyperv.vmops [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Successfully changed state of VM instance-0000004d to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:02:05.387 4088 3038340569400 MainThread DEBUG os_win.utils.jobutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': '8256E07E-52D5-4D9F-9C93-50F895F2EB9D', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15850), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:05.636 4088 3038340569400 MainThread DEBUG os_win.utils.jobutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job succeeded: {'InstanceID': '8256E07E-52D5-4D9F-9C93-50F895F2EB9D', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=147018), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:02:05.636 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-0000004d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:05.636 4088 3038340569400 MainThread DEBUG os_win.utils.pathutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Removing directory: C:\openstack\instances\instance-0000004d check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:02:05.636 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-0000004d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:05.636 4088 3038340569400 MainThread ERROR nova.compute.manager [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004d' failed to start. Not enough memory in the system to start the virtual machine instance-0000004d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004d' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Not enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) 'instance-0000004d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Error code: 32778. 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Traceback (most recent call last): 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] return function(*args, **kwargs) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] admin_password, network_info, block_device_info) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] return function(self, *args, **kwds) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self.force_reraise() 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] raise self.value 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] should_plug_vifs=False) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 'req_state': req_state}) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self.force_reraise() 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] raise self.value 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] time.sleep(sleep_time) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self.force_reraise() 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] raise self.value 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] return f(*args, **kwargs) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] return self._wait_for_job(job_path) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] error_desc=err_desc) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000004d' failed to start. 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Not enough memory in the system to start the virtual machine instance-0000004d. 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004d' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Not enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 'instance-0000004d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Error code: 32778. 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] During handling of the above exception, another exception occurred: 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Traceback (most recent call last): 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] yield resources 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] accel_info=accel_info) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] return function(*args, **kwargs) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] admin_password, network_info, block_device_info) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] return function(self, *args, **kwds) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self.force_reraise() 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] raise self.value 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] should_plug_vifs=False) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 'req_state': req_state}) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self.force_reraise() 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] raise self.value 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] time.sleep(sleep_time) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self.force_reraise() 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] raise self.value 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] return f(*args, **kwargs) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] return self._wait_for_job(job_path) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] error_desc=err_desc) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004d' failed to start. 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Not enough memory in the system to start the virtual machine instance-0000004d. 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004d' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Not enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 'instance-0000004d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Error code: 32778. 2021-09-10 17:02:05.636 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:05.655 4088 3038340569400 MainThread INFO nova.compute.manager [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Terminating instance 2021-09-10 17:02:05.655 4088 3038340569400 MainThread DEBUG nova.compute.manager [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:02:05.655 4088 3038340569400 MainThread INFO nova.virt.hyperv.vmops [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Got request to destroy instance 2021-09-10 17:02:05.669 4088 3038340569400 MainThread DEBUG nova.virt.hyperv.vmops [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:02:05.669 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-0000004d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:05.669 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-0000004d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:05.669 4088 3038340569400 MainThread INFO nova.compute.manager [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:02:05.669 4088 3038340569400 MainThread DEBUG nova.compute.claims [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:02:05.669 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:05.905 4088 3038340569400 MainThread DEBUG nova.virt.hyperv.hostops [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:02:05.918 4088 3038340569400 MainThread DEBUG nova.virt.hyperv.hostops [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:02:06.169 4088 3038340569400 MainThread DEBUG nova.compute.provider_tree [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:02:06.183 4088 3038340569400 MainThread DEBUG nova.scheduler.client.report [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:02:06.199 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.531s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:06.199 4088 3038340569400 MainThread ERROR nova.compute.manager [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004d' failed to start. Not enough memory in the system to start the virtual machine instance-0000004d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004d' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Not enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) 'instance-0000004d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Error code: 32778. 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Traceback (most recent call last): 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] return function(*args, **kwargs) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] admin_password, network_info, block_device_info) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] return function(self, *args, **kwds) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self.force_reraise() 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] raise self.value 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] should_plug_vifs=False) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 'req_state': req_state}) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self.force_reraise() 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] raise self.value 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] time.sleep(sleep_time) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self.force_reraise() 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] raise self.value 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] return f(*args, **kwargs) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] return self._wait_for_job(job_path) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] error_desc=err_desc) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000004d' failed to start. 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Not enough memory in the system to start the virtual machine instance-0000004d. 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004d' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Not enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 'instance-0000004d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Error code: 32778. 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] During handling of the above exception, another exception occurred: 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Traceback (most recent call last): 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] accel_info=accel_info) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] return function(*args, **kwargs) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] admin_password, network_info, block_device_info) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] return function(self, *args, **kwds) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self.force_reraise() 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] raise self.value 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] should_plug_vifs=False) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 'req_state': req_state}) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self.force_reraise() 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] raise self.value 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] time.sleep(sleep_time) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self.force_reraise() 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] raise self.value 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] return f(*args, **kwargs) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] return self._wait_for_job(job_path) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] error_desc=err_desc) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004d' failed to start. 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Not enough memory in the system to start the virtual machine instance-0000004d. 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004d' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Not enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 'instance-0000004d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Error code: 32778. 2021-09-10 17:02:06.199 4088 3038340569400 MainThread TRACE nova.compute.manager [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] 2021-09-10 17:02:06.199 4088 3038340569400 MainThread DEBUG nova.compute.utils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] WMI job failed with status 10. Error summary description: 'instance-0000004d' failed to start. Not enough memory in the system to start the virtual machine instance-0000004d. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:02:06.199 4088 3038340569400 MainThread DEBUG nova.compute.manager [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Build of instance 5d609bba-4fd0-487a-973f-650fbbd599db was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000004d' failed to start. Not enough memory in the system to start the virtual machine instance-0000004d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004d' failed to start. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Not enough memory in the system to start the virtual machine instance-0000004d with ram size 1024 megabytes. (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) 'instance-0000004d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 05628010-7785-4F6B-B1D0-1205A035A45F) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:02:06.199 4088 3038340569400 MainThread DEBUG nova.compute.manager [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:02:06.199 4088 3038340569400 MainThread DEBUG nova.compute.manager [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:02:06.199 4088 3038340569400 MainThread DEBUG nova.compute.manager [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:02:06.199 4088 3038340569400 MainThread DEBUG nova.network.neutron [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:02:07.823 4088 3038340569400 MainThread DEBUG nova.network.neutron [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:07.837 4088 3038340569400 MainThread INFO nova.compute.manager [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 5d609bba-4fd0-487a-973f-650fbbd599db] Took 1.64 seconds to deallocate network for instance. 2021-09-10 17:02:08.073 4088 3038340569400 MainThread INFO nova.scheduler.client.report [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Deleted allocations for instance 5d609bba-4fd0-487a-973f-650fbbd599db 2021-09-10 17:02:08.112 4088 3038340569400 MainThread DEBUG oslo_concurrency.lockutils [req-25254cbc-85c4-48a6-b99a-b205c8bdf5dc b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "5d609bba-4fd0-487a-973f-650fbbd599db" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 30.203s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:11.173 4088 3038340568520 MainThread DEBUG nova.network.neutron [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:11.233 4088 3038340568520 MainThread INFO nova.compute.manager [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] [instance: b0745679-4000-4aff-bd0a-29ded4711f24] Took 7.22 seconds to deallocate network for instance. 2021-09-10 17:02:11.494 4088 3038340568520 MainThread INFO nova.scheduler.client.report [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Deleted allocations for instance b0745679-4000-4aff-bd0a-29ded4711f24 2021-09-10 17:02:11.549 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-89e3c9f1-cf51-4a41-8c00-ba192222310f e257d97e390840179aaf42ec0308f2de f00087122c344aa8a15842d2b03f9a16 - default default] Lock "b0745679-4000-4aff-bd0a-29ded4711f24" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 102.750s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:12.838 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-a2d43362-5f6c-473d-8b02-eb90d155f911 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-vif-plugged-86609ec1-a690-46a4-8ef9-4623364e23fe external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:12.838 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-a2d43362-5f6c-473d-8b02-eb90d155f911 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:12.838 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-a2d43362-5f6c-473d-8b02-eb90d155f911 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:12.838 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-a2d43362-5f6c-473d-8b02-eb90d155f911 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Processing event network-vif-plugged-86609ec1-a690-46a4-8ef9-4623364e23fe _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:02:12.965 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "c4dcbaf6-eadf-45db-9755-790791af2bf7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:13.009 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:02:13.184 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:13.184 4088 3038340569048 MainThread DEBUG nova.virt.hardware [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:02:13.184 4088 3038340569048 MainThread INFO nova.compute.claims [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Claim successful on node n-h2-808474-1 2021-09-10 17:02:13.354 4088 3038340569048 MainThread DEBUG nova.virt.hyperv.hostops [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:02:13.369 4088 3038340569048 MainThread DEBUG nova.virt.hyperv.hostops [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:02:13.594 4088 3038340569048 MainThread DEBUG nova.compute.provider_tree [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:02:13.604 4088 3038340569048 MainThread DEBUG nova.scheduler.client.report [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:02:13.604 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:13.604 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:02:13.791 4088 3038340569048 MainThread DEBUG nova.compute.utils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 17:02:13.791 4088 3038340568520 GreenThread-68 DEBUG nova.compute.manager [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:02:13.791 4088 3038340568520 GreenThread-68 DEBUG nova.network.neutron [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:02:13.811 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:02:14.089 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:02:14.109 4088 3038340569048 MainThread INFO nova.virt.hyperv.vmops [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Spawning new instance 2021-09-10 17:02:14.119 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "instance-00000051" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:14.119 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "instance-00000051" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:14.119 4088 3038340569048 MainThread DEBUG nova.block_device [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:02:14.119 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:14.119 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:14.139 4088 3038340569048 MainThread DEBUG os_win.utils.pathutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Creating directory: C:\openstack\instances\instance-00000051 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:02:14.139 4088 3038340569048 MainThread DEBUG nova.virt.hyperv.vmops [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000051\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:02:14.358 4088 3038340569048 MainThread DEBUG nova.virt.hyperv.vmops [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Resizing VHD C:\openstack\instances\instance-00000051\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:02:14.479 4088 3038340568520 GreenThread-68 DEBUG nova.policy [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0063b05acec342499daf8129dc0ca365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d6026a33839407f9f68cb295fbb6928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:02:16.228 4088 3038340568520 GreenThread-68 DEBUG nova.network.neutron [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Successfully created port: 383e07c9-f8f6-4e9b-b3f0-4cce077fd021 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:02:16.946 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-6616c8b5-16c7-4500-afd9-415e9e5f4956 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-vif-plugged-94855bc3-5116-4b2f-ac7b-9de0d4d7ab82 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:16.946 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-6616c8b5-16c7-4500-afd9-415e9e5f4956 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:16.946 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-6616c8b5-16c7-4500-afd9-415e9e5f4956 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:16.946 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-6616c8b5-16c7-4500-afd9-415e9e5f4956 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Processing event network-vif-plugged-94855bc3-5116-4b2f-ac7b-9de0d4d7ab82 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:02:16.946 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-6616c8b5-16c7-4500-afd9-415e9e5f4956 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-vif-plugged-4179be6b-0ba7-4aaa-b9aa-0c37a0c9fab0 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:16.946 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-6616c8b5-16c7-4500-afd9-415e9e5f4956 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:16.946 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-6616c8b5-16c7-4500-afd9-415e9e5f4956 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:16.946 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-6616c8b5-16c7-4500-afd9-415e9e5f4956 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Processing event network-vif-plugged-4179be6b-0ba7-4aaa-b9aa-0c37a0c9fab0 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:02:16.946 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-6616c8b5-16c7-4500-afd9-415e9e5f4956 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-vif-plugged-2cb3a3ea-c0a3-46c3-851e-9241bf8661f1 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:16.946 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-6616c8b5-16c7-4500-afd9-415e9e5f4956 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:16.946 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-6616c8b5-16c7-4500-afd9-415e9e5f4956 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:16.946 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-6616c8b5-16c7-4500-afd9-415e9e5f4956 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Processing event network-vif-plugged-2cb3a3ea-c0a3-46c3-851e-9241bf8661f1 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:02:16.946 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-6616c8b5-16c7-4500-afd9-415e9e5f4956 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Received event network-vif-plugged-3c12494a-44a8-4efb-ad4a-56060a27286e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:16.946 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-6616c8b5-16c7-4500-afd9-415e9e5f4956 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "3111054c-9a20-4851-a793-42fbe94a3375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:16.966 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-6616c8b5-16c7-4500-afd9-415e9e5f4956 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "3111054c-9a20-4851-a793-42fbe94a3375-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:16.966 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-6616c8b5-16c7-4500-afd9-415e9e5f4956 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Processing event network-vif-plugged-3c12494a-44a8-4efb-ad4a-56060a27286e _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:02:17.031 4088 3038340735400 MainThread INFO nova.virt.hyperv.vmops [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Using config drive for instance 2021-09-10 17:02:17.934 4088 3038340735400 MainThread INFO nova.virt.hyperv.vmops [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Creating config drive at C:\openstack\instances\instance-0000004b\configdrive.iso 2021-09-10 17:02:18.042 4088 3038340735400 MainThread DEBUG oslo_concurrency.processutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000004b\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp41w16dyl execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:02:18.263 4088 3038340568520 GreenThread-68 DEBUG nova.network.neutron [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Successfully updated port: 383e07c9-f8f6-4e9b-b3f0-4cce077fd021 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:02:18.286 4088 3038340568520 GreenThread-68 DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Acquired lock "refresh_cache-c4dcbaf6-eadf-45db-9755-790791af2bf7" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:02:18.286 4088 3038340568520 GreenThread-68 DEBUG nova.network.neutron [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:02:18.371 4088 3038340735400 MainThread DEBUG oslo_concurrency.processutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000004b\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp41w16dyl" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:02:18.572 4088 3038340567640 MainThread DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "22ce4089-0acb-4f53-bb15-501df1d949ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:18.602 4088 3038340567640 MainThread DEBUG nova.compute.manager [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:02:18.745 4088 3038340567640 MainThread DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:18.745 4088 3038340567640 MainThread DEBUG nova.virt.hardware [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:02:18.745 4088 3038340567640 MainThread INFO nova.compute.claims [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Claim successful on node n-h2-808474-1 2021-09-10 17:02:18.850 4088 3038340568520 GreenThread-68 DEBUG nova.network.neutron [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:02:18.864 4088 3038340567640 MainThread DEBUG nova.virt.hyperv.hostops [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:02:18.883 4088 3038340567640 MainThread DEBUG nova.virt.hyperv.hostops [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:02:18.915 4088 3038340735400 MainThread DEBUG nova.virt.hyperv.vmops [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Setting boot order for instance: instance-0000004b: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:02:19.009 4088 3038340735400 MainThread DEBUG nova.virt.hyperv.vmops [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:02:19.071 4088 3038340735400 MainThread DEBUG os_win.utils.jobutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '8B3B0AE7-ACB2-4FC1-9C21-438F753629D4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=23869), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:19.150 4088 3038340567640 MainThread DEBUG nova.compute.provider_tree [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:02:19.169 4088 3038340567640 MainThread DEBUG nova.scheduler.client.report [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:02:19.169 4088 3038340567640 MainThread DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:19.169 4088 3038340567640 MainThread DEBUG nova.compute.manager [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:02:19.243 4088 3038340735400 MainThread ERROR os_win.utils.jobutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004b\' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)instance-0000004b820772AD-4295-42A6-918F-A9D9578684B112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)instance-0000004b820772AD-4295-42A6-918F-A9D9578684B110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)instance-0000004b820772AD-4295-42A6-918F-A9D9578684B1%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '8B3B0AE7-ACB2-4FC1-9C21-438F753629D4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=143135), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 19), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 19), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004b' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)\n\nNot enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)\n\n'instance-0000004b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)", 'ErrorSummaryDescription': "'instance-0000004b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:19.243 4088 3038340735400 MainThread DEBUG os_win._utils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004b' failed to start. Not enough memory in the system to start the virtual machine instance-0000004b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004b' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Not enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) 'instance-0000004b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.2115781307220459 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:19.262 4088 3038340567640 MainThread DEBUG nova.compute.manager [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:02:19.276 4088 3038340570984 GreenThread-69 DEBUG nova.compute.manager [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:02:19.276 4088 3038340570984 GreenThread-69 DEBUG nova.network.neutron [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:02:19.276 4088 3038340567816 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:19.276 4088 3038340567816 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:19.276 4088 3038340570808 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:19.276 4088 3038340570808 MainThread INFO nova.compute.manager [-] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] VM Stopped (Lifecycle Event) 2021-09-10 17:02:19.291 4088 3038340570808 MainThread DEBUG nova.compute.manager [req-d04852ef-373f-4952-beea-29304f770a53 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:19.291 4088 3038340570808 MainThread DEBUG nova.virt.hyperv.vmops [req-d04852ef-373f-4952-beea-29304f770a53 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:19.352 4088 3038340570808 MainThread DEBUG nova.compute.manager [req-d04852ef-373f-4952-beea-29304f770a53 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:19.383 4088 3038340568520 GreenThread-68 DEBUG nova.network.neutron [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Updating instance_info_cache with network_info: [{"id": "383e07c9-f8f6-4e9b-b3f0-4cce077fd021", "address": "fa:16:3e:e3:1c:09", "network": {"id": "7381cc3b-ab27-4454-8a5b-95f2bef2e954", "bridge": null, "label": "tempest-ServerRescueNegativeTestJSON-1471687160-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5d6026a33839407f9f68cb295fbb6928", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap383e07c9-f8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:19.383 4088 3038340570808 MainThread INFO nova.compute.manager [req-d04852ef-373f-4952-beea-29304f770a53 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:19.435 4088 3038340567640 MainThread DEBUG nova.compute.manager [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:02:19.435 4088 3038340568520 GreenThread-68 DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Releasing lock "refresh_cache-c4dcbaf6-eadf-45db-9755-790791af2bf7" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:02:19.435 4088 3038340568520 GreenThread-68 DEBUG nova.compute.manager [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Instance network_info: |[{"id": "383e07c9-f8f6-4e9b-b3f0-4cce077fd021", "address": "fa:16:3e:e3:1c:09", "network": {"id": "7381cc3b-ab27-4454-8a5b-95f2bef2e954", "bridge": null, "label": "tempest-ServerRescueNegativeTestJSON-1471687160-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5d6026a33839407f9f68cb295fbb6928", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap383e07c9-f8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:02:19.435 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Preparing to wait for external event network-vif-plugged-383e07c9-f8f6-4e9b-b3f0-4cce077fd021 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:02:19.435 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "c4dcbaf6-eadf-45db-9755-790791af2bf7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:19.435 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "c4dcbaf6-eadf-45db-9755-790791af2bf7-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:19.435 4088 3038340569048 MainThread DEBUG os_win.utils.compute.vmutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Creating VM instance-00000051 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:02:19.435 4088 3038340567640 MainThread INFO nova.virt.hyperv.vmops [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Spawning new instance 2021-09-10 17:02:19.451 4088 3038340567640 MainThread DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000004e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:19.451 4088 3038340567640 MainThread DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000004e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:19.451 4088 3038340567640 MainThread DEBUG nova.block_device [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:02:19.451 4088 3038340567640 MainThread DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:19.451 4088 3038340567640 MainThread DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:19.451 4088 3038340567640 MainThread DEBUG os_win.utils.pathutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Creating directory: C:\openstack\instances\instance-0000004e check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:02:19.469 4088 3038340567640 MainThread DEBUG nova.virt.hyperv.vmops [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000004e\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:02:19.727 4088 3038340567640 MainThread DEBUG nova.virt.hyperv.vmops [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Resizing VHD C:\openstack\instances\instance-0000004e\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:02:19.759 4088 3038340570984 GreenThread-69 DEBUG nova.policy [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3b19a6ed8024fe7b99f5aa4978b5af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecab78b34b0468f8c42e4b7f3444918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:02:19.790 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-80912ea1-c20e-4ce2-99a7-0e46d94e6182 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-vif-plugged-2328bac5-09f9-4dd3-a3ff-1f5673edded4 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:19.790 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-80912ea1-c20e-4ce2-99a7-0e46d94e6182 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:19.790 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-80912ea1-c20e-4ce2-99a7-0e46d94e6182 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:19.790 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-80912ea1-c20e-4ce2-99a7-0e46d94e6182 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Processing event network-vif-plugged-2328bac5-09f9-4dd3-a3ff-1f5673edded4 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:02:19.790 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-80912ea1-c20e-4ce2-99a7-0e46d94e6182 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-vif-plugged-ffc6e67e-0a49-4c79-9748-12da98323372 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:19.790 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-80912ea1-c20e-4ce2-99a7-0e46d94e6182 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:19.790 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-80912ea1-c20e-4ce2-99a7-0e46d94e6182 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:19.790 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-80912ea1-c20e-4ce2-99a7-0e46d94e6182 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Processing event network-vif-plugged-ffc6e67e-0a49-4c79-9748-12da98323372 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:02:19.790 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-80912ea1-c20e-4ce2-99a7-0e46d94e6182 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-vif-plugged-960e99f9-c9fe-476e-a025-db2754fea043 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:19.790 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-80912ea1-c20e-4ce2-99a7-0e46d94e6182 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:19.790 4088 3038340568520 MainThread DEBUG oslo_concurrency.lockutils [req-80912ea1-c20e-4ce2-99a7-0e46d94e6182 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:19.790 4088 3038340568520 MainThread DEBUG nova.compute.manager [req-80912ea1-c20e-4ce2-99a7-0e46d94e6182 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Processing event network-vif-plugged-960e99f9-c9fe-476e-a025-db2754fea043 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:02:19.822 4088 3038337403896 MainThread INFO nova.virt.hyperv.vmops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Using config drive for instance 2021-09-10 17:02:19.930 4088 3038340567464 MainThread DEBUG nova.compute.manager [req-4146f49e-fd27-4bfe-a88b-6a235beb55e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Received event network-changed-383e07c9-f8f6-4e9b-b3f0-4cce077fd021 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:19.930 4088 3038340567464 MainThread DEBUG nova.compute.manager [req-4146f49e-fd27-4bfe-a88b-6a235beb55e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Refreshing instance network info cache due to event network-changed-383e07c9-f8f6-4e9b-b3f0-4cce077fd021. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:02:19.930 4088 3038340567464 MainThread DEBUG oslo_concurrency.lockutils [req-4146f49e-fd27-4bfe-a88b-6a235beb55e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-c4dcbaf6-eadf-45db-9755-790791af2bf7" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:02:19.930 4088 3038340567464 MainThread DEBUG nova.network.neutron [req-4146f49e-fd27-4bfe-a88b-6a235beb55e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Refreshing network info cache for port 383e07c9-f8f6-4e9b-b3f0-4cce077fd021 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:02:20.013 4088 3038337403896 MainThread INFO nova.virt.hyperv.vmops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Creating config drive at C:\openstack\instances\instance-0000003f\configdrive.iso 2021-09-10 17:02:20.137 4088 3038337403896 MainThread DEBUG oslo_concurrency.processutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000003f\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpddavnvcj execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:02:20.309 4088 3038340735400 MainThread DEBUG os_win.utils.jobutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'AEB946F3-1CC0-40D7-9825-1A9F592D5763', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15505), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:20.469 4088 3038340735400 MainThread ERROR os_win.utils.jobutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004b\' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)instance-0000004b820772AD-4295-42A6-918F-A9D9578684B112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)instance-0000004b820772AD-4295-42A6-918F-A9D9578684B110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)instance-0000004b820772AD-4295-42A6-918F-A9D9578684B1%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'AEB946F3-1CC0-40D7-9825-1A9F592D5763', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=123727), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 20), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 20), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004b' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)\n\nNot enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)\n\n'instance-0000004b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)", 'ErrorSummaryDescription': "'instance-0000004b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:20.469 4088 3038340735400 MainThread DEBUG os_win._utils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004b' failed to start. Not enough memory in the system to start the virtual machine instance-0000004b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004b' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Not enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) 'instance-0000004b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4374265670776367 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:20.483 4088 3038337403896 MainThread DEBUG oslo_concurrency.processutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000003f\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpddavnvcj" returned: 0 in 0.344s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:02:20.547 4088 3038340569224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:20.547 4088 3038340569224 MainThread INFO nova.compute.manager [-] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] VM Stopped (Lifecycle Event) 2021-09-10 17:02:20.547 4088 3038340567112 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:20.547 4088 3038340567112 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:20.565 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-6463a861-bd64-4e9f-a447-0c1fb574aa10 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:20.565 4088 3038340569224 MainThread DEBUG nova.virt.hyperv.vmops [req-6463a861-bd64-4e9f-a447-0c1fb574aa10 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:20.618 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-6463a861-bd64-4e9f-a447-0c1fb574aa10 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:20.650 4088 3038340569224 MainThread INFO nova.compute.manager [req-6463a861-bd64-4e9f-a447-0c1fb574aa10 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:20.888 4088 3038340567464 MainThread DEBUG nova.network.neutron [req-4146f49e-fd27-4bfe-a88b-6a235beb55e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Updated VIF entry in instance network info cache for port 383e07c9-f8f6-4e9b-b3f0-4cce077fd021. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:02:20.888 4088 3038340567464 MainThread DEBUG nova.network.neutron [req-4146f49e-fd27-4bfe-a88b-6a235beb55e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Updating instance_info_cache with network_info: [{"id": "383e07c9-f8f6-4e9b-b3f0-4cce077fd021", "address": "fa:16:3e:e3:1c:09", "network": {"id": "7381cc3b-ab27-4454-8a5b-95f2bef2e954", "bridge": null, "label": "tempest-ServerRescueNegativeTestJSON-1471687160-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5d6026a33839407f9f68cb295fbb6928", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap383e07c9-f8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:20.907 4088 3038340567464 MainThread DEBUG oslo_concurrency.lockutils [req-4146f49e-fd27-4bfe-a88b-6a235beb55e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-c4dcbaf6-eadf-45db-9755-790791af2bf7" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:02:21.165 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.vmops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Setting boot order for instance: instance-0000003f: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:02:21.274 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.vmops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:02:21.307 4088 3038337403896 MainThread DEBUG os_win.utils.jobutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Waiting for WMI job: {'InstanceID': '76BE5DB2-24A0-4945-B334-C0374C0B4BE0', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15541), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:21.512 4088 3038340735400 MainThread DEBUG os_win.utils.jobutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '9F495EE1-DCD9-4224-A557-F51834E61185', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15663), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:21.661 4088 3038340569048 MainThread DEBUG nova.virt.hyperv.vmops [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:02:21.690 4088 3038337403896 MainThread ERROR os_win.utils.jobutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003f\' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)instance-0000003fF0DD020A-9530-47CC-A2E8-E20CD37D12AF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)instance-0000003fF0DD020A-9530-47CC-A2E8-E20CD37D12AF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)instance-0000003fF0DD020A-9530-47CC-A2E8-E20CD37D12AF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '76BE5DB2-24A0-4945-B334-C0374C0B4BE0', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=324942), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 21), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 21), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003f' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)\n\nNot enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)\n\n'instance-0000003f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)", 'ErrorSummaryDescription': "'instance-0000003f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:21.704 4088 3038337403896 MainThread DEBUG os_win._utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003f' failed to start. Not enough memory in the system to start the virtual machine instance-0000003f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003f' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Not enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) 'instance-0000003f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.4294779300689697 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:21.745 4088 3038340567464 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:21.745 4088 3038340567464 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:21.745 4088 3038340567112 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:21.745 4088 3038340567112 MainThread INFO nova.compute.manager [-] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] VM Stopped (Lifecycle Event) 2021-09-10 17:02:21.774 4088 3038340567112 MainThread DEBUG nova.compute.manager [req-c0e9f068-5abc-4612-b2cc-157d0f7b9a27 - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:21.774 4088 3038340567112 MainThread DEBUG nova.virt.hyperv.vmops [req-c0e9f068-5abc-4612-b2cc-157d0f7b9a27 - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:21.774 4088 3038340735400 MainThread ERROR os_win.utils.jobutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004b\' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)instance-0000004b820772AD-4295-42A6-918F-A9D9578684B112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)instance-0000004b820772AD-4295-42A6-918F-A9D9578684B110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)instance-0000004b820772AD-4295-42A6-918F-A9D9578684B1%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9F495EE1-DCD9-4224-A557-F51834E61185', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=248792), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 21), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 21), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004b' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)\n\nNot enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)\n\n'instance-0000004b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)", 'ErrorSummaryDescription': "'instance-0000004b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:21.774 4088 3038340735400 MainThread DEBUG os_win._utils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004b' failed to start. Not enough memory in the system to start the virtual machine instance-0000004b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004b' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Not enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) 'instance-0000004b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.7424352169036865 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:21.871 4088 3038340567464 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:21.871 4088 3038340567464 MainThread INFO nova.compute.manager [-] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] VM Stopped (Lifecycle Event) 2021-09-10 17:02:21.871 4088 3038340570456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:21.871 4088 3038340570456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:21.902 4088 3038340567464 MainThread DEBUG nova.compute.manager [req-b00c88b8-b1a9-4e4e-8050-05a3cec51623 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:21.902 4088 3038340567464 MainThread DEBUG nova.virt.hyperv.vmops [req-b00c88b8-b1a9-4e4e-8050-05a3cec51623 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:21.902 4088 3038340567112 MainThread DEBUG nova.compute.manager [req-c0e9f068-5abc-4612-b2cc-157d0f7b9a27 - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:21.934 4088 3038340567112 MainThread INFO nova.compute.manager [req-c0e9f068-5abc-4612-b2cc-157d0f7b9a27 - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:21.962 4088 3038340567464 MainThread DEBUG nova.compute.manager [req-b00c88b8-b1a9-4e4e-8050-05a3cec51623 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:21.979 4088 3038340567464 MainThread INFO nova.compute.manager [req-b00c88b8-b1a9-4e4e-8050-05a3cec51623 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:22.739 4088 3038337403896 MainThread DEBUG os_win.utils.jobutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Waiting for WMI job: {'InstanceID': '3E521EED-7277-4119-B526-8992E8A7762E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16314), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:22.815 4088 3038340735400 MainThread DEBUG os_win.utils.jobutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'AB4625FF-0C6C-4331-B113-53344D3B7F43', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17117), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:23.151 4088 3038337403896 MainThread ERROR os_win.utils.jobutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003f\' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)instance-0000003fF0DD020A-9530-47CC-A2E8-E20CD37D12AF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)instance-0000003fF0DD020A-9530-47CC-A2E8-E20CD37D12AF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)instance-0000003fF0DD020A-9530-47CC-A2E8-E20CD37D12AF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3E521EED-7277-4119-B526-8992E8A7762E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=323011), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 22), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 23), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003f' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)\n\nNot enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)\n\n'instance-0000003f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)", 'ErrorSummaryDescription': "'instance-0000003f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:23.151 4088 3038337403896 MainThread DEBUG os_win._utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003f' failed to start. Not enough memory in the system to start the virtual machine instance-0000003f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003f' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Not enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) 'instance-0000003f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.8769621849060059 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:23.229 4088 3038340567112 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:23.229 4088 3038340567112 MainThread INFO nova.compute.manager [-] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] VM Stopped (Lifecycle Event) 2021-09-10 17:02:23.229 4088 3038340567464 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:23.229 4088 3038340567464 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:23.249 4088 3038340567112 MainThread DEBUG nova.compute.manager [req-89111df4-aa10-4a4c-898b-b98093e1945d - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:23.249 4088 3038340567112 MainThread DEBUG nova.virt.hyperv.vmops [req-89111df4-aa10-4a4c-898b-b98093e1945d - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:23.249 4088 3038340567464 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:23.249 4088 3038340567464 MainThread INFO nova.compute.manager [-] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] VM Stopped (Lifecycle Event) 2021-09-10 17:02:23.249 4088 3038340570456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:23.249 4088 3038340570456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:23.277 4088 3038340567464 MainThread DEBUG nova.compute.manager [req-0b31854a-e69a-4237-9bd2-3157650415dc - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:23.277 4088 3038340567464 MainThread DEBUG nova.virt.hyperv.vmops [req-0b31854a-e69a-4237-9bd2-3157650415dc - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:23.306 4088 3038340567112 MainThread DEBUG nova.compute.manager [req-89111df4-aa10-4a4c-898b-b98093e1945d - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:23.306 4088 3038340735400 MainThread ERROR os_win.utils.jobutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004b\' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)instance-0000004b820772AD-4295-42A6-918F-A9D9578684B112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)instance-0000004b820772AD-4295-42A6-918F-A9D9578684B110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)instance-0000004b820772AD-4295-42A6-918F-A9D9578684B1%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'AB4625FF-0C6C-4331-B113-53344D3B7F43', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=369640), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 22), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 23), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004b' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)\n\nNot enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)\n\n'instance-0000004b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)", 'ErrorSummaryDescription': "'instance-0000004b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:23.306 4088 3038340735400 MainThread DEBUG os_win._utils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004b' failed to start. Not enough memory in the system to start the virtual machine instance-0000004b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004b' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Not enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) 'instance-0000004b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 4.273918151855469 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:23.322 4088 3038340567112 MainThread INFO nova.compute.manager [req-89111df4-aa10-4a4c-898b-b98093e1945d - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:23.339 4088 3038340567464 MainThread DEBUG nova.compute.manager [req-0b31854a-e69a-4237-9bd2-3157650415dc - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:23.368 4088 3038340567464 MainThread INFO nova.compute.manager [req-0b31854a-e69a-4237-9bd2-3157650415dc - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:23.409 4088 3038340570984 GreenThread-69 DEBUG nova.network.neutron [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Successfully created port: c8d5eafd-85a2-4d40-9b87-bdfc843fb561 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:02:24.181 4088 3038337403896 MainThread DEBUG os_win.utils.jobutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Waiting for WMI job: {'InstanceID': '3433E812-E905-444B-9FD4-F35C9F3B62D3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17204), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:24.339 4088 3038340735400 MainThread DEBUG os_win.utils.jobutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'D6E170DE-8446-479D-B015-B38F53AACD9F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17746), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:24.571 4088 3038337403896 MainThread ERROR os_win.utils.jobutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003f\' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)instance-0000003fF0DD020A-9530-47CC-A2E8-E20CD37D12AF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)instance-0000003fF0DD020A-9530-47CC-A2E8-E20CD37D12AF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)instance-0000003fF0DD020A-9530-47CC-A2E8-E20CD37D12AF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3433E812-E905-444B-9FD4-F35C9F3B62D3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=330597), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 24), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 24), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003f' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)\n\nNot enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)\n\n'instance-0000003f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)", 'ErrorSummaryDescription': "'instance-0000003f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:24.571 4088 3038337403896 MainThread DEBUG os_win._utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003f' failed to start. Not enough memory in the system to start the virtual machine instance-0000003f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003f' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Not enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) 'instance-0000003f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 3.29671049118042 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:24.636 4088 3038340567464 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:24.636 4088 3038340567464 MainThread INFO nova.compute.manager [-] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] VM Stopped (Lifecycle Event) 2021-09-10 17:02:24.651 4088 3038340567112 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:24.651 4088 3038340567112 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:24.682 4088 3038340567464 MainThread DEBUG nova.compute.manager [req-a50f2753-03e0-4d5c-b6b6-c75283587506 - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:24.682 4088 3038340567464 MainThread DEBUG nova.virt.hyperv.vmops [req-a50f2753-03e0-4d5c-b6b6-c75283587506 - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:24.733 4088 3038340735400 MainThread ERROR os_win.utils.jobutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004b\' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)instance-0000004b820772AD-4295-42A6-918F-A9D9578684B112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)instance-0000004b820772AD-4295-42A6-918F-A9D9578684B110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)instance-0000004b820772AD-4295-42A6-918F-A9D9578684B1%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D6E170DE-8446-479D-B015-B38F53AACD9F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=322803), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 24), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 24), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004b' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)\n\nNot enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)\n\n'instance-0000004b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)", 'ErrorSummaryDescription': "'instance-0000004b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:24.733 4088 3038340735400 MainThread DEBUG os_win._utils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004b' failed to start. Not enough memory in the system to start the virtual machine instance-0000004b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004b' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Not enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) 'instance-0000004b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.701875686645508 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:24.762 4088 3038340570456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:24.762 4088 3038340570456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:24.762 4088 3038340567112 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:24.762 4088 3038340567112 MainThread INFO nova.compute.manager [-] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] VM Stopped (Lifecycle Event) 2021-09-10 17:02:24.774 4088 3038340567464 MainThread DEBUG nova.compute.manager [req-a50f2753-03e0-4d5c-b6b6-c75283587506 - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:24.790 4088 3038340567112 MainThread DEBUG nova.compute.manager [req-5f96c213-2e36-4cea-8a16-4e6a83404b06 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:24.790 4088 3038340567112 MainThread DEBUG nova.virt.hyperv.vmops [req-5f96c213-2e36-4cea-8a16-4e6a83404b06 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:24.831 4088 3038340567464 MainThread INFO nova.compute.manager [req-a50f2753-03e0-4d5c-b6b6-c75283587506 - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:24.846 4088 3038340567112 MainThread DEBUG nova.compute.manager [req-5f96c213-2e36-4cea-8a16-4e6a83404b06 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:24.873 4088 3038340567112 MainThread INFO nova.compute.manager [req-5f96c213-2e36-4cea-8a16-4e6a83404b06 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:25.684 4088 3038337403896 MainThread DEBUG os_win.utils.jobutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Waiting for WMI job: {'InstanceID': 'B71F5403-D673-48C8-80AB-5E815E065992', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=33924), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:25.776 4088 3038340735400 MainThread DEBUG os_win.utils.jobutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '9E319311-BA13-4A58-A7C9-2DC1FDCCA52A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19350), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:26.074 4088 3038337403896 MainThread ERROR os_win.utils.jobutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003f\' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)instance-0000003fF0DD020A-9530-47CC-A2E8-E20CD37D12AF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)instance-0000003fF0DD020A-9530-47CC-A2E8-E20CD37D12AF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)instance-0000003fF0DD020A-9530-47CC-A2E8-E20CD37D12AF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B71F5403-D673-48C8-80AB-5E815E065992', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=367928), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 25), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 26), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003f' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)\n\nNot enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)\n\n'instance-0000003f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)", 'ErrorSummaryDescription': "'instance-0000003f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:26.074 4088 3038337403896 MainThread DEBUG os_win._utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003f' failed to start. Not enough memory in the system to start the virtual machine instance-0000003f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003f' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Not enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) 'instance-0000003f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 4.799630641937256 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:26.134 4088 3038340567112 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:26.134 4088 3038340567112 MainThread INFO nova.compute.manager [-] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] VM Stopped (Lifecycle Event) 2021-09-10 17:02:26.151 4088 3038340567464 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:26.151 4088 3038340567464 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:26.168 4088 3038340567112 MainThread DEBUG nova.compute.manager [req-4e5c1016-da22-447b-9fbc-61d8ae597a0b - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:26.168 4088 3038340567112 MainThread DEBUG nova.virt.hyperv.vmops [req-4e5c1016-da22-447b-9fbc-61d8ae597a0b - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:26.182 4088 3038340735400 MainThread ERROR os_win.utils.jobutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004b\' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)instance-0000004b820772AD-4295-42A6-918F-A9D9578684B112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)instance-0000004b820772AD-4295-42A6-918F-A9D9578684B110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)instance-0000004b820772AD-4295-42A6-918F-A9D9578684B1%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9E319311-BA13-4A58-A7C9-2DC1FDCCA52A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=374093), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 25), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 26), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004b' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)\n\nNot enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)\n\n'instance-0000004b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1)", 'ErrorSummaryDescription': "'instance-0000004b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:26.182 4088 3038340735400 MainThread ERROR nova.virt.hyperv.vmops [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Failed to change vm state of instance-0000004b to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000004b' failed to start. 2021-09-10 17:02:26.182 4088 3038340735400 MainThread INFO nova.virt.hyperv.vmops [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Got request to destroy instance 2021-09-10 17:02:26.228 4088 3038340570456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:26.228 4088 3038340570456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:26.228 4088 3038340567464 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:26.228 4088 3038340567464 MainThread INFO nova.compute.manager [-] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] VM Stopped (Lifecycle Event) 2021-09-10 17:02:26.258 4088 3038340567112 MainThread DEBUG nova.compute.manager [req-4e5c1016-da22-447b-9fbc-61d8ae597a0b - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:26.293 4088 3038340567112 MainThread INFO nova.compute.manager [req-4e5c1016-da22-447b-9fbc-61d8ae597a0b - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:26.293 4088 3038340567464 MainThread DEBUG nova.compute.manager [req-13c3f468-d0d2-4065-bec0-d56e46066ac5 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:26.293 4088 3038340567464 MainThread DEBUG nova.virt.hyperv.vmops [req-13c3f468-d0d2-4065-bec0-d56e46066ac5 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:26.353 4088 3038340567464 MainThread DEBUG nova.compute.manager [req-13c3f468-d0d2-4065-bec0-d56e46066ac5 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:26.416 4088 3038340567464 MainThread INFO nova.compute.manager [req-13c3f468-d0d2-4065-bec0-d56e46066ac5 - - - - -] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:26.634 4088 3038340570984 GreenThread-69 DEBUG nova.network.neutron [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Successfully updated port: c8d5eafd-85a2-4d40-9b87-bdfc843fb561 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:02:26.650 4088 3038340570984 GreenThread-69 DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Acquired lock "refresh_cache-22ce4089-0acb-4f53-bb15-501df1d949ed" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:02:26.650 4088 3038340570984 GreenThread-69 DEBUG nova.network.neutron [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:02:26.965 4088 3038340570984 GreenThread-69 DEBUG nova.network.neutron [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:02:27.121 4088 3038337403896 MainThread DEBUG os_win.utils.jobutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Waiting for WMI job: {'InstanceID': '40E9971E-C3FE-4357-88DE-A4CAE1AD456E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17508), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:27.540 4088 3038337403896 MainThread ERROR os_win.utils.jobutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003f\' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)instance-0000003fF0DD020A-9530-47CC-A2E8-E20CD37D12AF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)instance-0000003fF0DD020A-9530-47CC-A2E8-E20CD37D12AF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)instance-0000003fF0DD020A-9530-47CC-A2E8-E20CD37D12AF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '40E9971E-C3FE-4357-88DE-A4CAE1AD456E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=404909), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 27), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 27), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003f' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)\n\nNot enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)\n\n'instance-0000003f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)", 'ErrorSummaryDescription': "'instance-0000003f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:27.540 4088 3038337403896 MainThread DEBUG os_win._utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000003f' failed to start. Not enough memory in the system to start the virtual machine instance-0000003f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003f' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Not enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) 'instance-0000003f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 6.265510559082031 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:27.667 4088 3038340570456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:27.667 4088 3038340570456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:27.667 4088 3038340567464 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:27.667 4088 3038340567464 MainThread INFO nova.compute.manager [-] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] VM Stopped (Lifecycle Event) 2021-09-10 17:02:27.700 4088 3038340567464 MainThread DEBUG nova.compute.manager [req-a13b4701-69ea-43e9-9fff-9b42bf3664fa - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:27.700 4088 3038340567464 MainThread DEBUG nova.virt.hyperv.vmops [req-a13b4701-69ea-43e9-9fff-9b42bf3664fa - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:27.783 4088 3038340567464 MainThread DEBUG nova.compute.manager [req-a13b4701-69ea-43e9-9fff-9b42bf3664fa - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:27.831 4088 3038340567464 MainThread INFO nova.compute.manager [req-a13b4701-69ea-43e9-9fff-9b42bf3664fa - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:28.462 4088 3038340570984 GreenThread-69 DEBUG nova.network.neutron [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Updating instance_info_cache with network_info: [{"id": "c8d5eafd-85a2-4d40-9b87-bdfc843fb561", "address": "fa:16:3e:8a:10:a5", "network": {"id": "8a0fc2b4-bff6-4887-a969-81fb448d568f", "bridge": null, "label": "tempest-DeleteServersTestJSON-1414296899-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "eecab78b34b0468f8c42e4b7f3444918", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapc8d5eafd-85", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:28.479 4088 3038340570984 GreenThread-69 DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Releasing lock "refresh_cache-22ce4089-0acb-4f53-bb15-501df1d949ed" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:02:28.479 4088 3038340570984 GreenThread-69 DEBUG nova.compute.manager [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Instance network_info: |[{"id": "c8d5eafd-85a2-4d40-9b87-bdfc843fb561", "address": "fa:16:3e:8a:10:a5", "network": {"id": "8a0fc2b4-bff6-4887-a969-81fb448d568f", "bridge": null, "label": "tempest-DeleteServersTestJSON-1414296899-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "eecab78b34b0468f8c42e4b7f3444918", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapc8d5eafd-85", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:02:28.479 4088 3038340567640 MainThread DEBUG nova.compute.manager [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Preparing to wait for external event network-vif-plugged-c8d5eafd-85a2-4d40-9b87-bdfc843fb561 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:02:28.503 4088 3038340567640 MainThread DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "22ce4089-0acb-4f53-bb15-501df1d949ed-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:28.503 4088 3038340567640 MainThread DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "22ce4089-0acb-4f53-bb15-501df1d949ed-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:28.503 4088 3038340567640 MainThread DEBUG os_win.utils.compute.vmutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Creating VM instance-0000004e create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:02:28.578 4088 3038337403896 MainThread DEBUG os_win.utils.jobutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Waiting for WMI job: {'InstanceID': '321D290E-1CC6-42D2-8AD2-2B5C65C117BE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15330), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:28.636 4088 3038340570984 MainThread DEBUG nova.compute.manager [req-7c63f4f1-187c-4e2d-82a7-f31d28724a37 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Received event network-vif-plugged-383e07c9-f8f6-4e9b-b3f0-4cce077fd021 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:28.636 4088 3038340570984 MainThread DEBUG oslo_concurrency.lockutils [req-7c63f4f1-187c-4e2d-82a7-f31d28724a37 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "c4dcbaf6-eadf-45db-9755-790791af2bf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:28.636 4088 3038340570984 MainThread DEBUG oslo_concurrency.lockutils [req-7c63f4f1-187c-4e2d-82a7-f31d28724a37 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "c4dcbaf6-eadf-45db-9755-790791af2bf7-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:28.636 4088 3038340570984 MainThread DEBUG nova.compute.manager [req-7c63f4f1-187c-4e2d-82a7-f31d28724a37 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Processing event network-vif-plugged-383e07c9-f8f6-4e9b-b3f0-4cce077fd021 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:02:28.654 4088 3038340735400 MainThread DEBUG nova.virt.hyperv.vmops [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:02:28.654 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-0000004b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:28.654 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-0000004b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:28.673 4088 3038340735400 MainThread DEBUG os_win.utils.compute.vmutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Successfully changed vm state of instance-0000004b to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:02:28.673 4088 3038340735400 MainThread DEBUG nova.virt.hyperv.vmops [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Successfully changed state of VM instance-0000004b to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:02:28.673 4088 3038340569048 MainThread INFO nova.virt.hyperv.vmops [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Using config drive for instance 2021-09-10 17:02:28.952 4088 3038340735400 MainThread DEBUG os_win.utils.jobutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'F70B4CD1-A215-4191-99D4-10542BEA7BEE', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16425), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:28.952 4088 3038340569048 MainThread INFO nova.virt.hyperv.vmops [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Creating config drive at C:\openstack\instances\instance-00000051\configdrive.iso 2021-09-10 17:02:29.067 4088 3038340569048 MainThread DEBUG oslo_concurrency.processutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000051\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpqxo5hdtw execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:02:29.212 4088 3038340570456 MainThread DEBUG nova.compute.manager [req-9090d19b-9e73-4050-9237-a1c8f19a1560 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Received event network-changed-c8d5eafd-85a2-4d40-9b87-bdfc843fb561 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:29.227 4088 3038340570456 MainThread DEBUG nova.compute.manager [req-9090d19b-9e73-4050-9237-a1c8f19a1560 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Refreshing instance network info cache due to event network-changed-c8d5eafd-85a2-4d40-9b87-bdfc843fb561. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:02:29.227 4088 3038340570456 MainThread DEBUG oslo_concurrency.lockutils [req-9090d19b-9e73-4050-9237-a1c8f19a1560 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-22ce4089-0acb-4f53-bb15-501df1d949ed" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:02:29.227 4088 3038340570456 MainThread DEBUG nova.network.neutron [req-9090d19b-9e73-4050-9237-a1c8f19a1560 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Refreshing network info cache for port c8d5eafd-85a2-4d40-9b87-bdfc843fb561 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:02:29.227 4088 3038340735400 MainThread DEBUG os_win.utils.jobutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job succeeded: {'InstanceID': 'F70B4CD1-A215-4191-99D4-10542BEA7BEE', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=140839), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:02:29.227 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-0000004b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:29.227 4088 3038340735400 MainThread DEBUG os_win.utils.pathutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Removing directory: C:\openstack\instances\instance-0000004b check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:02:29.227 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-0000004b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:29.227 4088 3038340735400 MainThread ERROR nova.compute.manager [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004b' failed to start. Not enough memory in the system to start the virtual machine instance-0000004b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004b' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Not enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) 'instance-0000004b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Error code: 32778. 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Traceback (most recent call last): 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] return function(*args, **kwargs) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] admin_password, network_info, block_device_info) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] return function(self, *args, **kwds) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self.force_reraise() 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] raise self.value 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] should_plug_vifs=False) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 'req_state': req_state}) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self.force_reraise() 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] raise self.value 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] time.sleep(sleep_time) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self.force_reraise() 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] raise self.value 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] return f(*args, **kwargs) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] return self._wait_for_job(job_path) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] error_desc=err_desc) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000004b' failed to start. 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Not enough memory in the system to start the virtual machine instance-0000004b. 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004b' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Not enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 'instance-0000004b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Error code: 32778. 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] During handling of the above exception, another exception occurred: 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Traceback (most recent call last): 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] yield resources 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] accel_info=accel_info) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] return function(*args, **kwargs) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] admin_password, network_info, block_device_info) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] return function(self, *args, **kwds) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self.force_reraise() 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] raise self.value 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] should_plug_vifs=False) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 'req_state': req_state}) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self.force_reraise() 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] raise self.value 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] time.sleep(sleep_time) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self.force_reraise() 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] raise self.value 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] return f(*args, **kwargs) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] return self._wait_for_job(job_path) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] error_desc=err_desc) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004b' failed to start. 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Not enough memory in the system to start the virtual machine instance-0000004b. 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004b' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Not enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 'instance-0000004b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Error code: 32778. 2021-09-10 17:02:29.227 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.243 4088 3038340735400 MainThread INFO nova.compute.manager [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Terminating instance 2021-09-10 17:02:29.243 4088 3038340735400 MainThread DEBUG nova.compute.manager [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:02:29.243 4088 3038340735400 MainThread INFO nova.virt.hyperv.vmops [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Got request to destroy instance 2021-09-10 17:02:29.243 4088 3038337403896 MainThread ERROR os_win.utils.jobutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000003f\' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)instance-0000003fF0DD020A-9530-47CC-A2E8-E20CD37D12AF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)instance-0000003fF0DD020A-9530-47CC-A2E8-E20CD37D12AF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000003f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)instance-0000003fF0DD020A-9530-47CC-A2E8-E20CD37D12AF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '321D290E-1CC6-42D2-8AD2-2B5C65C117BE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=313562), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 28), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 28), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000003f' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)\n\nNot enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)\n\n'instance-0000003f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF)", 'ErrorSummaryDescription': "'instance-0000003f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000003f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:29.243 4088 3038337403896 MainThread ERROR nova.virt.hyperv.vmops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Failed to change vm state of instance-0000003f to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000003f' failed to start. 2021-09-10 17:02:29.243 4088 3038337403896 MainThread INFO nova.virt.hyperv.vmops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Got request to destroy instance 2021-09-10 17:02:29.261 4088 3038340735400 MainThread DEBUG nova.virt.hyperv.vmops [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:02:29.261 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-0000004b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:29.261 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-0000004b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:29.261 4088 3038340735400 MainThread INFO nova.compute.manager [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:02:29.261 4088 3038340735400 MainThread DEBUG nova.compute.claims [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:02:29.261 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:29.290 4088 3038340569928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:29.290 4088 3038340569928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000003f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:29.290 4088 3038340570808 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:29.290 4088 3038340570808 MainThread INFO nova.compute.manager [-] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] VM Stopped (Lifecycle Event) 2021-09-10 17:02:29.342 4088 3038340570808 MainThread DEBUG nova.compute.manager [req-5d91486b-776e-48b7-a43d-aedead8491e1 - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:29.342 4088 3038340570808 MainThread DEBUG nova.virt.hyperv.vmops [req-5d91486b-776e-48b7-a43d-aedead8491e1 - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:29.431 4088 3038340569048 MainThread DEBUG oslo_concurrency.processutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000051\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpqxo5hdtw" returned: 0 in 0.359s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:02:29.431 4088 3038340570808 MainThread DEBUG nova.compute.manager [req-5d91486b-776e-48b7-a43d-aedead8491e1 - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:29.475 4088 3038340735400 MainThread DEBUG nova.virt.hyperv.hostops [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:02:29.480 4088 3038340570808 MainThread INFO nova.compute.manager [req-5d91486b-776e-48b7-a43d-aedead8491e1 - - - - -] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:29.495 4088 3038340735400 MainThread DEBUG nova.virt.hyperv.hostops [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:02:29.840 4088 3038340735400 MainThread DEBUG nova.compute.provider_tree [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:02:29.858 4088 3038340735400 MainThread DEBUG nova.scheduler.client.report [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:02:29.858 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.594s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:29.858 4088 3038340735400 MainThread ERROR nova.compute.manager [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004b' failed to start. Not enough memory in the system to start the virtual machine instance-0000004b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004b' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Not enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) 'instance-0000004b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Error code: 32778. 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Traceback (most recent call last): 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] return function(*args, **kwargs) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] admin_password, network_info, block_device_info) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] return function(self, *args, **kwds) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self.force_reraise() 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] raise self.value 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] should_plug_vifs=False) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 'req_state': req_state}) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self.force_reraise() 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] raise self.value 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] time.sleep(sleep_time) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self.force_reraise() 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] raise self.value 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] return f(*args, **kwargs) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] return self._wait_for_job(job_path) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] error_desc=err_desc) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000004b' failed to start. 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Not enough memory in the system to start the virtual machine instance-0000004b. 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004b' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Not enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 'instance-0000004b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Error code: 32778. 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] During handling of the above exception, another exception occurred: 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Traceback (most recent call last): 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] accel_info=accel_info) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] return function(*args, **kwargs) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] admin_password, network_info, block_device_info) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] return function(self, *args, **kwds) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self.force_reraise() 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] raise self.value 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] should_plug_vifs=False) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 'req_state': req_state}) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self.force_reraise() 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] raise self.value 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] time.sleep(sleep_time) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self.force_reraise() 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] raise self.value 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] return f(*args, **kwargs) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] return self._wait_for_job(job_path) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] error_desc=err_desc) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004b' failed to start. 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Not enough memory in the system to start the virtual machine instance-0000004b. 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004b' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Not enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 'instance-0000004b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Error code: 32778. 2021-09-10 17:02:29.858 4088 3038340735400 MainThread TRACE nova.compute.manager [instance: 3111054c-9a20-4851-a793-42fbe94a3375] 2021-09-10 17:02:29.858 4088 3038340735400 MainThread DEBUG nova.compute.utils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] WMI job failed with status 10. Error summary description: 'instance-0000004b' failed to start. Not enough memory in the system to start the virtual machine instance-0000004b. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:02:29.883 4088 3038340735400 MainThread DEBUG nova.compute.manager [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Build of instance 3111054c-9a20-4851-a793-42fbe94a3375 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000004b' failed to start. Not enough memory in the system to start the virtual machine instance-0000004b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004b' failed to start. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Not enough memory in the system to start the virtual machine instance-0000004b with ram size 1024 megabytes. (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) 'instance-0000004b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 820772AD-4295-42A6-918F-A9D9578684B1) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:02:29.883 4088 3038340735400 MainThread DEBUG nova.compute.manager [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:02:29.888 4088 3038340735400 MainThread DEBUG nova.compute.manager [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:02:29.888 4088 3038340735400 MainThread DEBUG nova.compute.manager [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:02:29.888 4088 3038340735400 MainThread DEBUG nova.network.neutron [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:02:30.157 4088 3038340569048 MainThread DEBUG nova.virt.hyperv.vmops [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Setting boot order for instance: instance-00000051: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:02:30.260 4088 3038340569048 MainThread DEBUG nova.virt.hyperv.vmops [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:02:30.293 4088 3038340569048 MainThread DEBUG os_win.utils.jobutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Waiting for WMI job: {'InstanceID': 'D7363411-E5E0-4752-BDDD-842209EB8BA9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17473), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:30.450 4088 3038340569048 MainThread ERROR os_win.utils.jobutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000051\' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)instance-0000005173A15DCA-21FB-49FB-B7F3-D96FD07FDF1212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)instance-0000005173A15DCA-21FB-49FB-B7F3-D96FD07FDF1210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000051\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)instance-0000005173A15DCA-21FB-49FB-B7F3-D96FD07FDF12%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D7363411-E5E0-4752-BDDD-842209EB8BA9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=137721), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 30), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 30), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000051' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)\n\nNot enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)\n\n'instance-00000051' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)", 'ErrorSummaryDescription': "'instance-00000051' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000051.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:30.450 4088 3038340569048 MainThread DEBUG os_win._utils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000051' failed to start. Not enough memory in the system to start the virtual machine instance-00000051. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000051' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Not enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) 'instance-00000051' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18996620178222656 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:30.495 4088 3038340569224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:30.495 4088 3038340569224 MainThread INFO nova.compute.manager [-] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] VM Stopped (Lifecycle Event) 2021-09-10 17:02:30.495 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000051" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:30.495 4088 3038340567288 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000051" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:30.519 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-c4f597c7-732c-4727-a024-7017ac778cee - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:30.534 4088 3038340569224 MainThread DEBUG nova.virt.hyperv.vmops [req-c4f597c7-732c-4727-a024-7017ac778cee - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:30.717 4088 3038340569224 MainThread DEBUG nova.compute.manager [req-c4f597c7-732c-4727-a024-7017ac778cee - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:30.743 4088 3038340569224 MainThread INFO nova.compute.manager [req-c4f597c7-732c-4727-a024-7017ac778cee - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:30.825 4088 3038340735400 MainThread DEBUG nova.network.neutron [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:30.840 4088 3038340735400 MainThread INFO nova.compute.manager [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 3111054c-9a20-4851-a793-42fbe94a3375] Took 0.95 seconds to deallocate network for instance. 2021-09-10 17:02:30.867 4088 3038340567640 MainThread DEBUG nova.virt.hyperv.vmops [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:02:31.036 4088 3038340570456 MainThread DEBUG nova.network.neutron [req-9090d19b-9e73-4050-9237-a1c8f19a1560 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Updated VIF entry in instance network info cache for port c8d5eafd-85a2-4d40-9b87-bdfc843fb561. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:02:31.036 4088 3038340570456 MainThread DEBUG nova.network.neutron [req-9090d19b-9e73-4050-9237-a1c8f19a1560 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Updating instance_info_cache with network_info: [{"id": "c8d5eafd-85a2-4d40-9b87-bdfc843fb561", "address": "fa:16:3e:8a:10:a5", "network": {"id": "8a0fc2b4-bff6-4887-a969-81fb448d568f", "bridge": null, "label": "tempest-DeleteServersTestJSON-1414296899-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "eecab78b34b0468f8c42e4b7f3444918", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapc8d5eafd-85", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:31.055 4088 3038340570456 MainThread DEBUG oslo_concurrency.lockutils [req-9090d19b-9e73-4050-9237-a1c8f19a1560 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-22ce4089-0acb-4f53-bb15-501df1d949ed" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:02:31.149 4088 3038340735400 MainThread INFO nova.scheduler.client.report [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Deleted allocations for instance 3111054c-9a20-4851-a793-42fbe94a3375 2021-09-10 17:02:31.205 4088 3038340735400 MainThread DEBUG oslo_concurrency.lockutils [req-3e427c4d-772a-4f4c-b7a1-e4cbd186ea13 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "3111054c-9a20-4851-a793-42fbe94a3375" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 41.250s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:31.497 4088 3038340569048 MainThread DEBUG os_win.utils.jobutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Waiting for WMI job: {'InstanceID': 'E2541C83-82D1-45C5-B866-E8A4F5F14A7A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=26898), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:31.651 4088 3038340569048 MainThread ERROR os_win.utils.jobutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000051\' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)instance-0000005173A15DCA-21FB-49FB-B7F3-D96FD07FDF1212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)instance-0000005173A15DCA-21FB-49FB-B7F3-D96FD07FDF1210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000051\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)instance-0000005173A15DCA-21FB-49FB-B7F3-D96FD07FDF12%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E2541C83-82D1-45C5-B866-E8A4F5F14A7A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=132012), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 31), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 31), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000051' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)\n\nNot enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)\n\n'instance-00000051' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)", 'ErrorSummaryDescription': "'instance-00000051' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000051.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:31.651 4088 3038340569048 MainThread DEBUG os_win._utils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000051' failed to start. Not enough memory in the system to start the virtual machine instance-00000051. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000051' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Not enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) 'instance-00000051' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.391467571258545 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:31.696 4088 3038340568168 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:31.696 4088 3038340568168 MainThread INFO nova.compute.manager [-] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] VM Stopped (Lifecycle Event) 2021-09-10 17:02:31.696 4088 3038340570456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000051" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:31.696 4088 3038340570456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000051" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:31.721 4088 3038340568168 MainThread DEBUG nova.compute.manager [req-404902a0-7a7b-4c3e-8f39-1901a0d45661 - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:31.721 4088 3038340568168 MainThread DEBUG nova.virt.hyperv.vmops [req-404902a0-7a7b-4c3e-8f39-1901a0d45661 - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:31.777 4088 3038340568168 MainThread DEBUG nova.compute.manager [req-404902a0-7a7b-4c3e-8f39-1901a0d45661 - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:31.806 4088 3038340568168 MainThread INFO nova.compute.manager [req-404902a0-7a7b-4c3e-8f39-1901a0d45661 - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:32.680 4088 3038340569048 MainThread DEBUG os_win.utils.jobutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Waiting for WMI job: {'InstanceID': 'ADCAD178-4FC6-44BD-A699-63A8AEA2B4CA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16583), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:32.729 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.vmops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:02:32.729 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "instance-0000003f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:32.729 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "instance-0000003f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:32.753 4088 3038337403896 MainThread DEBUG os_win.utils.compute.vmutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Successfully changed vm state of instance-0000003f to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:02:32.753 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.vmops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Successfully changed state of VM instance-0000003f to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:02:32.808 4088 3038337403896 MainThread DEBUG os_win.utils.jobutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Waiting for WMI job: {'InstanceID': '3677D2F3-590B-48AC-874F-6E76FFACD4ED', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20553), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:32.852 4088 3038340569048 MainThread ERROR os_win.utils.jobutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000051\' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)instance-0000005173A15DCA-21FB-49FB-B7F3-D96FD07FDF1212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)instance-0000005173A15DCA-21FB-49FB-B7F3-D96FD07FDF1210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000051\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)instance-0000005173A15DCA-21FB-49FB-B7F3-D96FD07FDF12%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'ADCAD178-4FC6-44BD-A699-63A8AEA2B4CA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=122297), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 32), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 32), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000051' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)\n\nNot enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)\n\n'instance-00000051' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)", 'ErrorSummaryDescription': "'instance-00000051' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000051.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:32.852 4088 3038340569048 MainThread DEBUG os_win._utils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000051' failed to start. Not enough memory in the system to start the virtual machine instance-00000051. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000051' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Not enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) 'instance-00000051' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.592428684234619 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:32.940 4088 3038340570456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000051" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:32.940 4088 3038340570456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000051" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:32.952 4088 3038340568168 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:32.952 4088 3038340568168 MainThread INFO nova.compute.manager [-] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] VM Stopped (Lifecycle Event) 2021-09-10 17:02:32.952 4088 3038337403896 MainThread DEBUG os_win.utils.jobutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] WMI job succeeded: {'InstanceID': '3677D2F3-590B-48AC-874F-6E76FFACD4ED', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=157418), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:02:32.952 4088 3038337403896 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-174960b8-7aa2-43c8-aff0-31d5f7de9324', 'target_lun': 0, 'volume_id': '174960b8-7aa2-43c8-aff0-31d5f7de9324', 'auth_method': 'CHAP', 'auth_username': 'rYi4xVp8k8gT6zEJHGPP', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:02:32.952 4088 3038337403896 MainThread DEBUG os_win.utils.storage.diskutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:02:32.981 4088 3038340568168 MainThread DEBUG nova.compute.manager [req-0d2af3f9-6138-4b61-b5a7-fc9aa8c0677e - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:32.981 4088 3038340568168 MainThread DEBUG nova.virt.hyperv.vmops [req-0d2af3f9-6138-4b61-b5a7-fc9aa8c0677e - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:33.039 4088 3038340568168 MainThread DEBUG nova.compute.manager [req-0d2af3f9-6138-4b61-b5a7-fc9aa8c0677e - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:33.060 4088 3038340568168 MainThread INFO nova.compute.manager [req-0d2af3f9-6138-4b61-b5a7-fc9aa8c0677e - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:33.120 4088 3038337403896 MainThread DEBUG os_win.utils.storage.diskutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:02:33.135 4088 3038337403896 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-174960b8-7aa2-43c8-aff0-31d5f7de9324 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 17:02:33.214 4088 3038337403896 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Removing iSCSI target persistent login: iqn.2010-10.org.openstack:volume-174960b8-7aa2-43c8-aff0-31d5f7de9324 _remove_target_persistent_logins c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:495 2021-09-10 17:02:33.214 4088 3038337403896 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] <== disconnect_volume: return (261ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:02:33.214 4088 3038337403896 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-7687f3e5-535f-43cb-92df-79afc5c86fb1', 'target_lun': 0, 'volume_id': '7687f3e5-535f-43cb-92df-79afc5c86fb1', 'auth_method': 'CHAP', 'auth_username': 'zyJxKJaxT6B3MYRsZn7s', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:02:33.214 4088 3038337403896 MainThread DEBUG os_win.utils.storage.diskutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:02:33.348 4088 3038337403896 MainThread DEBUG os_win.utils.storage.diskutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:02:33.361 4088 3038337403896 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-7687f3e5-535f-43cb-92df-79afc5c86fb1 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 17:02:33.434 4088 3038337403896 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Removing iSCSI target persistent login: iqn.2010-10.org.openstack:volume-7687f3e5-535f-43cb-92df-79afc5c86fb1 _remove_target_persistent_logins c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:495 2021-09-10 17:02:33.447 4088 3038337403896 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] <== disconnect_volume: return (232ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:02:33.447 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "instance-0000003f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:33.447 4088 3038337403896 MainThread DEBUG os_win.utils.pathutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Removing directory: C:\openstack\instances\instance-0000003f check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:02:33.447 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "instance-0000003f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:33.447 4088 3038337403896 MainThread ERROR nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003f' failed to start. Not enough memory in the system to start the virtual machine instance-0000003f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003f' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Not enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) 'instance-0000003f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Error code: 32778. 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Traceback (most recent call last): 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] return function(*args, **kwargs) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] admin_password, network_info, block_device_info) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] return function(self, *args, **kwds) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self.force_reraise() 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] raise self.value 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] should_plug_vifs=False) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 'req_state': req_state}) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self.force_reraise() 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] raise self.value 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] time.sleep(sleep_time) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self.force_reraise() 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] raise self.value 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] return f(*args, **kwargs) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] return self._wait_for_job(job_path) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] error_desc=err_desc) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000003f' failed to start. 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Not enough memory in the system to start the virtual machine instance-0000003f. 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003f' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Not enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 'instance-0000003f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Error code: 32778. 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] During handling of the above exception, another exception occurred: 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Traceback (most recent call last): 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] yield resources 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] accel_info=accel_info) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] return function(*args, **kwargs) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] admin_password, network_info, block_device_info) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] return function(self, *args, **kwds) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self.force_reraise() 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] raise self.value 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] should_plug_vifs=False) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 'req_state': req_state}) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self.force_reraise() 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] raise self.value 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] time.sleep(sleep_time) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self.force_reraise() 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] raise self.value 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] return f(*args, **kwargs) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] return self._wait_for_job(job_path) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] error_desc=err_desc) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003f' failed to start. 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Not enough memory in the system to start the virtual machine instance-0000003f. 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003f' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Not enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 'instance-0000003f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Error code: 32778. 2021-09-10 17:02:33.447 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:33.447 4088 3038337403896 MainThread INFO nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Terminating instance 2021-09-10 17:02:33.447 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:02:33.447 4088 3038337403896 MainThread INFO nova.virt.hyperv.vmops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Got request to destroy instance 2021-09-10 17:02:33.481 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.vmops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:02:33.481 4088 3038337403896 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-36413d8d-e561-4803-ae3b-516b90e60d05', 'target_lun': 0, 'volume_id': '36413d8d-e561-4803-ae3b-516b90e60d05', 'auth_method': 'CHAP', 'auth_username': 'r7zZCaWyvbNG2TWUNX7m', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:02:33.481 4088 3038337403896 MainThread DEBUG os_win.utils.storage.diskutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:02:33.593 4088 3038337403896 MainThread DEBUG os_win.utils.storage.diskutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:02:33.593 4088 3038337403896 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-36413d8d-e561-4803-ae3b-516b90e60d05 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 17:02:33.675 4088 3038337403896 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Removing iSCSI target persistent login: iqn.2010-10.org.openstack:volume-36413d8d-e561-4803-ae3b-516b90e60d05 _remove_target_persistent_logins c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:495 2021-09-10 17:02:33.680 4088 3038337403896 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] <== disconnect_volume: return (198ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:02:33.680 4088 3038337403896 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-174960b8-7aa2-43c8-aff0-31d5f7de9324', 'target_lun': 0, 'volume_id': '174960b8-7aa2-43c8-aff0-31d5f7de9324', 'auth_method': 'CHAP', 'auth_username': 'rYi4xVp8k8gT6zEJHGPP', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:02:33.680 4088 3038337403896 MainThread DEBUG os_win.utils.storage.diskutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:02:33.782 4088 3038337403896 MainThread DEBUG os_win.utils.storage.diskutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:02:33.782 4088 3038337403896 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-174960b8-7aa2-43c8-aff0-31d5f7de9324 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 17:02:33.782 4088 3038337403896 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] <== disconnect_volume: return (102ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:02:33.782 4088 3038337403896 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-7687f3e5-535f-43cb-92df-79afc5c86fb1', 'target_lun': 0, 'volume_id': '7687f3e5-535f-43cb-92df-79afc5c86fb1', 'auth_method': 'CHAP', 'auth_username': 'zyJxKJaxT6B3MYRsZn7s', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:02:33.782 4088 3038337403896 MainThread DEBUG os_win.utils.storage.diskutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:02:33.883 4088 3038340569048 MainThread DEBUG os_win.utils.jobutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Waiting for WMI job: {'InstanceID': '9BBDE1E3-D3BB-43AC-B7F0-9A2B726B66BE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18577), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:33.951 4088 3038337403896 MainThread DEBUG os_win.utils.storage.diskutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:02:33.951 4088 3038337403896 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-7687f3e5-535f-43cb-92df-79afc5c86fb1 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 17:02:33.962 4088 3038337403896 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] <== disconnect_volume: return (179ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:02:33.962 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "instance-0000003f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:33.962 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "instance-0000003f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:33.962 4088 3038337403896 MainThread INFO nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Took 0.52 seconds to destroy the instance on the hypervisor. 2021-09-10 17:02:34.117 4088 3038340570456 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:34.117 4088 3038340570456 MainThread INFO nova.compute.manager [-] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] VM Stopped (Lifecycle Event) 2021-09-10 17:02:34.137 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000051" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:34.137 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000051" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:34.153 4088 3038340569048 MainThread ERROR os_win.utils.jobutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000051\' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)instance-0000005173A15DCA-21FB-49FB-B7F3-D96FD07FDF1212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)instance-0000005173A15DCA-21FB-49FB-B7F3-D96FD07FDF1210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000051\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)instance-0000005173A15DCA-21FB-49FB-B7F3-D96FD07FDF12%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9BBDE1E3-D3BB-43AC-B7F0-9A2B726B66BE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=153686), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 33), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 34), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000051' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)\n\nNot enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)\n\n'instance-00000051' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)", 'ErrorSummaryDescription': "'instance-00000051' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000051.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:34.153 4088 3038340569048 MainThread DEBUG os_win._utils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000051' failed to start. Not enough memory in the system to start the virtual machine instance-00000051. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000051' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Not enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) 'instance-00000051' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.8932902812957764 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:34.167 4088 3038340570456 MainThread DEBUG nova.compute.manager [req-faa41aea-9d34-46b6-85fd-ee95774b28d5 - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:34.167 4088 3038340570456 MainThread DEBUG nova.virt.hyperv.vmops [req-faa41aea-9d34-46b6-85fd-ee95774b28d5 - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:34.212 4088 3038340570456 MainThread DEBUG nova.compute.manager [req-faa41aea-9d34-46b6-85fd-ee95774b28d5 - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:34.249 4088 3038340570456 MainThread INFO nova.compute.manager [req-faa41aea-9d34-46b6-85fd-ee95774b28d5 - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:35.217 4088 3038340569048 MainThread DEBUG os_win.utils.jobutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Waiting for WMI job: {'InstanceID': '269E5CFE-E627-4027-ABA7-B646A8F18B0E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17819), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:35.369 4088 3038340569048 MainThread ERROR os_win.utils.jobutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000051\' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)instance-0000005173A15DCA-21FB-49FB-B7F3-D96FD07FDF1212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)instance-0000005173A15DCA-21FB-49FB-B7F3-D96FD07FDF1210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000051\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)instance-0000005173A15DCA-21FB-49FB-B7F3-D96FD07FDF12%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '269E5CFE-E627-4027-ABA7-B646A8F18B0E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121003), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 35), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 35), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000051' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)\n\nNot enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)\n\n'instance-00000051' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)", 'ErrorSummaryDescription': "'instance-00000051' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000051.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:35.369 4088 3038340569048 MainThread DEBUG os_win._utils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000051' failed to start. Not enough memory in the system to start the virtual machine instance-00000051. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000051' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Not enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) 'instance-00000051' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.109734058380127 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:35.400 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000051" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:35.400 4088 3038340568696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000051" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:35.400 4088 3038340570456 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:35.400 4088 3038340570456 MainThread INFO nova.compute.manager [-] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] VM Stopped (Lifecycle Event) 2021-09-10 17:02:35.434 4088 3038340570456 MainThread DEBUG nova.compute.manager [req-6c6c584d-55f8-40de-a6d8-c21e3dcafee4 - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:35.434 4088 3038340570456 MainThread DEBUG nova.virt.hyperv.vmops [req-6c6c584d-55f8-40de-a6d8-c21e3dcafee4 - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:35.478 4088 3038340570456 MainThread DEBUG nova.compute.manager [req-6c6c584d-55f8-40de-a6d8-c21e3dcafee4 - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:35.509 4088 3038340570456 MainThread INFO nova.compute.manager [req-6c6c584d-55f8-40de-a6d8-c21e3dcafee4 - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:35.883 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Lock "30a2e0f5-74d7-453d-ad6a-628ef91e6d39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:35.922 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:02:36.149 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:36.149 4088 3038342146184 MainThread DEBUG nova.virt.hardware [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:02:36.149 4088 3038342146184 MainThread INFO nova.compute.claims [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Claim successful on node n-h2-808474-1 2021-09-10 17:02:36.354 4088 3038342146184 MainThread DEBUG nova.virt.hyperv.hostops [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:02:36.384 4088 3038342146184 MainThread DEBUG nova.virt.hyperv.hostops [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:02:36.417 4088 3038340569048 MainThread DEBUG os_win.utils.jobutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Waiting for WMI job: {'InstanceID': 'FD2CD75D-8D20-420E-8993-47F063D03B80', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16860), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:36.572 4088 3038340569048 MainThread ERROR os_win.utils.jobutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000051\' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)instance-0000005173A15DCA-21FB-49FB-B7F3-D96FD07FDF1212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)instance-0000005173A15DCA-21FB-49FB-B7F3-D96FD07FDF1210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000051\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)instance-0000005173A15DCA-21FB-49FB-B7F3-D96FD07FDF12%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'FD2CD75D-8D20-420E-8993-47F063D03B80', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=127654), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 36), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 36), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000051' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)\n\nNot enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)\n\n'instance-00000051' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12)", 'ErrorSummaryDescription': "'instance-00000051' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000051.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:36.572 4088 3038340569048 MainThread ERROR nova.virt.hyperv.vmops [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Failed to change vm state of instance-00000051 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000051' failed to start. 2021-09-10 17:02:36.572 4088 3038340569048 MainThread INFO nova.virt.hyperv.vmops [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Got request to destroy instance 2021-09-10 17:02:36.603 4088 3038342144248 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:36.603 4088 3038342144248 MainThread INFO nova.compute.manager [-] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] VM Stopped (Lifecycle Event) 2021-09-10 17:02:36.603 4088 3038342146536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000051" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:36.603 4088 3038342146536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000051" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:36.627 4088 3038342144248 MainThread DEBUG nova.compute.manager [req-3386c088-f51b-4f4a-9c8d-ad198e063001 - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:36.627 4088 3038342144248 MainThread DEBUG nova.virt.hyperv.vmops [req-3386c088-f51b-4f4a-9c8d-ad198e063001 - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:36.640 4088 3038342146184 MainThread DEBUG nova.compute.provider_tree [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:02:36.681 4088 3038342146184 MainThread DEBUG nova.scheduler.client.report [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:02:36.681 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:36.681 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:02:36.681 4088 3038342144248 MainThread DEBUG nova.compute.manager [req-3386c088-f51b-4f4a-9c8d-ad198e063001 - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:36.714 4088 3038342144248 MainThread INFO nova.compute.manager [req-3386c088-f51b-4f4a-9c8d-ad198e063001 - - - - -] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:36.841 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:02:36.841 4088 3038342144248 GreenThread-70 DEBUG nova.compute.manager [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:02:36.841 4088 3038342144248 GreenThread-70 DEBUG nova.network.neutron [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:02:36.950 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-c9b5f3e9-2bbb-4076-a52c-b10587af8d8f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-vif-unplugged-4179be6b-0ba7-4aaa-b9aa-0c37a0c9fab0 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:36.950 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-c9b5f3e9-2bbb-4076-a52c-b10587af8d8f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:36.950 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-c9b5f3e9-2bbb-4076-a52c-b10587af8d8f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:36.950 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-c9b5f3e9-2bbb-4076-a52c-b10587af8d8f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] No waiting events found dispatching network-vif-unplugged-4179be6b-0ba7-4aaa-b9aa-0c37a0c9fab0 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:02:36.950 4088 3038342147592 MainThread WARNING nova.compute.manager [req-c9b5f3e9-2bbb-4076-a52c-b10587af8d8f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received unexpected event network-vif-unplugged-4179be6b-0ba7-4aaa-b9aa-0c37a0c9fab0 for instance with vm_state building and task_state spawning. 2021-09-10 17:02:36.950 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-c9b5f3e9-2bbb-4076-a52c-b10587af8d8f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-vif-unplugged-2cb3a3ea-c0a3-46c3-851e-9241bf8661f1 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:36.950 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-c9b5f3e9-2bbb-4076-a52c-b10587af8d8f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:36.950 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-c9b5f3e9-2bbb-4076-a52c-b10587af8d8f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:36.950 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-c9b5f3e9-2bbb-4076-a52c-b10587af8d8f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] No waiting events found dispatching network-vif-unplugged-2cb3a3ea-c0a3-46c3-851e-9241bf8661f1 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:02:36.950 4088 3038342147592 MainThread WARNING nova.compute.manager [req-c9b5f3e9-2bbb-4076-a52c-b10587af8d8f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received unexpected event network-vif-unplugged-2cb3a3ea-c0a3-46c3-851e-9241bf8661f1 for instance with vm_state building and task_state spawning. 2021-09-10 17:02:36.950 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-c9b5f3e9-2bbb-4076-a52c-b10587af8d8f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-vif-unplugged-86609ec1-a690-46a4-8ef9-4623364e23fe external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:36.950 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-c9b5f3e9-2bbb-4076-a52c-b10587af8d8f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:36.950 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-c9b5f3e9-2bbb-4076-a52c-b10587af8d8f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:36.950 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-c9b5f3e9-2bbb-4076-a52c-b10587af8d8f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] No waiting events found dispatching network-vif-unplugged-86609ec1-a690-46a4-8ef9-4623364e23fe pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:02:36.950 4088 3038342147592 MainThread WARNING nova.compute.manager [req-c9b5f3e9-2bbb-4076-a52c-b10587af8d8f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received unexpected event network-vif-unplugged-86609ec1-a690-46a4-8ef9-4623364e23fe for instance with vm_state building and task_state spawning. 2021-09-10 17:02:37.197 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:02:37.197 4088 3038342146184 MainThread INFO nova.virt.hyperv.vmops [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Spawning new instance 2021-09-10 17:02:37.227 4088 3038342144248 GreenThread-70 DEBUG nova.policy [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a57565d91e984026bfef16cbf8b6f2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e8809b286f4c5aad08911c6a289582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:02:37.227 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Lock "instance-0000004f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:37.227 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Lock "instance-0000004f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:37.227 4088 3038342146184 MainThread DEBUG nova.block_device [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:02:37.227 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:37.227 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:37.244 4088 3038342146184 MainThread DEBUG os_win.utils.pathutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Creating directory: C:\openstack\instances\instance-0000004f check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:02:37.244 4088 3038342146184 MainThread DEBUG nova.virt.hyperv.vmops [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000004f\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:02:37.508 4088 3038342146184 MainThread DEBUG nova.virt.hyperv.vmops [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Resizing VHD C:\openstack\instances\instance-0000004f\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:02:38.781 4088 3038340569048 MainThread DEBUG nova.virt.hyperv.vmops [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:02:38.781 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "instance-00000051" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:38.781 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "instance-00000051" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:38.806 4088 3038340569048 MainThread DEBUG os_win.utils.compute.vmutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Successfully changed vm state of instance-00000051 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:02:38.806 4088 3038340569048 MainThread DEBUG nova.virt.hyperv.vmops [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Successfully changed state of VM instance-00000051 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:02:38.872 4088 3038340569048 MainThread DEBUG os_win.utils.jobutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Waiting for WMI job: {'InstanceID': '8CEE0CC1-2F5F-4EB1-847A-E96540D88C0A', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20309), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:38.994 4088 3038340569048 MainThread DEBUG os_win.utils.jobutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] WMI job succeeded: {'InstanceID': '8CEE0CC1-2F5F-4EB1-847A-E96540D88C0A', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=107865), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:02:38.994 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "instance-00000051" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:38.994 4088 3038340569048 MainThread DEBUG os_win.utils.pathutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Removing directory: C:\openstack\instances\instance-00000051 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:02:38.994 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "instance-00000051" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:38.994 4088 3038340569048 MainThread ERROR nova.compute.manager [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000051' failed to start. Not enough memory in the system to start the virtual machine instance-00000051. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000051' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Not enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) 'instance-00000051' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Error code: 32778. 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Traceback (most recent call last): 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] return function(*args, **kwargs) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] admin_password, network_info, block_device_info) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] return function(self, *args, **kwds) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self.force_reraise() 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] raise self.value 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] should_plug_vifs=False) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 'req_state': req_state}) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self.force_reraise() 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] raise self.value 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] time.sleep(sleep_time) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self.force_reraise() 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] raise self.value 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] return f(*args, **kwargs) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] return self._wait_for_job(job_path) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] error_desc=err_desc) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000051' failed to start. 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Not enough memory in the system to start the virtual machine instance-00000051. 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000051' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Not enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 'instance-00000051' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Error code: 32778. 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] During handling of the above exception, another exception occurred: 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Traceback (most recent call last): 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] yield resources 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] accel_info=accel_info) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] return function(*args, **kwargs) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] admin_password, network_info, block_device_info) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] return function(self, *args, **kwds) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self.force_reraise() 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] raise self.value 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] should_plug_vifs=False) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 'req_state': req_state}) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self.force_reraise() 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] raise self.value 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] time.sleep(sleep_time) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self.force_reraise() 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] raise self.value 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] return f(*args, **kwargs) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] return self._wait_for_job(job_path) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] error_desc=err_desc) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000051' failed to start. 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Not enough memory in the system to start the virtual machine instance-00000051. 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000051' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Not enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 'instance-00000051' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Error code: 32778. 2021-09-10 17:02:38.994 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:38.994 4088 3038340569048 MainThread INFO nova.compute.manager [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Terminating instance 2021-09-10 17:02:38.994 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:02:38.994 4088 3038340569048 MainThread INFO nova.virt.hyperv.vmops [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Got request to destroy instance 2021-09-10 17:02:39.020 4088 3038340569048 MainThread DEBUG nova.virt.hyperv.vmops [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:02:39.020 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "instance-00000051" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:39.020 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "instance-00000051" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:39.020 4088 3038340569048 MainThread INFO nova.compute.manager [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:02:39.020 4088 3038340569048 MainThread DEBUG nova.compute.claims [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:02:39.020 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:39.211 4088 3038340569048 MainThread DEBUG nova.virt.hyperv.hostops [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:02:39.240 4088 3038340569048 MainThread DEBUG nova.virt.hyperv.hostops [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:02:39.479 4088 3038340569048 MainThread DEBUG nova.compute.provider_tree [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:02:39.503 4088 3038340569048 MainThread DEBUG nova.scheduler.client.report [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:02:39.503 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.484s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:39.503 4088 3038340569048 MainThread ERROR nova.compute.manager [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000051' failed to start. Not enough memory in the system to start the virtual machine instance-00000051. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000051' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Not enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) 'instance-00000051' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Error code: 32778. 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Traceback (most recent call last): 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] return function(*args, **kwargs) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] admin_password, network_info, block_device_info) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] return function(self, *args, **kwds) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self.force_reraise() 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] raise self.value 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] should_plug_vifs=False) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 'req_state': req_state}) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self.force_reraise() 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] raise self.value 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] time.sleep(sleep_time) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self.force_reraise() 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] raise self.value 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] return f(*args, **kwargs) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] return self._wait_for_job(job_path) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] error_desc=err_desc) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000051' failed to start. 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Not enough memory in the system to start the virtual machine instance-00000051. 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000051' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Not enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 'instance-00000051' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Error code: 32778. 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] During handling of the above exception, another exception occurred: 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Traceback (most recent call last): 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] accel_info=accel_info) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] return function(*args, **kwargs) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] admin_password, network_info, block_device_info) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] return function(self, *args, **kwds) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self.force_reraise() 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] raise self.value 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] should_plug_vifs=False) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 'req_state': req_state}) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self.force_reraise() 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] raise self.value 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] time.sleep(sleep_time) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self.force_reraise() 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] raise self.value 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] return f(*args, **kwargs) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] return self._wait_for_job(job_path) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] error_desc=err_desc) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000051' failed to start. 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Not enough memory in the system to start the virtual machine instance-00000051. 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000051' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Not enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 'instance-00000051' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Error code: 32778. 2021-09-10 17:02:39.503 4088 3038340569048 MainThread TRACE nova.compute.manager [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] 2021-09-10 17:02:39.503 4088 3038340569048 MainThread DEBUG nova.compute.utils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] WMI job failed with status 10. Error summary description: 'instance-00000051' failed to start. Not enough memory in the system to start the virtual machine instance-00000051. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:02:39.503 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Build of instance c4dcbaf6-eadf-45db-9755-790791af2bf7 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000051' failed to start. Not enough memory in the system to start the virtual machine instance-00000051. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000051' failed to start. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Not enough memory in the system to start the virtual machine instance-00000051 with ram size 1024 megabytes. (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) 'instance-00000051' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 73A15DCA-21FB-49FB-B7F3-D96FD07FDF12) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:02:39.503 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:02:39.503 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:02:39.503 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:02:39.503 4088 3038340569048 MainThread DEBUG nova.network.neutron [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:02:40.123 4088 3038342144248 GreenThread-70 DEBUG nova.network.neutron [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Successfully created port: fa0fabb5-417a-4cb7-91ae-030068cb0be9 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:02:40.399 4088 3038342144952 MainThread DEBUG nova.compute.manager [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-vif-unplugged-960e99f9-c9fe-476e-a025-db2754fea043 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:40.399 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:40.399 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:40.399 4088 3038342144952 MainThread DEBUG nova.compute.manager [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] No waiting events found dispatching network-vif-unplugged-960e99f9-c9fe-476e-a025-db2754fea043 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:02:40.399 4088 3038342144952 MainThread WARNING nova.compute.manager [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received unexpected event network-vif-unplugged-960e99f9-c9fe-476e-a025-db2754fea043 for instance with vm_state building and task_state spawning. 2021-09-10 17:02:40.399 4088 3038342144952 MainThread DEBUG nova.compute.manager [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-vif-unplugged-94855bc3-5116-4b2f-ac7b-9de0d4d7ab82 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:40.399 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:40.399 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:40.399 4088 3038342144952 MainThread DEBUG nova.compute.manager [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] No waiting events found dispatching network-vif-unplugged-94855bc3-5116-4b2f-ac7b-9de0d4d7ab82 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:02:40.399 4088 3038342144952 MainThread WARNING nova.compute.manager [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received unexpected event network-vif-unplugged-94855bc3-5116-4b2f-ac7b-9de0d4d7ab82 for instance with vm_state building and task_state spawning. 2021-09-10 17:02:40.399 4088 3038342144952 MainThread DEBUG nova.compute.manager [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-vif-unplugged-2328bac5-09f9-4dd3-a3ff-1f5673edded4 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:40.399 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:40.399 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:40.399 4088 3038342144952 MainThread DEBUG nova.compute.manager [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] No waiting events found dispatching network-vif-unplugged-2328bac5-09f9-4dd3-a3ff-1f5673edded4 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:02:40.399 4088 3038342144952 MainThread WARNING nova.compute.manager [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received unexpected event network-vif-unplugged-2328bac5-09f9-4dd3-a3ff-1f5673edded4 for instance with vm_state building and task_state spawning. 2021-09-10 17:02:40.399 4088 3038342144952 MainThread DEBUG nova.compute.manager [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received event network-vif-unplugged-ffc6e67e-0a49-4c79-9748-12da98323372 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:40.399 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:40.399 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:40.399 4088 3038342144952 MainThread DEBUG nova.compute.manager [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] No waiting events found dispatching network-vif-unplugged-ffc6e67e-0a49-4c79-9748-12da98323372 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:02:40.415 4088 3038342144952 MainThread WARNING nova.compute.manager [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Received unexpected event network-vif-unplugged-ffc6e67e-0a49-4c79-9748-12da98323372 for instance with vm_state building and task_state spawning. 2021-09-10 17:02:40.415 4088 3038342144952 MainThread DEBUG nova.compute.manager [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Received event network-vif-plugged-c8d5eafd-85a2-4d40-9b87-bdfc843fb561 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:40.415 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "22ce4089-0acb-4f53-bb15-501df1d949ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:40.415 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "22ce4089-0acb-4f53-bb15-501df1d949ed-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:40.415 4088 3038342144952 MainThread DEBUG nova.compute.manager [req-a6b064ff-05e2-4d90-8ae9-39b24d680fd5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Processing event network-vif-plugged-c8d5eafd-85a2-4d40-9b87-bdfc843fb561 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:02:40.461 4088 3038340567640 MainThread INFO nova.virt.hyperv.vmops [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Using config drive for instance 2021-09-10 17:02:40.664 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:02:40.664 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:02:40.664 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:02:41.082 4088 3038340567640 MainThread INFO nova.virt.hyperv.vmops [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Creating config drive at C:\openstack\instances\instance-0000004e\configdrive.iso 2021-09-10 17:02:41.172 4088 3038340567640 MainThread DEBUG oslo_concurrency.processutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000004e\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp2gtj9o9m execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:02:41.349 4088 3038340569048 MainThread DEBUG nova.network.neutron [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:41.379 4088 3038340569048 MainThread INFO nova.compute.manager [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: c4dcbaf6-eadf-45db-9755-790791af2bf7] Took 1.88 seconds to deallocate network for instance. 2021-09-10 17:02:41.495 4088 3038340567640 MainThread DEBUG oslo_concurrency.processutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000004e\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp2gtj9o9m" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:02:41.539 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:02:41.676 4088 3038340569048 MainThread INFO nova.scheduler.client.report [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Deleted allocations for instance c4dcbaf6-eadf-45db-9755-790791af2bf7 2021-09-10 17:02:41.729 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-21856b11-64e3-4027-a64e-15120ccd3f25 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "c4dcbaf6-eadf-45db-9755-790791af2bf7" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 28.765s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:42.139 4088 3038340567640 MainThread DEBUG nova.virt.hyperv.vmops [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Setting boot order for instance: instance-0000004e: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:02:42.242 4088 3038340567640 MainThread DEBUG nova.virt.hyperv.vmops [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:02:42.277 4088 3038340567640 MainThread DEBUG os_win.utils.jobutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '6AA80CC9-DB6B-42C8-A8B5-45E2042ABEA1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20760), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:42.478 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:42.478 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:42.478 4088 3038340569048 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:42.507 4088 3038340569048 MainThread INFO nova.compute.manager [-] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] VM Stopped (Lifecycle Event) 2021-09-10 17:02:42.520 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-58f269a8-d95e-4d97-9b4a-46fae684ee79 - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:42.520 4088 3038340569048 MainThread DEBUG nova.virt.hyperv.vmops [req-58f269a8-d95e-4d97-9b4a-46fae684ee79 - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:42.539 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:02:42.557 4088 3038340567640 MainThread ERROR os_win.utils.jobutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004e\' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)instance-0000004e0CD079D7-8B1C-4DB8-8F21-E4122129787A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)instance-0000004e0CD079D7-8B1C-4DB8-8F21-E4122129787A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)instance-0000004e0CD079D7-8B1C-4DB8-8F21-E4122129787A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6AA80CC9-DB6B-42C8-A8B5-45E2042ABEA1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=128191), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 42), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 42), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004e' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)\n\nNot enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)\n\n'instance-0000004e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)", 'ErrorSummaryDescription': "'instance-0000004e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:42.557 4088 3038340567640 MainThread DEBUG os_win._utils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004e' failed to start. Not enough memory in the system to start the virtual machine instance-0000004e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004e' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Not enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) 'instance-0000004e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.31522512435913086 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:42.586 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-58f269a8-d95e-4d97-9b4a-46fae684ee79 - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:42.667 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:02:42.667 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:02:42.734 4088 3038340569048 MainThread INFO nova.compute.manager [req-58f269a8-d95e-4d97-9b4a-46fae684ee79 - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:43.165 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-50586591-86ba-41be-b4e1-5004ea0d76dd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:02:43.165 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:02:43.596 4088 3038340567640 MainThread DEBUG os_win.utils.jobutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': 'F16DE91B-86B9-42D0-9DAE-1C485AEFA9F6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17743), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:43.666 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "84fb0901-77a9-482c-9355-34416b3289cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:43.687 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:02:43.744 4088 3038340567640 MainThread ERROR os_win.utils.jobutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004e\' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)instance-0000004e0CD079D7-8B1C-4DB8-8F21-E4122129787A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)instance-0000004e0CD079D7-8B1C-4DB8-8F21-E4122129787A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)instance-0000004e0CD079D7-8B1C-4DB8-8F21-E4122129787A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'F16DE91B-86B9-42D0-9DAE-1C485AEFA9F6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=127943), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 43), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 43), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004e' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)\n\nNot enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)\n\n'instance-0000004e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)", 'ErrorSummaryDescription': "'instance-0000004e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:43.759 4088 3038340567640 MainThread DEBUG os_win._utils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004e' failed to start. Not enough memory in the system to start the virtual machine instance-0000004e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004e' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Not enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) 'instance-0000004e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.5169498920440674 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:43.791 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:43.791 4088 3038342147768 MainThread DEBUG nova.virt.hardware [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:02:43.791 4088 3038342147768 MainThread INFO nova.compute.claims [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Claim successful on node n-h2-808474-1 2021-09-10 17:02:43.817 4088 3038342144072 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:43.817 4088 3038342144072 MainThread INFO nova.compute.manager [-] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] VM Stopped (Lifecycle Event) 2021-09-10 17:02:43.817 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:43.817 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:43.838 4088 3038342144072 MainThread DEBUG nova.compute.manager [req-044fc9a5-559a-47c5-abc6-fd4d7f2eaa34 - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:43.838 4088 3038342144072 MainThread DEBUG nova.virt.hyperv.vmops [req-044fc9a5-559a-47c5-abc6-fd4d7f2eaa34 - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:43.916 4088 3038342144072 MainThread DEBUG nova.compute.manager [req-044fc9a5-559a-47c5-abc6-fd4d7f2eaa34 - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:43.979 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.hostops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:02:43.992 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.hostops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:02:44.010 4088 3038342144072 MainThread INFO nova.compute.manager [req-044fc9a5-559a-47c5-abc6-fd4d7f2eaa34 - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:44.211 4088 3038342144248 GreenThread-70 DEBUG nova.network.neutron [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Successfully updated port: fa0fabb5-417a-4cb7-91ae-030068cb0be9 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:02:44.228 4088 3038342144248 GreenThread-70 DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Acquired lock "refresh_cache-30a2e0f5-74d7-453d-ad6a-628ef91e6d39" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:02:44.228 4088 3038342144248 GreenThread-70 DEBUG nova.network.neutron [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:02:44.243 4088 3038342147768 MainThread DEBUG nova.compute.provider_tree [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:02:44.260 4088 3038342147768 MainThread DEBUG nova.scheduler.client.report [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:02:44.260 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:44.260 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:02:44.336 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:02:44.362 4088 3038342144072 GreenThread-71 DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:02:44.362 4088 3038342144072 GreenThread-71 DEBUG nova.network.neutron [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:02:44.539 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:02:44.561 4088 3038342147768 MainThread INFO nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Spawning new instance 2021-09-10 17:02:44.573 4088 3038342144248 GreenThread-70 DEBUG nova.network.neutron [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:02:44.587 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-00000052" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:44.587 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-00000052" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:44.587 4088 3038342147768 MainThread DEBUG nova.block_device [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:02:44.587 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:44.587 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:44.609 4088 3038342147768 MainThread DEBUG os_win.utils.pathutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Creating directory: C:\openstack\instances\instance-00000052 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:02:44.609 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000052\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:02:44.791 4088 3038340567640 MainThread DEBUG os_win.utils.jobutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '057030EA-2942-448E-ADBC-DF8E809E132F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19107), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:44.900 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Resizing VHD C:\openstack\instances\instance-00000052\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:02:44.947 4088 3038340567640 MainThread ERROR os_win.utils.jobutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004e\' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)instance-0000004e0CD079D7-8B1C-4DB8-8F21-E4122129787A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)instance-0000004e0CD079D7-8B1C-4DB8-8F21-E4122129787A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)instance-0000004e0CD079D7-8B1C-4DB8-8F21-E4122129787A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '057030EA-2942-448E-ADBC-DF8E809E132F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117048), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 44), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 44), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004e' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)\n\nNot enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)\n\n'instance-0000004e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)", 'ErrorSummaryDescription': "'instance-0000004e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:44.947 4088 3038340567640 MainThread DEBUG os_win._utils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004e' failed to start. Not enough memory in the system to start the virtual machine instance-0000004e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004e' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Not enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) 'instance-0000004e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.704904079437256 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:44.962 4088 3038342144424 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:44.962 4088 3038342144424 MainThread INFO nova.compute.manager [-] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] VM Stopped (Lifecycle Event) 2021-09-10 17:02:44.978 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:44.978 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:45.008 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-c884bca0-b120-4650-8ce2-9234ce088a06 - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:45.008 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.vmops [req-c884bca0-b120-4650-8ce2-9234ce088a06 - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:45.043 4088 3038342144072 GreenThread-71 DEBUG nova.policy [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b207fe385eb647a4acf0331024dcf245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a75e521b5f4d89ab74f2701a36da12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:02:45.164 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-c884bca0-b120-4650-8ce2-9234ce088a06 - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:45.200 4088 3038342144424 MainThread INFO nova.compute.manager [req-c884bca0-b120-4650-8ce2-9234ce088a06 - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:45.337 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-f82d1023-d87a-4bea-8349-2c315bf24280 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Received event network-vif-deleted-c85f831d-3308-4358-afc7-f73a1171d746 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:45.404 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-14adc986-2a82-4b8b-8119-e1d5a737d5e8 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Received event network-changed-fa0fabb5-417a-4cb7-91ae-030068cb0be9 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:45.404 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-14adc986-2a82-4b8b-8119-e1d5a737d5e8 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Refreshing instance network info cache due to event network-changed-fa0fabb5-417a-4cb7-91ae-030068cb0be9. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:02:45.932 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Updating instance_info_cache with network_info: [{"id": "ad57189e-6845-4bd3-a7d1-681004b754a9", "address": "fa:16:3e:7f:ee:91", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapad57189e-68", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:45.962 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-50586591-86ba-41be-b4e1-5004ea0d76dd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:02:45.962 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:02:45.962 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:02:45.962 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:02:45.962 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:02:45.982 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:02:45.982 4088 3038340567640 MainThread DEBUG os_win.utils.jobutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '6EF1CD51-6EBE-4000-8AF2-1776BF0BBC55', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17667), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:46.145 4088 3038340567640 MainThread ERROR os_win.utils.jobutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004e\' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)instance-0000004e0CD079D7-8B1C-4DB8-8F21-E4122129787A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)instance-0000004e0CD079D7-8B1C-4DB8-8F21-E4122129787A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)instance-0000004e0CD079D7-8B1C-4DB8-8F21-E4122129787A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6EF1CD51-6EBE-4000-8AF2-1776BF0BBC55', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118996), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 45), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 46), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004e' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)\n\nNot enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)\n\n'instance-0000004e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)", 'ErrorSummaryDescription': "'instance-0000004e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:46.145 4088 3038340567640 MainThread DEBUG os_win._utils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004e' failed to start. Not enough memory in the system to start the virtual machine instance-0000004e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004e' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Not enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) 'instance-0000004e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.902794122695923 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:46.171 4088 3038342144248 GreenThread-70 DEBUG nova.network.neutron [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Updating instance_info_cache with network_info: [{"id": "fa0fabb5-417a-4cb7-91ae-030068cb0be9", "address": "fa:16:3e:aa:90:a2", "network": {"id": "a63611d6-d78b-4c79-b9d9-a82ebe7f3184", "bridge": null, "label": "tempest-ServersNegativeTestMultiTenantJSON-1395225850-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "57e8809b286f4c5aad08911c6a289582", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfa0fabb5-41", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:46.188 4088 3038340569048 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:46.188 4088 3038340569048 MainThread INFO nova.compute.manager [-] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] VM Stopped (Lifecycle Event) 2021-09-10 17:02:46.188 4088 3038342146536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:46.188 4088 3038342146536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:46.203 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-697ecf42-a04f-4ab5-b747-108871d71abd - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:46.203 4088 3038340569048 MainThread DEBUG nova.virt.hyperv.vmops [req-697ecf42-a04f-4ab5-b747-108871d71abd - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:46.220 4088 3038342144248 GreenThread-70 DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Releasing lock "refresh_cache-30a2e0f5-74d7-453d-ad6a-628ef91e6d39" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:02:46.220 4088 3038342144248 GreenThread-70 DEBUG nova.compute.manager [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Instance network_info: |[{"id": "fa0fabb5-417a-4cb7-91ae-030068cb0be9", "address": "fa:16:3e:aa:90:a2", "network": {"id": "a63611d6-d78b-4c79-b9d9-a82ebe7f3184", "bridge": null, "label": "tempest-ServersNegativeTestMultiTenantJSON-1395225850-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "57e8809b286f4c5aad08911c6a289582", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfa0fabb5-41", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:02:46.220 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Preparing to wait for external event network-vif-plugged-fa0fabb5-417a-4cb7-91ae-030068cb0be9 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:02:46.220 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Lock "30a2e0f5-74d7-453d-ad6a-628ef91e6d39-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:46.220 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Lock "30a2e0f5-74d7-453d-ad6a-628ef91e6d39-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:46.220 4088 3038342146184 MainThread DEBUG os_win.utils.compute.vmutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Creating VM instance-0000004f create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:02:46.220 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-14adc986-2a82-4b8b-8119-e1d5a737d5e8 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-30a2e0f5-74d7-453d-ad6a-628ef91e6d39" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:02:46.220 4088 3038342144600 MainThread DEBUG nova.network.neutron [req-14adc986-2a82-4b8b-8119-e1d5a737d5e8 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Refreshing network info cache for port fa0fabb5-417a-4cb7-91ae-030068cb0be9 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:02:46.278 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-697ecf42-a04f-4ab5-b747-108871d71abd - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:46.278 4088 3038340569048 MainThread INFO nova.compute.manager [req-697ecf42-a04f-4ab5-b747-108871d71abd - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:47.088 4088 3038342144072 GreenThread-71 DEBUG nova.network.neutron [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Successfully created port: 2159a11e-c2c4-44e9-9b93-151986521771 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:02:47.168 4088 3038340567640 MainThread DEBUG os_win.utils.jobutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '7E67083B-2A03-40B2-AF95-6E9DCE612810', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18247), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:47.317 4088 3038337404776 MainThread DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "8001e033-b435-408f-a338-cd26132a7cc1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:47.317 4088 3038340567640 MainThread ERROR os_win.utils.jobutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004e\' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)instance-0000004e0CD079D7-8B1C-4DB8-8F21-E4122129787A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)instance-0000004e0CD079D7-8B1C-4DB8-8F21-E4122129787A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)instance-0000004e0CD079D7-8B1C-4DB8-8F21-E4122129787A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7E67083B-2A03-40B2-AF95-6E9DCE612810', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116989), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 47), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 47), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004e' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)\n\nNot enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)\n\n'instance-0000004e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)", 'ErrorSummaryDescription': "'instance-0000004e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:47.317 4088 3038340567640 MainThread DEBUG os_win._utils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004e' failed to start. Not enough memory in the system to start the virtual machine instance-0000004e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004e' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Not enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) 'instance-0000004e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.074556112289429 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:47.336 4088 3038337404776 MainThread DEBUG nova.compute.manager [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:02:47.482 4088 3038337404776 MainThread DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:47.482 4088 3038337404776 MainThread DEBUG nova.virt.hardware [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:02:47.482 4088 3038337404776 MainThread INFO nova.compute.claims [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Claim successful on node n-h2-808474-1 2021-09-10 17:02:47.630 4088 3038337404776 MainThread DEBUG nova.virt.hyperv.hostops [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:02:47.660 4088 3038337404776 MainThread DEBUG nova.virt.hyperv.hostops [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:02:47.963 4088 3038337404776 MainThread DEBUG nova.compute.provider_tree [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:02:47.963 4088 3038337404776 MainThread DEBUG nova.scheduler.client.report [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:02:47.963 4088 3038337404776 MainThread DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:47.963 4088 3038337404776 MainThread DEBUG nova.compute.manager [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:02:48.067 4088 3038337404776 MainThread DEBUG nova.compute.manager [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:02:48.083 4088 3038340569048 GreenThread-72 DEBUG nova.compute.manager [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:02:48.083 4088 3038340569048 GreenThread-72 DEBUG nova.network.neutron [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:02:48.119 4088 3038342146184 MainThread DEBUG nova.virt.hyperv.vmops [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:02:48.211 4088 3038337404776 MainThread DEBUG nova.compute.manager [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:02:48.242 4088 3038337404776 MainThread INFO nova.virt.hyperv.vmops [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Spawning new instance 2021-09-10 17:02:48.242 4088 3038337404776 MainThread DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "instance-00000050" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:48.242 4088 3038337404776 MainThread DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "instance-00000050" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:48.242 4088 3038337404776 MainThread DEBUG nova.block_device [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:02:48.242 4088 3038337404776 MainThread DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:48.242 4088 3038337404776 MainThread DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:48.266 4088 3038337404776 MainThread DEBUG os_win.utils.pathutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Creating directory: C:\openstack\instances\instance-00000050 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:02:48.266 4088 3038337404776 MainThread DEBUG nova.virt.hyperv.vmops [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000050\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:02:48.337 4088 3038340567640 MainThread DEBUG os_win.utils.jobutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '7037AA42-A811-41C6-9757-B9371464250F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19272), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:48.492 4088 3038340567640 MainThread ERROR os_win.utils.jobutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004e\' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)instance-0000004e0CD079D7-8B1C-4DB8-8F21-E4122129787A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)instance-0000004e0CD079D7-8B1C-4DB8-8F21-E4122129787A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)instance-0000004e0CD079D7-8B1C-4DB8-8F21-E4122129787A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7037AA42-A811-41C6-9757-B9371464250F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119393), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 48), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 48), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004e' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)\n\nNot enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)\n\n'instance-0000004e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A)", 'ErrorSummaryDescription': "'instance-0000004e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:48.492 4088 3038340567640 MainThread ERROR nova.virt.hyperv.vmops [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Failed to change vm state of instance-0000004e to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000004e' failed to start. 2021-09-10 17:02:48.492 4088 3038340567640 MainThread INFO nova.virt.hyperv.vmops [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Got request to destroy instance 2021-09-10 17:02:48.511 4088 3038337404776 MainThread DEBUG nova.virt.hyperv.vmops [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Resizing VHD C:\openstack\instances\instance-00000050\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:02:48.534 4088 3038337403896 MainThread INFO nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Took 14.58 seconds to detach 3 volumes for instance. 2021-09-10 17:02:48.534 4088 3038337403896 MainThread DEBUG nova.compute.claims [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:02:48.534 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:48.539 4088 3038340568168 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:48.539 4088 3038340568168 MainThread INFO nova.compute.manager [-] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] VM Stopped (Lifecycle Event) 2021-09-10 17:02:48.539 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:48.539 4088 3038337402136 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:48.558 4088 3038340568168 MainThread DEBUG nova.compute.manager [req-41001b96-8619-4386-ab09-66df35ccf743 - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:48.558 4088 3038340568168 MainThread DEBUG nova.virt.hyperv.vmops [req-41001b96-8619-4386-ab09-66df35ccf743 - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:48.596 4088 3038340569048 GreenThread-72 DEBUG nova.policy [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0063b05acec342499daf8129dc0ca365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d6026a33839407f9f68cb295fbb6928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:02:48.651 4088 3038340568168 MainThread DEBUG nova.compute.manager [req-41001b96-8619-4386-ab09-66df35ccf743 - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:48.664 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.hostops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:02:48.664 4088 3038340568168 MainThread INFO nova.compute.manager [req-41001b96-8619-4386-ab09-66df35ccf743 - - - - -] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:48.664 4088 3038342144600 MainThread DEBUG nova.network.neutron [req-14adc986-2a82-4b8b-8119-e1d5a737d5e8 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Updated VIF entry in instance network info cache for port fa0fabb5-417a-4cb7-91ae-030068cb0be9. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:02:48.664 4088 3038342144600 MainThread DEBUG nova.network.neutron [req-14adc986-2a82-4b8b-8119-e1d5a737d5e8 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Updating instance_info_cache with network_info: [{"id": "fa0fabb5-417a-4cb7-91ae-030068cb0be9", "address": "fa:16:3e:aa:90:a2", "network": {"id": "a63611d6-d78b-4c79-b9d9-a82ebe7f3184", "bridge": null, "label": "tempest-ServersNegativeTestMultiTenantJSON-1395225850-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "57e8809b286f4c5aad08911c6a289582", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfa0fabb5-41", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:48.687 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.hostops [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:02:48.742 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-14adc986-2a82-4b8b-8119-e1d5a737d5e8 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-30a2e0f5-74d7-453d-ad6a-628ef91e6d39" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:02:48.820 4088 3038340568168 MainThread DEBUG nova.compute.manager [req-895f4eb7-e7fe-45e4-ab99-facc9a287f36 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Received event network-vif-deleted-5e9b878b-5ea4-4417-8d82-1b3ad6490c23 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:48.935 4088 3038342144072 GreenThread-71 DEBUG nova.network.neutron [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Successfully updated port: 2159a11e-c2c4-44e9-9b93-151986521771 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:02:48.956 4088 3038342144072 GreenThread-71 DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Acquired lock "refresh_cache-84fb0901-77a9-482c-9355-34416b3289cb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:02:48.956 4088 3038342144072 GreenThread-71 DEBUG nova.network.neutron [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:02:48.984 4088 3038337403896 MainThread DEBUG nova.compute.provider_tree [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:02:49.005 4088 3038337403896 MainThread DEBUG nova.scheduler.client.report [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:02:49.009 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.468s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:49.009 4088 3038337403896 MainThread ERROR nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003f' failed to start. Not enough memory in the system to start the virtual machine instance-0000003f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003f' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Not enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) 'instance-0000003f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Error code: 32778. 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Traceback (most recent call last): 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] return function(*args, **kwargs) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] admin_password, network_info, block_device_info) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] return function(self, *args, **kwds) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self.force_reraise() 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] raise self.value 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] should_plug_vifs=False) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 'req_state': req_state}) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self.force_reraise() 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] raise self.value 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] time.sleep(sleep_time) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self.force_reraise() 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] raise self.value 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] return f(*args, **kwargs) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] return self._wait_for_job(job_path) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] error_desc=err_desc) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000003f' failed to start. 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Not enough memory in the system to start the virtual machine instance-0000003f. 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003f' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Not enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 'instance-0000003f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Error code: 32778. 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] During handling of the above exception, another exception occurred: 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Traceback (most recent call last): 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] accel_info=accel_info) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] return function(*args, **kwargs) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] admin_password, network_info, block_device_info) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] return function(self, *args, **kwds) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self.force_reraise() 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] raise self.value 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] should_plug_vifs=False) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 'req_state': req_state}) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self.force_reraise() 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] raise self.value 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] time.sleep(sleep_time) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self.force_reraise() 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] raise self.value 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] return f(*args, **kwargs) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] return self._wait_for_job(job_path) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] error_desc=err_desc) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000003f' failed to start. 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Not enough memory in the system to start the virtual machine instance-0000003f. 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003f' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Not enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 'instance-0000003f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Error code: 32778. 2021-09-10 17:02:49.009 4088 3038337403896 MainThread TRACE nova.compute.manager [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] 2021-09-10 17:02:49.009 4088 3038337403896 MainThread DEBUG nova.compute.utils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] WMI job failed with status 10. Error summary description: 'instance-0000003f' failed to start. Not enough memory in the system to start the virtual machine instance-0000003f. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:02:49.009 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Build of instance d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000003f' failed to start. Not enough memory in the system to start the virtual machine instance-0000003f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000003f' failed to start. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Not enough memory in the system to start the virtual machine instance-0000003f with ram size 1024 megabytes. (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) 'instance-0000003f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F0DD020A-9530-47CC-A2E8-E20CD37D12AF) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:02:49.009 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:02:49.009 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:02:49.009 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:02:49.009 4088 3038337403896 MainThread DEBUG nova.network.neutron [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:02:49.156 4088 3038342144072 GreenThread-71 DEBUG nova.network.neutron [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:02:49.977 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "02a3f851-fc39-4889-aaff-e5a3385f19c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:50.019 4088 3038342144072 GreenThread-71 DEBUG nova.network.neutron [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Updating instance_info_cache with network_info: [{"id": "2159a11e-c2c4-44e9-9b93-151986521771", "address": "fa:16:3e:e7:fc:5d", "network": {"id": "c9c0a28f-d537-4eed-ab4c-79d1152a1146", "bridge": null, "label": "tempest-MultipleCreateTestJSON-430554862-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "00a75e521b5f4d89ab74f2701a36da12", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2159a11e-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:50.039 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:02:50.055 4088 3038342144072 GreenThread-71 DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Releasing lock "refresh_cache-84fb0901-77a9-482c-9355-34416b3289cb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:02:50.055 4088 3038342144072 GreenThread-71 DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Instance network_info: |[{"id": "2159a11e-c2c4-44e9-9b93-151986521771", "address": "fa:16:3e:e7:fc:5d", "network": {"id": "c9c0a28f-d537-4eed-ab4c-79d1152a1146", "bridge": null, "label": "tempest-MultipleCreateTestJSON-430554862-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "00a75e521b5f4d89ab74f2701a36da12", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2159a11e-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:02:50.055 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Preparing to wait for external event network-vif-plugged-2159a11e-c2c4-44e9-9b93-151986521771 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:02:50.055 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "84fb0901-77a9-482c-9355-34416b3289cb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:50.055 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "84fb0901-77a9-482c-9355-34416b3289cb-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:50.055 4088 3038342147768 MainThread DEBUG os_win.utils.compute.vmutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Creating VM instance-00000052 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:02:50.179 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:50.203 4088 3038337403192 MainThread DEBUG nova.virt.hardware [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:02:50.203 4088 3038337403192 MainThread INFO nova.compute.claims [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Claim successful on node n-h2-808474-1 2021-09-10 17:02:50.354 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.hostops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:02:50.383 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.hostops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:02:50.383 4088 3038340569048 GreenThread-72 DEBUG nova.network.neutron [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Successfully created port: b0d9b2b9-06aa-4c7d-873d-810803c7a5cb _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:02:50.539 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:02:50.742 4088 3038340567640 MainThread DEBUG nova.virt.hyperv.vmops [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:02:50.742 4088 3038340567640 MainThread DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000004e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:50.742 4088 3038340567640 MainThread DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000004e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:50.742 4088 3038337403192 MainThread DEBUG nova.compute.provider_tree [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:02:50.759 4088 3038340567640 MainThread DEBUG os_win.utils.compute.vmutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Successfully changed vm state of instance-0000004e to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:02:50.759 4088 3038340567640 MainThread DEBUG nova.virt.hyperv.vmops [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Successfully changed state of VM instance-0000004e to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:02:50.759 4088 3038337403192 MainThread DEBUG nova.scheduler.client.report [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:02:50.759 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:50.759 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:02:50.780 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.219s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:50.780 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:50.780 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:02:50.780 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:02:50.790 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:02:50.821 4088 3038340567640 MainThread DEBUG os_win.utils.jobutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '7D1B49C0-5C92-455E-A177-AA14793E08E6', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16691), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:50.851 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:02:50.851 4088 3038342145480 GreenThread-73 DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:02:50.851 4088 3038342145480 GreenThread-73 DEBUG nova.network.neutron [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:02:50.951 4088 3038340567640 MainThread DEBUG os_win.utils.jobutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job succeeded: {'InstanceID': '7D1B49C0-5C92-455E-A177-AA14793E08E6', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=104762), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:02:50.951 4088 3038340567640 MainThread DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000004e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:50.951 4088 3038340567640 MainThread DEBUG os_win.utils.pathutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Removing directory: C:\openstack\instances\instance-0000004e check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:02:50.951 4088 3038340567640 MainThread DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000004e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:50.951 4088 3038340567640 MainThread ERROR nova.compute.manager [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004e' failed to start. Not enough memory in the system to start the virtual machine instance-0000004e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004e' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Not enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) 'instance-0000004e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Error code: 32778. 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Traceback (most recent call last): 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] return function(*args, **kwargs) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] admin_password, network_info, block_device_info) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] return function(self, *args, **kwds) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self.force_reraise() 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] raise self.value 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] should_plug_vifs=False) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 'req_state': req_state}) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self.force_reraise() 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] raise self.value 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] time.sleep(sleep_time) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self.force_reraise() 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] raise self.value 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] return f(*args, **kwargs) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] return self._wait_for_job(job_path) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] error_desc=err_desc) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000004e' failed to start. 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Not enough memory in the system to start the virtual machine instance-0000004e. 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004e' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Not enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 'instance-0000004e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Error code: 32778. 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] During handling of the above exception, another exception occurred: 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Traceback (most recent call last): 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] yield resources 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] accel_info=accel_info) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] return function(*args, **kwargs) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] admin_password, network_info, block_device_info) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] return function(self, *args, **kwds) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self.force_reraise() 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] raise self.value 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] should_plug_vifs=False) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 'req_state': req_state}) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self.force_reraise() 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] raise self.value 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] time.sleep(sleep_time) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self.force_reraise() 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] raise self.value 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] return f(*args, **kwargs) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] return self._wait_for_job(job_path) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] error_desc=err_desc) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004e' failed to start. 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Not enough memory in the system to start the virtual machine instance-0000004e. 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004e' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Not enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 'instance-0000004e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Error code: 32778. 2021-09-10 17:02:50.951 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:50.951 4088 3038340567640 MainThread INFO nova.compute.manager [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Terminating instance 2021-09-10 17:02:50.967 4088 3038340567640 MainThread DEBUG nova.compute.manager [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:02:50.967 4088 3038340567640 MainThread INFO nova.virt.hyperv.vmops [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Got request to destroy instance 2021-09-10 17:02:51.039 4088 3038342145480 GreenThread-73 DEBUG nova.policy [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b207fe385eb647a4acf0331024dcf245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a75e521b5f4d89ab74f2701a36da12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:02:51.055 4088 3038340567640 MainThread DEBUG nova.virt.hyperv.vmops [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:02:51.055 4088 3038340567640 MainThread DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000004e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:51.055 4088 3038340567640 MainThread DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000004e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:51.055 4088 3038340567640 MainThread INFO nova.compute.manager [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Took 0.09 seconds to destroy the instance on the hypervisor. 2021-09-10 17:02:51.055 4088 3038340567640 MainThread DEBUG nova.compute.claims [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:02:51.055 4088 3038340567640 MainThread DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:51.071 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:02:51.102 4088 3038337403192 MainThread INFO nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Spawning new instance 2021-09-10 17:02:51.117 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2127MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:02:51.117 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-00000053" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:51.117 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-00000053" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:51.117 4088 3038337403192 MainThread DEBUG nova.block_device [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:02:51.117 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:51.117 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:51.135 4088 3038337403192 MainThread DEBUG os_win.utils.pathutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Creating directory: C:\openstack\instances\instance-00000053 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:02:51.135 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000053\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:02:51.227 4088 3038340567640 MainThread DEBUG nova.virt.hyperv.hostops [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:02:51.227 4088 3038340567640 MainThread DEBUG nova.virt.hyperv.hostops [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:02:51.259 4088 3038337401784 MainThread DEBUG nova.compute.manager [req-b3ebc804-3d36-46c4-a06f-390d19888b4e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Received event network-changed-2159a11e-c2c4-44e9-9b93-151986521771 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:51.259 4088 3038337401784 MainThread DEBUG nova.compute.manager [req-b3ebc804-3d36-46c4-a06f-390d19888b4e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Refreshing instance network info cache due to event network-changed-2159a11e-c2c4-44e9-9b93-151986521771. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:02:51.259 4088 3038337401784 MainThread DEBUG oslo_concurrency.lockutils [req-b3ebc804-3d36-46c4-a06f-390d19888b4e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-84fb0901-77a9-482c-9355-34416b3289cb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:02:51.259 4088 3038337401784 MainThread DEBUG nova.network.neutron [req-b3ebc804-3d36-46c4-a06f-390d19888b4e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Refreshing network info cache for port 2159a11e-c2c4-44e9-9b93-151986521771 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:02:51.383 4088 3038337400904 MainThread DEBUG nova.compute.manager [req-0e54ab9c-1b14-4f0d-b624-4278dd8f5582 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Received event network-vif-deleted-b166f44b-43d3-4457-b778-4531693659ec external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:51.445 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Resizing VHD C:\openstack\instances\instance-00000053\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:02:51.524 4088 3038340567640 MainThread DEBUG nova.compute.provider_tree [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:02:51.543 4088 3038340567640 MainThread DEBUG nova.scheduler.client.report [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:02:51.543 4088 3038340567640 MainThread DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.485s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:51.543 4088 3038340567640 MainThread ERROR nova.compute.manager [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004e' failed to start. Not enough memory in the system to start the virtual machine instance-0000004e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004e' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Not enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) 'instance-0000004e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Error code: 32778. 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Traceback (most recent call last): 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] return function(*args, **kwargs) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] admin_password, network_info, block_device_info) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] return function(self, *args, **kwds) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self.force_reraise() 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] raise self.value 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] should_plug_vifs=False) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 'req_state': req_state}) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self.force_reraise() 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] raise self.value 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] time.sleep(sleep_time) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self.force_reraise() 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] raise self.value 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] return f(*args, **kwargs) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] return self._wait_for_job(job_path) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] error_desc=err_desc) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000004e' failed to start. 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Not enough memory in the system to start the virtual machine instance-0000004e. 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004e' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Not enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 'instance-0000004e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Error code: 32778. 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] During handling of the above exception, another exception occurred: 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Traceback (most recent call last): 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] accel_info=accel_info) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] return function(*args, **kwargs) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] admin_password, network_info, block_device_info) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] return function(self, *args, **kwds) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self.force_reraise() 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] raise self.value 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] should_plug_vifs=False) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 'req_state': req_state}) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self.force_reraise() 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] raise self.value 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] time.sleep(sleep_time) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self.force_reraise() 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] raise self.value 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] return f(*args, **kwargs) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] return self._wait_for_job(job_path) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] error_desc=err_desc) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004e' failed to start. 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Not enough memory in the system to start the virtual machine instance-0000004e. 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004e' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Not enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 'instance-0000004e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Error code: 32778. 2021-09-10 17:02:51.543 4088 3038340567640 MainThread TRACE nova.compute.manager [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] 2021-09-10 17:02:51.543 4088 3038340567640 MainThread DEBUG nova.compute.utils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] WMI job failed with status 10. Error summary description: 'instance-0000004e' failed to start. Not enough memory in the system to start the virtual machine instance-0000004e. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:02:51.543 4088 3038340567640 MainThread DEBUG nova.compute.manager [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Build of instance 22ce4089-0acb-4f53-bb15-501df1d949ed was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000004e' failed to start. Not enough memory in the system to start the virtual machine instance-0000004e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004e' failed to start. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Not enough memory in the system to start the virtual machine instance-0000004e with ram size 1024 megabytes. (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) 'instance-0000004e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0CD079D7-8B1C-4DB8-8F21-E4122129787A) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:02:51.543 4088 3038340567640 MainThread DEBUG nova.compute.manager [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:02:51.543 4088 3038340567640 MainThread DEBUG nova.compute.manager [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:02:51.543 4088 3038340567640 MainThread DEBUG nova.compute.manager [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:02:51.543 4088 3038340567640 MainThread DEBUG nova.network.neutron [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:02:51.563 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.437s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:51.741 4088 3038340569048 GreenThread-72 DEBUG nova.network.neutron [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Successfully updated port: b0d9b2b9-06aa-4c7d-873d-810803c7a5cb _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:02:51.775 4088 3038340569048 GreenThread-72 DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Acquired lock "refresh_cache-8001e033-b435-408f-a338-cd26132a7cc1" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:02:51.775 4088 3038340569048 GreenThread-72 DEBUG nova.network.neutron [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:02:51.804 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:02:51.804 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:02:51.804 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:02:51.804 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:02:51.804 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:02:51.804 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:02:51.804 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:02:51.804 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:02:51.804 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:02:51.804 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:02:51.804 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:02:51.804 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:02:51.804 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:02:51.836 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1591 2021-09-10 17:02:51.855 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 22ce4089-0acb-4f53-bb15-501df1d949ed has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1591 2021-09-10 17:02:51.855 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 30a2e0f5-74d7-453d-ad6a-628ef91e6d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:02:51.855 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 84fb0901-77a9-482c-9355-34416b3289cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:02:51.855 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 8001e033-b435-408f-a338-cd26132a7cc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:02:51.855 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 02a3f851-fc39-4889-aaff-e5a3385f19c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:02:51.855 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 17 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:02:51.855 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=17920MB phys_disk=79GB used_disk=17GB total_vcpus=6 used_vcpus=17 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:02:51.914 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:02:51.932 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:02:51.932 4088 3038340569048 GreenThread-72 DEBUG nova.network.neutron [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:02:52.230 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:02:52.230 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:02:52.260 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:02:52.260 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:02:52.260 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.703s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:52.260 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:02:52.952 4088 3038340569048 GreenThread-72 DEBUG nova.network.neutron [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Updating instance_info_cache with network_info: [{"id": "b0d9b2b9-06aa-4c7d-873d-810803c7a5cb", "address": "fa:16:3e:3c:03:40", "network": {"id": "7381cc3b-ab27-4454-8a5b-95f2bef2e954", "bridge": null, "label": "tempest-ServerRescueNegativeTestJSON-1471687160-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5d6026a33839407f9f68cb295fbb6928", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapb0d9b2b9-06", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:52.982 4088 3038340569048 GreenThread-72 DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Releasing lock "refresh_cache-8001e033-b435-408f-a338-cd26132a7cc1" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:02:52.982 4088 3038340569048 GreenThread-72 DEBUG nova.compute.manager [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Instance network_info: |[{"id": "b0d9b2b9-06aa-4c7d-873d-810803c7a5cb", "address": "fa:16:3e:3c:03:40", "network": {"id": "7381cc3b-ab27-4454-8a5b-95f2bef2e954", "bridge": null, "label": "tempest-ServerRescueNegativeTestJSON-1471687160-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5d6026a33839407f9f68cb295fbb6928", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapb0d9b2b9-06", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:02:52.982 4088 3038337404776 MainThread DEBUG nova.compute.manager [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Preparing to wait for external event network-vif-plugged-b0d9b2b9-06aa-4c7d-873d-810803c7a5cb prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:02:52.982 4088 3038337404776 MainThread DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "8001e033-b435-408f-a338-cd26132a7cc1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:52.982 4088 3038337404776 MainThread DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "8001e033-b435-408f-a338-cd26132a7cc1-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:52.992 4088 3038337404776 MainThread DEBUG os_win.utils.compute.vmutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Creating VM instance-00000050 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:02:52.992 4088 3038342145480 GreenThread-73 DEBUG nova.network.neutron [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Successfully created port: fb608d54-2a23-4319-ae48-913aad2e171a _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:02:53.914 4088 3038342145480 GreenThread-73 DEBUG nova.network.neutron [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Successfully updated port: fb608d54-2a23-4319-ae48-913aad2e171a _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:02:53.941 4088 3038342145480 GreenThread-73 DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Acquired lock "refresh_cache-02a3f851-fc39-4889-aaff-e5a3385f19c0" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:02:53.941 4088 3038342145480 GreenThread-73 DEBUG nova.network.neutron [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:02:54.026 4088 3038342145480 GreenThread-73 DEBUG nova.network.neutron [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:02:54.148 4088 3038337401784 MainThread DEBUG nova.network.neutron [req-b3ebc804-3d36-46c4-a06f-390d19888b4e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Updated VIF entry in instance network info cache for port 2159a11e-c2c4-44e9-9b93-151986521771. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:02:54.148 4088 3038337401784 MainThread DEBUG nova.network.neutron [req-b3ebc804-3d36-46c4-a06f-390d19888b4e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Updating instance_info_cache with network_info: [{"id": "2159a11e-c2c4-44e9-9b93-151986521771", "address": "fa:16:3e:e7:fc:5d", "network": {"id": "c9c0a28f-d537-4eed-ab4c-79d1152a1146", "bridge": null, "label": "tempest-MultipleCreateTestJSON-430554862-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "00a75e521b5f4d89ab74f2701a36da12", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2159a11e-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:54.183 4088 3038337401784 MainThread DEBUG oslo_concurrency.lockutils [req-b3ebc804-3d36-46c4-a06f-390d19888b4e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-84fb0901-77a9-482c-9355-34416b3289cb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:02:54.547 4088 3038340567640 MainThread DEBUG nova.network.neutron [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:54.575 4088 3038340567640 MainThread INFO nova.compute.manager [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 22ce4089-0acb-4f53-bb15-501df1d949ed] Took 3.03 seconds to deallocate network for instance. 2021-09-10 17:02:54.617 4088 3038342145480 GreenThread-73 DEBUG nova.network.neutron [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Updating instance_info_cache with network_info: [{"id": "fb608d54-2a23-4319-ae48-913aad2e171a", "address": "fa:16:3e:ba:0c:82", "network": {"id": "c9c0a28f-d537-4eed-ab4c-79d1152a1146", "bridge": null, "label": "tempest-MultipleCreateTestJSON-430554862-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "00a75e521b5f4d89ab74f2701a36da12", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfb608d54-2a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:54.635 4088 3038342145480 GreenThread-73 DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Releasing lock "refresh_cache-02a3f851-fc39-4889-aaff-e5a3385f19c0" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:02:54.635 4088 3038342145480 GreenThread-73 DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Instance network_info: |[{"id": "fb608d54-2a23-4319-ae48-913aad2e171a", "address": "fa:16:3e:ba:0c:82", "network": {"id": "c9c0a28f-d537-4eed-ab4c-79d1152a1146", "bridge": null, "label": "tempest-MultipleCreateTestJSON-430554862-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "00a75e521b5f4d89ab74f2701a36da12", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfb608d54-2a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:02:54.635 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Preparing to wait for external event network-vif-plugged-fb608d54-2a23-4319-ae48-913aad2e171a prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:02:54.635 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "02a3f851-fc39-4889-aaff-e5a3385f19c0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:54.635 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "02a3f851-fc39-4889-aaff-e5a3385f19c0-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:54.635 4088 3038337403192 MainThread DEBUG os_win.utils.compute.vmutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Creating VM instance-00000053 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:02:54.728 4088 3038340567640 MainThread INFO nova.scheduler.client.report [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Deleted allocations for instance 22ce4089-0acb-4f53-bb15-501df1d949ed 2021-09-10 17:02:54.773 4088 3038340567640 MainThread DEBUG oslo_concurrency.lockutils [req-18c9d1a8-1554-452f-91be-fe40bd4f9fb5 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "22ce4089-0acb-4f53-bb15-501df1d949ed" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 36.203s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:54.813 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-1583d02d-41f4-4754-b2c1-1d01693a9819 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Received event network-changed-b0d9b2b9-06aa-4c7d-873d-810803c7a5cb external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:54.813 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-1583d02d-41f4-4754-b2c1-1d01693a9819 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Refreshing instance network info cache due to event network-changed-b0d9b2b9-06aa-4c7d-873d-810803c7a5cb. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:02:54.813 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-1583d02d-41f4-4754-b2c1-1d01693a9819 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-8001e033-b435-408f-a338-cd26132a7cc1" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:02:54.813 4088 3038342145480 MainThread DEBUG nova.network.neutron [req-1583d02d-41f4-4754-b2c1-1d01693a9819 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Refreshing network info cache for port b0d9b2b9-06aa-4c7d-873d-810803c7a5cb _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:02:55.118 4088 3038337404776 MainThread DEBUG nova.virt.hyperv.vmops [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:02:55.477 4088 3038342145480 MainThread DEBUG nova.network.neutron [req-1583d02d-41f4-4754-b2c1-1d01693a9819 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Updated VIF entry in instance network info cache for port b0d9b2b9-06aa-4c7d-873d-810803c7a5cb. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:02:55.477 4088 3038342145480 MainThread DEBUG nova.network.neutron [req-1583d02d-41f4-4754-b2c1-1d01693a9819 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Updating instance_info_cache with network_info: [{"id": "b0d9b2b9-06aa-4c7d-873d-810803c7a5cb", "address": "fa:16:3e:3c:03:40", "network": {"id": "7381cc3b-ab27-4454-8a5b-95f2bef2e954", "bridge": null, "label": "tempest-ServerRescueNegativeTestJSON-1471687160-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5d6026a33839407f9f68cb295fbb6928", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapb0d9b2b9-06", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:55.507 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-1583d02d-41f4-4754-b2c1-1d01693a9819 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-8001e033-b435-408f-a338-cd26132a7cc1" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:02:56.775 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:02:56.820 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-fc8360f5-8303-4a48-bb6c-8a02c426568f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Received event network-vif-plugged-fa0fabb5-417a-4cb7-91ae-030068cb0be9 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:56.820 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-fc8360f5-8303-4a48-bb6c-8a02c426568f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "30a2e0f5-74d7-453d-ad6a-628ef91e6d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:56.820 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-fc8360f5-8303-4a48-bb6c-8a02c426568f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "30a2e0f5-74d7-453d-ad6a-628ef91e6d39-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:56.820 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-fc8360f5-8303-4a48-bb6c-8a02c426568f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Processing event network-vif-plugged-fa0fabb5-417a-4cb7-91ae-030068cb0be9 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:02:56.860 4088 3038342146184 MainThread INFO nova.virt.hyperv.vmops [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Using config drive for instance 2021-09-10 17:02:57.072 4088 3038342146184 MainThread INFO nova.virt.hyperv.vmops [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Creating config drive at C:\openstack\instances\instance-0000004f\configdrive.iso 2021-09-10 17:02:57.169 4088 3038342146184 MainThread DEBUG oslo_concurrency.processutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000004f\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpxx7cfd3f execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:02:57.311 4088 3038337401608 MainThread DEBUG nova.compute.manager [req-b8cb1604-c799-4d6e-8af6-4814cbb5d491 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Received event network-changed-fb608d54-2a23-4319-ae48-913aad2e171a external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:57.311 4088 3038337401608 MainThread DEBUG nova.compute.manager [req-b8cb1604-c799-4d6e-8af6-4814cbb5d491 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Refreshing instance network info cache due to event network-changed-fb608d54-2a23-4319-ae48-913aad2e171a. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:02:57.311 4088 3038337401608 MainThread DEBUG oslo_concurrency.lockutils [req-b8cb1604-c799-4d6e-8af6-4814cbb5d491 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-02a3f851-fc39-4889-aaff-e5a3385f19c0" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:02:57.331 4088 3038337401608 MainThread DEBUG nova.network.neutron [req-b8cb1604-c799-4d6e-8af6-4814cbb5d491 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Refreshing network info cache for port fb608d54-2a23-4319-ae48-913aad2e171a _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:02:57.525 4088 3038342146184 MainThread DEBUG oslo_concurrency.processutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000004f\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpxx7cfd3f" returned: 0 in 0.359s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:02:57.836 4088 3038337401608 MainThread DEBUG nova.network.neutron [req-b8cb1604-c799-4d6e-8af6-4814cbb5d491 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Updated VIF entry in instance network info cache for port fb608d54-2a23-4319-ae48-913aad2e171a. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:02:57.836 4088 3038337401608 MainThread DEBUG nova.network.neutron [req-b8cb1604-c799-4d6e-8af6-4814cbb5d491 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Updating instance_info_cache with network_info: [{"id": "fb608d54-2a23-4319-ae48-913aad2e171a", "address": "fa:16:3e:ba:0c:82", "network": {"id": "c9c0a28f-d537-4eed-ab4c-79d1152a1146", "bridge": null, "label": "tempest-MultipleCreateTestJSON-430554862-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "00a75e521b5f4d89ab74f2701a36da12", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfb608d54-2a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:57.867 4088 3038337401608 MainThread DEBUG oslo_concurrency.lockutils [req-b8cb1604-c799-4d6e-8af6-4814cbb5d491 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-02a3f851-fc39-4889-aaff-e5a3385f19c0" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:02:58.133 4088 3038342146184 MainThread DEBUG nova.virt.hyperv.vmops [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Setting boot order for instance: instance-0000004f: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:02:58.227 4088 3038342146184 MainThread DEBUG nova.virt.hyperv.vmops [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:02:58.275 4088 3038342146184 MainThread DEBUG os_win.utils.jobutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Waiting for WMI job: {'InstanceID': 'E951E7D7-DCE7-4034-872D-7ABE6BA1ACD9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17917), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:58.415 4088 3038342146184 MainThread ERROR os_win.utils.jobutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004f\' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)instance-0000004fCF976D26-05E5-486A-B8A0-1CDD61E98B6C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)instance-0000004fCF976D26-05E5-486A-B8A0-1CDD61E98B6C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)instance-0000004fCF976D26-05E5-486A-B8A0-1CDD61E98B6C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E951E7D7-DCE7-4034-872D-7ABE6BA1ACD9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121608), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 58), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 58), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004f' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)\n\nNot enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)\n\n'instance-0000004f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)", 'ErrorSummaryDescription': "'instance-0000004f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:58.432 4088 3038342146184 MainThread DEBUG os_win._utils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004f' failed to start. Not enough memory in the system to start the virtual machine instance-0000004f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004f' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Not enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) 'instance-0000004f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.20469331741333008 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:58.476 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:58.476 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:58.476 4088 3038337401608 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:58.476 4088 3038337401608 MainThread INFO nova.compute.manager [-] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] VM Stopped (Lifecycle Event) 2021-09-10 17:02:58.509 4088 3038337401608 MainThread DEBUG nova.compute.manager [req-6c083596-0f21-4695-bf64-a7a38faef662 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:58.509 4088 3038337401608 MainThread DEBUG nova.virt.hyperv.vmops [req-6c083596-0f21-4695-bf64-a7a38faef662 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:58.555 4088 3038337401608 MainThread DEBUG nova.compute.manager [req-6c083596-0f21-4695-bf64-a7a38faef662 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:58.587 4088 3038337401608 MainThread INFO nova.compute.manager [req-6c083596-0f21-4695-bf64-a7a38faef662 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:59.355 4088 3038337403896 MainThread DEBUG nova.network.neutron [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:02:59.415 4088 3038337402488 MainThread DEBUG nova.compute.manager [req-fb76af40-f285-401f-8ff5-0a4b54c980b6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Received event network-vif-plugged-2159a11e-c2c4-44e9-9b93-151986521771 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:02:59.430 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-fb76af40-f285-401f-8ff5-0a4b54c980b6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "84fb0901-77a9-482c-9355-34416b3289cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:59.430 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [req-fb76af40-f285-401f-8ff5-0a4b54c980b6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "84fb0901-77a9-482c-9355-34416b3289cb-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:59.430 4088 3038337402488 MainThread DEBUG nova.compute.manager [req-fb76af40-f285-401f-8ff5-0a4b54c980b6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Processing event network-vif-plugged-2159a11e-c2c4-44e9-9b93-151986521771 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:02:59.430 4088 3038337403896 MainThread INFO nova.compute.manager [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] [instance: d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869] Took 10.42 seconds to deallocate network for instance. 2021-09-10 17:02:59.465 4088 3038342146184 MainThread DEBUG os_win.utils.jobutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Waiting for WMI job: {'InstanceID': '4BEA9392-240C-42FD-AD5C-CCC61966E8CC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20133), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:02:59.478 4088 3038342147768 MainThread INFO nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Using config drive for instance 2021-09-10 17:02:59.616 4088 3038342146184 MainThread ERROR os_win.utils.jobutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004f\' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)instance-0000004fCF976D26-05E5-486A-B8A0-1CDD61E98B6C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)instance-0000004fCF976D26-05E5-486A-B8A0-1CDD61E98B6C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)instance-0000004fCF976D26-05E5-486A-B8A0-1CDD61E98B6C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4BEA9392-240C-42FD-AD5C-CCC61966E8CC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=123030), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 2, 59), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 2, 59), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004f' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)\n\nNot enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)\n\n'instance-0000004f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)", 'ErrorSummaryDescription': "'instance-0000004f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:02:59.616 4088 3038342146184 MainThread DEBUG os_win._utils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004f' failed to start. Not enough memory in the system to start the virtual machine instance-0000004f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004f' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Not enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) 'instance-0000004f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3894460201263428 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:02:59.665 4088 3038337403896 MainThread INFO nova.scheduler.client.report [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Deleted allocations for instance d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869 2021-09-10 17:02:59.684 4088 3038337401608 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:02:59.684 4088 3038337401608 MainThread INFO nova.compute.manager [-] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] VM Stopped (Lifecycle Event) 2021-09-10 17:02:59.684 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:02:59.684 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:59.684 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-6d233a42-e81a-4392-ab3d-5e95c272f207 b736354cedde4200845a6c18d167eda3 fe5b53ea59bd43bf84431d6daec45a04 - default default] Lock "d4b1aa5b-c1ae-4df7-afd7-15d31bbaa869" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 126.187s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:02:59.727 4088 3038337401608 MainThread DEBUG nova.compute.manager [req-4332fa89-5374-4791-8f96-ab3d57c92a90 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:02:59.727 4088 3038337401608 MainThread DEBUG nova.virt.hyperv.vmops [req-4332fa89-5374-4791-8f96-ab3d57c92a90 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:02:59.774 4088 3038337401608 MainThread DEBUG nova.compute.manager [req-4332fa89-5374-4791-8f96-ab3d57c92a90 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:02:59.805 4088 3038337401608 MainThread INFO nova.compute.manager [req-4332fa89-5374-4791-8f96-ab3d57c92a90 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:02:59.931 4088 3038342147768 MainThread INFO nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Creating config drive at C:\openstack\instances\instance-00000052\configdrive.iso 2021-09-10 17:03:00.009 4088 3038342147768 MainThread DEBUG oslo_concurrency.processutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000052\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpmpmioznp execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:03:00.352 4088 3038342147768 MainThread DEBUG oslo_concurrency.processutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000052\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpmpmioznp" returned: 0 in 0.344s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:03:00.663 4088 3038342146184 MainThread DEBUG os_win.utils.jobutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Waiting for WMI job: {'InstanceID': '6F4B23A5-3512-4F40-8DDD-399EFE1F1BE4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17456), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:00.868 4088 3038337403896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:00.868 4088 3038337403896 MainThread INFO nova.compute.manager [-] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] VM Stopped (Lifecycle Event) 2021-09-10 17:03:00.868 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:00.868 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:00.883 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-ee91cb01-feb2-45ce-a567-0921ef9f1b19 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:00.883 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.vmops [req-ee91cb01-feb2-45ce-a567-0921ef9f1b19 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:00.899 4088 3038342146184 MainThread ERROR os_win.utils.jobutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004f\' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)instance-0000004fCF976D26-05E5-486A-B8A0-1CDD61E98B6C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)instance-0000004fCF976D26-05E5-486A-B8A0-1CDD61E98B6C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)instance-0000004fCF976D26-05E5-486A-B8A0-1CDD61E98B6C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6F4B23A5-3512-4F40-8DDD-399EFE1F1BE4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=137693), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004f' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)\n\nNot enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)\n\n'instance-0000004f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)", 'ErrorSummaryDescription': "'instance-0000004f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:00.899 4088 3038342146184 MainThread DEBUG os_win._utils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004f' failed to start. Not enough memory in the system to start the virtual machine instance-0000004f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004f' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Not enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) 'instance-0000004f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.671721935272217 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:00.977 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Setting boot order for instance: instance-00000052: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:03:01.008 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-ee91cb01-feb2-45ce-a567-0921ef9f1b19 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:01.031 4088 3038337403896 MainThread INFO nova.compute.manager [req-ee91cb01-feb2-45ce-a567-0921ef9f1b19 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:01.071 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:03:01.116 4088 3038342147768 MainThread DEBUG os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': '5BDC29B6-515F-47F7-A02F-1F95778228AA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15645), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:01.274 4088 3038342147768 MainThread ERROR os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000052\' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)instance-000000520D0D1649-3ADA-4CCC-977A-46163F43EA0012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)instance-000000520D0D1649-3ADA-4CCC-977A-46163F43EA0010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000052\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)instance-000000520D0D1649-3ADA-4CCC-977A-46163F43EA00%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5BDC29B6-515F-47F7-A02F-1F95778228AA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=134766), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 1), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 1), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000052' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)\n\nNot enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)\n\n'instance-00000052' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)", 'ErrorSummaryDescription': "'instance-00000052' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000052.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:01.274 4088 3038342147768 MainThread DEBUG os_win._utils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000052' failed to start. Not enough memory in the system to start the virtual machine instance-00000052. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000052' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Not enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) 'instance-00000052' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.20340275764465332 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:01.305 4088 3038337403896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:01.305 4088 3038337403896 MainThread INFO nova.compute.manager [-] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] VM Stopped (Lifecycle Event) 2021-09-10 17:03:01.321 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000052" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:01.321 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000052" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:01.335 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-fe95d1d3-3940-4789-919a-cab4bcf736b1 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:01.335 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.vmops [req-fe95d1d3-3940-4789-919a-cab4bcf736b1 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:01.393 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-fe95d1d3-3940-4789-919a-cab4bcf736b1 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:01.414 4088 3038337403896 MainThread INFO nova.compute.manager [req-fe95d1d3-3940-4789-919a-cab4bcf736b1 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:01.758 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-27232072-7ace-4b85-873a-0477cab62f7f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Received event network-vif-plugged-b0d9b2b9-06aa-4c7d-873d-810803c7a5cb external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:03:01.758 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-27232072-7ace-4b85-873a-0477cab62f7f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "8001e033-b435-408f-a338-cd26132a7cc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:01.758 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-27232072-7ace-4b85-873a-0477cab62f7f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "8001e033-b435-408f-a338-cd26132a7cc1-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:01.758 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-27232072-7ace-4b85-873a-0477cab62f7f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Processing event network-vif-plugged-b0d9b2b9-06aa-4c7d-873d-810803c7a5cb _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:03:01.805 4088 3038337404776 MainThread INFO nova.virt.hyperv.vmops [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Using config drive for instance 2021-09-10 17:03:01.915 4088 3038342146184 MainThread DEBUG os_win.utils.jobutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Waiting for WMI job: {'InstanceID': '52D6A40C-94C3-4167-A3A0-F77B99915BC2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17454), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:02.073 4088 3038342146184 MainThread ERROR os_win.utils.jobutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004f\' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)instance-0000004fCF976D26-05E5-486A-B8A0-1CDD61E98B6C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)instance-0000004fCF976D26-05E5-486A-B8A0-1CDD61E98B6C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)instance-0000004fCF976D26-05E5-486A-B8A0-1CDD61E98B6C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '52D6A40C-94C3-4167-A3A0-F77B99915BC2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114046), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 1), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 2), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004f' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)\n\nNot enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)\n\n'instance-0000004f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)", 'ErrorSummaryDescription': "'instance-0000004f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:02.073 4088 3038342146184 MainThread DEBUG os_win._utils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004f' failed to start. Not enough memory in the system to start the virtual machine instance-0000004f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004f' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Not enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) 'instance-0000004f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.8461265563964844 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:02.102 4088 3038337402488 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:02.102 4088 3038337402488 MainThread INFO nova.compute.manager [-] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] VM Stopped (Lifecycle Event) 2021-09-10 17:03:02.102 4088 3038337401608 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:02.102 4088 3038337401608 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:02.151 4088 3038337402488 MainThread DEBUG nova.compute.manager [req-bb390d1d-d190-4ace-b39f-55a8fa381891 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:02.151 4088 3038337402488 MainThread DEBUG nova.virt.hyperv.vmops [req-bb390d1d-d190-4ace-b39f-55a8fa381891 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:02.165 4088 3038337404776 MainThread INFO nova.virt.hyperv.vmops [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Creating config drive at C:\openstack\instances\instance-00000050\configdrive.iso 2021-09-10 17:03:02.258 4088 3038337404776 MainThread DEBUG oslo_concurrency.processutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000050\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpxm183gk2 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:03:02.440 4088 3038337402488 MainThread DEBUG nova.compute.manager [req-bb390d1d-d190-4ace-b39f-55a8fa381891 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:02.440 4088 3038342147768 MainThread DEBUG os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': '60E3C8FD-1539-4EB4-A714-B6838A782E6D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17475), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:02.462 4088 3038337402488 MainThread INFO nova.compute.manager [req-bb390d1d-d190-4ace-b39f-55a8fa381891 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:02.601 4088 3038342147768 MainThread ERROR os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000052\' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)instance-000000520D0D1649-3ADA-4CCC-977A-46163F43EA0012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)instance-000000520D0D1649-3ADA-4CCC-977A-46163F43EA0010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000052\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)instance-000000520D0D1649-3ADA-4CCC-977A-46163F43EA00%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '60E3C8FD-1539-4EB4-A714-B6838A782E6D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=136153), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 2), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 2), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000052' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)\n\nNot enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)\n\n'instance-00000052' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)", 'ErrorSummaryDescription': "'instance-00000052' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000052.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:02.601 4088 3038342147768 MainThread DEBUG os_win._utils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000052' failed to start. Not enough memory in the system to start the virtual machine instance-00000052. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000052' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Not enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) 'instance-00000052' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.529850721359253 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:02.649 4088 3038337404776 MainThread DEBUG oslo_concurrency.processutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000050\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpxm183gk2" returned: 0 in 0.391s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:03:02.680 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000052" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:02.680 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000052" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:02.680 4088 3038337401432 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:02.680 4088 3038337401432 MainThread INFO nova.compute.manager [-] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] VM Stopped (Lifecycle Event) 2021-09-10 17:03:02.717 4088 3038337401432 MainThread DEBUG nova.compute.manager [req-2081ca7a-fa95-443a-9215-f8edad8f2408 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:02.717 4088 3038337401432 MainThread DEBUG nova.virt.hyperv.vmops [req-2081ca7a-fa95-443a-9215-f8edad8f2408 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:02.774 4088 3038337401432 MainThread DEBUG nova.compute.manager [req-2081ca7a-fa95-443a-9215-f8edad8f2408 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:02.804 4088 3038337401432 MainThread INFO nova.compute.manager [req-2081ca7a-fa95-443a-9215-f8edad8f2408 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:03.101 4088 3038342146184 MainThread DEBUG os_win.utils.jobutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Waiting for WMI job: {'InstanceID': '9FAD4CDF-2CA4-427F-BA2F-588812DD7289', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16336), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:03.243 4088 3038342146184 MainThread ERROR os_win.utils.jobutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004f\' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)instance-0000004fCF976D26-05E5-486A-B8A0-1CDD61E98B6C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)instance-0000004fCF976D26-05E5-486A-B8A0-1CDD61E98B6C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)instance-0000004fCF976D26-05E5-486A-B8A0-1CDD61E98B6C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9FAD4CDF-2CA4-427F-BA2F-588812DD7289', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117630), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 3), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004f' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)\n\nNot enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)\n\n'instance-0000004f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)", 'ErrorSummaryDescription': "'instance-0000004f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:03.243 4088 3038342146184 MainThread DEBUG os_win._utils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000004f' failed to start. Not enough memory in the system to start the virtual machine instance-0000004f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004f' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Not enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) 'instance-0000004f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.015927314758301 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:03.290 4088 3038337404776 MainThread DEBUG nova.virt.hyperv.vmops [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Setting boot order for instance: instance-00000050: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:03:03.413 4088 3038337404776 MainThread DEBUG nova.virt.hyperv.vmops [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:03:03.446 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "f817e731-74c6-4c6f-8109-5984539d364a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:03.446 4088 3038337404776 MainThread DEBUG os_win.utils.jobutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Waiting for WMI job: {'InstanceID': 'AF5D84A0-0717-41EC-9B58-09A9CF1C861F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16381), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:03.462 4088 3038337401432 MainThread DEBUG nova.compute.manager [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:03:03.587 4088 3038337404776 MainThread ERROR os_win.utils.jobutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000050\' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)instance-00000050E945329A-F714-45F9-B225-47D73ED9AE3112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)instance-00000050E945329A-F714-45F9-B225-47D73ED9AE3110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000050\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)instance-00000050E945329A-F714-45F9-B225-47D73ED9AE31%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'AF5D84A0-0717-41EC-9B58-09A9CF1C861F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117641), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 3), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000050' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)\n\nNot enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)\n\n'instance-00000050' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)", 'ErrorSummaryDescription': "'instance-00000050' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000050.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:03.587 4088 3038337404776 MainThread DEBUG os_win._utils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000050' failed to start. Not enough memory in the system to start the virtual machine instance-00000050. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000050' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Not enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) 'instance-00000050' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.17404603958129883 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:03.603 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:03.619 4088 3038337401432 MainThread DEBUG nova.virt.hardware [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:03:03.619 4088 3038337401432 MainThread INFO nova.compute.claims [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Claim successful on node n-h2-808474-1 2021-09-10 17:03:03.647 4088 3038337403896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:03.647 4088 3038337403896 MainThread INFO nova.compute.manager [-] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] VM Stopped (Lifecycle Event) 2021-09-10 17:03:03.647 4088 3038337401608 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000050" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:03.647 4088 3038337401608 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000050" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:03.647 4088 3038342147768 MainThread DEBUG os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': '974B4E0A-C0AE-4FFE-88D8-C09DE03B0CD6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16521), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:03.665 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-28273084-2164-4786-803e-76719a296098 - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:03.665 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.vmops [req-28273084-2164-4786-803e-76719a296098 - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:03.743 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-28273084-2164-4786-803e-76719a296098 - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:03.761 4088 3038337401432 MainThread DEBUG nova.virt.hyperv.hostops [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:03:03.761 4088 3038337403896 MainThread INFO nova.compute.manager [req-28273084-2164-4786-803e-76719a296098 - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:03.780 4088 3038337401432 MainThread DEBUG nova.virt.hyperv.hostops [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:03:03.807 4088 3038342147768 MainThread ERROR os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000052\' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)instance-000000520D0D1649-3ADA-4CCC-977A-46163F43EA0012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)instance-000000520D0D1649-3ADA-4CCC-977A-46163F43EA0010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000052\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)instance-000000520D0D1649-3ADA-4CCC-977A-46163F43EA00%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '974B4E0A-C0AE-4FFE-88D8-C09DE03B0CD6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=128357), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 3), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000052' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)\n\nNot enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)\n\n'instance-00000052' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)", 'ErrorSummaryDescription': "'instance-00000052' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000052.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:03.807 4088 3038342147768 MainThread DEBUG os_win._utils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000052' failed to start. Not enough memory in the system to start the virtual machine instance-00000052. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000052' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Not enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) 'instance-00000052' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.735989809036255 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:03.821 4088 3038337403896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:03.821 4088 3038337403896 MainThread INFO nova.compute.manager [-] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] VM Stopped (Lifecycle Event) 2021-09-10 17:03:03.821 4088 3038337401608 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000052" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:03.821 4088 3038337401608 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000052" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:03.852 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-0c72cab6-d50c-46b2-b2ef-f183a09880c2 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:03.852 4088 3038337403896 MainThread DEBUG nova.virt.hyperv.vmops [req-0c72cab6-d50c-46b2-b2ef-f183a09880c2 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:03.914 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-0c72cab6-d50c-46b2-b2ef-f183a09880c2 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:03.945 4088 3038337403896 MainThread INFO nova.compute.manager [req-0c72cab6-d50c-46b2-b2ef-f183a09880c2 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:04.009 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-7c6c0652-ad4f-4973-92e2-32ab6aac777a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Received event network-vif-plugged-fb608d54-2a23-4319-ae48-913aad2e171a external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:03:04.009 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-7c6c0652-ad4f-4973-92e2-32ab6aac777a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "02a3f851-fc39-4889-aaff-e5a3385f19c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:04.009 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [req-7c6c0652-ad4f-4973-92e2-32ab6aac777a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "02a3f851-fc39-4889-aaff-e5a3385f19c0-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:04.009 4088 3038337403896 MainThread DEBUG nova.compute.manager [req-7c6c0652-ad4f-4973-92e2-32ab6aac777a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Processing event network-vif-plugged-fb608d54-2a23-4319-ae48-913aad2e171a _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:03:04.023 4088 3038337401432 MainThread DEBUG nova.compute.provider_tree [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:03:04.056 4088 3038337403192 MainThread INFO nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Using config drive for instance 2021-09-10 17:03:04.071 4088 3038337401432 MainThread DEBUG nova.scheduler.client.report [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:03:04.071 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:04.087 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "749db01c-d4b1-4eea-aa48-d7dd148b27f7" acquired by "nova.compute.manager.ComputeManager._validate_instance_group_policy.._do_validation" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:04.111 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "749db01c-d4b1-4eea-aa48-d7dd148b27f7" released by "nova.compute.manager.ComputeManager._validate_instance_group_policy.._do_validation" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:04.111 4088 3038337401432 MainThread DEBUG nova.compute.manager [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:03:04.179 4088 3038337401432 MainThread DEBUG nova.compute.utils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 17:03:04.179 4088 3038337401608 GreenThread-74 DEBUG nova.compute.manager [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:03:04.179 4088 3038337401608 GreenThread-74 DEBUG nova.network.neutron [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:03:04.212 4088 3038337401432 MainThread DEBUG nova.compute.manager [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:03:04.278 4088 3038342146184 MainThread DEBUG os_win.utils.jobutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Waiting for WMI job: {'InstanceID': '63DF5330-E93F-4B5D-B5B1-4849F9AA5C8D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17834), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:04.366 4088 3038337401608 GreenThread-74 DEBUG nova.policy [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f13c7f24aed435daa5c4c3caf5d68c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7a5fed42ca440bb659840e05ce1f95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:03:04.430 4088 3038342146184 MainThread ERROR os_win.utils.jobutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000004f\' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)instance-0000004fCF976D26-05E5-486A-B8A0-1CDD61E98B6C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)instance-0000004fCF976D26-05E5-486A-B8A0-1CDD61E98B6C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000004f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)instance-0000004fCF976D26-05E5-486A-B8A0-1CDD61E98B6C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '63DF5330-E93F-4B5D-B5B1-4849F9AA5C8D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=129783), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 4), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000004f' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)\n\nNot enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)\n\n'instance-0000004f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C)", 'ErrorSummaryDescription': "'instance-0000004f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000004f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:04.430 4088 3038342146184 MainThread ERROR nova.virt.hyperv.vmops [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Failed to change vm state of instance-0000004f to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000004f' failed to start. 2021-09-10 17:03:04.430 4088 3038342146184 MainThread INFO nova.virt.hyperv.vmops [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Got request to destroy instance 2021-09-10 17:03:04.499 4088 3038337403192 MainThread INFO nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Creating config drive at C:\openstack\instances\instance-00000053\configdrive.iso 2021-09-10 17:03:04.619 4088 3038337403192 MainThread DEBUG oslo_concurrency.processutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000053\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpb1te8iyg execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:03:04.743 4088 3038337401432 MainThread DEBUG nova.compute.manager [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:03:04.775 4088 3038337401432 MainThread INFO nova.virt.hyperv.vmops [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Spawning new instance 2021-09-10 17:03:04.775 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "instance-00000057" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:04.775 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "instance-00000057" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:04.775 4088 3038337401432 MainThread DEBUG nova.block_device [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:03:04.796 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:04.796 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:04.796 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:04.796 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000004f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:04.796 4088 3038342144072 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:04.796 4088 3038342144072 MainThread INFO nova.compute.manager [-] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] VM Stopped (Lifecycle Event) 2021-09-10 17:03:04.809 4088 3038337401432 MainThread DEBUG os_win.utils.pathutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Creating directory: C:\openstack\instances\instance-00000057 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:03:04.809 4088 3038337401432 MainThread DEBUG nova.virt.hyperv.vmops [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000057\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:03:04.809 4088 3038337404776 MainThread DEBUG os_win.utils.jobutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Waiting for WMI job: {'InstanceID': '5271B756-669A-4DF2-AEAB-EDBBB9D7A2C7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=27643), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:04.821 4088 3038342144072 MainThread DEBUG nova.compute.manager [req-40284ffc-8e64-4eb6-9c17-62469033e1b6 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:04.835 4088 3038342144072 MainThread DEBUG nova.virt.hyperv.vmops [req-40284ffc-8e64-4eb6-9c17-62469033e1b6 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:04.868 4088 3038342147768 MainThread DEBUG os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': 'C3DD4B01-7D73-4262-94E2-8C2C8E7FF428', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=24534), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:04.899 4088 3038342144072 MainThread DEBUG nova.compute.manager [req-40284ffc-8e64-4eb6-9c17-62469033e1b6 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:04.949 4088 3038342144072 MainThread INFO nova.compute.manager [req-40284ffc-8e64-4eb6-9c17-62469033e1b6 - - - - -] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:05.026 4088 3038337403192 MainThread DEBUG oslo_concurrency.processutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000053\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpb1te8iyg" returned: 0 in 0.406s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:03:05.038 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000050" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:05.061 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000050" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:05.061 4088 3038337401784 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:05.061 4088 3038337401784 MainThread INFO nova.compute.manager [-] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] VM Stopped (Lifecycle Event) 2021-09-10 17:03:05.071 4088 3038337404776 MainThread ERROR os_win.utils.jobutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000050\' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)instance-00000050E945329A-F714-45F9-B225-47D73ED9AE3112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)instance-00000050E945329A-F714-45F9-B225-47D73ED9AE3110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000050\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)instance-00000050E945329A-F714-45F9-B225-47D73ED9AE31%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5271B756-669A-4DF2-AEAB-EDBBB9D7A2C7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=161433), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 4), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000050' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)\n\nNot enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)\n\n'instance-00000050' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)", 'ErrorSummaryDescription': "'instance-00000050' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000050.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:05.071 4088 3038337404776 MainThread DEBUG os_win._utils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000050' failed to start. Not enough memory in the system to start the virtual machine instance-00000050. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000050' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Not enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) 'instance-00000050' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.6573877334594727 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:05.093 4088 3038337401784 MainThread DEBUG nova.compute.manager [req-bb5ec8e7-58bb-428a-9a24-ac68701314eb - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:05.093 4088 3038337401784 MainThread DEBUG nova.virt.hyperv.vmops [req-bb5ec8e7-58bb-428a-9a24-ac68701314eb - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:05.136 4088 3038337401432 MainThread DEBUG nova.virt.hyperv.vmops [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Resizing VHD C:\openstack\instances\instance-00000057\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:03:05.167 4088 3038342147768 MainThread ERROR os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000052\' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)instance-000000520D0D1649-3ADA-4CCC-977A-46163F43EA0012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)instance-000000520D0D1649-3ADA-4CCC-977A-46163F43EA0010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000052\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)instance-000000520D0D1649-3ADA-4CCC-977A-46163F43EA00%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C3DD4B01-7D73-4262-94E2-8C2C8E7FF428', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=269472), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 5), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000052' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)\n\nNot enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)\n\n'instance-00000052' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)", 'ErrorSummaryDescription': "'instance-00000052' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000052.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:05.167 4088 3038342147768 MainThread DEBUG os_win._utils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000052' failed to start. Not enough memory in the system to start the virtual machine instance-00000052. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000052' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Not enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) 'instance-00000052' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 4.096617937088013 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:05.181 4088 3038337401784 MainThread DEBUG nova.compute.manager [req-bb5ec8e7-58bb-428a-9a24-ac68701314eb - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:05.200 4088 3038337401784 MainThread INFO nova.compute.manager [req-bb5ec8e7-58bb-428a-9a24-ac68701314eb - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:05.200 4088 3038337401784 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:05.200 4088 3038337401784 MainThread INFO nova.compute.manager [-] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] VM Stopped (Lifecycle Event) 2021-09-10 17:03:05.200 4088 3038337401256 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000052" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:05.200 4088 3038337401256 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000052" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:05.227 4088 3038337401784 MainThread DEBUG nova.compute.manager [req-f166dd6b-e8b1-40a0-ba85-84b993129a64 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:05.227 4088 3038337401784 MainThread DEBUG nova.virt.hyperv.vmops [req-f166dd6b-e8b1-40a0-ba85-84b993129a64 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:05.351 4088 3038337401784 MainThread DEBUG nova.compute.manager [req-f166dd6b-e8b1-40a0-ba85-84b993129a64 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:05.385 4088 3038337401784 MainThread INFO nova.compute.manager [req-f166dd6b-e8b1-40a0-ba85-84b993129a64 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:05.680 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Setting boot order for instance: instance-00000053: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:03:05.774 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:03:05.820 4088 3038337403192 MainThread DEBUG os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': '29249987-72E4-444B-8B44-8A3B8D2CDA16', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20695), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:05.921 4088 3038337401608 GreenThread-74 DEBUG nova.network.neutron [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Successfully created port: a460edb0-9bbf-4681-bdf2-95008d45a5c6 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:03:06.038 4088 3038337401784 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:06.038 4088 3038337401784 MainThread INFO nova.compute.manager [-] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] VM Stopped (Lifecycle Event) 2021-09-10 17:03:06.038 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000053" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:06.038 4088 3038337403896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000053" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:06.065 4088 3038337401784 MainThread DEBUG nova.compute.manager [req-5b8dc9ae-5835-4365-a08f-82262bf6d92c - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:06.065 4088 3038337401784 MainThread DEBUG nova.virt.hyperv.vmops [req-5b8dc9ae-5835-4365-a08f-82262bf6d92c - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:06.102 4088 3038337404776 MainThread DEBUG os_win.utils.jobutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Waiting for WMI job: {'InstanceID': '614CA482-7F03-464B-8D4C-13B693F2C9E3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=23293), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:06.102 4088 3038337403192 MainThread ERROR os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000053\' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)instance-00000053F618CFC6-5070-4291-BE16-EA6A8CF6810C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)instance-00000053F618CFC6-5070-4291-BE16-EA6A8CF6810C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000053\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)instance-00000053F618CFC6-5070-4291-BE16-EA6A8CF6810C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '29249987-72E4-444B-8B44-8A3B8D2CDA16', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=143384), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 5), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 5), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000053' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)\n\nNot enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)\n\n'instance-00000053' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)", 'ErrorSummaryDescription': "'instance-00000053' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000053.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:06.102 4088 3038337403192 MainThread DEBUG os_win._utils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000053' failed to start. Not enough memory in the system to start the virtual machine instance-00000053. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000053' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Not enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) 'instance-00000053' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.3282780647277832 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:06.133 4088 3038337401784 MainThread DEBUG nova.compute.manager [req-5b8dc9ae-5835-4365-a08f-82262bf6d92c - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:06.195 4088 3038337401784 MainThread INFO nova.compute.manager [req-5b8dc9ae-5835-4365-a08f-82262bf6d92c - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:06.212 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "d358307f-112b-4be6-9b2a-08f9ad26205e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:06.244 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:03:06.244 4088 3038342147768 MainThread DEBUG os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': '3B5DD87F-9E5F-4486-BBF5-852EA8890B0B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=34501), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:06.261 4088 3038337404776 MainThread ERROR os_win.utils.jobutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000050\' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)instance-00000050E945329A-F714-45F9-B225-47D73ED9AE3112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)instance-00000050E945329A-F714-45F9-B225-47D73ED9AE3110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000050\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)instance-00000050E945329A-F714-45F9-B225-47D73ED9AE31%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '614CA482-7F03-464B-8D4C-13B693F2C9E3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=149431), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 6), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 6), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000050' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)\n\nNot enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)\n\n'instance-00000050' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)", 'ErrorSummaryDescription': "'instance-00000050' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000050.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:06.281 4088 3038337404776 MainThread DEBUG os_win._utils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000050' failed to start. Not enough memory in the system to start the virtual machine instance-00000050. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000050' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Not enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) 'instance-00000050' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.8673593997955322 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:06.319 4088 3038340567640 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:06.319 4088 3038340567640 MainThread INFO nova.compute.manager [-] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] VM Stopped (Lifecycle Event) 2021-09-10 17:03:06.319 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000050" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:06.336 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000050" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:06.352 4088 3038340567640 MainThread DEBUG nova.compute.manager [req-6d59d0ce-397a-46d3-8a97-a7659b323926 - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:06.352 4088 3038340567640 MainThread DEBUG nova.virt.hyperv.vmops [req-6d59d0ce-397a-46d3-8a97-a7659b323926 - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:06.398 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:06.416 4088 3038340570104 MainThread DEBUG nova.virt.hardware [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:03:06.416 4088 3038340570104 MainThread INFO nova.compute.claims [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Claim successful on node n-h2-808474-1 2021-09-10 17:03:06.416 4088 3038340567640 MainThread DEBUG nova.compute.manager [req-6d59d0ce-397a-46d3-8a97-a7659b323926 - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:06.468 4088 3038340567640 MainThread INFO nova.compute.manager [req-6d59d0ce-397a-46d3-8a97-a7659b323926 - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:06.468 4088 3038340567640 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:06.468 4088 3038340567640 MainThread INFO nova.compute.manager [-] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] VM Stopped (Lifecycle Event) 2021-09-10 17:03:06.468 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000052" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:06.468 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000052" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:06.527 4088 3038342147768 MainThread ERROR os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000052\' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)instance-000000520D0D1649-3ADA-4CCC-977A-46163F43EA0012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)instance-000000520D0D1649-3ADA-4CCC-977A-46163F43EA0010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000052\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)instance-000000520D0D1649-3ADA-4CCC-977A-46163F43EA00%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3B5DD87F-9E5F-4486-BBF5-852EA8890B0B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=183943), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 6), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 6), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000052' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)\n\nNot enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)\n\n'instance-00000052' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)", 'ErrorSummaryDescription': "'instance-00000052' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000052.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:06.527 4088 3038342147768 MainThread DEBUG os_win._utils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000052' failed to start. Not enough memory in the system to start the virtual machine instance-00000052. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000052' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Not enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) 'instance-00000052' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.456071376800537 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:06.555 4088 3038340567640 MainThread DEBUG nova.compute.manager [req-796830ca-7667-484a-b703-f573042eb8ec - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:06.555 4088 3038340567640 MainThread DEBUG nova.virt.hyperv.vmops [req-796830ca-7667-484a-b703-f573042eb8ec - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:06.587 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.hostops [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:03:06.601 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.hostops [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:03:06.619 4088 3038340567640 MainThread DEBUG nova.compute.manager [req-796830ca-7667-484a-b703-f573042eb8ec - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:06.648 4088 3038340567640 MainThread INFO nova.compute.manager [req-796830ca-7667-484a-b703-f573042eb8ec - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:06.846 4088 3038337401608 GreenThread-74 DEBUG nova.network.neutron [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Successfully updated port: a460edb0-9bbf-4681-bdf2-95008d45a5c6 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:03:06.860 4088 3038337401608 GreenThread-74 DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Acquired lock "refresh_cache-f817e731-74c6-4c6f-8109-5984539d364a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:03:06.860 4088 3038337401608 GreenThread-74 DEBUG nova.network.neutron [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:03:06.882 4088 3038340570104 MainThread DEBUG nova.compute.provider_tree [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:03:06.899 4088 3038340570104 MainThread DEBUG nova.scheduler.client.report [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:03:06.899 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:06.899 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:03:06.977 4088 3038337401608 GreenThread-74 DEBUG nova.network.neutron [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:03:06.977 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-ca2de6e3-1007-49ef-81ff-987aa9efd28e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Received event network-changed-a460edb0-9bbf-4681-bdf2-95008d45a5c6 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:03:06.977 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-ca2de6e3-1007-49ef-81ff-987aa9efd28e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Refreshing instance network info cache due to event network-changed-a460edb0-9bbf-4681-bdf2-95008d45a5c6. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:03:07.024 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:03:07.024 4088 3038340567640 GreenThread-75 DEBUG nova.compute.manager [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:03:07.024 4088 3038340567640 GreenThread-75 DEBUG nova.network.neutron [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:03:07.149 4088 3038337403192 MainThread DEBUG os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': '0E543D66-F53F-4413-BE46-CE48D725441B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=26761), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:07.196 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:03:07.196 4088 3038340567640 GreenThread-75 DEBUG nova.policy [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '206940e6bc1a478bb7f92f7778bec0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5283391577e14a77bbd03e5dcf9f9e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:03:07.212 4088 3038340570104 MainThread INFO nova.virt.hyperv.vmops [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Spawning new instance 2021-09-10 17:03:07.227 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "instance-00000054" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:07.227 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "instance-00000054" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:07.227 4088 3038340570104 MainThread DEBUG nova.block_device [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:03:07.227 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:07.227 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:07.243 4088 3038340570104 MainThread DEBUG os_win.utils.pathutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Creating directory: C:\openstack\instances\instance-00000054 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:03:07.243 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000054\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:03:07.306 4088 3038337403192 MainThread ERROR os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000053\' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)instance-00000053F618CFC6-5070-4291-BE16-EA6A8CF6810C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)instance-00000053F618CFC6-5070-4291-BE16-EA6A8CF6810C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000053\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)instance-00000053F618CFC6-5070-4291-BE16-EA6A8CF6810C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0E543D66-F53F-4413-BE46-CE48D725441B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=138313), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 7), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000053' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)\n\nNot enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)\n\n'instance-00000053' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)", 'ErrorSummaryDescription': "'instance-00000053' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000053.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:07.306 4088 3038337403192 MainThread DEBUG os_win._utils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000053' failed to start. Not enough memory in the system to start the virtual machine instance-00000053. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000053' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Not enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) 'instance-00000053' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.532515048980713 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:07.335 4088 3038342146184 MainThread DEBUG nova.virt.hyperv.vmops [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:03:07.351 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Lock "instance-0000004f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:07.351 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Lock "instance-0000004f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:07.351 4088 3038340570280 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:07.351 4088 3038340570280 MainThread INFO nova.compute.manager [-] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] VM Stopped (Lifecycle Event) 2021-09-10 17:03:07.351 4088 3038340569752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000053" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:07.351 4088 3038340569752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000053" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:07.376 4088 3038342146184 MainThread DEBUG os_win.utils.compute.vmutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Successfully changed vm state of instance-0000004f to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:03:07.376 4088 3038342146184 MainThread DEBUG nova.virt.hyperv.vmops [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Successfully changed state of VM instance-0000004f to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:03:07.376 4088 3038337404776 MainThread DEBUG os_win.utils.jobutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Waiting for WMI job: {'InstanceID': '0723C97D-7D3A-4130-AD88-70D55DBFEF79', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=22813), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:07.403 4088 3038340570280 MainThread DEBUG nova.compute.manager [req-b1064c98-ed0f-40b0-9ded-00e0b50f6b61 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:07.403 4088 3038340570280 MainThread DEBUG nova.virt.hyperv.vmops [req-b1064c98-ed0f-40b0-9ded-00e0b50f6b61 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:07.403 4088 3038337401608 GreenThread-74 DEBUG nova.network.neutron [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Updating instance_info_cache with network_info: [{"id": "a460edb0-9bbf-4681-bdf2-95008d45a5c6", "address": "fa:16:3e:71:69:7a", "network": {"id": "531a14a9-553f-4e9e-bbc0-ffeae3b418e3", "bridge": null, "label": "tempest-ServerGroupTestJSON-894972691-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3f7a5fed42ca440bb659840e05ce1f95", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa460edb0-9b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:07.431 4088 3038337401608 GreenThread-74 DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Releasing lock "refresh_cache-f817e731-74c6-4c6f-8109-5984539d364a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:03:07.431 4088 3038337401608 GreenThread-74 DEBUG nova.compute.manager [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Instance network_info: |[{"id": "a460edb0-9bbf-4681-bdf2-95008d45a5c6", "address": "fa:16:3e:71:69:7a", "network": {"id": "531a14a9-553f-4e9e-bbc0-ffeae3b418e3", "bridge": null, "label": "tempest-ServerGroupTestJSON-894972691-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3f7a5fed42ca440bb659840e05ce1f95", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa460edb0-9b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:03:07.431 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-ca2de6e3-1007-49ef-81ff-987aa9efd28e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-f817e731-74c6-4c6f-8109-5984539d364a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:03:07.431 4088 3038340569048 MainThread DEBUG nova.network.neutron [req-ca2de6e3-1007-49ef-81ff-987aa9efd28e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Refreshing network info cache for port a460edb0-9bbf-4681-bdf2-95008d45a5c6 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:03:07.446 4088 3038337401432 MainThread DEBUG nova.compute.manager [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Preparing to wait for external event network-vif-plugged-a460edb0-9bbf-4681-bdf2-95008d45a5c6 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:03:07.446 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "f817e731-74c6-4c6f-8109-5984539d364a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:07.446 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "f817e731-74c6-4c6f-8109-5984539d364a-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:07.446 4088 3038337401432 MainThread DEBUG os_win.utils.compute.vmutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Creating VM instance-00000057 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:03:07.446 4088 3038342146184 MainThread DEBUG os_win.utils.jobutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Waiting for WMI job: {'InstanceID': '5EF7ED92-645F-4F5D-B3B9-6BBF1E738E7E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20144), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:07.547 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Resizing VHD C:\openstack\instances\instance-00000054\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:03:07.556 4088 3038340570280 MainThread DEBUG nova.compute.manager [req-b1064c98-ed0f-40b0-9ded-00e0b50f6b61 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:07.593 4088 3038342146184 MainThread DEBUG os_win.utils.jobutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] WMI job succeeded: {'InstanceID': '5EF7ED92-645F-4F5D-B3B9-6BBF1E738E7E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=131571), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:03:07.593 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Lock "instance-0000004f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:07.593 4088 3038342146184 MainThread DEBUG os_win.utils.pathutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Removing directory: C:\openstack\instances\instance-0000004f check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:03:07.602 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Lock "instance-0000004f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:07.602 4088 3038342146184 MainThread ERROR nova.compute.manager [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004f' failed to start. Not enough memory in the system to start the virtual machine instance-0000004f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004f' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Not enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) 'instance-0000004f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Error code: 32778. 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Traceback (most recent call last): 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] return function(*args, **kwargs) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] admin_password, network_info, block_device_info) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] return function(self, *args, **kwds) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self.force_reraise() 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] raise self.value 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] should_plug_vifs=False) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 'req_state': req_state}) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self.force_reraise() 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] raise self.value 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] time.sleep(sleep_time) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self.force_reraise() 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] raise self.value 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] return f(*args, **kwargs) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] return self._wait_for_job(job_path) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] error_desc=err_desc) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000004f' failed to start. 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Not enough memory in the system to start the virtual machine instance-0000004f. 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004f' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Not enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 'instance-0000004f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Error code: 32778. 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] During handling of the above exception, another exception occurred: 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Traceback (most recent call last): 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] yield resources 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] accel_info=accel_info) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] return function(*args, **kwargs) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] admin_password, network_info, block_device_info) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] return function(self, *args, **kwds) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self.force_reraise() 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] raise self.value 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] should_plug_vifs=False) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 'req_state': req_state}) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self.force_reraise() 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] raise self.value 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] time.sleep(sleep_time) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self.force_reraise() 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] raise self.value 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] return f(*args, **kwargs) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] return self._wait_for_job(job_path) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] error_desc=err_desc) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004f' failed to start. 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Not enough memory in the system to start the virtual machine instance-0000004f. 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004f' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Not enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 'instance-0000004f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Error code: 32778. 2021-09-10 17:03:07.602 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:07.602 4088 3038342146184 MainThread INFO nova.compute.manager [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Terminating instance 2021-09-10 17:03:07.616 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:03:07.616 4088 3038342146184 MainThread INFO nova.virt.hyperv.vmops [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Got request to destroy instance 2021-09-10 17:03:07.616 4088 3038342147768 MainThread DEBUG os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': 'E55142EF-FC43-48FE-AE9E-FB9AD902D703', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=33374), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:07.616 4088 3038340570280 MainThread INFO nova.compute.manager [req-b1064c98-ed0f-40b0-9ded-00e0b50f6b61 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:07.664 4088 3038342146184 MainThread DEBUG nova.virt.hyperv.vmops [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:03:07.664 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Lock "instance-0000004f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:07.664 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Lock "instance-0000004f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:07.664 4088 3038342146184 MainThread INFO nova.compute.manager [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Took 0.05 seconds to destroy the instance on the hypervisor. 2021-09-10 17:03:07.664 4088 3038342146184 MainThread DEBUG nova.compute.claims [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:03:07.664 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:07.680 4088 3038337404776 MainThread ERROR os_win.utils.jobutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000050\' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)instance-00000050E945329A-F714-45F9-B225-47D73ED9AE3112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)instance-00000050E945329A-F714-45F9-B225-47D73ED9AE3110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000050\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)instance-00000050E945329A-F714-45F9-B225-47D73ED9AE31%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0723C97D-7D3A-4130-AD88-70D55DBFEF79', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=217766), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 7), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000050' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)\n\nNot enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)\n\n'instance-00000050' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)", 'ErrorSummaryDescription': "'instance-00000050' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000050.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:07.680 4088 3038337404776 MainThread DEBUG os_win._utils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000050' failed to start. Not enough memory in the system to start the virtual machine instance-00000050. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000050' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Not enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) 'instance-00000050' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 4.26694130897522 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:07.680 4088 3038340570280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000050" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:07.696 4088 3038340570280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000050" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:07.696 4088 3038340569752 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:07.696 4088 3038340569752 MainThread INFO nova.compute.manager [-] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] VM Stopped (Lifecycle Event) 2021-09-10 17:03:07.775 4088 3038340569752 MainThread DEBUG nova.compute.manager [req-7f90f3cd-bec4-47fe-8811-b585b473ec02 - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:07.775 4088 3038340569752 MainThread DEBUG nova.virt.hyperv.vmops [req-7f90f3cd-bec4-47fe-8811-b585b473ec02 - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:07.821 4088 3038342146184 MainThread DEBUG nova.virt.hyperv.hostops [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:03:07.835 4088 3038342147768 MainThread ERROR os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000052\' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)instance-000000520D0D1649-3ADA-4CCC-977A-46163F43EA0012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)instance-000000520D0D1649-3ADA-4CCC-977A-46163F43EA0010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000052\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)instance-000000520D0D1649-3ADA-4CCC-977A-46163F43EA00%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E55142EF-FC43-48FE-AE9E-FB9AD902D703', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=149183), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 7), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000052' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)\n\nNot enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)\n\n'instance-00000052' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00)", 'ErrorSummaryDescription': "'instance-00000052' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000052.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:07.835 4088 3038342147768 MainThread ERROR nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Failed to change vm state of instance-00000052 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000052' failed to start. 2021-09-10 17:03:07.835 4088 3038342147768 MainThread INFO nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Got request to destroy instance 2021-09-10 17:03:07.835 4088 3038342146184 MainThread DEBUG nova.virt.hyperv.hostops [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:03:07.902 4088 3038340570280 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:07.902 4088 3038340570280 MainThread INFO nova.compute.manager [-] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] VM Stopped (Lifecycle Event) 2021-09-10 17:03:07.902 4088 3038340570632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000052" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:07.914 4088 3038340570632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000052" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:07.929 4088 3038340570280 MainThread DEBUG nova.compute.manager [req-e519aed7-ac53-4685-8213-a9580ab4d0f3 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:07.929 4088 3038340570280 MainThread DEBUG nova.virt.hyperv.vmops [req-e519aed7-ac53-4685-8213-a9580ab4d0f3 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:07.977 4088 3038340569752 MainThread DEBUG nova.compute.manager [req-7f90f3cd-bec4-47fe-8811-b585b473ec02 - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:08.014 4088 3038340570280 MainThread DEBUG nova.compute.manager [req-e519aed7-ac53-4685-8213-a9580ab4d0f3 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:08.014 4088 3038340569752 MainThread INFO nova.compute.manager [req-7f90f3cd-bec4-47fe-8811-b585b473ec02 - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:08.039 4088 3038340570280 MainThread INFO nova.compute.manager [req-e519aed7-ac53-4685-8213-a9580ab4d0f3 - - - - -] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:08.180 4088 3038340569048 MainThread DEBUG nova.network.neutron [req-ca2de6e3-1007-49ef-81ff-987aa9efd28e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Updated VIF entry in instance network info cache for port a460edb0-9bbf-4681-bdf2-95008d45a5c6. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:03:08.180 4088 3038340569048 MainThread DEBUG nova.network.neutron [req-ca2de6e3-1007-49ef-81ff-987aa9efd28e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Updating instance_info_cache with network_info: [{"id": "a460edb0-9bbf-4681-bdf2-95008d45a5c6", "address": "fa:16:3e:71:69:7a", "network": {"id": "531a14a9-553f-4e9e-bbc0-ffeae3b418e3", "bridge": null, "label": "tempest-ServerGroupTestJSON-894972691-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3f7a5fed42ca440bb659840e05ce1f95", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa460edb0-9b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:08.180 4088 3038342146184 MainThread DEBUG nova.compute.provider_tree [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:03:08.200 4088 3038342146184 MainThread DEBUG nova.scheduler.client.report [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:03:08.200 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.531s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:08.200 4088 3038342146184 MainThread ERROR nova.compute.manager [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004f' failed to start. Not enough memory in the system to start the virtual machine instance-0000004f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004f' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Not enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) 'instance-0000004f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Error code: 32778. 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Traceback (most recent call last): 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] return function(*args, **kwargs) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] admin_password, network_info, block_device_info) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] return function(self, *args, **kwds) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self.force_reraise() 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] raise self.value 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] should_plug_vifs=False) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 'req_state': req_state}) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self.force_reraise() 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] raise self.value 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] time.sleep(sleep_time) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self.force_reraise() 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] raise self.value 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] return f(*args, **kwargs) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] return self._wait_for_job(job_path) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] error_desc=err_desc) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000004f' failed to start. 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Not enough memory in the system to start the virtual machine instance-0000004f. 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004f' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Not enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 'instance-0000004f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Error code: 32778. 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] During handling of the above exception, another exception occurred: 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Traceback (most recent call last): 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] accel_info=accel_info) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] return function(*args, **kwargs) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] admin_password, network_info, block_device_info) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] return function(self, *args, **kwds) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self.force_reraise() 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] raise self.value 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] should_plug_vifs=False) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 'req_state': req_state}) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self.force_reraise() 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] raise self.value 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] time.sleep(sleep_time) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self.force_reraise() 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] raise self.value 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] return f(*args, **kwargs) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] return self._wait_for_job(job_path) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] error_desc=err_desc) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000004f' failed to start. 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Not enough memory in the system to start the virtual machine instance-0000004f. 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004f' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Not enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 'instance-0000004f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Error code: 32778. 2021-09-10 17:03:08.200 4088 3038342146184 MainThread TRACE nova.compute.manager [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] 2021-09-10 17:03:08.210 4088 3038342146184 MainThread DEBUG nova.compute.utils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] WMI job failed with status 10. Error summary description: 'instance-0000004f' failed to start. Not enough memory in the system to start the virtual machine instance-0000004f. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:03:08.210 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Build of instance 30a2e0f5-74d7-453d-ad6a-628ef91e6d39 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000004f' failed to start. Not enough memory in the system to start the virtual machine instance-0000004f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000004f' failed to start. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Not enough memory in the system to start the virtual machine instance-0000004f with ram size 1024 megabytes. (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) 'instance-0000004f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID CF976D26-05E5-486A-B8A0-1CDD61E98B6C) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:03:08.210 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:03:08.210 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:03:08.210 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:03:08.210 4088 3038342146184 MainThread DEBUG nova.network.neutron [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:03:08.225 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [req-ca2de6e3-1007-49ef-81ff-987aa9efd28e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-f817e731-74c6-4c6f-8109-5984539d364a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:03:08.289 4088 3038340567640 GreenThread-75 DEBUG nova.network.neutron [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Successfully created port: e949d578-b15b-494e-b468-3526d92e3165 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:03:08.382 4088 3038337403192 MainThread DEBUG os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': 'A0920331-205A-41FA-8ADC-098804582D96', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16800), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:08.539 4088 3038337403192 MainThread ERROR os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000053\' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)instance-00000053F618CFC6-5070-4291-BE16-EA6A8CF6810C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)instance-00000053F618CFC6-5070-4291-BE16-EA6A8CF6810C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000053\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)instance-00000053F618CFC6-5070-4291-BE16-EA6A8CF6810C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A0920331-205A-41FA-8ADC-098804582D96', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=126169), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 8), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 8), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000053' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)\n\nNot enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)\n\n'instance-00000053' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)", 'ErrorSummaryDescription': "'instance-00000053' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000053.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:08.539 4088 3038337403192 MainThread DEBUG os_win._utils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000053' failed to start. Not enough memory in the system to start the virtual machine instance-00000053. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000053' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Not enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) 'instance-00000053' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.765704393386841 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:08.679 4088 3038340492104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:08.679 4088 3038340492104 MainThread INFO nova.compute.manager [-] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] VM Stopped (Lifecycle Event) 2021-09-10 17:03:08.679 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000053" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:08.679 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000053" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:08.726 4088 3038337404776 MainThread DEBUG os_win.utils.jobutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Waiting for WMI job: {'InstanceID': '094F2ACE-589C-4AEF-96C2-4F6E5DA51FEC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18427), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:08.726 4088 3038340492104 MainThread DEBUG nova.compute.manager [req-5be8cb00-af21-4884-9446-90921d0ce7f4 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:08.726 4088 3038340492104 MainThread DEBUG nova.virt.hyperv.vmops [req-5be8cb00-af21-4884-9446-90921d0ce7f4 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:08.790 4088 3038340492104 MainThread DEBUG nova.compute.manager [req-5be8cb00-af21-4884-9446-90921d0ce7f4 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:08.821 4088 3038340492104 MainThread INFO nova.compute.manager [req-5be8cb00-af21-4884-9446-90921d0ce7f4 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:08.854 4088 3038337404776 MainThread ERROR os_win.utils.jobutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000050\' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)instance-00000050E945329A-F714-45F9-B225-47D73ED9AE3112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)instance-00000050E945329A-F714-45F9-B225-47D73ED9AE3110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000050\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)instance-00000050E945329A-F714-45F9-B225-47D73ED9AE31%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '094F2ACE-589C-4AEF-96C2-4F6E5DA51FEC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=125565), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 8), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 8), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000050' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)\n\nNot enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)\n\n'instance-00000050' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)", 'ErrorSummaryDescription': "'instance-00000050' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000050.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:08.877 4088 3038337404776 MainThread DEBUG os_win._utils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000050' failed to start. Not enough memory in the system to start the virtual machine instance-00000050. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000050' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Not enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) 'instance-00000050' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.464074373245239 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:08.900 4088 3038342146184 MainThread DEBUG nova.network.neutron [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:08.900 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000050" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:08.900 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000050" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:08.900 4088 3038340569048 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:08.900 4088 3038340569048 MainThread INFO nova.compute.manager [-] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] VM Stopped (Lifecycle Event) 2021-09-10 17:03:08.935 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-10014cf6-7215-406f-8c73-c7ea43ced572 - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:08.935 4088 3038340569048 MainThread DEBUG nova.virt.hyperv.vmops [req-10014cf6-7215-406f-8c73-c7ea43ced572 - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:08.935 4088 3038342146184 MainThread INFO nova.compute.manager [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] [instance: 30a2e0f5-74d7-453d-ad6a-628ef91e6d39] Took 0.72 seconds to deallocate network for instance. 2021-09-10 17:03:08.977 4088 3038340569048 MainThread DEBUG nova.compute.manager [req-10014cf6-7215-406f-8c73-c7ea43ced572 - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:09.023 4088 3038340569048 MainThread INFO nova.compute.manager [req-10014cf6-7215-406f-8c73-c7ea43ced572 - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:09.118 4088 3038342146184 MainThread INFO nova.scheduler.client.report [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Deleted allocations for instance 30a2e0f5-74d7-453d-ad6a-628ef91e6d39 2021-09-10 17:03:09.164 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-41772b22-dcb9-4a17-abb7-f6b90cd34b21 a57565d91e984026bfef16cbf8b6f2bc 57e8809b286f4c5aad08911c6a289582 - default default] Lock "30a2e0f5-74d7-453d-ad6a-628ef91e6d39" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 33.282s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:09.444 4088 3038337401432 MainThread DEBUG nova.virt.hyperv.vmops [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:03:09.604 4088 3038337403192 MainThread DEBUG os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': '7BEAF93C-AE44-46D5-80BA-AFA62B8BD79C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17057), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:09.741 4088 3038337403192 MainThread ERROR os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000053\' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)instance-00000053F618CFC6-5070-4291-BE16-EA6A8CF6810C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)instance-00000053F618CFC6-5070-4291-BE16-EA6A8CF6810C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000053\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)instance-00000053F618CFC6-5070-4291-BE16-EA6A8CF6810C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7BEAF93C-AE44-46D5-80BA-AFA62B8BD79C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117776), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 9), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 9), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000053' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)\n\nNot enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)\n\n'instance-00000053' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)", 'ErrorSummaryDescription': "'instance-00000053' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000053.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:09.741 4088 3038337403192 MainThread DEBUG os_win._utils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000053' failed to start. Not enough memory in the system to start the virtual machine instance-00000053. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000053' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Not enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) 'instance-00000053' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.967723846435547 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:09.778 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000053" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:09.778 4088 3038340569048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000053" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:09.778 4088 3038342146184 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:09.778 4088 3038342146184 MainThread INFO nova.compute.manager [-] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] VM Stopped (Lifecycle Event) 2021-09-10 17:03:09.804 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-b10eab13-1008-4d3f-9bcf-62a555b438e7 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:09.804 4088 3038342146184 MainThread DEBUG nova.virt.hyperv.vmops [req-b10eab13-1008-4d3f-9bcf-62a555b438e7 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:09.852 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-b10eab13-1008-4d3f-9bcf-62a555b438e7 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:09.867 4088 3038342146184 MainThread INFO nova.compute.manager [req-b10eab13-1008-4d3f-9bcf-62a555b438e7 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:09.915 4088 3038337404776 MainThread DEBUG os_win.utils.jobutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Waiting for WMI job: {'InstanceID': 'EBEDA9E1-3E70-4F26-8F32-5C7F9FED8B28', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16769), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:10.041 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:03:10.041 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-00000052" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:10.041 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-00000052" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:10.069 4088 3038337404776 MainThread ERROR os_win.utils.jobutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000050\' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)instance-00000050E945329A-F714-45F9-B225-47D73ED9AE3112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)instance-00000050E945329A-F714-45F9-B225-47D73ED9AE3110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000050\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)instance-00000050E945329A-F714-45F9-B225-47D73ED9AE31%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'EBEDA9E1-3E70-4F26-8F32-5C7F9FED8B28', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119871), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 9), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 10), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000050' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)\n\nNot enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)\n\n'instance-00000050' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31)", 'ErrorSummaryDescription': "'instance-00000050' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000050.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:10.069 4088 3038337404776 MainThread ERROR nova.virt.hyperv.vmops [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Failed to change vm state of instance-00000050 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000050' failed to start. 2021-09-10 17:03:10.069 4088 3038337404776 MainThread INFO nova.virt.hyperv.vmops [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Got request to destroy instance 2021-09-10 17:03:10.086 4088 3038342147768 MainThread DEBUG os_win.utils.compute.vmutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Successfully changed vm state of instance-00000052 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:03:10.086 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Successfully changed state of VM instance-00000052 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:03:10.103 4088 3038340492104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:10.103 4088 3038340492104 MainThread INFO nova.compute.manager [-] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] VM Stopped (Lifecycle Event) 2021-09-10 17:03:10.103 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000050" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:10.103 4088 3038340492456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000050" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:10.142 4088 3038340492104 MainThread DEBUG nova.compute.manager [req-0c3d5034-05fb-4183-a82e-8db99d423dbf - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:10.142 4088 3038340492104 MainThread DEBUG nova.virt.hyperv.vmops [req-0c3d5034-05fb-4183-a82e-8db99d423dbf - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:10.142 4088 3038342147768 MainThread DEBUG os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': 'CF459F63-D059-44F3-9FF8-9A0D75F6D5EE', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16346), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:10.260 4088 3038342147768 MainThread DEBUG os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job succeeded: {'InstanceID': 'CF459F63-D059-44F3-9FF8-9A0D75F6D5EE', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=120957), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:03:10.260 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-00000052" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:10.260 4088 3038342147768 MainThread DEBUG os_win.utils.pathutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Removing directory: C:\openstack\instances\instance-00000052 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:03:10.274 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-00000052" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:10.274 4088 3038342147768 MainThread ERROR nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000052' failed to start. Not enough memory in the system to start the virtual machine instance-00000052. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000052' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Not enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) 'instance-00000052' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Error code: 32778. 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Traceback (most recent call last): 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] return function(*args, **kwargs) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] admin_password, network_info, block_device_info) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] return function(self, *args, **kwds) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self.force_reraise() 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] raise self.value 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] should_plug_vifs=False) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 'req_state': req_state}) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self.force_reraise() 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] raise self.value 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] time.sleep(sleep_time) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self.force_reraise() 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] raise self.value 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] return f(*args, **kwargs) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] return self._wait_for_job(job_path) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] error_desc=err_desc) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000052' failed to start. 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Not enough memory in the system to start the virtual machine instance-00000052. 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000052' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Not enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 'instance-00000052' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Error code: 32778. 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] During handling of the above exception, another exception occurred: 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Traceback (most recent call last): 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] yield resources 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] accel_info=accel_info) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] return function(*args, **kwargs) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] admin_password, network_info, block_device_info) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] return function(self, *args, **kwds) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self.force_reraise() 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] raise self.value 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] should_plug_vifs=False) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 'req_state': req_state}) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self.force_reraise() 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] raise self.value 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] time.sleep(sleep_time) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self.force_reraise() 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] raise self.value 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] return f(*args, **kwargs) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] return self._wait_for_job(job_path) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] error_desc=err_desc) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000052' failed to start. 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Not enough memory in the system to start the virtual machine instance-00000052. 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000052' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Not enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 'instance-00000052' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Error code: 32778. 2021-09-10 17:03:10.274 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.274 4088 3038342147768 MainThread INFO nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Terminating instance 2021-09-10 17:03:10.274 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:03:10.274 4088 3038342147768 MainThread INFO nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Got request to destroy instance 2021-09-10 17:03:10.290 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:03:10.290 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-00000052" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:10.304 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-00000052" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:10.304 4088 3038342147768 MainThread INFO nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:03:10.304 4088 3038342147768 MainThread DEBUG nova.compute.claims [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:03:10.304 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:10.304 4088 3038340492104 MainThread DEBUG nova.compute.manager [req-0c3d5034-05fb-4183-a82e-8db99d423dbf - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:10.336 4088 3038340492104 MainThread INFO nova.compute.manager [req-0c3d5034-05fb-4183-a82e-8db99d423dbf - - - - -] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:10.444 4088 3038340567640 GreenThread-75 DEBUG nova.network.neutron [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Successfully updated port: e949d578-b15b-494e-b468-3526d92e3165 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:03:10.476 4088 3038340567640 GreenThread-75 DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Acquired lock "refresh_cache-d358307f-112b-4be6-9b2a-08f9ad26205e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:03:10.476 4088 3038340567640 GreenThread-75 DEBUG nova.network.neutron [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:03:10.476 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.hostops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:03:10.508 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.hostops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:03:10.727 4088 3038342147768 MainThread DEBUG nova.compute.provider_tree [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:03:10.758 4088 3038340567640 GreenThread-75 DEBUG nova.network.neutron [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:03:10.758 4088 3038342147768 MainThread DEBUG nova.scheduler.client.report [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:03:10.758 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:10.758 4088 3038342147768 MainThread ERROR nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000052' failed to start. Not enough memory in the system to start the virtual machine instance-00000052. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000052' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Not enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) 'instance-00000052' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Error code: 32778. 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Traceback (most recent call last): 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] return function(*args, **kwargs) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] admin_password, network_info, block_device_info) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] return function(self, *args, **kwds) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self.force_reraise() 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] raise self.value 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] should_plug_vifs=False) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 'req_state': req_state}) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self.force_reraise() 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] raise self.value 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] time.sleep(sleep_time) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self.force_reraise() 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] raise self.value 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] return f(*args, **kwargs) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] return self._wait_for_job(job_path) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] error_desc=err_desc) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000052' failed to start. 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Not enough memory in the system to start the virtual machine instance-00000052. 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000052' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Not enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 'instance-00000052' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Error code: 32778. 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] During handling of the above exception, another exception occurred: 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Traceback (most recent call last): 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] accel_info=accel_info) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] return function(*args, **kwargs) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] admin_password, network_info, block_device_info) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] return function(self, *args, **kwds) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self.force_reraise() 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] raise self.value 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] should_plug_vifs=False) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 'req_state': req_state}) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self.force_reraise() 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] raise self.value 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] time.sleep(sleep_time) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self.force_reraise() 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] raise self.value 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] return f(*args, **kwargs) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] return self._wait_for_job(job_path) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] error_desc=err_desc) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000052' failed to start. 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Not enough memory in the system to start the virtual machine instance-00000052. 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000052' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Not enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 'instance-00000052' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Error code: 32778. 2021-09-10 17:03:10.758 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 84fb0901-77a9-482c-9355-34416b3289cb] 2021-09-10 17:03:10.778 4088 3038342147768 MainThread DEBUG nova.compute.utils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] WMI job failed with status 10. Error summary description: 'instance-00000052' failed to start. Not enough memory in the system to start the virtual machine instance-00000052. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:03:10.778 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Build of instance 84fb0901-77a9-482c-9355-34416b3289cb was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000052' failed to start. Not enough memory in the system to start the virtual machine instance-00000052. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000052' failed to start. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Not enough memory in the system to start the virtual machine instance-00000052 with ram size 1024 megabytes. (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) 'instance-00000052' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0D0D1649-3ADA-4CCC-977A-46163F43EA00) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:03:10.778 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:03:10.778 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:03:10.778 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:03:10.788 4088 3038342147768 MainThread DEBUG nova.network.neutron [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:03:10.788 4088 3038337403192 MainThread DEBUG os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': 'D1808A55-DB4B-4C48-8757-35014B267C40', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17358), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:10.930 4088 3038337403192 MainThread ERROR os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000053\' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)instance-00000053F618CFC6-5070-4291-BE16-EA6A8CF6810C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)instance-00000053F618CFC6-5070-4291-BE16-EA6A8CF6810C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000053\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)instance-00000053F618CFC6-5070-4291-BE16-EA6A8CF6810C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D1808A55-DB4B-4C48-8757-35014B267C40', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117571), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 10), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 10), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000053' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)\n\nNot enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)\n\n'instance-00000053' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)", 'ErrorSummaryDescription': "'instance-00000053' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000053.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:10.930 4088 3038337403192 MainThread DEBUG os_win._utils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000053' failed to start. Not enough memory in the system to start the virtual machine instance-00000053. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000053' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Not enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) 'instance-00000053' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.156383514404297 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:10.953 4088 3038342145832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000053" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:10.953 4088 3038342145832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000053" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:10.953 4088 3038342144776 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:10.953 4088 3038342144776 MainThread INFO nova.compute.manager [-] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] VM Stopped (Lifecycle Event) 2021-09-10 17:03:10.965 4088 3038342144776 MainThread DEBUG nova.compute.manager [req-5d7bcee9-425e-4a28-b62f-bf704ab2ccf8 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:10.965 4088 3038342144776 MainThread DEBUG nova.virt.hyperv.vmops [req-5d7bcee9-425e-4a28-b62f-bf704ab2ccf8 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:11.016 4088 3038342144776 MainThread DEBUG nova.compute.manager [req-5d7bcee9-425e-4a28-b62f-bf704ab2ccf8 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:11.040 4088 3038342144776 MainThread INFO nova.compute.manager [req-5d7bcee9-425e-4a28-b62f-bf704ab2ccf8 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:11.070 4088 3038342144776 MainThread DEBUG nova.compute.manager [req-25866bdf-18a5-4a19-84bc-3939be8b5232 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Received event network-changed-e949d578-b15b-494e-b468-3526d92e3165 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:03:11.070 4088 3038342144776 MainThread DEBUG nova.compute.manager [req-25866bdf-18a5-4a19-84bc-3939be8b5232 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Refreshing instance network info cache due to event network-changed-e949d578-b15b-494e-b468-3526d92e3165. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:03:11.387 4088 3038342147768 MainThread DEBUG nova.network.neutron [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:11.418 4088 3038342147768 MainThread INFO nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 84fb0901-77a9-482c-9355-34416b3289cb] Took 0.64 seconds to deallocate network for instance. 2021-09-10 17:03:11.603 4088 3038342147768 MainThread INFO nova.scheduler.client.report [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Deleted allocations for instance 84fb0901-77a9-482c-9355-34416b3289cb 2021-09-10 17:03:11.680 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "84fb0901-77a9-482c-9355-34416b3289cb" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 28.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:11.867 4088 3038340567640 GreenThread-75 DEBUG nova.network.neutron [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Updating instance_info_cache with network_info: [{"id": "e949d578-b15b-494e-b468-3526d92e3165", "address": "fa:16:3e:e6:a1:58", "network": {"id": "e365bc30-8c38-4b70-a29c-e076c845f9de", "bridge": null, "label": "tempest-AttachVolumeTestJSON-1488926721-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5283391577e14a77bbd03e5dcf9f9e5c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape949d578-b1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:11.930 4088 3038340567640 GreenThread-75 DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Releasing lock "refresh_cache-d358307f-112b-4be6-9b2a-08f9ad26205e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:03:11.930 4088 3038340567640 GreenThread-75 DEBUG nova.compute.manager [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Instance network_info: |[{"id": "e949d578-b15b-494e-b468-3526d92e3165", "address": "fa:16:3e:e6:a1:58", "network": {"id": "e365bc30-8c38-4b70-a29c-e076c845f9de", "bridge": null, "label": "tempest-AttachVolumeTestJSON-1488926721-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5283391577e14a77bbd03e5dcf9f9e5c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape949d578-b1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:03:11.930 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Preparing to wait for external event network-vif-plugged-e949d578-b15b-494e-b468-3526d92e3165 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:03:11.930 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "d358307f-112b-4be6-9b2a-08f9ad26205e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:11.930 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "d358307f-112b-4be6-9b2a-08f9ad26205e-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:11.944 4088 3038340570104 MainThread DEBUG os_win.utils.compute.vmutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Creating VM instance-00000054 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:03:11.944 4088 3038342144776 MainThread DEBUG oslo_concurrency.lockutils [req-25866bdf-18a5-4a19-84bc-3939be8b5232 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-d358307f-112b-4be6-9b2a-08f9ad26205e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:03:11.944 4088 3038342144776 MainThread DEBUG nova.network.neutron [req-25866bdf-18a5-4a19-84bc-3939be8b5232 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Refreshing network info cache for port e949d578-b15b-494e-b468-3526d92e3165 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:03:11.975 4088 3038337403192 MainThread DEBUG os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': '7ADF3434-8FAA-4F6B-81C0-358DAA3B7933', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17577), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:12.135 4088 3038337403192 MainThread ERROR os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000053\' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)instance-00000053F618CFC6-5070-4291-BE16-EA6A8CF6810C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)instance-00000053F618CFC6-5070-4291-BE16-EA6A8CF6810C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000053\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)instance-00000053F618CFC6-5070-4291-BE16-EA6A8CF6810C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7ADF3434-8FAA-4F6B-81C0-358DAA3B7933', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120628), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 11), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 12), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000053' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)\n\nNot enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)\n\n'instance-00000053' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C)", 'ErrorSummaryDescription': "'instance-00000053' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000053.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:12.135 4088 3038337403192 MainThread ERROR nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Failed to change vm state of instance-00000053 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000053' failed to start. 2021-09-10 17:03:12.135 4088 3038337403192 MainThread INFO nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Got request to destroy instance 2021-09-10 17:03:12.179 4088 3038337404776 MainThread DEBUG nova.virt.hyperv.vmops [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:03:12.179 4088 3038337404776 MainThread DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "instance-00000050" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:12.179 4088 3038337404776 MainThread DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "instance-00000050" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:12.272 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "ba57675b-1666-430f-bbaa-84c5ca720900" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:12.289 4088 3038340489288 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000053" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:12.289 4088 3038340489288 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000053" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:12.289 4088 3038342145128 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:12.307 4088 3038342145128 MainThread INFO nova.compute.manager [-] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] VM Stopped (Lifecycle Event) 2021-09-10 17:03:12.307 4088 3038337404776 MainThread DEBUG os_win.utils.compute.vmutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Successfully changed vm state of instance-00000050 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:03:12.307 4088 3038337404776 MainThread DEBUG nova.virt.hyperv.vmops [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Successfully changed state of VM instance-00000050 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:03:12.336 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:03:12.336 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-9aa834b5-8db2-44b9-bc8d-f700e97bcef6 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:12.336 4088 3038342145128 MainThread DEBUG nova.virt.hyperv.vmops [req-9aa834b5-8db2-44b9-bc8d-f700e97bcef6 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:12.366 4088 3038337404776 MainThread DEBUG os_win.utils.jobutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Waiting for WMI job: {'InstanceID': 'AAC4987E-C98A-47D9-A55B-E16D4058974B', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21393), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:12.512 4088 3038337404776 MainThread DEBUG os_win.utils.jobutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] WMI job succeeded: {'InstanceID': 'AAC4987E-C98A-47D9-A55B-E16D4058974B', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=131351), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:03:12.524 4088 3038337404776 MainThread DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "instance-00000050" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:12.524 4088 3038337404776 MainThread DEBUG os_win.utils.pathutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Removing directory: C:\openstack\instances\instance-00000050 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:03:12.524 4088 3038337404776 MainThread DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "instance-00000050" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:12.524 4088 3038337404776 MainThread ERROR nova.compute.manager [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000050' failed to start. Not enough memory in the system to start the virtual machine instance-00000050. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000050' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Not enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) 'instance-00000050' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Error code: 32778. 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Traceback (most recent call last): 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] return function(*args, **kwargs) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] admin_password, network_info, block_device_info) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] return function(self, *args, **kwds) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self.force_reraise() 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] raise self.value 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] should_plug_vifs=False) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 'req_state': req_state}) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self.force_reraise() 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] raise self.value 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] time.sleep(sleep_time) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self.force_reraise() 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] raise self.value 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] return f(*args, **kwargs) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] return self._wait_for_job(job_path) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] error_desc=err_desc) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000050' failed to start. 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Not enough memory in the system to start the virtual machine instance-00000050. 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000050' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Not enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 'instance-00000050' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Error code: 32778. 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] During handling of the above exception, another exception occurred: 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Traceback (most recent call last): 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] yield resources 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] accel_info=accel_info) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] return function(*args, **kwargs) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] admin_password, network_info, block_device_info) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] return function(self, *args, **kwds) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self.force_reraise() 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] raise self.value 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] should_plug_vifs=False) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 'req_state': req_state}) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self.force_reraise() 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] raise self.value 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] time.sleep(sleep_time) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self.force_reraise() 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] raise self.value 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] return f(*args, **kwargs) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] return self._wait_for_job(job_path) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] error_desc=err_desc) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000050' failed to start. 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Not enough memory in the system to start the virtual machine instance-00000050. 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000050' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Not enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 'instance-00000050' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Error code: 32778. 2021-09-10 17:03:12.524 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:12.524 4088 3038337404776 MainThread INFO nova.compute.manager [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Terminating instance 2021-09-10 17:03:12.524 4088 3038337404776 MainThread DEBUG nova.compute.manager [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:03:12.524 4088 3038337404776 MainThread INFO nova.virt.hyperv.vmops [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Got request to destroy instance 2021-09-10 17:03:12.559 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:12.559 4088 3038340491224 MainThread DEBUG nova.virt.hardware [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:03:12.559 4088 3038340491224 MainThread INFO nova.compute.claims [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Claim successful on node n-h2-808474-1 2021-09-10 17:03:12.571 4088 3038337404776 MainThread DEBUG nova.virt.hyperv.vmops [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:03:12.571 4088 3038337404776 MainThread DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "instance-00000050" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:12.571 4088 3038337404776 MainThread DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "instance-00000050" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:12.571 4088 3038337404776 MainThread INFO nova.compute.manager [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Took 0.05 seconds to destroy the instance on the hypervisor. 2021-09-10 17:03:12.595 4088 3038337404776 MainThread DEBUG nova.compute.claims [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:03:12.595 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-9aa834b5-8db2-44b9-bc8d-f700e97bcef6 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:12.624 4088 3038342145128 MainThread INFO nova.compute.manager [req-9aa834b5-8db2-44b9-bc8d-f700e97bcef6 - - - - -] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:12.711 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.hostops [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:03:12.711 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.hostops [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:03:12.977 4088 3038342144776 MainThread DEBUG nova.network.neutron [req-25866bdf-18a5-4a19-84bc-3939be8b5232 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Updated VIF entry in instance network info cache for port e949d578-b15b-494e-b468-3526d92e3165. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:03:12.977 4088 3038342144776 MainThread DEBUG nova.network.neutron [req-25866bdf-18a5-4a19-84bc-3939be8b5232 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Updating instance_info_cache with network_info: [{"id": "e949d578-b15b-494e-b468-3526d92e3165", "address": "fa:16:3e:e6:a1:58", "network": {"id": "e365bc30-8c38-4b70-a29c-e076c845f9de", "bridge": null, "label": "tempest-AttachVolumeTestJSON-1488926721-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5283391577e14a77bbd03e5dcf9f9e5c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape949d578-b1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:13.007 4088 3038342144776 MainThread DEBUG oslo_concurrency.lockutils [req-25866bdf-18a5-4a19-84bc-3939be8b5232 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-d358307f-112b-4be6-9b2a-08f9ad26205e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:03:13.007 4088 3038340491224 MainThread DEBUG nova.compute.provider_tree [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:03:13.078 4088 3038340491224 MainThread DEBUG nova.scheduler.client.report [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:03:13.078 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:13.078 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:03:13.078 4088 3038337404776 MainThread DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:13.211 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:03:13.229 4088 3038342147768 GreenThread-76 DEBUG nova.compute.manager [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:03:13.229 4088 3038342147768 GreenThread-76 DEBUG nova.network.neutron [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:03:13.262 4088 3038337404776 MainThread DEBUG nova.virt.hyperv.hostops [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:03:13.275 4088 3038337404776 MainThread DEBUG nova.virt.hyperv.hostops [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:03:13.352 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:03:13.372 4088 3038340491224 MainThread INFO nova.virt.hyperv.vmops [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Spawning new instance 2021-09-10 17:03:13.382 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000055" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:13.382 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000055" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:13.382 4088 3038340491224 MainThread DEBUG nova.block_device [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:03:13.382 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:13.382 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:13.397 4088 3038340491224 MainThread DEBUG os_win.utils.pathutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Creating directory: C:\openstack\instances\instance-00000055 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:03:13.397 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000055\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:03:13.509 4088 3038337404776 MainThread DEBUG nova.compute.provider_tree [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:03:13.544 4088 3038337404776 MainThread DEBUG nova.scheduler.client.report [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:03:13.544 4088 3038337404776 MainThread DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:13.544 4088 3038337404776 MainThread ERROR nova.compute.manager [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000050' failed to start. Not enough memory in the system to start the virtual machine instance-00000050. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000050' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Not enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) 'instance-00000050' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Error code: 32778. 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Traceback (most recent call last): 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] return function(*args, **kwargs) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] admin_password, network_info, block_device_info) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] return function(self, *args, **kwds) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self.force_reraise() 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] raise self.value 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] should_plug_vifs=False) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 'req_state': req_state}) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self.force_reraise() 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] raise self.value 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] time.sleep(sleep_time) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self.force_reraise() 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] raise self.value 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] return f(*args, **kwargs) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] return self._wait_for_job(job_path) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] error_desc=err_desc) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000050' failed to start. 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Not enough memory in the system to start the virtual machine instance-00000050. 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000050' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Not enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 'instance-00000050' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Error code: 32778. 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] During handling of the above exception, another exception occurred: 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Traceback (most recent call last): 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] accel_info=accel_info) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] return function(*args, **kwargs) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] admin_password, network_info, block_device_info) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] return function(self, *args, **kwds) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self.force_reraise() 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] raise self.value 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] should_plug_vifs=False) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 'req_state': req_state}) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self.force_reraise() 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] raise self.value 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] time.sleep(sleep_time) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self.force_reraise() 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] raise self.value 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] return f(*args, **kwargs) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] return self._wait_for_job(job_path) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] error_desc=err_desc) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000050' failed to start. 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Not enough memory in the system to start the virtual machine instance-00000050. 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000050' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Not enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 'instance-00000050' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Error code: 32778. 2021-09-10 17:03:13.544 4088 3038337404776 MainThread TRACE nova.compute.manager [instance: 8001e033-b435-408f-a338-cd26132a7cc1] 2021-09-10 17:03:13.544 4088 3038337404776 MainThread DEBUG nova.compute.utils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] WMI job failed with status 10. Error summary description: 'instance-00000050' failed to start. Not enough memory in the system to start the virtual machine instance-00000050. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:03:13.544 4088 3038337404776 MainThread DEBUG nova.compute.manager [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Build of instance 8001e033-b435-408f-a338-cd26132a7cc1 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000050' failed to start. Not enough memory in the system to start the virtual machine instance-00000050. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000050' failed to start. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Not enough memory in the system to start the virtual machine instance-00000050 with ram size 1024 megabytes. (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) 'instance-00000050' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID E945329A-F714-45F9-B225-47D73ED9AE31) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:03:13.544 4088 3038337404776 MainThread DEBUG nova.compute.manager [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:03:13.544 4088 3038337404776 MainThread DEBUG nova.compute.manager [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:03:13.544 4088 3038337404776 MainThread DEBUG nova.compute.manager [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:03:13.544 4088 3038337404776 MainThread DEBUG nova.network.neutron [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:03:13.648 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Resizing VHD C:\openstack\instances\instance-00000055\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:03:13.837 4088 3038340491576 MainThread DEBUG nova.compute.manager [req-79ab445b-a09e-4a69-b022-7131c5bcf2f9 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Received event network-vif-deleted-501733fd-1af5-48d6-aec1-204bd50f155d external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:03:13.928 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:03:13.991 4088 3038342147768 GreenThread-76 DEBUG nova.policy [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f286737f0e6452bbe04f42184b6d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df662acac0f043bb8be9c87490878d93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:03:14.287 4088 3038337404776 MainThread DEBUG nova.network.neutron [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:14.303 4088 3038337404776 MainThread INFO nova.compute.manager [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] [instance: 8001e033-b435-408f-a338-cd26132a7cc1] Took 0.77 seconds to deallocate network for instance. 2021-09-10 17:03:14.511 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-0dda3442-79f0-48d3-a3c3-d6615cd9295a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Received event network-vif-plugged-a460edb0-9bbf-4681-bdf2-95008d45a5c6 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:03:14.511 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [req-0dda3442-79f0-48d3-a3c3-d6615cd9295a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "f817e731-74c6-4c6f-8109-5984539d364a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:14.511 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [req-0dda3442-79f0-48d3-a3c3-d6615cd9295a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "f817e731-74c6-4c6f-8109-5984539d364a-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:14.511 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-0dda3442-79f0-48d3-a3c3-d6615cd9295a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Processing event network-vif-plugged-a460edb0-9bbf-4681-bdf2-95008d45a5c6 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:03:14.511 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:03:14.511 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-00000053" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:14.511 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-00000053" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:14.537 4088 3038337404776 MainThread INFO nova.scheduler.client.report [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Deleted allocations for instance 8001e033-b435-408f-a338-cd26132a7cc1 2021-09-10 17:03:14.555 4088 3038337403192 MainThread DEBUG os_win.utils.compute.vmutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Successfully changed vm state of instance-00000053 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:03:14.555 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Successfully changed state of VM instance-00000053 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:03:14.571 4088 3038337401432 MainThread INFO nova.virt.hyperv.vmops [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Using config drive for instance 2021-09-10 17:03:14.603 4088 3038337404776 MainThread DEBUG oslo_concurrency.lockutils [req-3b5a268a-8c60-404d-8378-b380f189b636 0063b05acec342499daf8129dc0ca365 5d6026a33839407f9f68cb295fbb6928 - default default] Lock "8001e033-b435-408f-a338-cd26132a7cc1" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 27.281s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:14.617 4088 3038337403192 MainThread DEBUG os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Waiting for WMI job: {'InstanceID': '8CC77663-5E32-4B22-96B8-E962DBE28C44', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16097), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:14.727 4088 3038337403192 MainThread DEBUG os_win.utils.jobutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] WMI job succeeded: {'InstanceID': '8CC77663-5E32-4B22-96B8-E962DBE28C44', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=110909), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:03:14.727 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-00000053" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:14.727 4088 3038337403192 MainThread DEBUG os_win.utils.pathutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Removing directory: C:\openstack\instances\instance-00000053 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:03:14.727 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-00000053" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:14.743 4088 3038337403192 MainThread ERROR nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000053' failed to start. Not enough memory in the system to start the virtual machine instance-00000053. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000053' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Not enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) 'instance-00000053' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Error code: 32778. 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Traceback (most recent call last): 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] return function(*args, **kwargs) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] admin_password, network_info, block_device_info) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] return function(self, *args, **kwds) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self.force_reraise() 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] raise self.value 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] should_plug_vifs=False) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 'req_state': req_state}) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self.force_reraise() 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] raise self.value 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] time.sleep(sleep_time) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self.force_reraise() 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] raise self.value 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] return f(*args, **kwargs) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] return self._wait_for_job(job_path) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] error_desc=err_desc) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000053' failed to start. 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Not enough memory in the system to start the virtual machine instance-00000053. 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000053' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Not enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 'instance-00000053' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Error code: 32778. 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] During handling of the above exception, another exception occurred: 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Traceback (most recent call last): 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] yield resources 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] accel_info=accel_info) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] return function(*args, **kwargs) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] admin_password, network_info, block_device_info) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] return function(self, *args, **kwds) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self.force_reraise() 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] raise self.value 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] should_plug_vifs=False) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 'req_state': req_state}) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self.force_reraise() 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] raise self.value 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] time.sleep(sleep_time) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self.force_reraise() 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] raise self.value 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] return f(*args, **kwargs) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] return self._wait_for_job(job_path) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] error_desc=err_desc) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000053' failed to start. 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Not enough memory in the system to start the virtual machine instance-00000053. 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000053' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Not enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 'instance-00000053' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Error code: 32778. 2021-09-10 17:03:14.743 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:14.743 4088 3038337403192 MainThread INFO nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Terminating instance 2021-09-10 17:03:14.743 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:03:14.743 4088 3038337403192 MainThread INFO nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Got request to destroy instance 2021-09-10 17:03:14.743 4088 3038337401432 MainThread INFO nova.virt.hyperv.vmops [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Creating config drive at C:\openstack\instances\instance-00000057\configdrive.iso 2021-09-10 17:03:14.852 4088 3038337401432 MainThread DEBUG oslo_concurrency.processutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000057\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp8khcihvk execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:03:15.023 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.vmops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:03:15.023 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-00000053" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:15.023 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "instance-00000053" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:15.023 4088 3038337403192 MainThread INFO nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Took 0.28 seconds to destroy the instance on the hypervisor. 2021-09-10 17:03:15.023 4088 3038337403192 MainThread DEBUG nova.compute.claims [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:03:15.023 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:15.168 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.hostops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:03:15.189 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.hostops [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:03:15.189 4088 3038337401432 MainThread DEBUG oslo_concurrency.processutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000057\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp8khcihvk" returned: 0 in 0.344s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:03:15.430 4088 3038337403192 MainThread DEBUG nova.compute.provider_tree [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:03:15.445 4088 3038337403192 MainThread DEBUG nova.scheduler.client.report [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:03:15.445 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:15.445 4088 3038337403192 MainThread ERROR nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000053' failed to start. Not enough memory in the system to start the virtual machine instance-00000053. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000053' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Not enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) 'instance-00000053' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Error code: 32778. 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Traceback (most recent call last): 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] return function(*args, **kwargs) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] admin_password, network_info, block_device_info) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] return function(self, *args, **kwds) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self.force_reraise() 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] raise self.value 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] should_plug_vifs=False) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 'req_state': req_state}) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self.force_reraise() 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] raise self.value 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] time.sleep(sleep_time) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self.force_reraise() 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] raise self.value 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] return f(*args, **kwargs) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] return self._wait_for_job(job_path) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] error_desc=err_desc) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000053' failed to start. 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Not enough memory in the system to start the virtual machine instance-00000053. 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000053' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Not enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 'instance-00000053' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Error code: 32778. 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] During handling of the above exception, another exception occurred: 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Traceback (most recent call last): 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] accel_info=accel_info) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] return function(*args, **kwargs) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] admin_password, network_info, block_device_info) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] return function(self, *args, **kwds) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self.force_reraise() 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] raise self.value 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] should_plug_vifs=False) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 'req_state': req_state}) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self.force_reraise() 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] raise self.value 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] time.sleep(sleep_time) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self.force_reraise() 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] raise self.value 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] return f(*args, **kwargs) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] return self._wait_for_job(job_path) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] error_desc=err_desc) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000053' failed to start. 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Not enough memory in the system to start the virtual machine instance-00000053. 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000053' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Not enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 'instance-00000053' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Error code: 32778. 2021-09-10 17:03:15.445 4088 3038337403192 MainThread TRACE nova.compute.manager [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] 2021-09-10 17:03:15.445 4088 3038337403192 MainThread DEBUG nova.compute.utils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] WMI job failed with status 10. Error summary description: 'instance-00000053' failed to start. Not enough memory in the system to start the virtual machine instance-00000053. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:03:15.445 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Build of instance 02a3f851-fc39-4889-aaff-e5a3385f19c0 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000053' failed to start. Not enough memory in the system to start the virtual machine instance-00000053. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000053' failed to start. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Not enough memory in the system to start the virtual machine instance-00000053 with ram size 1024 megabytes. (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) 'instance-00000053' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F618CFC6-5070-4291-BE16-EA6A8CF6810C) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:03:15.445 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:03:15.445 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:03:15.445 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:03:15.445 4088 3038337403192 MainThread DEBUG nova.network.neutron [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:03:15.509 4088 3038342147768 GreenThread-76 DEBUG nova.network.neutron [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Successfully created port: 74f0c1ba-810b-4915-a0ac-2a1b7bb7cea0 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:03:15.742 4088 3038337401432 MainThread DEBUG nova.virt.hyperv.vmops [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Setting boot order for instance: instance-00000057: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:03:15.850 4088 3038337401432 MainThread DEBUG nova.virt.hyperv.vmops [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:03:15.882 4088 3038337401432 MainThread DEBUG os_win.utils.jobutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Waiting for WMI job: {'InstanceID': '1FE3F05A-A00D-4AF3-8B2C-B6D2868A542A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15816), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:16.022 4088 3038337401432 MainThread ERROR os_win.utils.jobutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000057\' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)instance-00000057DC78885B-5663-402B-A82C-F0DC0E45B11712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)instance-00000057DC78885B-5663-402B-A82C-F0DC0E45B11710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000057\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)instance-00000057DC78885B-5663-402B-A82C-F0DC0E45B117%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1FE3F05A-A00D-4AF3-8B2C-B6D2868A542A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121062), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 15), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 15), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000057' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)\n\nNot enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)\n\n'instance-00000057' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)", 'ErrorSummaryDescription': "'instance-00000057' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000057.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:16.022 4088 3038337401432 MainThread DEBUG os_win._utils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000057' failed to start. Not enough memory in the system to start the virtual machine instance-00000057. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000057' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Not enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) 'instance-00000057' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1645503044128418 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:16.071 4088 3038337402840 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:16.071 4088 3038337402840 MainThread INFO nova.compute.manager [-] [instance: f817e731-74c6-4c6f-8109-5984539d364a] VM Stopped (Lifecycle Event) 2021-09-10 17:03:16.071 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000057" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:16.071 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000057" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:16.086 4088 3038337402840 MainThread DEBUG nova.compute.manager [req-408e42cf-e8a4-463f-8b06-184133b0cbbb - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:16.086 4088 3038337402840 MainThread DEBUG nova.virt.hyperv.vmops [req-408e42cf-e8a4-463f-8b06-184133b0cbbb - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:16.133 4088 3038337402840 MainThread DEBUG nova.compute.manager [req-408e42cf-e8a4-463f-8b06-184133b0cbbb - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:16.196 4088 3038337402840 MainThread INFO nova.compute.manager [req-408e42cf-e8a4-463f-8b06-184133b0cbbb - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:16.758 4088 3038342147768 GreenThread-76 DEBUG nova.network.neutron [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Successfully updated port: 74f0c1ba-810b-4915-a0ac-2a1b7bb7cea0 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:03:16.787 4088 3038342147768 GreenThread-76 DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Acquired lock "refresh_cache-ba57675b-1666-430f-bbaa-84c5ca720900" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:03:16.787 4088 3038342147768 GreenThread-76 DEBUG nova.network.neutron [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:03:16.975 4088 3038342147768 GreenThread-76 DEBUG nova.network.neutron [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:03:17.072 4088 3038337401432 MainThread DEBUG os_win.utils.jobutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Waiting for WMI job: {'InstanceID': '85705BE6-9755-475C-B53C-5752D45176E3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19788), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:17.090 4088 3038337402840 MainThread DEBUG nova.compute.manager [req-b57c9fa6-a43c-42f3-81ed-7ab6d73a2387 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Received event network-changed-74f0c1ba-810b-4915-a0ac-2a1b7bb7cea0 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:03:17.090 4088 3038337402840 MainThread DEBUG nova.compute.manager [req-b57c9fa6-a43c-42f3-81ed-7ab6d73a2387 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Refreshing instance network info cache due to event network-changed-74f0c1ba-810b-4915-a0ac-2a1b7bb7cea0. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:03:17.100 4088 3038337403192 MainThread DEBUG nova.network.neutron [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:17.141 4088 3038337403192 MainThread INFO nova.compute.manager [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] [instance: 02a3f851-fc39-4889-aaff-e5a3385f19c0] Took 1.70 seconds to deallocate network for instance. 2021-09-10 17:03:17.227 4088 3038337401432 MainThread ERROR os_win.utils.jobutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000057\' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)instance-00000057DC78885B-5663-402B-A82C-F0DC0E45B11712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)instance-00000057DC78885B-5663-402B-A82C-F0DC0E45B11710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000057\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)instance-00000057DC78885B-5663-402B-A82C-F0DC0E45B117%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '85705BE6-9755-475C-B53C-5752D45176E3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119054), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 17), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 17), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000057' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)\n\nNot enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)\n\n'instance-00000057' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)", 'ErrorSummaryDescription': "'instance-00000057' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000057.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:17.227 4088 3038337401432 MainThread DEBUG os_win._utils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000057' failed to start. Not enough memory in the system to start the virtual machine instance-00000057. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000057' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Not enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) 'instance-00000057' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3700153827667236 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:17.279 4088 3038337404072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000057" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:17.279 4088 3038337404072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000057" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:17.279 4088 3038342144600 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:17.288 4088 3038342144600 MainThread INFO nova.compute.manager [-] [instance: f817e731-74c6-4c6f-8109-5984539d364a] VM Stopped (Lifecycle Event) 2021-09-10 17:03:17.307 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-43f3caf8-c798-4bf7-b803-a698f416025c - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:17.319 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-43f3caf8-c798-4bf7-b803-a698f416025c - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:17.365 4088 3038337403192 MainThread INFO nova.scheduler.client.report [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Deleted allocations for instance 02a3f851-fc39-4889-aaff-e5a3385f19c0 2021-09-10 17:03:17.399 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [req-2d5a0231-1a13-447a-9dcf-69eac5e08631 b207fe385eb647a4acf0331024dcf245 00a75e521b5f4d89ab74f2701a36da12 - default default] Lock "02a3f851-fc39-4889-aaff-e5a3385f19c0" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 27.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:17.399 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-43f3caf8-c798-4bf7-b803-a698f416025c - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:17.491 4088 3038342144600 MainThread INFO nova.compute.manager [req-43f3caf8-c798-4bf7-b803-a698f416025c - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:17.915 4088 3038342147768 GreenThread-76 DEBUG nova.network.neutron [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Updating instance_info_cache with network_info: [{"id": "74f0c1ba-810b-4915-a0ac-2a1b7bb7cea0", "address": "fa:16:3e:be:54:1f", "network": {"id": "5b608de7-ebcb-494c-bcfe-060ce4426ed6", "bridge": null, "label": "tempest-ServersTestJSON-497725561-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "df662acac0f043bb8be9c87490878d93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap74f0c1ba-81", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:17.949 4088 3038342147768 GreenThread-76 DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Releasing lock "refresh_cache-ba57675b-1666-430f-bbaa-84c5ca720900" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:03:17.963 4088 3038342147768 GreenThread-76 DEBUG nova.compute.manager [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Instance network_info: |[{"id": "74f0c1ba-810b-4915-a0ac-2a1b7bb7cea0", "address": "fa:16:3e:be:54:1f", "network": {"id": "5b608de7-ebcb-494c-bcfe-060ce4426ed6", "bridge": null, "label": "tempest-ServersTestJSON-497725561-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "df662acac0f043bb8be9c87490878d93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap74f0c1ba-81", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:03:17.963 4088 3038337402840 MainThread DEBUG oslo_concurrency.lockutils [req-b57c9fa6-a43c-42f3-81ed-7ab6d73a2387 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-ba57675b-1666-430f-bbaa-84c5ca720900" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:03:17.963 4088 3038337402840 MainThread DEBUG nova.network.neutron [req-b57c9fa6-a43c-42f3-81ed-7ab6d73a2387 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Refreshing network info cache for port 74f0c1ba-810b-4915-a0ac-2a1b7bb7cea0 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:03:17.963 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Preparing to wait for external event network-vif-plugged-74f0c1ba-810b-4915-a0ac-2a1b7bb7cea0 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:03:17.963 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "ba57675b-1666-430f-bbaa-84c5ca720900-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:17.963 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "ba57675b-1666-430f-bbaa-84c5ca720900-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:17.963 4088 3038340491224 MainThread DEBUG os_win.utils.compute.vmutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Creating VM instance-00000055 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:03:18.353 4088 3038337401432 MainThread DEBUG os_win.utils.jobutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Waiting for WMI job: {'InstanceID': 'E2AD3FED-B7D4-4EB7-AF85-023FC831FB3E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15690), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:18.509 4088 3038337401432 MainThread ERROR os_win.utils.jobutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000057\' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)instance-00000057DC78885B-5663-402B-A82C-F0DC0E45B11712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)instance-00000057DC78885B-5663-402B-A82C-F0DC0E45B11710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000057\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)instance-00000057DC78885B-5663-402B-A82C-F0DC0E45B117%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E2AD3FED-B7D4-4EB7-AF85-023FC831FB3E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121095), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 18), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 18), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000057' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)\n\nNot enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)\n\n'instance-00000057' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)", 'ErrorSummaryDescription': "'instance-00000057' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000057.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:18.509 4088 3038337401432 MainThread DEBUG os_win._utils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000057' failed to start. Not enough memory in the system to start the virtual machine instance-00000057. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000057' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Not enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) 'instance-00000057' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.6518707275390625 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:18.570 4088 3038342145128 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:18.570 4088 3038342145128 MainThread INFO nova.compute.manager [-] [instance: f817e731-74c6-4c6f-8109-5984539d364a] VM Stopped (Lifecycle Event) 2021-09-10 17:03:18.588 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000057" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:18.588 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000057" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:18.588 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-0a823324-05ff-4eea-90c6-8b427a9fe69c - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:18.588 4088 3038342145128 MainThread DEBUG nova.virt.hyperv.vmops [req-0a823324-05ff-4eea-90c6-8b427a9fe69c - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:18.681 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-0a823324-05ff-4eea-90c6-8b427a9fe69c - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:18.697 4088 3038342145128 MainThread INFO nova.compute.manager [req-0a823324-05ff-4eea-90c6-8b427a9fe69c - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:19.619 4088 3038337401432 MainThread DEBUG os_win.utils.jobutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Waiting for WMI job: {'InstanceID': 'A7EF0974-7683-4F5C-895B-72B3060CB173', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16253), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:19.760 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:03:19.773 4088 3038337401432 MainThread ERROR os_win.utils.jobutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000057\' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)instance-00000057DC78885B-5663-402B-A82C-F0DC0E45B11712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)instance-00000057DC78885B-5663-402B-A82C-F0DC0E45B11710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000057\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)instance-00000057DC78885B-5663-402B-A82C-F0DC0E45B117%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A7EF0974-7683-4F5C-895B-72B3060CB173', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=133463), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 19), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 19), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000057' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)\n\nNot enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)\n\n'instance-00000057' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)", 'ErrorSummaryDescription': "'instance-00000057' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000057.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:19.773 4088 3038337401432 MainThread DEBUG os_win._utils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000057' failed to start. Not enough memory in the system to start the virtual machine instance-00000057. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000057' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Not enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) 'instance-00000057' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.9156925678253174 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:20.115 4088 3038337402840 MainThread DEBUG nova.network.neutron [req-b57c9fa6-a43c-42f3-81ed-7ab6d73a2387 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Updated VIF entry in instance network info cache for port 74f0c1ba-810b-4915-a0ac-2a1b7bb7cea0. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:03:20.115 4088 3038337402840 MainThread DEBUG nova.network.neutron [req-b57c9fa6-a43c-42f3-81ed-7ab6d73a2387 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Updating instance_info_cache with network_info: [{"id": "74f0c1ba-810b-4915-a0ac-2a1b7bb7cea0", "address": "fa:16:3e:be:54:1f", "network": {"id": "5b608de7-ebcb-494c-bcfe-060ce4426ed6", "bridge": null, "label": "tempest-ServersTestJSON-497725561-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "df662acac0f043bb8be9c87490878d93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap74f0c1ba-81", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:20.147 4088 3038337402840 MainThread DEBUG oslo_concurrency.lockutils [req-b57c9fa6-a43c-42f3-81ed-7ab6d73a2387 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-ba57675b-1666-430f-bbaa-84c5ca720900" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:03:20.693 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-3bb22443-f411-40b8-b505-28ffabceb810 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Received event network-vif-plugged-e949d578-b15b-494e-b468-3526d92e3165 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:03:20.693 4088 3038342145128 MainThread DEBUG oslo_concurrency.lockutils [req-3bb22443-f411-40b8-b505-28ffabceb810 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d358307f-112b-4be6-9b2a-08f9ad26205e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:20.693 4088 3038342145128 MainThread DEBUG oslo_concurrency.lockutils [req-3bb22443-f411-40b8-b505-28ffabceb810 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d358307f-112b-4be6-9b2a-08f9ad26205e-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:20.693 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-3bb22443-f411-40b8-b505-28ffabceb810 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Processing event network-vif-plugged-e949d578-b15b-494e-b468-3526d92e3165 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:03:20.740 4088 3038340570104 MainThread INFO nova.virt.hyperv.vmops [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Using config drive for instance 2021-09-10 17:03:20.789 4088 3038337401432 MainThread DEBUG os_win.utils.jobutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Waiting for WMI job: {'InstanceID': 'C9E1AE37-2D48-44ED-9C95-E161D28CFE1C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=23857), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:20.960 4088 3038337401432 MainThread ERROR os_win.utils.jobutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000057\' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)instance-00000057DC78885B-5663-402B-A82C-F0DC0E45B11712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)instance-00000057DC78885B-5663-402B-A82C-F0DC0E45B11710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000057\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)instance-00000057DC78885B-5663-402B-A82C-F0DC0E45B117%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C9E1AE37-2D48-44ED-9C95-E161D28CFE1C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=123032), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 20), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 20), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000057' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)\n\nNot enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)\n\n'instance-00000057' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)", 'ErrorSummaryDescription': "'instance-00000057' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000057.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:20.960 4088 3038337401432 MainThread DEBUG os_win._utils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000057' failed to start. Not enough memory in the system to start the virtual machine instance-00000057. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000057' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Not enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) 'instance-00000057' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.102289915084839 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:20.988 4088 3038342147768 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:20.988 4088 3038342147768 MainThread INFO nova.compute.manager [-] [instance: f817e731-74c6-4c6f-8109-5984539d364a] VM Stopped (Lifecycle Event) 2021-09-10 17:03:20.988 4088 3038337402840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000057" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:20.988 4088 3038337402840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000057" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:21.022 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-be89ef61-ff59-4442-99e0-88fdbce25048 - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:21.022 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.vmops [req-be89ef61-ff59-4442-99e0-88fdbce25048 - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:21.069 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-be89ef61-ff59-4442-99e0-88fdbce25048 - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:21.100 4088 3038342147768 MainThread INFO nova.compute.manager [req-be89ef61-ff59-4442-99e0-88fdbce25048 - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:21.147 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "953a9285-8fdf-45ca-bec8-d0d9cc154d5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:21.195 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:03:21.290 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:21.290 4088 3038340492280 MainThread DEBUG nova.virt.hardware [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:03:21.290 4088 3038340492280 MainThread INFO nova.compute.claims [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Claim successful on node n-h2-808474-1 2021-09-10 17:03:21.443 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.hostops [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:03:21.447 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.hostops [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:03:21.546 4088 3038340570104 MainThread INFO nova.virt.hyperv.vmops [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Creating config drive at C:\openstack\instances\instance-00000054\configdrive.iso 2021-09-10 17:03:21.653 4088 3038340570104 MainThread DEBUG oslo_concurrency.processutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000054\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmptr4syg4i execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:03:21.931 4088 3038340492280 MainThread DEBUG nova.compute.provider_tree [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:03:21.951 4088 3038340492280 MainThread DEBUG nova.scheduler.client.report [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:03:21.951 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.656s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:21.951 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:03:21.988 4088 3038340570104 MainThread DEBUG oslo_concurrency.processutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000054\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmptr4syg4i" returned: 0 in 0.344s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:03:22.040 4088 3038337401432 MainThread DEBUG os_win.utils.jobutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Waiting for WMI job: {'InstanceID': '39E9D915-983C-4D49-A0FA-2F863B97513D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20605), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:22.072 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:03:22.072 4088 3038342144600 GreenThread-77 DEBUG nova.compute.manager [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:03:22.072 4088 3038342144600 GreenThread-77 DEBUG nova.network.neutron [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:03:22.201 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:22.201 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: f817e731-74c6-4c6f-8109-5984539d364a] VM Stopped (Lifecycle Event) 2021-09-10 17:03:22.201 4088 3038340490344 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000057" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:22.213 4088 3038340490344 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000057" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:22.213 4088 3038337401432 MainThread ERROR os_win.utils.jobutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000057\' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)instance-00000057DC78885B-5663-402B-A82C-F0DC0E45B11712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)instance-00000057DC78885B-5663-402B-A82C-F0DC0E45B11710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000057\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)instance-00000057DC78885B-5663-402B-A82C-F0DC0E45B117%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '39E9D915-983C-4D49-A0FA-2F863B97513D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=125630), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 21), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 22), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000057' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)\n\nNot enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)\n\n'instance-00000057' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117)", 'ErrorSummaryDescription': "'instance-00000057' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000057.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:22.213 4088 3038337401432 MainThread ERROR nova.virt.hyperv.vmops [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Failed to change vm state of instance-00000057 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000057' failed to start. 2021-09-10 17:03:22.213 4088 3038337401432 MainThread INFO nova.virt.hyperv.vmops [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Got request to destroy instance 2021-09-10 17:03:22.228 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-5ec43471-f5a7-4def-a2e2-a16f1f118d3f - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:22.228 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-5ec43471-f5a7-4def-a2e2-a16f1f118d3f - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:22.290 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-5ec43471-f5a7-4def-a2e2-a16f1f118d3f - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:22.290 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:03:22.309 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Spawning new instance 2021-09-10 17:03:22.321 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000056" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:22.321 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000056" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:22.321 4088 3038340492280 MainThread DEBUG nova.block_device [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:03:22.321 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:22.321 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:22.336 4088 3038340492280 MainThread DEBUG os_win.utils.pathutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Creating directory: C:\openstack\instances\instance-00000056 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:03:22.336 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000056\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:03:22.350 4088 3038340489992 MainThread INFO nova.compute.manager [req-5ec43471-f5a7-4def-a2e2-a16f1f118d3f - - - - -] [instance: f817e731-74c6-4c6f-8109-5984539d364a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:22.383 4088 3038342144600 GreenThread-77 DEBUG nova.policy [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3b19a6ed8024fe7b99f5aa4978b5af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecab78b34b0468f8c42e4b7f3444918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:03:22.601 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Resizing VHD C:\openstack\instances\instance-00000056\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:03:22.601 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Setting boot order for instance: instance-00000054: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:03:22.726 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:03:22.805 4088 3038340570104 MainThread DEBUG os_win.utils.jobutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Waiting for WMI job: {'InstanceID': 'BDF72573-23DA-4CF1-8E4F-5F40D740505A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=22738), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:22.977 4088 3038340570104 MainThread ERROR os_win.utils.jobutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] WMI job failed: {'RawErrors': (('124\'instance-00000054\' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)instance-00000054F622FB66-3976-4DD3-A896-727D0071580B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)instance-00000054F622FB66-3976-4DD3-A896-727D0071580B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000054\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)instance-00000054F622FB66-3976-4DD3-A896-727D0071580B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BDF72573-23DA-4CF1-8E4F-5F40D740505A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=137473), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 22), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 22), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000054' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)\n\nNot enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)\n\n'instance-00000054' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)", 'ErrorSummaryDescription': "'instance-00000054' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000054.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:22.977 4088 3038340570104 MainThread DEBUG os_win._utils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000054' failed to start. Not enough memory in the system to start the virtual machine instance-00000054. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000054' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Not enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) 'instance-00000054' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.2510988712310791 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:22.991 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000054" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:22.991 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000054" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:22.991 4088 3038337404424 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:22.991 4088 3038337404424 MainThread INFO nova.compute.manager [-] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] VM Stopped (Lifecycle Event) 2021-09-10 17:03:23.056 4088 3038337404424 MainThread DEBUG nova.compute.manager [req-195e7ce8-9803-4bd4-b797-df4c77d9d726 - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:23.056 4088 3038337404424 MainThread DEBUG nova.virt.hyperv.vmops [req-195e7ce8-9803-4bd4-b797-df4c77d9d726 - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:23.109 4088 3038337404424 MainThread DEBUG nova.compute.manager [req-195e7ce8-9803-4bd4-b797-df4c77d9d726 - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:23.150 4088 3038337404424 MainThread INFO nova.compute.manager [req-195e7ce8-9803-4bd4-b797-df4c77d9d726 - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:24.023 4088 3038340570104 MainThread DEBUG os_win.utils.jobutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Waiting for WMI job: {'InstanceID': '172EF5F5-769C-4F6B-9086-2E92417D793A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18740), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:24.083 4088 3038342144600 GreenThread-77 DEBUG nova.network.neutron [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Successfully created port: 017b262b-de39-45aa-9d95-268d363afe2e _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:03:24.180 4088 3038340570104 MainThread ERROR os_win.utils.jobutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] WMI job failed: {'RawErrors': (('124\'instance-00000054\' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)instance-00000054F622FB66-3976-4DD3-A896-727D0071580B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)instance-00000054F622FB66-3976-4DD3-A896-727D0071580B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000054\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)instance-00000054F622FB66-3976-4DD3-A896-727D0071580B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '172EF5F5-769C-4F6B-9086-2E92417D793A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=136277), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 23), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 24), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000054' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)\n\nNot enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)\n\n'instance-00000054' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)", 'ErrorSummaryDescription': "'instance-00000054' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000054.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:24.180 4088 3038340570104 MainThread DEBUG os_win._utils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000054' failed to start. Not enough memory in the system to start the virtual machine instance-00000054. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000054' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Not enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) 'instance-00000054' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4537053108215332 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:24.212 4088 3038337404424 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:24.212 4088 3038337404424 MainThread INFO nova.compute.manager [-] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] VM Stopped (Lifecycle Event) 2021-09-10 17:03:24.212 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000054" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:24.212 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000054" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:24.244 4088 3038337404424 MainThread DEBUG nova.compute.manager [req-6d9c25f3-d64c-4fb0-b943-8933d6aa4988 - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:24.244 4088 3038337404424 MainThread DEBUG nova.virt.hyperv.vmops [req-6d9c25f3-d64c-4fb0-b943-8933d6aa4988 - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:24.365 4088 3038337404424 MainThread DEBUG nova.compute.manager [req-6d9c25f3-d64c-4fb0-b943-8933d6aa4988 - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:24.401 4088 3038337404424 MainThread INFO nova.compute.manager [req-6d9c25f3-d64c-4fb0-b943-8933d6aa4988 - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:24.447 4088 3038337401432 MainThread DEBUG nova.virt.hyperv.vmops [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:03:24.463 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "instance-00000057" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:24.463 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "instance-00000057" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:24.539 4088 3038337401432 MainThread DEBUG os_win.utils.compute.vmutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Successfully changed vm state of instance-00000057 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:03:24.539 4088 3038337401432 MainThread DEBUG nova.virt.hyperv.vmops [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Successfully changed state of VM instance-00000057 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:03:24.600 4088 3038337401432 MainThread DEBUG os_win.utils.jobutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Waiting for WMI job: {'InstanceID': '3DC75E39-E13A-4122-A89E-33799E400BC8', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17863), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:24.728 4088 3038337401432 MainThread DEBUG os_win.utils.jobutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] WMI job succeeded: {'InstanceID': '3DC75E39-E13A-4122-A89E-33799E400BC8', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=109185), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:03:24.728 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "instance-00000057" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:24.728 4088 3038337401432 MainThread DEBUG os_win.utils.pathutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Removing directory: C:\openstack\instances\instance-00000057 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:03:24.728 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "instance-00000057" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:24.728 4088 3038337401432 MainThread ERROR nova.compute.manager [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000057' failed to start. Not enough memory in the system to start the virtual machine instance-00000057. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000057' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Not enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) 'instance-00000057' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Error code: 32778. 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] Traceback (most recent call last): 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] return function(*args, **kwargs) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] admin_password, network_info, block_device_info) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] return function(self, *args, **kwds) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self.force_reraise() 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] raise self.value 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] should_plug_vifs=False) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 'req_state': req_state}) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self.force_reraise() 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] raise self.value 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] time.sleep(sleep_time) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self.force_reraise() 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] raise self.value 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] return f(*args, **kwargs) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] return self._wait_for_job(job_path) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] error_desc=err_desc) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000057' failed to start. 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] Not enough memory in the system to start the virtual machine instance-00000057. 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000057' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] Not enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 'instance-00000057' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Error code: 32778. 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] During handling of the above exception, another exception occurred: 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] Traceback (most recent call last): 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] yield resources 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] accel_info=accel_info) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] return function(*args, **kwargs) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] admin_password, network_info, block_device_info) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] return function(self, *args, **kwds) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self.force_reraise() 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] raise self.value 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] should_plug_vifs=False) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 'req_state': req_state}) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self.force_reraise() 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] raise self.value 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] time.sleep(sleep_time) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self.force_reraise() 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] raise self.value 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] return f(*args, **kwargs) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] return self._wait_for_job(job_path) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] error_desc=err_desc) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000057' failed to start. 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] Not enough memory in the system to start the virtual machine instance-00000057. 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000057' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] Not enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 'instance-00000057' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Error code: 32778. 2021-09-10 17:03:24.728 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:24.728 4088 3038337401432 MainThread INFO nova.compute.manager [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Terminating instance 2021-09-10 17:03:24.728 4088 3038337401432 MainThread DEBUG nova.compute.manager [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:03:24.728 4088 3038337401432 MainThread INFO nova.virt.hyperv.vmops [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Got request to destroy instance 2021-09-10 17:03:24.749 4088 3038337401432 MainThread DEBUG nova.virt.hyperv.vmops [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:03:24.749 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "instance-00000057" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:24.749 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "instance-00000057" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:24.749 4088 3038337401432 MainThread INFO nova.compute.manager [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:03:24.749 4088 3038337401432 MainThread DEBUG nova.compute.claims [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:03:24.749 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:24.912 4088 3038337401432 MainThread DEBUG nova.virt.hyperv.hostops [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:03:24.944 4088 3038337401432 MainThread DEBUG nova.virt.hyperv.hostops [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:03:25.163 4088 3038337401432 MainThread DEBUG nova.compute.provider_tree [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:03:25.193 4088 3038337401432 MainThread DEBUG nova.scheduler.client.report [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:03:25.193 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:25.207 4088 3038337401432 MainThread ERROR nova.compute.manager [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000057' failed to start. Not enough memory in the system to start the virtual machine instance-00000057. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000057' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Not enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) 'instance-00000057' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Error code: 32778. 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] Traceback (most recent call last): 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] return function(*args, **kwargs) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] admin_password, network_info, block_device_info) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] return function(self, *args, **kwds) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self.force_reraise() 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] raise self.value 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] should_plug_vifs=False) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 'req_state': req_state}) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self.force_reraise() 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] raise self.value 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] time.sleep(sleep_time) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self.force_reraise() 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] raise self.value 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] return f(*args, **kwargs) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] return self._wait_for_job(job_path) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] error_desc=err_desc) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000057' failed to start. 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] Not enough memory in the system to start the virtual machine instance-00000057. 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000057' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] Not enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 'instance-00000057' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Error code: 32778. 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] During handling of the above exception, another exception occurred: 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] Traceback (most recent call last): 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] accel_info=accel_info) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] return function(*args, **kwargs) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] admin_password, network_info, block_device_info) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] return function(self, *args, **kwds) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self.force_reraise() 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] raise self.value 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] should_plug_vifs=False) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 'req_state': req_state}) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self.force_reraise() 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] raise self.value 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] time.sleep(sleep_time) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self.force_reraise() 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] raise self.value 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] return f(*args, **kwargs) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] return self._wait_for_job(job_path) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] error_desc=err_desc) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000057' failed to start. 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] Not enough memory in the system to start the virtual machine instance-00000057. 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000057' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] Not enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 'instance-00000057' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Error code: 32778. 2021-09-10 17:03:25.207 4088 3038337401432 MainThread TRACE nova.compute.manager [instance: f817e731-74c6-4c6f-8109-5984539d364a] 2021-09-10 17:03:25.210 4088 3038337401432 MainThread DEBUG nova.compute.utils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] WMI job failed with status 10. Error summary description: 'instance-00000057' failed to start. Not enough memory in the system to start the virtual machine instance-00000057. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:03:25.210 4088 3038337401432 MainThread DEBUG nova.compute.manager [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Build of instance f817e731-74c6-4c6f-8109-5984539d364a was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000057' failed to start. Not enough memory in the system to start the virtual machine instance-00000057. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000057' failed to start. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Not enough memory in the system to start the virtual machine instance-00000057 with ram size 1024 megabytes. (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) 'instance-00000057' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID DC78885B-5663-402B-A82C-F0DC0E45B117) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:03:25.210 4088 3038337401432 MainThread DEBUG nova.compute.manager [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:03:25.210 4088 3038337401432 MainThread DEBUG nova.compute.manager [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:03:25.210 4088 3038337401432 MainThread DEBUG nova.compute.manager [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:03:25.210 4088 3038337401432 MainThread DEBUG nova.network.neutron [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:03:25.243 4088 3038340570104 MainThread DEBUG os_win.utils.jobutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Waiting for WMI job: {'InstanceID': '8865211B-5B8C-4360-995E-8418B70E2A96', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18197), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:25.387 4088 3038340570104 MainThread ERROR os_win.utils.jobutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] WMI job failed: {'RawErrors': (('124\'instance-00000054\' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)instance-00000054F622FB66-3976-4DD3-A896-727D0071580B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)instance-00000054F622FB66-3976-4DD3-A896-727D0071580B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000054\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)instance-00000054F622FB66-3976-4DD3-A896-727D0071580B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '8865211B-5B8C-4360-995E-8418B70E2A96', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117206), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 25), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 25), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000054' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)\n\nNot enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)\n\n'instance-00000054' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)", 'ErrorSummaryDescription': "'instance-00000054' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000054.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:25.387 4088 3038340570104 MainThread DEBUG os_win._utils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000054' failed to start. Not enough memory in the system to start the virtual machine instance-00000054. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000054' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Not enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) 'instance-00000054' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.6601438522338867 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:25.438 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000054" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:25.445 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000054" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:25.445 4088 3038342258184 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:25.445 4088 3038342258184 MainThread INFO nova.compute.manager [-] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] VM Stopped (Lifecycle Event) 2021-09-10 17:03:25.462 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-8e56a535-1c4a-4cff-a70e-f03b0b6352f6 - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:25.475 4088 3038342258184 MainThread DEBUG nova.virt.hyperv.vmops [req-8e56a535-1c4a-4cff-a70e-f03b0b6352f6 - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:25.521 4088 3038342258184 MainThread DEBUG nova.compute.manager [req-8e56a535-1c4a-4cff-a70e-f03b0b6352f6 - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:25.539 4088 3038342258184 MainThread INFO nova.compute.manager [req-8e56a535-1c4a-4cff-a70e-f03b0b6352f6 - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:26.149 4088 3038342144600 GreenThread-77 DEBUG nova.network.neutron [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Successfully updated port: 017b262b-de39-45aa-9d95-268d363afe2e _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:03:26.166 4088 3038342144600 GreenThread-77 DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Acquired lock "refresh_cache-953a9285-8fdf-45ca-bec8-d0d9cc154d5d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:03:26.166 4088 3038342144600 GreenThread-77 DEBUG nova.network.neutron [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:03:26.383 4088 3038342254840 MainThread DEBUG nova.compute.manager [req-1dacc619-a6b2-41dc-bc49-af25e0e28a63 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Received event network-changed-017b262b-de39-45aa-9d95-268d363afe2e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:03:26.383 4088 3038342254840 MainThread DEBUG nova.compute.manager [req-1dacc619-a6b2-41dc-bc49-af25e0e28a63 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Refreshing instance network info cache due to event network-changed-017b262b-de39-45aa-9d95-268d363afe2e. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:03:26.383 4088 3038337401432 MainThread DEBUG nova.network.neutron [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:26.429 4088 3038340570104 MainThread DEBUG os_win.utils.jobutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Waiting for WMI job: {'InstanceID': '68347197-22DD-4B2B-A690-91747C499B6F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16113), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:26.429 4088 3038337401432 MainThread INFO nova.compute.manager [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] [instance: f817e731-74c6-4c6f-8109-5984539d364a] Took 1.22 seconds to deallocate network for instance. 2021-09-10 17:03:26.429 4088 3038342144600 GreenThread-77 DEBUG nova.network.neutron [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:03:26.478 4088 3038342255192 MainThread DEBUG nova.compute.manager [req-95c5f142-9780-4d96-8ba6-7cd32817b0de 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Received event network-vif-plugged-74f0c1ba-810b-4915-a0ac-2a1b7bb7cea0 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:03:26.478 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [req-95c5f142-9780-4d96-8ba6-7cd32817b0de 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "ba57675b-1666-430f-bbaa-84c5ca720900-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:26.478 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [req-95c5f142-9780-4d96-8ba6-7cd32817b0de 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "ba57675b-1666-430f-bbaa-84c5ca720900-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:26.478 4088 3038342255192 MainThread DEBUG nova.compute.manager [req-95c5f142-9780-4d96-8ba6-7cd32817b0de 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Processing event network-vif-plugged-74f0c1ba-810b-4915-a0ac-2a1b7bb7cea0 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:03:26.557 4088 3038340491224 MainThread INFO nova.virt.hyperv.vmops [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Using config drive for instance 2021-09-10 17:03:26.572 4088 3038340570104 MainThread ERROR os_win.utils.jobutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] WMI job failed: {'RawErrors': (('124\'instance-00000054\' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)instance-00000054F622FB66-3976-4DD3-A896-727D0071580B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)instance-00000054F622FB66-3976-4DD3-A896-727D0071580B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000054\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)instance-00000054F622FB66-3976-4DD3-A896-727D0071580B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '68347197-22DD-4B2B-A690-91747C499B6F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116300), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 26), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 26), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000054' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)\n\nNot enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)\n\n'instance-00000054' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)", 'ErrorSummaryDescription': "'instance-00000054' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000054.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:26.572 4088 3038340570104 MainThread DEBUG os_win._utils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000054' failed to start. Not enough memory in the system to start the virtual machine instance-00000054. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000054' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Not enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) 'instance-00000054' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.845883846282959 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:26.588 4088 3038342255192 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:26.588 4088 3038342255192 MainThread INFO nova.compute.manager [-] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] VM Stopped (Lifecycle Event) 2021-09-10 17:03:26.588 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000054" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:26.588 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000054" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:26.611 4088 3038342255192 MainThread DEBUG nova.compute.manager [req-7c47ced3-29f7-4df5-88f6-d0a7afa6f07e - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:26.611 4088 3038342255192 MainThread DEBUG nova.virt.hyperv.vmops [req-7c47ced3-29f7-4df5-88f6-d0a7afa6f07e - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:26.680 4088 3038342255192 MainThread DEBUG nova.compute.manager [req-7c47ced3-29f7-4df5-88f6-d0a7afa6f07e - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:26.726 4088 3038342255192 MainThread INFO nova.compute.manager [req-7c47ced3-29f7-4df5-88f6-d0a7afa6f07e - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:26.741 4088 3038337401432 MainThread INFO nova.scheduler.client.report [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Deleted allocations for instance f817e731-74c6-4c6f-8109-5984539d364a 2021-09-10 17:03:26.774 4088 3038340491224 MainThread INFO nova.virt.hyperv.vmops [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Creating config drive at C:\openstack\instances\instance-00000055\configdrive.iso 2021-09-10 17:03:26.869 4088 3038340491224 MainThread DEBUG oslo_concurrency.processutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000055\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpzm4y_0hd execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:03:27.006 4088 3038337401432 MainThread DEBUG oslo_concurrency.lockutils [req-93177b03-ec0a-493f-bf8c-a47bdb5b1966 7f13c7f24aed435daa5c4c3caf5d68c9 3f7a5fed42ca440bb659840e05ce1f95 - default default] Lock "f817e731-74c6-4c6f-8109-5984539d364a" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 23.562s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:27.150 4088 3038342144600 GreenThread-77 DEBUG nova.network.neutron [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Updating instance_info_cache with network_info: [{"id": "017b262b-de39-45aa-9d95-268d363afe2e", "address": "fa:16:3e:3e:04:83", "network": {"id": "8a0fc2b4-bff6-4887-a969-81fb448d568f", "bridge": null, "label": "tempest-DeleteServersTestJSON-1414296899-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "eecab78b34b0468f8c42e4b7f3444918", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap017b262b-de", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:27.181 4088 3038340491224 MainThread DEBUG oslo_concurrency.processutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000055\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpzm4y_0hd" returned: 0 in 0.312s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:03:27.197 4088 3038342144600 GreenThread-77 DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Releasing lock "refresh_cache-953a9285-8fdf-45ca-bec8-d0d9cc154d5d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:03:27.197 4088 3038342144600 GreenThread-77 DEBUG nova.compute.manager [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Instance network_info: |[{"id": "017b262b-de39-45aa-9d95-268d363afe2e", "address": "fa:16:3e:3e:04:83", "network": {"id": "8a0fc2b4-bff6-4887-a969-81fb448d568f", "bridge": null, "label": "tempest-DeleteServersTestJSON-1414296899-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "eecab78b34b0468f8c42e4b7f3444918", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap017b262b-de", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:03:27.197 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [req-1dacc619-a6b2-41dc-bc49-af25e0e28a63 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-953a9285-8fdf-45ca-bec8-d0d9cc154d5d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:03:27.197 4088 3038342254840 MainThread DEBUG nova.network.neutron [req-1dacc619-a6b2-41dc-bc49-af25e0e28a63 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Refreshing network info cache for port 017b262b-de39-45aa-9d95-268d363afe2e _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:03:27.197 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Preparing to wait for external event network-vif-plugged-017b262b-de39-45aa-9d95-268d363afe2e prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:03:27.197 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "953a9285-8fdf-45ca-bec8-d0d9cc154d5d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:27.197 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "953a9285-8fdf-45ca-bec8-d0d9cc154d5d-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:27.197 4088 3038340492280 MainThread DEBUG os_win.utils.compute.vmutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Creating VM instance-00000056 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:03:27.617 4088 3038340570104 MainThread DEBUG os_win.utils.jobutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Waiting for WMI job: {'InstanceID': '43ED76C4-0839-4082-B678-C46C74EC90DD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17952), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:27.789 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Setting boot order for instance: instance-00000055: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:03:27.898 4088 3038340570104 MainThread ERROR os_win.utils.jobutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] WMI job failed: {'RawErrors': (('124\'instance-00000054\' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)instance-00000054F622FB66-3976-4DD3-A896-727D0071580B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)instance-00000054F622FB66-3976-4DD3-A896-727D0071580B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000054\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)instance-00000054F622FB66-3976-4DD3-A896-727D0071580B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '43ED76C4-0839-4082-B678-C46C74EC90DD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=130770), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 27), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 27), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000054' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)\n\nNot enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)\n\n'instance-00000054' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)", 'ErrorSummaryDescription': "'instance-00000054' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000054.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:27.898 4088 3038340570104 MainThread DEBUG os_win._utils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000054' failed to start. Not enough memory in the system to start the virtual machine instance-00000054. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000054' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Not enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) 'instance-00000054' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.1711506843566895 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:27.898 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:03:27.948 4088 3038340491224 MainThread DEBUG os_win.utils.jobutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '5C596739-42EC-429D-A6FF-B6BD0DBAD84D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15991), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:28.097 4088 3038340491224 MainThread ERROR os_win.utils.jobutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000055\' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)instance-0000005574AC8296-DB17-46CC-9ADD-B6C5422EEBB412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)instance-0000005574AC8296-DB17-46CC-9ADD-B6C5422EEBB410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000055\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)instance-0000005574AC8296-DB17-46CC-9ADD-B6C5422EEBB4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5C596739-42EC-429D-A6FF-B6BD0DBAD84D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120117), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 27), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 28), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000055' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)\n\nNot enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)\n\n'instance-00000055' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)", 'ErrorSummaryDescription': "'instance-00000055' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000055.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:28.100 4088 3038340491224 MainThread DEBUG os_win._utils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000055' failed to start. Not enough memory in the system to start the virtual machine instance-00000055. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000055' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Not enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) 'instance-00000055' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.20270228385925293 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:28.226 4088 3038342254840 MainThread DEBUG nova.network.neutron [req-1dacc619-a6b2-41dc-bc49-af25e0e28a63 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Updated VIF entry in instance network info cache for port 017b262b-de39-45aa-9d95-268d363afe2e. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:03:28.226 4088 3038342254840 MainThread DEBUG nova.network.neutron [req-1dacc619-a6b2-41dc-bc49-af25e0e28a63 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Updating instance_info_cache with network_info: [{"id": "017b262b-de39-45aa-9d95-268d363afe2e", "address": "fa:16:3e:3e:04:83", "network": {"id": "8a0fc2b4-bff6-4887-a969-81fb448d568f", "bridge": null, "label": "tempest-DeleteServersTestJSON-1414296899-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "eecab78b34b0468f8c42e4b7f3444918", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap017b262b-de", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:28.260 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [req-1dacc619-a6b2-41dc-bc49-af25e0e28a63 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-953a9285-8fdf-45ca-bec8-d0d9cc154d5d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:03:28.982 4088 3038340570104 MainThread DEBUG os_win.utils.jobutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Waiting for WMI job: {'InstanceID': '153D8396-9D9B-4E3E-99AA-57471FAFFE84', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16445), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:29.117 4088 3038340570104 MainThread ERROR os_win.utils.jobutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] WMI job failed: {'RawErrors': (('124\'instance-00000054\' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)instance-00000054F622FB66-3976-4DD3-A896-727D0071580B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)instance-00000054F622FB66-3976-4DD3-A896-727D0071580B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000054\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)instance-00000054F622FB66-3976-4DD3-A896-727D0071580B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '153D8396-9D9B-4E3E-99AA-57471FAFFE84', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116231), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 28), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 29), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000054' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)\n\nNot enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)\n\n'instance-00000054' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B)", 'ErrorSummaryDescription': "'instance-00000054' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000054.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:29.117 4088 3038340570104 MainThread ERROR nova.virt.hyperv.vmops [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Failed to change vm state of instance-00000054 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000054' failed to start. 2021-09-10 17:03:29.117 4088 3038340570104 MainThread INFO nova.virt.hyperv.vmops [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Got request to destroy instance 2021-09-10 17:03:29.117 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:03:29.171 4088 3038342145128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000054" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:29.171 4088 3038342145128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000054" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:29.171 4088 3038337401432 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:29.183 4088 3038337401432 MainThread INFO nova.compute.manager [-] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] VM Stopped (Lifecycle Event) 2021-09-10 17:03:29.183 4088 3038340491224 MainThread DEBUG os_win.utils.jobutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'DFACE723-00EF-43A2-B0E7-7602C2F9E131', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17425), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:29.199 4088 3038337401432 MainThread DEBUG nova.compute.manager [req-112bce99-6682-40c6-8317-21f40bcb99ff - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:29.199 4088 3038337401432 MainThread DEBUG nova.virt.hyperv.vmops [req-112bce99-6682-40c6-8317-21f40bcb99ff - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:29.321 4088 3038340491224 MainThread ERROR os_win.utils.jobutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000055\' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)instance-0000005574AC8296-DB17-46CC-9ADD-B6C5422EEBB412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)instance-0000005574AC8296-DB17-46CC-9ADD-B6C5422EEBB410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000055\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)instance-0000005574AC8296-DB17-46CC-9ADD-B6C5422EEBB4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'DFACE723-00EF-43A2-B0E7-7602C2F9E131', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118560), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 29), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 29), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000055' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)\n\nNot enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)\n\n'instance-00000055' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)", 'ErrorSummaryDescription': "'instance-00000055' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000055.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:29.321 4088 3038340491224 MainThread DEBUG os_win._utils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000055' failed to start. Not enough memory in the system to start the virtual machine instance-00000055. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000055' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Not enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) 'instance-00000055' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4239296913146973 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:29.366 4088 3038337401432 MainThread DEBUG nova.compute.manager [req-112bce99-6682-40c6-8317-21f40bcb99ff - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:29.401 4088 3038337401432 MainThread INFO nova.compute.manager [req-112bce99-6682-40c6-8317-21f40bcb99ff - - - - -] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:30.367 4088 3038340491224 MainThread DEBUG os_win.utils.jobutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '0B06F962-ABAF-4BC5-81FE-688B100F6AFF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16546), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:30.506 4088 3038340491224 MainThread ERROR os_win.utils.jobutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000055\' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)instance-0000005574AC8296-DB17-46CC-9ADD-B6C5422EEBB412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)instance-0000005574AC8296-DB17-46CC-9ADD-B6C5422EEBB410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000055\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)instance-0000005574AC8296-DB17-46CC-9ADD-B6C5422EEBB4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0B06F962-ABAF-4BC5-81FE-688B100F6AFF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121575), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 30), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 30), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000055' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)\n\nNot enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)\n\n'instance-00000055' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)", 'ErrorSummaryDescription': "'instance-00000055' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000055.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:30.506 4088 3038340491224 MainThread DEBUG os_win._utils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000055' failed to start. Not enough memory in the system to start the virtual machine instance-00000055. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000055' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Not enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) 'instance-00000055' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.6084418296813965 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:30.587 4088 3038340490344 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000055" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:30.587 4088 3038340490344 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000055" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:30.587 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:30.587 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] VM Stopped (Lifecycle Event) 2021-09-10 17:03:30.619 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-06c19275-fd19-4f91-9484-a14b4beba9a4 - - - - -] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:30.619 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-06c19275-fd19-4f91-9484-a14b4beba9a4 - - - - -] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:30.671 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-06c19275-fd19-4f91-9484-a14b4beba9a4 - - - - -] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:30.680 4088 3038340489992 MainThread INFO nova.compute.manager [req-06c19275-fd19-4f91-9484-a14b4beba9a4 - - - - -] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:31.105 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:03:31.105 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "instance-00000054" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:31.105 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "instance-00000054" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:31.117 4088 3038340570104 MainThread DEBUG os_win.utils.compute.vmutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Successfully changed vm state of instance-00000054 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:03:31.117 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Successfully changed state of VM instance-00000054 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:03:31.172 4088 3038340570104 MainThread DEBUG os_win.utils.jobutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Waiting for WMI job: {'InstanceID': 'D8470209-5AEB-4650-9038-19A669D6A257', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14577), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:31.290 4088 3038340570104 MainThread DEBUG os_win.utils.jobutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] WMI job succeeded: {'InstanceID': 'D8470209-5AEB-4650-9038-19A669D6A257', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=117667), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:03:31.290 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "instance-00000054" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:31.290 4088 3038340570104 MainThread DEBUG os_win.utils.pathutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Removing directory: C:\openstack\instances\instance-00000054 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:03:31.290 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "instance-00000054" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:31.290 4088 3038340570104 MainThread ERROR nova.compute.manager [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000054' failed to start. Not enough memory in the system to start the virtual machine instance-00000054. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000054' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Not enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) 'instance-00000054' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Error code: 32778. 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Traceback (most recent call last): 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] return function(*args, **kwargs) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] admin_password, network_info, block_device_info) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] return function(self, *args, **kwds) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self.force_reraise() 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] raise self.value 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] should_plug_vifs=False) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 'req_state': req_state}) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self.force_reraise() 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] raise self.value 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] time.sleep(sleep_time) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self.force_reraise() 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] raise self.value 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] return f(*args, **kwargs) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] return self._wait_for_job(job_path) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] error_desc=err_desc) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000054' failed to start. 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Not enough memory in the system to start the virtual machine instance-00000054. 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000054' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Not enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 'instance-00000054' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Error code: 32778. 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] During handling of the above exception, another exception occurred: 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Traceback (most recent call last): 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] yield resources 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] accel_info=accel_info) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] return function(*args, **kwargs) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] admin_password, network_info, block_device_info) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] return function(self, *args, **kwds) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self.force_reraise() 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] raise self.value 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] should_plug_vifs=False) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 'req_state': req_state}) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self.force_reraise() 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] raise self.value 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] time.sleep(sleep_time) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self.force_reraise() 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] raise self.value 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] return f(*args, **kwargs) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] return self._wait_for_job(job_path) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] error_desc=err_desc) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000054' failed to start. 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Not enough memory in the system to start the virtual machine instance-00000054. 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000054' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Not enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 'instance-00000054' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Error code: 32778. 2021-09-10 17:03:31.290 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.319 4088 3038340570104 MainThread INFO nova.compute.manager [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Terminating instance 2021-09-10 17:03:31.319 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:03:31.319 4088 3038340570104 MainThread INFO nova.virt.hyperv.vmops [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Got request to destroy instance 2021-09-10 17:03:31.334 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:03:31.334 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "instance-00000054" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:31.334 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "instance-00000054" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:31.334 4088 3038340570104 MainThread INFO nova.compute.manager [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:03:31.334 4088 3038340570104 MainThread DEBUG nova.compute.claims [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:03:31.334 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:31.465 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.hostops [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:03:31.475 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.hostops [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:03:31.537 4088 3038340491224 MainThread DEBUG os_win.utils.jobutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '73F67662-7981-4D95-8385-EFBF06C991FE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15643), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:31.679 4088 3038340491224 MainThread ERROR os_win.utils.jobutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000055\' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)instance-0000005574AC8296-DB17-46CC-9ADD-B6C5422EEBB412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)instance-0000005574AC8296-DB17-46CC-9ADD-B6C5422EEBB410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000055\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)instance-0000005574AC8296-DB17-46CC-9ADD-B6C5422EEBB4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '73F67662-7981-4D95-8385-EFBF06C991FE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116874), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 31), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 31), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000055' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)\n\nNot enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)\n\n'instance-00000055' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)", 'ErrorSummaryDescription': "'instance-00000055' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000055.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:31.679 4088 3038340491224 MainThread DEBUG os_win._utils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000055' failed to start. Not enough memory in the system to start the virtual machine instance-00000055. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000055' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Not enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) 'instance-00000055' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.780989170074463 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:31.710 4088 3038340570104 MainThread DEBUG nova.compute.provider_tree [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:03:31.728 4088 3038340490344 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000055" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:31.728 4088 3038340490344 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000055" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:31.728 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:31.728 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] VM Stopped (Lifecycle Event) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread DEBUG nova.scheduler.client.report [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:03:31.728 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.390s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:31.728 4088 3038340570104 MainThread ERROR nova.compute.manager [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000054' failed to start. Not enough memory in the system to start the virtual machine instance-00000054. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000054' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Not enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) 'instance-00000054' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Error code: 32778. 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Traceback (most recent call last): 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] return function(*args, **kwargs) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] admin_password, network_info, block_device_info) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] return function(self, *args, **kwds) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self.force_reraise() 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] raise self.value 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] should_plug_vifs=False) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 'req_state': req_state}) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self.force_reraise() 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] raise self.value 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] time.sleep(sleep_time) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self.force_reraise() 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] raise self.value 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] return f(*args, **kwargs) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] return self._wait_for_job(job_path) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] error_desc=err_desc) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000054' failed to start. 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Not enough memory in the system to start the virtual machine instance-00000054. 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000054' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Not enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 'instance-00000054' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Error code: 32778. 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] During handling of the above exception, another exception occurred: 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Traceback (most recent call last): 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] accel_info=accel_info) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] return function(*args, **kwargs) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] admin_password, network_info, block_device_info) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] return function(self, *args, **kwds) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self.force_reraise() 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] raise self.value 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] should_plug_vifs=False) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 'req_state': req_state}) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self.force_reraise() 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] raise self.value 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] time.sleep(sleep_time) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self.force_reraise() 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] raise self.value 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] return f(*args, **kwargs) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] return self._wait_for_job(job_path) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] error_desc=err_desc) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000054' failed to start. 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Not enough memory in the system to start the virtual machine instance-00000054. 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000054' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Not enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 'instance-00000054' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Error code: 32778. 2021-09-10 17:03:31.728 4088 3038340570104 MainThread TRACE nova.compute.manager [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] 2021-09-10 17:03:31.746 4088 3038340570104 MainThread DEBUG nova.compute.utils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] WMI job failed with status 10. Error summary description: 'instance-00000054' failed to start. Not enough memory in the system to start the virtual machine instance-00000054. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:03:31.746 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Build of instance d358307f-112b-4be6-9b2a-08f9ad26205e was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000054' failed to start. Not enough memory in the system to start the virtual machine instance-00000054. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000054' failed to start. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Not enough memory in the system to start the virtual machine instance-00000054 with ram size 1024 megabytes. (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) 'instance-00000054' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F622FB66-3976-4DD3-A896-727D0071580B) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:03:31.746 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:03:31.746 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:03:31.746 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:03:31.746 4088 3038340570104 MainThread DEBUG nova.network.neutron [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:03:31.760 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-e68c8c8d-0c8e-4d66-b740-bcdd624a2f7c - - - - -] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:31.760 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-e68c8c8d-0c8e-4d66-b740-bcdd624a2f7c - - - - -] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:31.806 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-e68c8c8d-0c8e-4d66-b740-bcdd624a2f7c - - - - -] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:31.850 4088 3038340489992 MainThread INFO nova.compute.manager [req-e68c8c8d-0c8e-4d66-b740-bcdd624a2f7c - - - - -] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:31.943 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Lock "5b9c2a38-845e-44ce-ba83-cfe2a9acbb11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:31.993 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:03:32.132 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:32.132 4088 3038342255016 MainThread DEBUG nova.virt.hardware [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:03:32.132 4088 3038342255016 MainThread INFO nova.compute.claims [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Claim successful on node n-h2-808474-1 2021-09-10 17:03:32.259 4088 3038342255016 MainThread DEBUG nova.virt.hyperv.hostops [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:03:32.272 4088 3038342255016 MainThread DEBUG nova.virt.hyperv.hostops [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:03:32.541 4088 3038342255016 MainThread DEBUG nova.compute.provider_tree [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:03:32.555 4088 3038342255016 MainThread DEBUG nova.scheduler.client.report [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:03:32.555 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:32.555 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:03:32.627 4088 3038342255016 MainThread DEBUG nova.compute.utils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 17:03:32.627 4088 3038340489992 GreenThread-78 DEBUG nova.compute.manager [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:03:32.627 4088 3038340489992 GreenThread-78 DEBUG nova.network.neutron [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:03:32.650 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:03:32.728 4088 3038340491224 MainThread DEBUG os_win.utils.jobutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'A71AC8C5-E35B-49FE-ADAC-6476BDF75213', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15531), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:32.772 4088 3038340489992 GreenThread-78 DEBUG nova.policy [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f602a288fe3b4ea0bf8af5b656e8681a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7055b5c60f1f45d6b0dd2b8a9a6f7f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:03:32.834 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:03:32.851 4088 3038342255016 MainThread INFO nova.virt.hyperv.vmops [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Spawning new instance 2021-09-10 17:03:32.865 4088 3038340491224 MainThread ERROR os_win.utils.jobutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000055\' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)instance-0000005574AC8296-DB17-46CC-9ADD-B6C5422EEBB412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)instance-0000005574AC8296-DB17-46CC-9ADD-B6C5422EEBB410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000055\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)instance-0000005574AC8296-DB17-46CC-9ADD-B6C5422EEBB4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A71AC8C5-E35B-49FE-ADAC-6476BDF75213', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118900), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 32), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 32), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000055' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)\n\nNot enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)\n\n'instance-00000055' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)", 'ErrorSummaryDescription': "'instance-00000055' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000055.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:32.865 4088 3038340491224 MainThread DEBUG os_win._utils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000055' failed to start. Not enough memory in the system to start the virtual machine instance-00000055. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000055' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Not enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) 'instance-00000055' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.967953205108643 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:32.891 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Lock "instance-0000005b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:32.891 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Lock "instance-0000005b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:32.891 4088 3038342255016 MainThread DEBUG nova.block_device [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:03:32.891 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:32.891 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:32.912 4088 3038342255016 MainThread DEBUG os_win.utils.pathutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Creating directory: C:\openstack\instances\instance-0000005b check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:03:32.916 4088 3038342255016 MainThread DEBUG nova.virt.hyperv.vmops [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000005b\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:03:32.929 4088 3038342254840 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:32.929 4088 3038342254840 MainThread INFO nova.compute.manager [-] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] VM Stopped (Lifecycle Event) 2021-09-10 17:03:32.929 4088 3038342256776 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000055" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:32.929 4088 3038342256776 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000055" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:32.946 4088 3038342254840 MainThread DEBUG nova.compute.manager [req-be001f58-e3d8-4673-8045-be3821840d4f - - - - -] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:32.946 4088 3038342254840 MainThread DEBUG nova.virt.hyperv.vmops [req-be001f58-e3d8-4673-8045-be3821840d4f - - - - -] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:32.993 4088 3038342254840 MainThread DEBUG nova.compute.manager [req-be001f58-e3d8-4673-8045-be3821840d4f - - - - -] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:33.043 4088 3038342254840 MainThread INFO nova.compute.manager [req-be001f58-e3d8-4673-8045-be3821840d4f - - - - -] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:33.086 4088 3038340570104 MainThread DEBUG nova.network.neutron [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:33.132 4088 3038340570104 MainThread INFO nova.compute.manager [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d358307f-112b-4be6-9b2a-08f9ad26205e] Took 1.39 seconds to deallocate network for instance. 2021-09-10 17:03:33.150 4088 3038342255016 MainThread DEBUG nova.virt.hyperv.vmops [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Resizing VHD C:\openstack\instances\instance-0000005b\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:03:33.389 4088 3038340570104 MainThread INFO nova.scheduler.client.report [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Deleted allocations for instance d358307f-112b-4be6-9b2a-08f9ad26205e 2021-09-10 17:03:33.447 4088 3038340570104 MainThread DEBUG oslo_concurrency.lockutils [req-e0b907f3-2e5f-4e44-a734-89fe2900ab1f 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "d358307f-112b-4be6-9b2a-08f9ad26205e" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 27.234s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:33.897 4088 3038340491224 MainThread DEBUG os_win.utils.jobutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '80532F10-61FE-4105-83C1-9EDE0969BF04', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17822), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:34.051 4088 3038340491224 MainThread ERROR os_win.utils.jobutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000055\' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)instance-0000005574AC8296-DB17-46CC-9ADD-B6C5422EEBB412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)instance-0000005574AC8296-DB17-46CC-9ADD-B6C5422EEBB410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000055\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)instance-0000005574AC8296-DB17-46CC-9ADD-B6C5422EEBB4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '80532F10-61FE-4105-83C1-9EDE0969BF04', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117018), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 33), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 33), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000055' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)\n\nNot enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)\n\n'instance-00000055' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4)", 'ErrorSummaryDescription': "'instance-00000055' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000055.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:34.055 4088 3038340491224 MainThread ERROR nova.virt.hyperv.vmops [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Failed to change vm state of instance-00000055 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000055' failed to start. 2021-09-10 17:03:34.055 4088 3038340491224 MainThread INFO nova.virt.hyperv.vmops [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Got request to destroy instance 2021-09-10 17:03:34.069 4088 3038340570104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:34.069 4088 3038340570104 MainThread INFO nova.compute.manager [-] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] VM Stopped (Lifecycle Event) 2021-09-10 17:03:34.085 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000055" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:34.085 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000055" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:34.105 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-14830434-5fc7-43f5-a71a-1272ef8ef767 - - - - -] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:34.105 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-14830434-5fc7-43f5-a71a-1272ef8ef767 - - - - -] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:34.241 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-14830434-5fc7-43f5-a71a-1272ef8ef767 - - - - -] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:34.275 4088 3038340570104 MainThread INFO nova.compute.manager [req-14830434-5fc7-43f5-a71a-1272ef8ef767 - - - - -] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:35.545 4088 3038340489992 GreenThread-78 DEBUG nova.network.neutron [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Successfully created port: e6fecae3-cd06-43a6-ac04-dfd6bd3fdc61 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:03:36.072 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:03:36.072 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000055" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:36.072 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000055" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:36.086 4088 3038340491224 MainThread DEBUG os_win.utils.compute.vmutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Successfully changed vm state of instance-00000055 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:03:36.086 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Successfully changed state of VM instance-00000055 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:03:36.086 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Lock "ce937990-b827-4d67-85b2-7c454a6b252b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:36.132 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:03:36.132 4088 3038340491224 MainThread DEBUG os_win.utils.jobutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '5CAD1A31-D683-4CCF-91AF-587D37C0016A', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16238), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:36.215 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:36.240 4088 3038342256952 MainThread DEBUG nova.virt.hardware [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:03:36.240 4088 3038342256952 MainThread INFO nova.compute.claims [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Claim successful on node n-h2-808474-1 2021-09-10 17:03:36.371 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.hostops [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:03:36.371 4088 3038340491224 MainThread DEBUG os_win.utils.jobutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job succeeded: {'InstanceID': '5CAD1A31-D683-4CCF-91AF-587D37C0016A', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=133747), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:03:36.371 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000055" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:36.371 4088 3038340491224 MainThread DEBUG os_win.utils.pathutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Removing directory: C:\openstack\instances\instance-00000055 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:03:36.371 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000055" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:36.371 4088 3038340491224 MainThread ERROR nova.compute.manager [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000055' failed to start. Not enough memory in the system to start the virtual machine instance-00000055. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000055' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Not enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) 'instance-00000055' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Error code: 32778. 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Traceback (most recent call last): 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] return function(*args, **kwargs) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] admin_password, network_info, block_device_info) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] return function(self, *args, **kwds) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self.force_reraise() 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] raise self.value 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] should_plug_vifs=False) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 'req_state': req_state}) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self.force_reraise() 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] raise self.value 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] time.sleep(sleep_time) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self.force_reraise() 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] raise self.value 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] return f(*args, **kwargs) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] return self._wait_for_job(job_path) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] error_desc=err_desc) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000055' failed to start. 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Not enough memory in the system to start the virtual machine instance-00000055. 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000055' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Not enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 'instance-00000055' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Error code: 32778. 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] During handling of the above exception, another exception occurred: 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Traceback (most recent call last): 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] yield resources 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] accel_info=accel_info) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] return function(*args, **kwargs) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] admin_password, network_info, block_device_info) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] return function(self, *args, **kwds) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self.force_reraise() 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] raise self.value 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] should_plug_vifs=False) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 'req_state': req_state}) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self.force_reraise() 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] raise self.value 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] time.sleep(sleep_time) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self.force_reraise() 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] raise self.value 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] return f(*args, **kwargs) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] return self._wait_for_job(job_path) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] error_desc=err_desc) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000055' failed to start. 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Not enough memory in the system to start the virtual machine instance-00000055. 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000055' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Not enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 'instance-00000055' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Error code: 32778. 2021-09-10 17:03:36.371 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:36.396 4088 3038340491224 MainThread INFO nova.compute.manager [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Terminating instance 2021-09-10 17:03:36.396 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:03:36.396 4088 3038340491224 MainThread INFO nova.virt.hyperv.vmops [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Got request to destroy instance 2021-09-10 17:03:36.402 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.hostops [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:03:36.415 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:03:36.415 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000055" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:36.415 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000055" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:36.415 4088 3038340491224 MainThread INFO nova.compute.manager [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:03:36.415 4088 3038340491224 MainThread DEBUG nova.compute.claims [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:03:36.446 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-dc60f8ef-5c66-4387-9763-942b58b5e291 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Received event network-vif-plugged-017b262b-de39-45aa-9d95-268d363afe2e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:03:36.446 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-dc60f8ef-5c66-4387-9763-942b58b5e291 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "953a9285-8fdf-45ca-bec8-d0d9cc154d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:36.446 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-dc60f8ef-5c66-4387-9763-942b58b5e291 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "953a9285-8fdf-45ca-bec8-d0d9cc154d5d-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:36.446 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-dc60f8ef-5c66-4387-9763-942b58b5e291 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Processing event network-vif-plugged-017b262b-de39-45aa-9d95-268d363afe2e _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:03:36.458 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Using config drive for instance 2021-09-10 17:03:36.619 4088 3038342256952 MainThread DEBUG nova.compute.provider_tree [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:03:36.646 4088 3038342256952 MainThread DEBUG nova.scheduler.client.report [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:03:36.646 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:36.646 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:03:36.646 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.234s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:36.709 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:03:36.730 4088 3038342255896 GreenThread-79 DEBUG nova.compute.manager [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Not allocating networking since 'none' was specified. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1752 2021-09-10 17:03:36.760 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.hostops [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:03:36.774 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.hostops [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:03:36.869 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:03:36.887 4088 3038342256952 MainThread INFO nova.virt.hyperv.vmops [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Spawning new instance 2021-09-10 17:03:36.887 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Lock "instance-00000058" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:36.903 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Lock "instance-00000058" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:36.903 4088 3038342256952 MainThread DEBUG nova.block_device [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:03:36.903 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:36.903 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:36.914 4088 3038342256952 MainThread DEBUG os_win.utils.pathutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Creating directory: C:\openstack\instances\instance-00000058 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:03:36.914 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.vmops [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000058\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:03:36.959 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Creating config drive at C:\openstack\instances\instance-00000056\configdrive.iso 2021-09-10 17:03:37.074 4088 3038340492280 MainThread DEBUG oslo_concurrency.processutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000056\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmplee1mur2 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:03:37.228 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.vmops [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Resizing VHD C:\openstack\instances\instance-00000058\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:03:37.275 4088 3038340491224 MainThread DEBUG nova.compute.provider_tree [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:03:37.323 4088 3038340491224 MainThread DEBUG nova.scheduler.client.report [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:03:37.323 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.672s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:37.323 4088 3038340491224 MainThread ERROR nova.compute.manager [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000055' failed to start. Not enough memory in the system to start the virtual machine instance-00000055. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000055' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Not enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) 'instance-00000055' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Error code: 32778. 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Traceback (most recent call last): 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] return function(*args, **kwargs) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] admin_password, network_info, block_device_info) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] return function(self, *args, **kwds) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self.force_reraise() 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] raise self.value 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] should_plug_vifs=False) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 'req_state': req_state}) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self.force_reraise() 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] raise self.value 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] time.sleep(sleep_time) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self.force_reraise() 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] raise self.value 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] return f(*args, **kwargs) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] return self._wait_for_job(job_path) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] error_desc=err_desc) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000055' failed to start. 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Not enough memory in the system to start the virtual machine instance-00000055. 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000055' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Not enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 'instance-00000055' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Error code: 32778. 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] During handling of the above exception, another exception occurred: 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Traceback (most recent call last): 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] accel_info=accel_info) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] return function(*args, **kwargs) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] admin_password, network_info, block_device_info) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] return function(self, *args, **kwds) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self.force_reraise() 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] raise self.value 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] should_plug_vifs=False) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 'req_state': req_state}) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self.force_reraise() 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] raise self.value 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] time.sleep(sleep_time) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self.force_reraise() 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] raise self.value 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] return f(*args, **kwargs) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] return self._wait_for_job(job_path) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] error_desc=err_desc) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000055' failed to start. 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Not enough memory in the system to start the virtual machine instance-00000055. 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000055' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Not enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 'instance-00000055' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Error code: 32778. 2021-09-10 17:03:37.323 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: ba57675b-1666-430f-bbaa-84c5ca720900] 2021-09-10 17:03:37.340 4088 3038340491224 MainThread DEBUG nova.compute.utils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] WMI job failed with status 10. Error summary description: 'instance-00000055' failed to start. Not enough memory in the system to start the virtual machine instance-00000055. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:03:37.340 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Build of instance ba57675b-1666-430f-bbaa-84c5ca720900 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000055' failed to start. Not enough memory in the system to start the virtual machine instance-00000055. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000055' failed to start. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Not enough memory in the system to start the virtual machine instance-00000055 with ram size 1024 megabytes. (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) 'instance-00000055' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 74AC8296-DB17-46CC-9ADD-B6C5422EEBB4) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:03:37.340 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:03:37.340 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:03:37.340 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:03:37.340 4088 3038340491224 MainThread DEBUG nova.network.neutron [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:03:37.427 4088 3038342256952 MainThread DEBUG os_win.utils.compute.vmutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Creating VM instance-00000058 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:03:37.427 4088 3038340492280 MainThread DEBUG oslo_concurrency.processutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000056\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmplee1mur2" returned: 0 in 0.359s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:03:37.602 4088 3038340489992 GreenThread-78 DEBUG nova.network.neutron [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Successfully updated port: e6fecae3-cd06-43a6-ac04-dfd6bd3fdc61 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:03:37.633 4088 3038340489992 GreenThread-78 DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Acquired lock "refresh_cache-5b9c2a38-845e-44ce-ba83-cfe2a9acbb11" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:03:37.633 4088 3038340489992 GreenThread-78 DEBUG nova.network.neutron [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:03:37.778 4088 3038340489992 GreenThread-78 DEBUG nova.network.neutron [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:03:37.865 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-56c0b8fa-3fc7-431b-ab2e-9e42d88ad230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Received event network-changed-e6fecae3-cd06-43a6-ac04-dfd6bd3fdc61 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:03:37.865 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-56c0b8fa-3fc7-431b-ab2e-9e42d88ad230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Refreshing instance network info cache due to event network-changed-e6fecae3-cd06-43a6-ac04-dfd6bd3fdc61. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:03:38.068 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Setting boot order for instance: instance-00000056: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:03:38.225 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:03:38.256 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '0FB3E9F8-06E1-40F3-8B7D-63C184D97C6C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16004), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:38.414 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000056\' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)instance-0000005630B593DB-8443-4C1E-8FF6-3214B95FA3FC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)instance-0000005630B593DB-8443-4C1E-8FF6-3214B95FA3FC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000056\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)instance-0000005630B593DB-8443-4C1E-8FF6-3214B95FA3FC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0FB3E9F8-06E1-40F3-8B7D-63C184D97C6C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117448), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 38), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 38), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000056' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)\n\nNot enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)\n\n'instance-00000056' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)", 'ErrorSummaryDescription': "'instance-00000056' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000056.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:38.414 4088 3038340492280 MainThread DEBUG os_win._utils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000056' failed to start. Not enough memory in the system to start the virtual machine instance-00000056. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000056' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Not enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) 'instance-00000056' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1890859603881836 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:38.414 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000056" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:38.414 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000056" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:38.414 4088 3038342144952 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:38.414 4088 3038342144952 MainThread INFO nova.compute.manager [-] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] VM Stopped (Lifecycle Event) 2021-09-10 17:03:38.466 4088 3038342144952 MainThread DEBUG nova.compute.manager [req-69c5615e-9a63-4422-9962-720b541c5814 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:38.466 4088 3038342144952 MainThread DEBUG nova.virt.hyperv.vmops [req-69c5615e-9a63-4422-9962-720b541c5814 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:38.507 4088 3038342144952 MainThread DEBUG nova.compute.manager [req-69c5615e-9a63-4422-9962-720b541c5814 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:38.584 4088 3038342144952 MainThread INFO nova.compute.manager [req-69c5615e-9a63-4422-9962-720b541c5814 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:38.584 4088 3038340489992 GreenThread-78 DEBUG nova.network.neutron [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Updating instance_info_cache with network_info: [{"id": "e6fecae3-cd06-43a6-ac04-dfd6bd3fdc61", "address": "fa:16:3e:78:8b:5a", "network": {"id": "51960055-efb4-4c4f-8674-2e7a379abd57", "bridge": null, "label": "tempest-ListServersNegativeTestJSON-278608844-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7055b5c60f1f45d6b0dd2b8a9a6f7f0a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape6fecae3-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:38.637 4088 3038340489992 GreenThread-78 DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Releasing lock "refresh_cache-5b9c2a38-845e-44ce-ba83-cfe2a9acbb11" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:03:38.637 4088 3038340489992 GreenThread-78 DEBUG nova.compute.manager [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Instance network_info: |[{"id": "e6fecae3-cd06-43a6-ac04-dfd6bd3fdc61", "address": "fa:16:3e:78:8b:5a", "network": {"id": "51960055-efb4-4c4f-8674-2e7a379abd57", "bridge": null, "label": "tempest-ListServersNegativeTestJSON-278608844-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7055b5c60f1f45d6b0dd2b8a9a6f7f0a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape6fecae3-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:03:38.637 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-56c0b8fa-3fc7-431b-ab2e-9e42d88ad230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-5b9c2a38-845e-44ce-ba83-cfe2a9acbb11" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:03:38.637 4088 3038342146184 MainThread DEBUG nova.network.neutron [req-56c0b8fa-3fc7-431b-ab2e-9e42d88ad230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Refreshing network info cache for port e6fecae3-cd06-43a6-ac04-dfd6bd3fdc61 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:03:38.637 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Preparing to wait for external event network-vif-plugged-e6fecae3-cd06-43a6-ac04-dfd6bd3fdc61 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:03:38.637 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Lock "5b9c2a38-845e-44ce-ba83-cfe2a9acbb11-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:38.637 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Lock "5b9c2a38-845e-44ce-ba83-cfe2a9acbb11-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:38.651 4088 3038342255016 MainThread DEBUG os_win.utils.compute.vmutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Creating VM instance-0000005b create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:03:38.958 4088 3038340491224 MainThread DEBUG nova.network.neutron [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:38.990 4088 3038340491224 MainThread INFO nova.compute.manager [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: ba57675b-1666-430f-bbaa-84c5ca720900] Took 1.66 seconds to deallocate network for instance. 2021-09-10 17:03:39.162 4088 3038340491224 MainThread INFO nova.scheduler.client.report [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Deleted allocations for instance ba57675b-1666-430f-bbaa-84c5ca720900 2021-09-10 17:03:39.208 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-52e3f898-b55b-4d09-9d87-cc99d15ae661 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "ba57675b-1666-430f-bbaa-84c5ca720900" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 26.938s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:39.448 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': 'A7EEC37E-9E88-4510-A210-8369359A0F7C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19592), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:39.596 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000056\' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)instance-0000005630B593DB-8443-4C1E-8FF6-3214B95FA3FC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)instance-0000005630B593DB-8443-4C1E-8FF6-3214B95FA3FC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000056\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)instance-0000005630B593DB-8443-4C1E-8FF6-3214B95FA3FC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A7EEC37E-9E88-4510-A210-8369359A0F7C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113768), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 39), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 39), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000056' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)\n\nNot enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)\n\n'instance-00000056' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)", 'ErrorSummaryDescription': "'instance-00000056' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000056.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:39.605 4088 3038340492280 MainThread DEBUG os_win._utils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000056' failed to start. Not enough memory in the system to start the virtual machine instance-00000056. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000056' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Not enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) 'instance-00000056' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3799407482147217 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:39.630 4088 3038340491224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:39.646 4088 3038340491224 MainThread INFO nova.compute.manager [-] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] VM Stopped (Lifecycle Event) 2021-09-10 17:03:39.646 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000056" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:39.646 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000056" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:39.662 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-24bea374-75ef-42d5-921e-519c8651bc16 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:39.662 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-24bea374-75ef-42d5-921e-519c8651bc16 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:39.712 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-24bea374-75ef-42d5-921e-519c8651bc16 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:39.740 4088 3038340491224 MainThread INFO nova.compute.manager [req-24bea374-75ef-42d5-921e-519c8651bc16 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:39.928 4088 3038342256952 MainThread INFO nova.virt.hyperv.vmops [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Using config drive for instance 2021-09-10 17:03:40.068 4088 3038342146184 MainThread DEBUG nova.network.neutron [req-56c0b8fa-3fc7-431b-ab2e-9e42d88ad230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Updated VIF entry in instance network info cache for port e6fecae3-cd06-43a6-ac04-dfd6bd3fdc61. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:03:40.069 4088 3038342146184 MainThread DEBUG nova.network.neutron [req-56c0b8fa-3fc7-431b-ab2e-9e42d88ad230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Updating instance_info_cache with network_info: [{"id": "e6fecae3-cd06-43a6-ac04-dfd6bd3fdc61", "address": "fa:16:3e:78:8b:5a", "network": {"id": "51960055-efb4-4c4f-8674-2e7a379abd57", "bridge": null, "label": "tempest-ListServersNegativeTestJSON-278608844-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7055b5c60f1f45d6b0dd2b8a9a6f7f0a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape6fecae3-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:40.086 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-56c0b8fa-3fc7-431b-ab2e-9e42d88ad230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-5b9c2a38-845e-44ce-ba83-cfe2a9acbb11" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:03:40.277 4088 3038342256952 MainThread INFO nova.virt.hyperv.vmops [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Creating config drive at C:\openstack\instances\instance-00000058\configdrive.iso 2021-09-10 17:03:40.365 4088 3038342256952 MainThread DEBUG oslo_concurrency.processutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000058\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpefmspptp execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:03:40.699 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '1FF65D46-A046-4719-9E27-348F99B9C501', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19710), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:40.732 4088 3038342256952 MainThread DEBUG oslo_concurrency.processutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000058\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpefmspptp" returned: 0 in 0.359s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:03:40.833 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000056\' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)instance-0000005630B593DB-8443-4C1E-8FF6-3214B95FA3FC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)instance-0000005630B593DB-8443-4C1E-8FF6-3214B95FA3FC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000056\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)instance-0000005630B593DB-8443-4C1E-8FF6-3214B95FA3FC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1FF65D46-A046-4719-9E27-348F99B9C501', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120069), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 40), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 40), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000056' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)\n\nNot enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)\n\n'instance-00000056' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)", 'ErrorSummaryDescription': "'instance-00000056' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000056.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:40.833 4088 3038340492280 MainThread DEBUG os_win._utils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000056' failed to start. Not enough memory in the system to start the virtual machine instance-00000056. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000056' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Not enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) 'instance-00000056' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.608372688293457 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:40.884 4088 3038342255016 MainThread DEBUG nova.virt.hyperv.vmops [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:03:40.902 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000056" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:40.902 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000056" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:40.916 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:40.916 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] VM Stopped (Lifecycle Event) 2021-09-10 17:03:40.948 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-0e4a5ec3-1dc2-4ba0-b8d7-0afbd0ff32fc - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:40.948 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-0e4a5ec3-1dc2-4ba0-b8d7-0afbd0ff32fc - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:41.125 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-0e4a5ec3-1dc2-4ba0-b8d7-0afbd0ff32fc - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:41.152 4088 3038340489992 MainThread INFO nova.compute.manager [req-0e4a5ec3-1dc2-4ba0-b8d7-0afbd0ff32fc - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:41.380 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.vmops [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Setting boot order for instance: instance-00000058: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:03:41.458 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.vmops [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:03:41.514 4088 3038342256952 MainThread DEBUG os_win.utils.jobutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Waiting for WMI job: {'InstanceID': 'DC616A61-82B1-40C8-BC23-E5C1B4B9006A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15599), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:41.631 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:41.661 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] VM Stopped (Lifecycle Event) 2021-09-10 17:03:41.661 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000058" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:41.661 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000058" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:41.661 4088 3038342256952 MainThread ERROR os_win.utils.jobutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000058\' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)instance-00000058ED205DBF-AD3F-4D6F-A4E2-159C873B758012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)instance-00000058ED205DBF-AD3F-4D6F-A4E2-159C873B758010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000058\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)instance-00000058ED205DBF-AD3F-4D6F-A4E2-159C873B7580%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'DC616A61-82B1-40C8-BC23-E5C1B4B9006A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=98834), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 41), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 41), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000058' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)\n\nNot enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)\n\n'instance-00000058' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)", 'ErrorSummaryDescription': "'instance-00000058' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000058.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:41.661 4088 3038342256952 MainThread DEBUG os_win._utils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000058' failed to start. Not enough memory in the system to start the virtual machine instance-00000058. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000058' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Not enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) 'instance-00000058' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.20297861099243164 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:41.686 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-9e4a375a-7b6d-4a65-8f43-1a4d53a06169 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:41.686 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-9e4a375a-7b6d-4a65-8f43-1a4d53a06169 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:41.717 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-9e4a375a-7b6d-4a65-8f43-1a4d53a06169 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:41.758 4088 3038340489992 MainThread INFO nova.compute.manager [req-9e4a375a-7b6d-4a65-8f43-1a4d53a06169 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:41.849 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': 'D137C7D1-8ED7-41BE-9BE1-017F22B68E39', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15326), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:42.004 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000056\' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)instance-0000005630B593DB-8443-4C1E-8FF6-3214B95FA3FC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)instance-0000005630B593DB-8443-4C1E-8FF6-3214B95FA3FC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000056\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)instance-0000005630B593DB-8443-4C1E-8FF6-3214B95FA3FC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D137C7D1-8ED7-41BE-9BE1-017F22B68E39', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120605), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 41), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 41), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000056' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)\n\nNot enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)\n\n'instance-00000056' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)", 'ErrorSummaryDescription': "'instance-00000056' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000056.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:42.021 4088 3038340492280 MainThread DEBUG os_win._utils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000056' failed to start. Not enough memory in the system to start the virtual machine instance-00000056. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000056' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Not enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) 'instance-00000056' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.795607805252075 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:42.031 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000056" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:42.031 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000056" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:42.031 4088 3038340570104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:42.031 4088 3038340570104 MainThread INFO nova.compute.manager [-] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] VM Stopped (Lifecycle Event) 2021-09-10 17:03:42.060 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-30a3cd8c-ba95-47b3-b53a-f87b0d3b3ba6 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:42.076 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-30a3cd8c-ba95-47b3-b53a-f87b0d3b3ba6 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:42.114 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-30a3cd8c-ba95-47b3-b53a-f87b0d3b3ba6 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:42.162 4088 3038340570104 MainThread INFO nova.compute.manager [req-30a3cd8c-ba95-47b3-b53a-f87b0d3b3ba6 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:42.300 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:03:42.311 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:03:42.311 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:03:42.552 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:03:42.696 4088 3038342256952 MainThread DEBUG os_win.utils.jobutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Waiting for WMI job: {'InstanceID': 'FA1AD510-BD4E-4F96-98BF-E22440A22DA5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15804), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:42.850 4088 3038342256952 MainThread ERROR os_win.utils.jobutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000058\' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)instance-00000058ED205DBF-AD3F-4D6F-A4E2-159C873B758012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)instance-00000058ED205DBF-AD3F-4D6F-A4E2-159C873B758010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000058\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)instance-00000058ED205DBF-AD3F-4D6F-A4E2-159C873B7580%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'FA1AD510-BD4E-4F96-98BF-E22440A22DA5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=94059), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 42), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 42), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000058' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)\n\nNot enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)\n\n'instance-00000058' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)", 'ErrorSummaryDescription': "'instance-00000058' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000058.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:42.850 4088 3038342256952 MainThread DEBUG os_win._utils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000058' failed to start. Not enough memory in the system to start the virtual machine instance-00000058. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000058' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Not enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) 'instance-00000058' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3915181159973145 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:42.850 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000058" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:42.850 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000058" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:42.850 4088 3038340570104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:42.850 4088 3038340570104 MainThread INFO nova.compute.manager [-] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] VM Stopped (Lifecycle Event) 2021-09-10 17:03:42.889 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-eb489fe1-1c06-4145-afa7-457a25102843 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:42.889 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-eb489fe1-1c06-4145-afa7-457a25102843 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:42.944 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-eb489fe1-1c06-4145-afa7-457a25102843 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:42.974 4088 3038340570104 MainThread INFO nova.compute.manager [req-eb489fe1-1c06-4145-afa7-457a25102843 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:43.074 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '88F9AF27-A316-429F-AED5-2B4D9B37DCE2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17052), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:43.210 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000056\' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)instance-0000005630B593DB-8443-4C1E-8FF6-3214B95FA3FC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)instance-0000005630B593DB-8443-4C1E-8FF6-3214B95FA3FC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000056\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)instance-0000005630B593DB-8443-4C1E-8FF6-3214B95FA3FC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '88F9AF27-A316-429F-AED5-2B4D9B37DCE2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111973), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 43), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 43), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000056' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)\n\nNot enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)\n\n'instance-00000056' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)", 'ErrorSummaryDescription': "'instance-00000056' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000056.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:43.210 4088 3038340492280 MainThread DEBUG os_win._utils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000056' failed to start. Not enough memory in the system to start the virtual machine instance-00000056. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000056' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Not enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) 'instance-00000056' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.985271453857422 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:43.231 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000056" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:43.231 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000056" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:43.251 4088 3038340570104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:43.251 4088 3038340570104 MainThread INFO nova.compute.manager [-] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] VM Stopped (Lifecycle Event) 2021-09-10 17:03:43.274 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-ce92f415-8600-4317-9f2d-cdd9cc2a4e87 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:43.274 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-ce92f415-8600-4317-9f2d-cdd9cc2a4e87 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:43.322 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-ce92f415-8600-4317-9f2d-cdd9cc2a4e87 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:43.349 4088 3038340570104 MainThread INFO nova.compute.manager [req-ce92f415-8600-4317-9f2d-cdd9cc2a4e87 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:43.889 4088 3038342256952 MainThread DEBUG os_win.utils.jobutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Waiting for WMI job: {'InstanceID': '6CFCC48A-2B87-4C7C-835F-CD81FE39B301', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16199), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:44.039 4088 3038342256952 MainThread ERROR os_win.utils.jobutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000058\' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)instance-00000058ED205DBF-AD3F-4D6F-A4E2-159C873B758012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)instance-00000058ED205DBF-AD3F-4D6F-A4E2-159C873B758010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000058\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)instance-00000058ED205DBF-AD3F-4D6F-A4E2-159C873B7580%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6CFCC48A-2B87-4C7C-835F-CD81FE39B301', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=94613), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 43), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 43), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000058' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)\n\nNot enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)\n\n'instance-00000058' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)", 'ErrorSummaryDescription': "'instance-00000058' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000058.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:44.039 4088 3038342256952 MainThread DEBUG os_win._utils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000058' failed to start. Not enough memory in the system to start the virtual machine instance-00000058. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000058' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Not enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) 'instance-00000058' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.580214738845825 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:44.039 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000058" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:44.061 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000058" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:44.061 4088 3038340570104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:44.061 4088 3038340570104 MainThread INFO nova.compute.manager [-] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] VM Stopped (Lifecycle Event) 2021-09-10 17:03:44.069 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-cee38613-a9b1-418a-a5b3-5d0d7eb5c359 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:44.091 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-cee38613-a9b1-418a-a5b3-5d0d7eb5c359 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:44.139 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-cee38613-a9b1-418a-a5b3-5d0d7eb5c359 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:44.147 4088 3038340570104 MainThread INFO nova.compute.manager [req-cee38613-a9b1-418a-a5b3-5d0d7eb5c359 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:44.243 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '1B5BD699-96BA-49CC-A8D6-9FF20E35C0B6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16137), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:44.401 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000056\' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)instance-0000005630B593DB-8443-4C1E-8FF6-3214B95FA3FC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)instance-0000005630B593DB-8443-4C1E-8FF6-3214B95FA3FC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000056\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)instance-0000005630B593DB-8443-4C1E-8FF6-3214B95FA3FC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1B5BD699-96BA-49CC-A8D6-9FF20E35C0B6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117078), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 44), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 44), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000056' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)\n\nNot enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)\n\n'instance-00000056' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC)", 'ErrorSummaryDescription': "'instance-00000056' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000056.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:44.401 4088 3038340492280 MainThread ERROR nova.virt.hyperv.vmops [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Failed to change vm state of instance-00000056 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000056' failed to start. 2021-09-10 17:03:44.401 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Got request to destroy instance 2021-09-10 17:03:44.427 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000056" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:44.427 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000056" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:44.427 4088 3038340570104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:44.427 4088 3038340570104 MainThread INFO nova.compute.manager [-] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] VM Stopped (Lifecycle Event) 2021-09-10 17:03:44.460 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-2776af6f-a0d3-4c04-bf7b-850b87149488 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:44.460 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-2776af6f-a0d3-4c04-bf7b-850b87149488 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:44.515 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-2776af6f-a0d3-4c04-bf7b-850b87149488 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:44.536 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:03:44.536 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:03:44.536 4088 3038340570104 MainThread INFO nova.compute.manager [req-2776af6f-a0d3-4c04-bf7b-850b87149488 - - - - -] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:44.656 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-98da4c02-e4db-4a02-a807-c737f9038672" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:03:44.656 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:03:45.069 4088 3038342256952 MainThread DEBUG os_win.utils.jobutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Waiting for WMI job: {'InstanceID': '9CCBA5B6-4B86-4FD5-A981-C2DBC82E1980', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17378), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:45.227 4088 3038342256952 MainThread ERROR os_win.utils.jobutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000058\' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)instance-00000058ED205DBF-AD3F-4D6F-A4E2-159C873B758012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)instance-00000058ED205DBF-AD3F-4D6F-A4E2-159C873B758010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000058\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)instance-00000058ED205DBF-AD3F-4D6F-A4E2-159C873B7580%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9CCBA5B6-4B86-4FD5-A981-C2DBC82E1980', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=101179), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 45), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 45), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000058' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)\n\nNot enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)\n\n'instance-00000058' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)", 'ErrorSummaryDescription': "'instance-00000058' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000058.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:45.227 4088 3038342256952 MainThread DEBUG os_win._utils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000058' failed to start. Not enough memory in the system to start the virtual machine instance-00000058. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000058' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Not enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) 'instance-00000058' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7685348987579346 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:45.247 4088 3038337402488 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:45.247 4088 3038337402488 MainThread INFO nova.compute.manager [-] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] VM Stopped (Lifecycle Event) 2021-09-10 17:03:45.258 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000058" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:45.258 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000058" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:45.272 4088 3038337402488 MainThread DEBUG nova.compute.manager [req-349f7333-7094-4b4d-ae5b-8f36400ad7c9 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:45.272 4088 3038337402488 MainThread DEBUG nova.virt.hyperv.vmops [req-349f7333-7094-4b4d-ae5b-8f36400ad7c9 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:45.340 4088 3038337402488 MainThread DEBUG nova.compute.manager [req-349f7333-7094-4b4d-ae5b-8f36400ad7c9 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:45.366 4088 3038337402488 MainThread INFO nova.compute.manager [req-349f7333-7094-4b4d-ae5b-8f36400ad7c9 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:45.568 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Updating instance_info_cache with network_info: [{"id": "51e81291-5d40-4203-b72f-f016060edd87", "address": "fa:16:3e:82:36:43", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap51e81291-5d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:45.614 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-98da4c02-e4db-4a02-a807-c737f9038672" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:03:45.614 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:03:45.614 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:03:45.614 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:03:45.614 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:03:46.259 4088 3038342256952 MainThread DEBUG os_win.utils.jobutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Waiting for WMI job: {'InstanceID': '8E703447-EE12-467D-974D-D5EEF60A639F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19803), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:46.381 4088 3038342256952 MainThread ERROR os_win.utils.jobutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000058\' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)instance-00000058ED205DBF-AD3F-4D6F-A4E2-159C873B758012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)instance-00000058ED205DBF-AD3F-4D6F-A4E2-159C873B758010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000058\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)instance-00000058ED205DBF-AD3F-4D6F-A4E2-159C873B7580%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '8E703447-EE12-467D-974D-D5EEF60A639F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=96779), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 46), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 46), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000058' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)\n\nNot enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)\n\n'instance-00000058' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)", 'ErrorSummaryDescription': "'instance-00000058' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000058.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:46.403 4088 3038342256952 MainThread DEBUG os_win._utils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000058' failed to start. Not enough memory in the system to start the virtual machine instance-00000058. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000058' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Not enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) 'instance-00000058' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.944110631942749 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:46.429 4088 3038340570104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:46.429 4088 3038340570104 MainThread INFO nova.compute.manager [-] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] VM Stopped (Lifecycle Event) 2021-09-10 17:03:46.429 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000058" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:46.429 4088 3038337402488 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000058" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:46.451 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-2e0730d5-3b9f-41b7-93dc-081d73d617d9 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:46.451 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-2e0730d5-3b9f-41b7-93dc-081d73d617d9 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:46.490 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-2e0730d5-3b9f-41b7-93dc-081d73d617d9 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:46.490 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:03:46.490 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000056" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:46.490 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000056" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:46.523 4088 3038340492280 MainThread DEBUG os_win.utils.compute.vmutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Successfully changed vm state of instance-00000056 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:03:46.523 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Successfully changed state of VM instance-00000056 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:03:46.523 4088 3038340570104 MainThread INFO nova.compute.manager [req-2e0730d5-3b9f-41b7-93dc-081d73d617d9 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:46.552 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:03:46.571 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '99282680-9E11-4430-AD16-29549F954260', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17851), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:46.819 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job succeeded: {'InstanceID': '99282680-9E11-4430-AD16-29549F954260', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=148797), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:03:46.819 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000056" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:46.819 4088 3038340492280 MainThread DEBUG os_win.utils.pathutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Removing directory: C:\openstack\instances\instance-00000056 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:03:46.819 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000056" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:46.819 4088 3038340492280 MainThread ERROR nova.compute.manager [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000056' failed to start. Not enough memory in the system to start the virtual machine instance-00000056. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000056' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Not enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) 'instance-00000056' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Error code: 32778. 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Traceback (most recent call last): 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] return function(*args, **kwargs) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] admin_password, network_info, block_device_info) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] return function(self, *args, **kwds) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self.force_reraise() 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] raise self.value 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] should_plug_vifs=False) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 'req_state': req_state}) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self.force_reraise() 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] raise self.value 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] time.sleep(sleep_time) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self.force_reraise() 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] raise self.value 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] return f(*args, **kwargs) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] return self._wait_for_job(job_path) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] error_desc=err_desc) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000056' failed to start. 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Not enough memory in the system to start the virtual machine instance-00000056. 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000056' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Not enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 'instance-00000056' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Error code: 32778. 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] During handling of the above exception, another exception occurred: 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Traceback (most recent call last): 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] yield resources 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] accel_info=accel_info) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] return function(*args, **kwargs) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] admin_password, network_info, block_device_info) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] return function(self, *args, **kwds) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self.force_reraise() 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] raise self.value 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] should_plug_vifs=False) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 'req_state': req_state}) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self.force_reraise() 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] raise self.value 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] time.sleep(sleep_time) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self.force_reraise() 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] raise self.value 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] return f(*args, **kwargs) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] return self._wait_for_job(job_path) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] error_desc=err_desc) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000056' failed to start. 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Not enough memory in the system to start the virtual machine instance-00000056. 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000056' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Not enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 'instance-00000056' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Error code: 32778. 2021-09-10 17:03:46.819 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:46.819 4088 3038340492280 MainThread INFO nova.compute.manager [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Terminating instance 2021-09-10 17:03:46.819 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:03:46.819 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Got request to destroy instance 2021-09-10 17:03:46.841 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:03:46.841 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000056" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:46.841 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000056" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:46.841 4088 3038340492280 MainThread INFO nova.compute.manager [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:03:46.841 4088 3038340492280 MainThread DEBUG nova.compute.claims [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:03:46.841 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:47.039 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.hostops [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:03:47.071 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.hostops [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:03:47.303 4088 3038340492280 MainThread DEBUG nova.compute.provider_tree [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:03:47.317 4088 3038340492280 MainThread DEBUG nova.scheduler.client.report [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:03:47.317 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.484s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:47.317 4088 3038340492280 MainThread ERROR nova.compute.manager [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000056' failed to start. Not enough memory in the system to start the virtual machine instance-00000056. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000056' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Not enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) 'instance-00000056' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Error code: 32778. 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Traceback (most recent call last): 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] return function(*args, **kwargs) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] admin_password, network_info, block_device_info) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] return function(self, *args, **kwds) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self.force_reraise() 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] raise self.value 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] should_plug_vifs=False) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 'req_state': req_state}) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self.force_reraise() 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] raise self.value 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] time.sleep(sleep_time) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self.force_reraise() 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] raise self.value 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] return f(*args, **kwargs) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] return self._wait_for_job(job_path) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] error_desc=err_desc) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000056' failed to start. 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Not enough memory in the system to start the virtual machine instance-00000056. 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000056' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Not enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 'instance-00000056' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Error code: 32778. 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] During handling of the above exception, another exception occurred: 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Traceback (most recent call last): 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] accel_info=accel_info) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] return function(*args, **kwargs) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] admin_password, network_info, block_device_info) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] return function(self, *args, **kwds) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self.force_reraise() 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] raise self.value 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] should_plug_vifs=False) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 'req_state': req_state}) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self.force_reraise() 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] raise self.value 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] time.sleep(sleep_time) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self.force_reraise() 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] raise self.value 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] return f(*args, **kwargs) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] return self._wait_for_job(job_path) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] error_desc=err_desc) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000056' failed to start. 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Not enough memory in the system to start the virtual machine instance-00000056. 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000056' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Not enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 'instance-00000056' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Error code: 32778. 2021-09-10 17:03:47.317 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] 2021-09-10 17:03:47.317 4088 3038340492280 MainThread DEBUG nova.compute.utils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] WMI job failed with status 10. Error summary description: 'instance-00000056' failed to start. Not enough memory in the system to start the virtual machine instance-00000056. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:03:47.317 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Build of instance 953a9285-8fdf-45ca-bec8-d0d9cc154d5d was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000056' failed to start. Not enough memory in the system to start the virtual machine instance-00000056. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000056' failed to start. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Not enough memory in the system to start the virtual machine instance-00000056 with ram size 1024 megabytes. (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) 'instance-00000056' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 30B593DB-8443-4C1E-8FF6-3214B95FA3FC) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:03:47.317 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:03:47.317 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:03:47.317 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:03:47.333 4088 3038340492280 MainThread DEBUG nova.network.neutron [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:03:47.430 4088 3038342256952 MainThread DEBUG os_win.utils.jobutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Waiting for WMI job: {'InstanceID': '08146A94-222F-44A5-9F21-BF12559EE6D8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16249), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:47.571 4088 3038342256952 MainThread ERROR os_win.utils.jobutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000058\' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)instance-00000058ED205DBF-AD3F-4D6F-A4E2-159C873B758012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)instance-00000058ED205DBF-AD3F-4D6F-A4E2-159C873B758010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000058\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)instance-00000058ED205DBF-AD3F-4D6F-A4E2-159C873B7580%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '08146A94-222F-44A5-9F21-BF12559EE6D8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=96699), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 47), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 47), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000058' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)\n\nNot enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)\n\n'instance-00000058' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580)", 'ErrorSummaryDescription': "'instance-00000058' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000058.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:47.571 4088 3038342256952 MainThread ERROR nova.virt.hyperv.vmops [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Failed to change vm state of instance-00000058 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000058' failed to start. 2021-09-10 17:03:47.571 4088 3038342256952 MainThread INFO nova.virt.hyperv.vmops [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Got request to destroy instance 2021-09-10 17:03:47.585 4088 3038337403192 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:47.585 4088 3038337403192 MainThread INFO nova.compute.manager [-] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] VM Stopped (Lifecycle Event) 2021-09-10 17:03:47.585 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000058" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:47.585 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000058" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:47.613 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-93b2e7bb-c393-4868-97f0-9c6f85663544 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:47.613 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.vmops [req-93b2e7bb-c393-4868-97f0-9c6f85663544 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:47.655 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-93b2e7bb-c393-4868-97f0-9c6f85663544 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:47.687 4088 3038337403192 MainThread INFO nova.compute.manager [req-93b2e7bb-c393-4868-97f0-9c6f85663544 - - - - -] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:48.383 4088 3038340492280 MainThread DEBUG nova.network.neutron [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:48.412 4088 3038340492280 MainThread INFO nova.compute.manager [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 953a9285-8fdf-45ca-bec8-d0d9cc154d5d] Took 1.09 seconds to deallocate network for instance. 2021-09-10 17:03:48.708 4088 3038340492280 MainThread INFO nova.scheduler.client.report [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Deleted allocations for instance 953a9285-8fdf-45ca-bec8-d0d9cc154d5d 2021-09-10 17:03:48.770 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-1552972b-5777-4936-acc5-e086d2344707 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "953a9285-8fdf-45ca-bec8-d0d9cc154d5d" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 27.625s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:49.411 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.vmops [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:03:49.411 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Lock "instance-00000058" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:49.411 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Lock "instance-00000058" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:49.430 4088 3038342256952 MainThread DEBUG os_win.utils.compute.vmutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Successfully changed vm state of instance-00000058 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:03:49.430 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.vmops [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Successfully changed state of VM instance-00000058 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:03:49.474 4088 3038342256952 MainThread DEBUG os_win.utils.jobutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Waiting for WMI job: {'InstanceID': '0F589F31-F229-4165-8493-AFD1EBB7AB6E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15775), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:49.585 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-7a58467f-ecf6-45ee-8ec1-7945f04d2551 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Received event network-vif-plugged-e6fecae3-cd06-43a6-ac04-dfd6bd3fdc61 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:03:49.585 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-7a58467f-ecf6-45ee-8ec1-7945f04d2551 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "5b9c2a38-845e-44ce-ba83-cfe2a9acbb11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:49.585 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-7a58467f-ecf6-45ee-8ec1-7945f04d2551 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "5b9c2a38-845e-44ce-ba83-cfe2a9acbb11-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:49.585 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-7a58467f-ecf6-45ee-8ec1-7945f04d2551 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Processing event network-vif-plugged-e6fecae3-cd06-43a6-ac04-dfd6bd3fdc61 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:03:49.642 4088 3038342255016 MainThread INFO nova.virt.hyperv.vmops [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Using config drive for instance 2021-09-10 17:03:49.696 4088 3038342256952 MainThread DEBUG os_win.utils.jobutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] WMI job succeeded: {'InstanceID': '0F589F31-F229-4165-8493-AFD1EBB7AB6E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=138972), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:03:49.696 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Lock "instance-00000058" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:49.696 4088 3038342256952 MainThread DEBUG os_win.utils.pathutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Removing directory: C:\openstack\instances\instance-00000058 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:03:49.696 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Lock "instance-00000058" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:49.696 4088 3038342256952 MainThread ERROR nova.compute.manager [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000058' failed to start. Not enough memory in the system to start the virtual machine instance-00000058. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000058' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Not enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) 'instance-00000058' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Error code: 32778. 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Traceback (most recent call last): 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] return function(*args, **kwargs) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] admin_password, network_info, block_device_info) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] return function(self, *args, **kwds) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self.force_reraise() 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] raise self.value 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] should_plug_vifs=False) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 'req_state': req_state}) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self.force_reraise() 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] raise self.value 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] time.sleep(sleep_time) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self.force_reraise() 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] raise self.value 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] return f(*args, **kwargs) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] return self._wait_for_job(job_path) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] error_desc=err_desc) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000058' failed to start. 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Not enough memory in the system to start the virtual machine instance-00000058. 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000058' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Not enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 'instance-00000058' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Error code: 32778. 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] During handling of the above exception, another exception occurred: 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Traceback (most recent call last): 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] yield resources 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] accel_info=accel_info) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] return function(*args, **kwargs) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] admin_password, network_info, block_device_info) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] return function(self, *args, **kwds) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self.force_reraise() 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] raise self.value 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] should_plug_vifs=False) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 'req_state': req_state}) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self.force_reraise() 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] raise self.value 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] time.sleep(sleep_time) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self.force_reraise() 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] raise self.value 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] return f(*args, **kwargs) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] return self._wait_for_job(job_path) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] error_desc=err_desc) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000058' failed to start. 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Not enough memory in the system to start the virtual machine instance-00000058. 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000058' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Not enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 'instance-00000058' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Error code: 32778. 2021-09-10 17:03:49.696 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:49.696 4088 3038342256952 MainThread INFO nova.compute.manager [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Terminating instance 2021-09-10 17:03:49.696 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Acquired lock "refresh_cache-ce937990-b827-4d67-85b2-7c454a6b252b" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:03:49.696 4088 3038342256952 MainThread DEBUG nova.network.neutron [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:03:49.824 4088 3038342256952 MainThread DEBUG nova.network.neutron [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:03:50.023 4088 3038342256952 MainThread DEBUG nova.network.neutron [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:50.023 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Releasing lock "refresh_cache-ce937990-b827-4d67-85b2-7c454a6b252b" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:03:50.023 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:03:50.023 4088 3038342256952 MainThread INFO nova.virt.hyperv.vmops [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Got request to destroy instance 2021-09-10 17:03:50.052 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.vmops [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:03:50.052 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Lock "instance-00000058" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:50.052 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Lock "instance-00000058" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:50.052 4088 3038342256952 MainThread INFO nova.compute.manager [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:03:50.052 4088 3038342256952 MainThread DEBUG oslo.service.loopingcall [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. func c:\python37\lib\site-packages\oslo_service\loopingcall.py:435 2021-09-10 17:03:50.052 4088 3038340492280 GreenThread-80 DEBUG nova.compute.manager [-] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Skipping network deallocation for instance since networking was not requested. _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2054 2021-09-10 17:03:50.052 4088 3038342256952 MainThread DEBUG nova.compute.claims [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:03:50.052 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:50.204 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.hostops [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:03:50.229 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.hostops [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:03:50.302 4088 3038342255016 MainThread INFO nova.virt.hyperv.vmops [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Creating config drive at C:\openstack\instances\instance-0000005b\configdrive.iso 2021-09-10 17:03:50.411 4088 3038342255016 MainThread DEBUG oslo_concurrency.processutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000005b\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpbpdcfn40 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:03:50.728 4088 3038342256952 MainThread DEBUG nova.compute.provider_tree [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:03:50.728 4088 3038342256952 MainThread DEBUG nova.scheduler.client.report [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:03:50.749 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.703s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:50.749 4088 3038342256952 MainThread ERROR nova.compute.manager [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000058' failed to start. Not enough memory in the system to start the virtual machine instance-00000058. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000058' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Not enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) 'instance-00000058' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Error code: 32778. 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Traceback (most recent call last): 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] return function(*args, **kwargs) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] admin_password, network_info, block_device_info) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] return function(self, *args, **kwds) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self.force_reraise() 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] raise self.value 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] should_plug_vifs=False) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 'req_state': req_state}) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self.force_reraise() 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] raise self.value 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] time.sleep(sleep_time) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self.force_reraise() 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] raise self.value 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] return f(*args, **kwargs) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] return self._wait_for_job(job_path) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] error_desc=err_desc) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000058' failed to start. 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Not enough memory in the system to start the virtual machine instance-00000058. 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000058' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Not enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 'instance-00000058' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Error code: 32778. 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] During handling of the above exception, another exception occurred: 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Traceback (most recent call last): 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] accel_info=accel_info) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] return function(*args, **kwargs) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] admin_password, network_info, block_device_info) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] return function(self, *args, **kwds) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self.force_reraise() 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] raise self.value 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] should_plug_vifs=False) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 'req_state': req_state}) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self.force_reraise() 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] raise self.value 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] time.sleep(sleep_time) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self.force_reraise() 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] raise self.value 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] return f(*args, **kwargs) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] return self._wait_for_job(job_path) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] error_desc=err_desc) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000058' failed to start. 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Not enough memory in the system to start the virtual machine instance-00000058. 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000058' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Not enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 'instance-00000058' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Error code: 32778. 2021-09-10 17:03:50.749 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: ce937990-b827-4d67-85b2-7c454a6b252b] 2021-09-10 17:03:50.755 4088 3038342256952 MainThread DEBUG nova.compute.utils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] WMI job failed with status 10. Error summary description: 'instance-00000058' failed to start. Not enough memory in the system to start the virtual machine instance-00000058. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:03:50.755 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Build of instance ce937990-b827-4d67-85b2-7c454a6b252b was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000058' failed to start. Not enough memory in the system to start the virtual machine instance-00000058. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000058' failed to start. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Not enough memory in the system to start the virtual machine instance-00000058 with ram size 1024 megabytes. (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) 'instance-00000058' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID ED205DBF-AD3F-4D6F-A4E2-159C873B7580) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:03:50.755 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:03:50.755 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Acquired lock "refresh_cache-ce937990-b827-4d67-85b2-7c454a6b252b" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:03:50.755 4088 3038342256952 MainThread DEBUG nova.network.neutron [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:03:50.755 4088 3038342255016 MainThread DEBUG oslo_concurrency.processutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000005b\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpbpdcfn40" returned: 0 in 0.343s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:03:50.850 4088 3038342256952 MainThread DEBUG nova.network.neutron [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:03:51.090 4088 3038342256952 MainThread DEBUG nova.network.neutron [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:03:51.114 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Releasing lock "refresh_cache-ce937990-b827-4d67-85b2-7c454a6b252b" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:03:51.114 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:03:51.117 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] [instance: ce937990-b827-4d67-85b2-7c454a6b252b] Skipping network deallocation for instance since networking was not requested. _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2054 2021-09-10 17:03:51.256 4088 3038342255016 MainThread DEBUG nova.virt.hyperv.vmops [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Setting boot order for instance: instance-0000005b: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:03:51.303 4088 3038342256952 MainThread INFO nova.scheduler.client.report [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Deleted allocations for instance ce937990-b827-4d67-85b2-7c454a6b252b 2021-09-10 17:03:51.352 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-7a8dcf3b-4b50-49c5-9d06-d323d71793f6 905e3c6ad96d46c19a0c053a75b0be3f c076dc2ea49744da8488050f198edf70 - default default] Lock "ce937990-b827-4d67-85b2-7c454a6b252b" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.265s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:51.376 4088 3038342255016 MainThread DEBUG nova.virt.hyperv.vmops [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:03:51.404 4088 3038342255016 MainThread DEBUG os_win.utils.jobutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Waiting for WMI job: {'InstanceID': 'EFE20B5C-0211-4730-850A-A18485CB7377', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15775), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:51.556 4088 3038342255016 MainThread ERROR os_win.utils.jobutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005b\' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)instance-0000005bB75AB60D-DB2C-4810-BCA8-69CFFE4E443212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)instance-0000005bB75AB60D-DB2C-4810-BCA8-69CFFE4E443210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)instance-0000005bB75AB60D-DB2C-4810-BCA8-69CFFE4E4432%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'EFE20B5C-0211-4730-850A-A18485CB7377', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120461), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 51), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 51), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005b' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)\n\nNot enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)\n\n'instance-0000005b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)", 'ErrorSummaryDescription': "'instance-0000005b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:51.556 4088 3038342255016 MainThread DEBUG os_win._utils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005b' failed to start. Not enough memory in the system to start the virtual machine instance-0000005b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005b' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Not enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) 'instance-0000005b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18018746376037598 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:51.583 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:51.583 4088 3038337403544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:51.583 4088 3038337402840 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:51.583 4088 3038337402840 MainThread INFO nova.compute.manager [-] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] VM Stopped (Lifecycle Event) 2021-09-10 17:03:51.610 4088 3038337402840 MainThread DEBUG nova.compute.manager [req-47808956-47df-42ae-a2e4-cced82192735 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:51.610 4088 3038337402840 MainThread DEBUG nova.virt.hyperv.vmops [req-47808956-47df-42ae-a2e4-cced82192735 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:51.662 4088 3038337402840 MainThread DEBUG nova.compute.manager [req-47808956-47df-42ae-a2e4-cced82192735 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:51.696 4088 3038337402840 MainThread INFO nova.compute.manager [req-47808956-47df-42ae-a2e4-cced82192735 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:52.536 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:03:52.552 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:52.552 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:52.552 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:03:52.552 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:03:52.568 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:03:52.584 4088 3038342255016 MainThread DEBUG os_win.utils.jobutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Waiting for WMI job: {'InstanceID': '02239FE1-870F-4870-89A3-7DBD5953E547', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16555), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:52.724 4088 3038342255016 MainThread ERROR os_win.utils.jobutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005b\' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)instance-0000005bB75AB60D-DB2C-4810-BCA8-69CFFE4E443212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)instance-0000005bB75AB60D-DB2C-4810-BCA8-69CFFE4E443210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)instance-0000005bB75AB60D-DB2C-4810-BCA8-69CFFE4E4432%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '02239FE1-870F-4870-89A3-7DBD5953E547', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119981), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 52), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 52), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005b' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)\n\nNot enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)\n\n'instance-0000005b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)", 'ErrorSummaryDescription': "'instance-0000005b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:52.745 4088 3038342255016 MainThread DEBUG os_win._utils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005b' failed to start. Not enough memory in the system to start the virtual machine instance-0000005b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005b' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Not enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) 'instance-0000005b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3696260452270508 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:52.771 4088 3038340570104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:52.771 4088 3038340570104 MainThread INFO nova.compute.manager [-] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] VM Stopped (Lifecycle Event) 2021-09-10 17:03:52.771 4088 3038337404072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:52.771 4088 3038337404072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:52.794 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-6a7fa7a1-cb1b-4089-bb65-cca0693a3567 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:52.810 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-6a7fa7a1-cb1b-4089-bb65-cca0693a3567 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:52.810 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2126MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:03:52.810 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:52.866 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-6a7fa7a1-cb1b-4089-bb65-cca0693a3567 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:52.986 4088 3038340570104 MainThread INFO nova.compute.manager [req-6a7fa7a1-cb1b-4089-bb65-cca0693a3567 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:53.048 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:03:53.048 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:03:53.048 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:03:53.048 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:03:53.048 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:03:53.048 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:03:53.048 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:03:53.048 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:03:53.048 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:03:53.048 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:03:53.048 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:03:53.048 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:03:53.048 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:03:53.048 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:03:53.048 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:03:53.048 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=14GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:03:53.098 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:03:53.111 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:03:53.318 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:03:53.333 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:03:53.350 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:03:53.350 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.547s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:53.767 4088 3038342255016 MainThread DEBUG os_win.utils.jobutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Waiting for WMI job: {'InstanceID': '72884D97-CEA0-488F-BA1B-90DD371A313D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17050), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:53.911 4088 3038342255016 MainThread ERROR os_win.utils.jobutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005b\' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)instance-0000005bB75AB60D-DB2C-4810-BCA8-69CFFE4E443212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)instance-0000005bB75AB60D-DB2C-4810-BCA8-69CFFE4E443210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)instance-0000005bB75AB60D-DB2C-4810-BCA8-69CFFE4E4432%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '72884D97-CEA0-488F-BA1B-90DD371A313D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116541), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 53), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 53), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005b' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)\n\nNot enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)\n\n'instance-0000005b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)", 'ErrorSummaryDescription': "'instance-0000005b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:53.911 4088 3038342255016 MainThread DEBUG os_win._utils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005b' failed to start. Not enough memory in the system to start the virtual machine instance-0000005b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005b' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Not enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) 'instance-0000005b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5356545448303223 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:53.928 4088 3038337404072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:53.958 4088 3038337404072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.032s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:53.958 4088 3038340570104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:53.958 4088 3038340570104 MainThread INFO nova.compute.manager [-] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] VM Stopped (Lifecycle Event) 2021-09-10 17:03:53.975 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-9cd1338e-56a4-4cce-bc15-9dc6d316e274 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:53.975 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-9cd1338e-56a4-4cce-bc15-9dc6d316e274 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:54.006 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-9cd1338e-56a4-4cce-bc15-9dc6d316e274 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:54.063 4088 3038340570104 MainThread INFO nova.compute.manager [req-9cd1338e-56a4-4cce-bc15-9dc6d316e274 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:54.959 4088 3038342255016 MainThread DEBUG os_win.utils.jobutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Waiting for WMI job: {'InstanceID': '91B406F6-A469-4453-8E99-5A180B51C574', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16284), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:55.098 4088 3038342255016 MainThread ERROR os_win.utils.jobutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005b\' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)instance-0000005bB75AB60D-DB2C-4810-BCA8-69CFFE4E443212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)instance-0000005bB75AB60D-DB2C-4810-BCA8-69CFFE4E443210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)instance-0000005bB75AB60D-DB2C-4810-BCA8-69CFFE4E4432%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '91B406F6-A469-4453-8E99-5A180B51C574', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121509), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 54), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 55), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005b' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)\n\nNot enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)\n\n'instance-0000005b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)", 'ErrorSummaryDescription': "'instance-0000005b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:55.098 4088 3038342255016 MainThread DEBUG os_win._utils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005b' failed to start. Not enough memory in the system to start the virtual machine instance-0000005b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005b' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Not enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) 'instance-0000005b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7225725650787354 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:55.148 4088 3038337404072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:55.148 4088 3038337404072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:55.148 4088 3038340570104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:55.148 4088 3038340570104 MainThread INFO nova.compute.manager [-] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] VM Stopped (Lifecycle Event) 2021-09-10 17:03:55.176 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-96a95bff-948e-40a5-a72d-8dec998de3b3 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:55.176 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-96a95bff-948e-40a5-a72d-8dec998de3b3 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:55.224 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-96a95bff-948e-40a5-a72d-8dec998de3b3 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:55.251 4088 3038340570104 MainThread INFO nova.compute.manager [req-96a95bff-948e-40a5-a72d-8dec998de3b3 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:56.133 4088 3038342255016 MainThread DEBUG os_win.utils.jobutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Waiting for WMI job: {'InstanceID': '4131A43B-5540-4867-B42A-213DD1D6D5B4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19164), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:56.271 4088 3038342255016 MainThread ERROR os_win.utils.jobutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005b\' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)instance-0000005bB75AB60D-DB2C-4810-BCA8-69CFFE4E443212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)instance-0000005bB75AB60D-DB2C-4810-BCA8-69CFFE4E443210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)instance-0000005bB75AB60D-DB2C-4810-BCA8-69CFFE4E4432%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4131A43B-5540-4867-B42A-213DD1D6D5B4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116430), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 56), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 56), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005b' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)\n\nNot enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)\n\n'instance-0000005b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)", 'ErrorSummaryDescription': "'instance-0000005b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:56.271 4088 3038342255016 MainThread DEBUG os_win._utils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005b' failed to start. Not enough memory in the system to start the virtual machine instance-0000005b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005b' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Not enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) 'instance-0000005b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.895589828491211 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:03:56.303 4088 3038337404072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:56.303 4088 3038337404072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:56.303 4088 3038340570104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:56.303 4088 3038340570104 MainThread INFO nova.compute.manager [-] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] VM Stopped (Lifecycle Event) 2021-09-10 17:03:56.333 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-bc078371-55e9-49b7-9a3f-91c1f9a62017 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:56.333 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-bc078371-55e9-49b7-9a3f-91c1f9a62017 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:56.381 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-bc078371-55e9-49b7-9a3f-91c1f9a62017 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:56.423 4088 3038340570104 MainThread INFO nova.compute.manager [req-bc078371-55e9-49b7-9a3f-91c1f9a62017 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:57.286 4088 3038342255016 MainThread DEBUG os_win.utils.jobutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Waiting for WMI job: {'InstanceID': '9BADA374-CB3F-4B1A-8B04-0549642ADCD7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15500), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:57.445 4088 3038342255016 MainThread ERROR os_win.utils.jobutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005b\' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)instance-0000005bB75AB60D-DB2C-4810-BCA8-69CFFE4E443212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)instance-0000005bB75AB60D-DB2C-4810-BCA8-69CFFE4E443210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)instance-0000005bB75AB60D-DB2C-4810-BCA8-69CFFE4E4432%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9BADA374-CB3F-4B1A-8B04-0549642ADCD7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115503), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 3, 57), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 3, 57), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005b' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)\n\nNot enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)\n\n'instance-0000005b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432)", 'ErrorSummaryDescription': "'instance-0000005b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:03:57.445 4088 3038342255016 MainThread ERROR nova.virt.hyperv.vmops [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Failed to change vm state of instance-0000005b to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000005b' failed to start. 2021-09-10 17:03:57.445 4088 3038342255016 MainThread INFO nova.virt.hyperv.vmops [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Got request to destroy instance 2021-09-10 17:03:57.492 4088 3038340570104 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:03:57.492 4088 3038340570104 MainThread INFO nova.compute.manager [-] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] VM Stopped (Lifecycle Event) 2021-09-10 17:03:57.492 4088 3038337404072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:57.492 4088 3038337404072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:57.528 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-562ed819-588e-4199-9638-3a9008c3bdd6 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:03:57.528 4088 3038340570104 MainThread DEBUG nova.virt.hyperv.vmops [req-562ed819-588e-4199-9638-3a9008c3bdd6 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:03:57.585 4088 3038340570104 MainThread DEBUG nova.compute.manager [req-562ed819-588e-4199-9638-3a9008c3bdd6 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:03:57.615 4088 3038340570104 MainThread INFO nova.compute.manager [req-562ed819-588e-4199-9638-3a9008c3bdd6 - - - - -] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:03:59.551 4088 3038342255016 MainThread DEBUG nova.virt.hyperv.vmops [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:03:59.551 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Lock "instance-0000005b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:59.551 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Lock "instance-0000005b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:59.562 4088 3038342255016 MainThread DEBUG os_win.utils.compute.vmutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Successfully changed vm state of instance-0000005b to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:03:59.562 4088 3038342255016 MainThread DEBUG nova.virt.hyperv.vmops [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Successfully changed state of VM instance-0000005b to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:03:59.614 4088 3038342255016 MainThread DEBUG os_win.utils.jobutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Waiting for WMI job: {'InstanceID': '1CCE2108-F788-488B-97A1-76A8B464B42E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15490), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:03:59.725 4088 3038342255016 MainThread DEBUG os_win.utils.jobutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] WMI job succeeded: {'InstanceID': '1CCE2108-F788-488B-97A1-76A8B464B42E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=113085), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:03:59.725 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Lock "instance-0000005b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:59.725 4088 3038342255016 MainThread DEBUG os_win.utils.pathutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Removing directory: C:\openstack\instances\instance-0000005b check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:03:59.725 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Lock "instance-0000005b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:59.725 4088 3038342255016 MainThread ERROR nova.compute.manager [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000005b' failed to start. Not enough memory in the system to start the virtual machine instance-0000005b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005b' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Not enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) 'instance-0000005b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Error code: 32778. 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Traceback (most recent call last): 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] return function(*args, **kwargs) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] admin_password, network_info, block_device_info) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] return function(self, *args, **kwds) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self.force_reraise() 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] raise self.value 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] should_plug_vifs=False) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 'req_state': req_state}) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self.force_reraise() 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] raise self.value 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] time.sleep(sleep_time) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self.force_reraise() 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] raise self.value 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] return f(*args, **kwargs) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] return self._wait_for_job(job_path) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] error_desc=err_desc) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000005b' failed to start. 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Not enough memory in the system to start the virtual machine instance-0000005b. 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005b' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Not enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 'instance-0000005b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Error code: 32778. 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] During handling of the above exception, another exception occurred: 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Traceback (most recent call last): 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] yield resources 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] accel_info=accel_info) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] return function(*args, **kwargs) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] admin_password, network_info, block_device_info) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] return function(self, *args, **kwds) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self.force_reraise() 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] raise self.value 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] should_plug_vifs=False) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 'req_state': req_state}) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self.force_reraise() 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] raise self.value 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] time.sleep(sleep_time) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self.force_reraise() 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] raise self.value 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] return f(*args, **kwargs) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] return self._wait_for_job(job_path) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] error_desc=err_desc) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000005b' failed to start. 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Not enough memory in the system to start the virtual machine instance-0000005b. 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005b' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Not enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 'instance-0000005b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Error code: 32778. 2021-09-10 17:03:59.725 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:03:59.751 4088 3038342255016 MainThread INFO nova.compute.manager [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Terminating instance 2021-09-10 17:03:59.751 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:03:59.751 4088 3038342255016 MainThread INFO nova.virt.hyperv.vmops [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Got request to destroy instance 2021-09-10 17:03:59.770 4088 3038342255016 MainThread DEBUG nova.virt.hyperv.vmops [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:03:59.770 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Lock "instance-0000005b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:59.770 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Lock "instance-0000005b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:03:59.770 4088 3038342255016 MainThread INFO nova.compute.manager [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:03:59.770 4088 3038342255016 MainThread DEBUG nova.compute.claims [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:03:59.770 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:03:59.920 4088 3038342255016 MainThread DEBUG nova.virt.hyperv.hostops [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:03:59.920 4088 3038342255016 MainThread DEBUG nova.virt.hyperv.hostops [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:04:00.143 4088 3038342255016 MainThread DEBUG nova.compute.provider_tree [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:04:00.166 4088 3038342255016 MainThread DEBUG nova.scheduler.client.report [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:04:00.166 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.391s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:00.166 4088 3038342255016 MainThread ERROR nova.compute.manager [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000005b' failed to start. Not enough memory in the system to start the virtual machine instance-0000005b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005b' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Not enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) 'instance-0000005b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Error code: 32778. 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Traceback (most recent call last): 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] return function(*args, **kwargs) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] admin_password, network_info, block_device_info) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] return function(self, *args, **kwds) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self.force_reraise() 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] raise self.value 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] should_plug_vifs=False) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 'req_state': req_state}) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self.force_reraise() 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] raise self.value 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] time.sleep(sleep_time) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self.force_reraise() 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] raise self.value 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] return f(*args, **kwargs) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] return self._wait_for_job(job_path) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] error_desc=err_desc) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000005b' failed to start. 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Not enough memory in the system to start the virtual machine instance-0000005b. 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005b' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Not enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 'instance-0000005b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Error code: 32778. 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] During handling of the above exception, another exception occurred: 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Traceback (most recent call last): 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] accel_info=accel_info) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] return function(*args, **kwargs) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] admin_password, network_info, block_device_info) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] return function(self, *args, **kwds) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self.force_reraise() 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] raise self.value 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] should_plug_vifs=False) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 'req_state': req_state}) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self.force_reraise() 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] raise self.value 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] time.sleep(sleep_time) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self.force_reraise() 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] raise self.value 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] return f(*args, **kwargs) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] return self._wait_for_job(job_path) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] error_desc=err_desc) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000005b' failed to start. 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Not enough memory in the system to start the virtual machine instance-0000005b. 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005b' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Not enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 'instance-0000005b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Error code: 32778. 2021-09-10 17:04:00.166 4088 3038342255016 MainThread TRACE nova.compute.manager [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] 2021-09-10 17:04:00.166 4088 3038342255016 MainThread DEBUG nova.compute.utils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] WMI job failed with status 10. Error summary description: 'instance-0000005b' failed to start. Not enough memory in the system to start the virtual machine instance-0000005b. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:04:00.166 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Build of instance 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000005b' failed to start. Not enough memory in the system to start the virtual machine instance-0000005b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005b' failed to start. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Not enough memory in the system to start the virtual machine instance-0000005b with ram size 1024 megabytes. (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) 'instance-0000005b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID B75AB60D-DB2C-4810-BCA8-69CFFE4E4432) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:04:00.166 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:04:00.166 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:04:00.166 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:04:00.166 4088 3038342255016 MainThread DEBUG nova.network.neutron [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:04:02.346 4088 3038342255016 MainThread DEBUG nova.network.neutron [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:04:02.364 4088 3038342255016 MainThread INFO nova.compute.manager [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] [instance: 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11] Took 2.20 seconds to deallocate network for instance. 2021-09-10 17:04:02.754 4088 3038342255016 MainThread INFO nova.scheduler.client.report [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Deleted allocations for instance 5b9c2a38-845e-44ce-ba83-cfe2a9acbb11 2021-09-10 17:04:02.801 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-622b339b-8955-4c6c-b50a-facf7d4bb938 f602a288fe3b4ea0bf8af5b656e8681a 7055b5c60f1f45d6b0dd2b8a9a6f7f0a - default default] Lock "5b9c2a38-845e-44ce-ba83-cfe2a9acbb11" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 30.859s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:06.833 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "442531a0-4fb7-4282-a436-20dfe4a05c72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:06.896 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:04:07.036 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:07.063 4088 3038342147768 MainThread DEBUG nova.virt.hardware [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:04:07.063 4088 3038342147768 MainThread INFO nova.compute.claims [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Claim successful on node n-h2-808474-1 2021-09-10 17:04:07.223 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.hostops [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:04:07.238 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.hostops [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:04:07.467 4088 3038342147768 MainThread DEBUG nova.compute.provider_tree [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:04:07.488 4088 3038342147768 MainThread DEBUG nova.scheduler.client.report [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:04:07.488 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:07.488 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:04:07.615 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:04:07.615 4088 3038337403192 GreenThread-81 DEBUG nova.compute.manager [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:04:07.615 4088 3038337403192 GreenThread-81 DEBUG nova.network.neutron [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:04:07.773 4088 3038337403192 GreenThread-81 DEBUG nova.policy [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f286737f0e6452bbe04f42184b6d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df662acac0f043bb8be9c87490878d93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:04:07.855 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:04:07.871 4088 3038342147768 MainThread INFO nova.virt.hyperv.vmops [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Spawning new instance 2021-09-10 17:04:07.871 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-0000005c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:07.871 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-0000005c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:07.871 4088 3038342147768 MainThread DEBUG nova.block_device [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:04:07.890 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:07.890 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:07.908 4088 3038342147768 MainThread DEBUG os_win.utils.pathutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Creating directory: C:\openstack\instances\instance-0000005c check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:04:07.908 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.vmops [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000005c\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:04:08.196 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.vmops [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Resizing VHD C:\openstack\instances\instance-0000005c\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:04:08.865 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "d856fdf2-ccbb-4aa6-8dbf-c62e4989911d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:08.895 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:04:09.077 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:09.077 4088 3038340492280 MainThread DEBUG nova.virt.hardware [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:04:09.077 4088 3038340492280 MainThread INFO nova.compute.claims [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Claim successful on node n-h2-808474-1 2021-09-10 17:04:09.303 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.hostops [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:04:09.303 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.hostops [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:04:09.523 4088 3038340492280 MainThread DEBUG nova.compute.provider_tree [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:04:09.535 4088 3038340492280 MainThread DEBUG nova.scheduler.client.report [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:04:09.551 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:09.551 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:04:09.690 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:04:09.690 4088 3038340491224 GreenThread-82 DEBUG nova.compute.manager [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:04:09.690 4088 3038340491224 GreenThread-82 DEBUG nova.network.neutron [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:04:09.853 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:04:09.853 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Spawning new instance 2021-09-10 17:04:09.853 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "instance-0000005d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:09.853 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "instance-0000005d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:09.853 4088 3038340492280 MainThread DEBUG nova.block_device [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:04:09.877 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:09.877 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:09.877 4088 3038340492280 MainThread DEBUG os_win.utils.pathutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Creating directory: C:\openstack\instances\instance-0000005d check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:04:09.877 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000005d\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:04:09.995 4088 3038340491224 GreenThread-82 DEBUG nova.policy [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '206940e6bc1a478bb7f92f7778bec0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5283391577e14a77bbd03e5dcf9f9e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:04:10.191 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Resizing VHD C:\openstack\instances\instance-0000005d\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:04:10.208 4088 3038337403192 GreenThread-81 DEBUG nova.network.neutron [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Successfully created port: cf153e8e-640d-4e66-915e-3fbbafd154b1 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:04:11.489 4088 3038340491224 GreenThread-82 DEBUG nova.network.neutron [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Successfully created port: 55b0db75-b299-42b2-bb1d-27d22fa05d5a _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:04:12.426 4088 3038340491224 GreenThread-82 DEBUG nova.network.neutron [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Successfully updated port: 55b0db75-b299-42b2-bb1d-27d22fa05d5a _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:04:12.443 4088 3038340491224 GreenThread-82 DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Acquired lock "refresh_cache-d856fdf2-ccbb-4aa6-8dbf-c62e4989911d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:04:12.443 4088 3038340491224 GreenThread-82 DEBUG nova.network.neutron [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:04:12.567 4088 3038337403192 GreenThread-81 DEBUG nova.network.neutron [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Successfully updated port: cf153e8e-640d-4e66-915e-3fbbafd154b1 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:04:12.612 4088 3038337403192 GreenThread-81 DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Acquired lock "refresh_cache-442531a0-4fb7-4282-a436-20dfe4a05c72" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:04:12.612 4088 3038337403192 GreenThread-81 DEBUG nova.network.neutron [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:04:13.096 4088 3038340491224 GreenThread-82 DEBUG nova.network.neutron [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:04:13.426 4088 3038337403192 GreenThread-81 DEBUG nova.network.neutron [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:04:13.551 4088 3038342255192 MainThread DEBUG nova.compute.manager [req-5fe8ad3b-0ef6-4a68-b8c0-976d1d52c899 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Received event network-changed-55b0db75-b299-42b2-bb1d-27d22fa05d5a external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:04:13.551 4088 3038342255192 MainThread DEBUG nova.compute.manager [req-5fe8ad3b-0ef6-4a68-b8c0-976d1d52c899 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Refreshing instance network info cache due to event network-changed-55b0db75-b299-42b2-bb1d-27d22fa05d5a. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:04:13.733 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-35e2bc3c-533a-4f97-b5be-a483badc8f68 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Received event network-changed-cf153e8e-640d-4e66-915e-3fbbafd154b1 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:04:13.733 4088 3038342255016 MainThread DEBUG nova.compute.manager [req-35e2bc3c-533a-4f97-b5be-a483badc8f68 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Refreshing instance network info cache due to event network-changed-cf153e8e-640d-4e66-915e-3fbbafd154b1. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:04:13.791 4088 3038340491224 GreenThread-82 DEBUG nova.network.neutron [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Updating instance_info_cache with network_info: [{"id": "55b0db75-b299-42b2-bb1d-27d22fa05d5a", "address": "fa:16:3e:c2:60:f7", "network": {"id": "e365bc30-8c38-4b70-a29c-e076c845f9de", "bridge": null, "label": "tempest-AttachVolumeTestJSON-1488926721-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5283391577e14a77bbd03e5dcf9f9e5c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap55b0db75-b2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:04:13.832 4088 3038340491224 GreenThread-82 DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Releasing lock "refresh_cache-d856fdf2-ccbb-4aa6-8dbf-c62e4989911d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:04:13.832 4088 3038340491224 GreenThread-82 DEBUG nova.compute.manager [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Instance network_info: |[{"id": "55b0db75-b299-42b2-bb1d-27d22fa05d5a", "address": "fa:16:3e:c2:60:f7", "network": {"id": "e365bc30-8c38-4b70-a29c-e076c845f9de", "bridge": null, "label": "tempest-AttachVolumeTestJSON-1488926721-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5283391577e14a77bbd03e5dcf9f9e5c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap55b0db75-b2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:04:13.832 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [req-5fe8ad3b-0ef6-4a68-b8c0-976d1d52c899 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-d856fdf2-ccbb-4aa6-8dbf-c62e4989911d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:04:13.832 4088 3038342255192 MainThread DEBUG nova.network.neutron [req-5fe8ad3b-0ef6-4a68-b8c0-976d1d52c899 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Refreshing network info cache for port 55b0db75-b299-42b2-bb1d-27d22fa05d5a _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:04:13.832 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Preparing to wait for external event network-vif-plugged-55b0db75-b299-42b2-bb1d-27d22fa05d5a prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:04:13.832 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "d856fdf2-ccbb-4aa6-8dbf-c62e4989911d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:13.832 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "d856fdf2-ccbb-4aa6-8dbf-c62e4989911d-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:13.832 4088 3038340492280 MainThread DEBUG os_win.utils.compute.vmutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Creating VM instance-0000005d create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:04:14.534 4088 3038337403192 GreenThread-81 DEBUG nova.network.neutron [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Updating instance_info_cache with network_info: [{"id": "cf153e8e-640d-4e66-915e-3fbbafd154b1", "address": "fa:16:3e:a4:b8:ce", "network": {"id": "5b608de7-ebcb-494c-bcfe-060ce4426ed6", "bridge": null, "label": "tempest-ServersTestJSON-497725561-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "df662acac0f043bb8be9c87490878d93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcf153e8e-64", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:04:14.551 4088 3038337403192 GreenThread-81 DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Releasing lock "refresh_cache-442531a0-4fb7-4282-a436-20dfe4a05c72" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:04:14.551 4088 3038337403192 GreenThread-81 DEBUG nova.compute.manager [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Instance network_info: |[{"id": "cf153e8e-640d-4e66-915e-3fbbafd154b1", "address": "fa:16:3e:a4:b8:ce", "network": {"id": "5b608de7-ebcb-494c-bcfe-060ce4426ed6", "bridge": null, "label": "tempest-ServersTestJSON-497725561-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "df662acac0f043bb8be9c87490878d93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcf153e8e-64", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:04:14.551 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-35e2bc3c-533a-4f97-b5be-a483badc8f68 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-442531a0-4fb7-4282-a436-20dfe4a05c72" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:04:14.551 4088 3038342255016 MainThread DEBUG nova.network.neutron [req-35e2bc3c-533a-4f97-b5be-a483badc8f68 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Refreshing network info cache for port cf153e8e-640d-4e66-915e-3fbbafd154b1 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:04:14.551 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Preparing to wait for external event network-vif-plugged-cf153e8e-640d-4e66-915e-3fbbafd154b1 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:04:14.571 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "442531a0-4fb7-4282-a436-20dfe4a05c72-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:14.571 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "442531a0-4fb7-4282-a436-20dfe4a05c72-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:14.571 4088 3038342147768 MainThread DEBUG os_win.utils.compute.vmutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Creating VM instance-0000005c create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:04:15.080 4088 3038342255192 MainThread DEBUG nova.network.neutron [req-5fe8ad3b-0ef6-4a68-b8c0-976d1d52c899 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Updated VIF entry in instance network info cache for port 55b0db75-b299-42b2-bb1d-27d22fa05d5a. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:04:15.080 4088 3038342255192 MainThread DEBUG nova.network.neutron [req-5fe8ad3b-0ef6-4a68-b8c0-976d1d52c899 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Updating instance_info_cache with network_info: [{"id": "55b0db75-b299-42b2-bb1d-27d22fa05d5a", "address": "fa:16:3e:c2:60:f7", "network": {"id": "e365bc30-8c38-4b70-a29c-e076c845f9de", "bridge": null, "label": "tempest-AttachVolumeTestJSON-1488926721-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5283391577e14a77bbd03e5dcf9f9e5c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap55b0db75-b2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:04:15.094 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [req-5fe8ad3b-0ef6-4a68-b8c0-976d1d52c899 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-d856fdf2-ccbb-4aa6-8dbf-c62e4989911d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:04:15.771 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:04:16.131 4088 3038342255016 MainThread DEBUG nova.network.neutron [req-35e2bc3c-533a-4f97-b5be-a483badc8f68 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Updated VIF entry in instance network info cache for port cf153e8e-640d-4e66-915e-3fbbafd154b1. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:04:16.131 4088 3038342255016 MainThread DEBUG nova.network.neutron [req-35e2bc3c-533a-4f97-b5be-a483badc8f68 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Updating instance_info_cache with network_info: [{"id": "cf153e8e-640d-4e66-915e-3fbbafd154b1", "address": "fa:16:3e:a4:b8:ce", "network": {"id": "5b608de7-ebcb-494c-bcfe-060ce4426ed6", "bridge": null, "label": "tempest-ServersTestJSON-497725561-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "df662acac0f043bb8be9c87490878d93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcf153e8e-64", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:04:16.153 4088 3038342255016 MainThread DEBUG oslo_concurrency.lockutils [req-35e2bc3c-533a-4f97-b5be-a483badc8f68 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-442531a0-4fb7-4282-a436-20dfe4a05c72" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:04:16.708 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.vmops [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:04:18.162 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "45310242-58a0-47b9-9655-a45945084513" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:18.194 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:04:18.410 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:18.410 4088 3038342256952 MainThread DEBUG nova.virt.hardware [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:04:18.410 4088 3038342256952 MainThread INFO nova.compute.claims [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Claim successful on node n-h2-808474-1 2021-09-10 17:04:18.614 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.hostops [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:04:18.631 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.hostops [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:04:18.888 4088 3038342256952 MainThread DEBUG nova.compute.provider_tree [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:04:18.907 4088 3038342256952 MainThread DEBUG nova.scheduler.client.report [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:04:18.907 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:18.907 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:04:19.066 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:04:19.066 4088 3038342254840 GreenThread-83 DEBUG nova.compute.manager [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:04:19.066 4088 3038342254840 GreenThread-83 DEBUG nova.network.neutron [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:04:19.350 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:04:19.350 4088 3038342256952 MainThread INFO nova.virt.hyperv.vmops [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Spawning new instance 2021-09-10 17:04:19.350 4088 3038342254840 GreenThread-83 DEBUG nova.policy [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3b19a6ed8024fe7b99f5aa4978b5af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecab78b34b0468f8c42e4b7f3444918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:04:19.382 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000005f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:19.382 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000005f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:19.382 4088 3038342256952 MainThread DEBUG nova.block_device [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:04:19.382 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:19.382 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:19.382 4088 3038342256952 MainThread DEBUG os_win.utils.pathutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Creating directory: C:\openstack\instances\instance-0000005f check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:04:19.382 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.vmops [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000005f\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:04:19.662 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.vmops [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Resizing VHD C:\openstack\instances\instance-0000005f\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:04:21.477 4088 3038342254840 GreenThread-83 DEBUG nova.network.neutron [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Successfully created port: 24d4280e-49cf-4219-b2c0-7ef24c1290f1 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:04:22.583 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-b2820ce7-064d-4113-9546-af48a1ce670d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Received event network-vif-plugged-55b0db75-b299-42b2-bb1d-27d22fa05d5a external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:04:22.583 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [req-b2820ce7-064d-4113-9546-af48a1ce670d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d856fdf2-ccbb-4aa6-8dbf-c62e4989911d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:22.583 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [req-b2820ce7-064d-4113-9546-af48a1ce670d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d856fdf2-ccbb-4aa6-8dbf-c62e4989911d-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:22.583 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-b2820ce7-064d-4113-9546-af48a1ce670d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Processing event network-vif-plugged-55b0db75-b299-42b2-bb1d-27d22fa05d5a _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:04:22.621 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Using config drive for instance 2021-09-10 17:04:22.757 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Creating config drive at C:\openstack\instances\instance-0000005d\configdrive.iso 2021-09-10 17:04:22.878 4088 3038340492280 MainThread DEBUG oslo_concurrency.processutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000005d\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpnq89fzuq execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:04:23.207 4088 3038340492280 MainThread DEBUG oslo_concurrency.processutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000005d\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpnq89fzuq" returned: 0 in 0.329s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:04:23.238 4088 3038342254840 GreenThread-83 DEBUG nova.network.neutron [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Successfully updated port: 24d4280e-49cf-4219-b2c0-7ef24c1290f1 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:04:23.270 4088 3038342254840 GreenThread-83 DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Acquired lock "refresh_cache-45310242-58a0-47b9-9655-a45945084513" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:04:23.270 4088 3038342254840 GreenThread-83 DEBUG nova.network.neutron [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:04:23.754 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Setting boot order for instance: instance-0000005d: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:04:23.834 4088 3038342254840 GreenThread-83 DEBUG nova.network.neutron [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:04:23.834 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:04:23.881 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Waiting for WMI job: {'InstanceID': 'EA259AA9-98B8-42EF-92C8-C16AEC5B0E3F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15462), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:24.006 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005d\' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)instance-0000005d539459E1-AB00-4513-802D-1AD68813B2BA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)instance-0000005d539459E1-AB00-4513-802D-1AD68813B2BA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)instance-0000005d539459E1-AB00-4513-802D-1AD68813B2BA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'EA259AA9-98B8-42EF-92C8-C16AEC5B0E3F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116292), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 23), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 23), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005d' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)\n\nNot enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)\n\n'instance-0000005d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)", 'ErrorSummaryDescription': "'instance-0000005d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:24.006 4088 3038340492280 MainThread DEBUG os_win._utils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005d' failed to start. Not enough memory in the system to start the virtual machine instance-0000005d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005d' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Not enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) 'instance-0000005d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.172438383102417 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:24.067 4088 3038342255720 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:24.067 4088 3038342255720 MainThread INFO nova.compute.manager [-] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] VM Stopped (Lifecycle Event) 2021-09-10 17:04:24.067 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:24.067 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:24.088 4088 3038342255720 MainThread DEBUG nova.compute.manager [req-b7f9092f-42be-4bda-a681-9a32a1758c35 - - - - -] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:24.098 4088 3038342255720 MainThread DEBUG nova.virt.hyperv.vmops [req-b7f9092f-42be-4bda-a681-9a32a1758c35 - - - - -] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:24.130 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-f7a8317c-abf0-4a31-ba28-b208bf47beaf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Received event network-changed-24d4280e-49cf-4219-b2c0-7ef24c1290f1 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:04:24.130 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-f7a8317c-abf0-4a31-ba28-b208bf47beaf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Refreshing instance network info cache due to event network-changed-24d4280e-49cf-4219-b2c0-7ef24c1290f1. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:04:24.147 4088 3038342255720 MainThread DEBUG nova.compute.manager [req-b7f9092f-42be-4bda-a681-9a32a1758c35 - - - - -] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:24.162 4088 3038342255720 MainThread INFO nova.compute.manager [req-b7f9092f-42be-4bda-a681-9a32a1758c35 - - - - -] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:24.488 4088 3038342254840 GreenThread-83 DEBUG nova.network.neutron [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Updating instance_info_cache with network_info: [{"id": "24d4280e-49cf-4219-b2c0-7ef24c1290f1", "address": "fa:16:3e:04:5a:5f", "network": {"id": "8a0fc2b4-bff6-4887-a969-81fb448d568f", "bridge": null, "label": "tempest-DeleteServersTestJSON-1414296899-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "eecab78b34b0468f8c42e4b7f3444918", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap24d4280e-49", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:04:24.506 4088 3038342254840 GreenThread-83 DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Releasing lock "refresh_cache-45310242-58a0-47b9-9655-a45945084513" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:04:24.506 4088 3038342254840 GreenThread-83 DEBUG nova.compute.manager [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Instance network_info: |[{"id": "24d4280e-49cf-4219-b2c0-7ef24c1290f1", "address": "fa:16:3e:04:5a:5f", "network": {"id": "8a0fc2b4-bff6-4887-a969-81fb448d568f", "bridge": null, "label": "tempest-DeleteServersTestJSON-1414296899-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "eecab78b34b0468f8c42e4b7f3444918", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap24d4280e-49", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:04:24.506 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Preparing to wait for external event network-vif-plugged-24d4280e-49cf-4219-b2c0-7ef24c1290f1 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:04:24.506 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "45310242-58a0-47b9-9655-a45945084513-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:24.506 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "45310242-58a0-47b9-9655-a45945084513-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:24.506 4088 3038342256952 MainThread DEBUG os_win.utils.compute.vmutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Creating VM instance-0000005f create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:04:24.506 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [req-f7a8317c-abf0-4a31-ba28-b208bf47beaf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-45310242-58a0-47b9-9655-a45945084513" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:04:24.506 4088 3038342256072 MainThread DEBUG nova.network.neutron [req-f7a8317c-abf0-4a31-ba28-b208bf47beaf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Refreshing network info cache for port 24d4280e-49cf-4219-b2c0-7ef24c1290f1 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:04:24.709 4088 3038342256600 MainThread DEBUG nova.compute.manager [req-3415761b-8262-49c5-9266-83cd65ae78ab 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Received event network-vif-plugged-cf153e8e-640d-4e66-915e-3fbbafd154b1 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:04:24.709 4088 3038342256600 MainThread DEBUG oslo_concurrency.lockutils [req-3415761b-8262-49c5-9266-83cd65ae78ab 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "442531a0-4fb7-4282-a436-20dfe4a05c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:24.709 4088 3038342256600 MainThread DEBUG oslo_concurrency.lockutils [req-3415761b-8262-49c5-9266-83cd65ae78ab 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "442531a0-4fb7-4282-a436-20dfe4a05c72-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:24.709 4088 3038342256600 MainThread DEBUG nova.compute.manager [req-3415761b-8262-49c5-9266-83cd65ae78ab 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Processing event network-vif-plugged-cf153e8e-640d-4e66-915e-3fbbafd154b1 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:04:24.748 4088 3038342147768 MainThread INFO nova.virt.hyperv.vmops [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Using config drive for instance 2021-09-10 17:04:24.865 4088 3038342147768 MainThread INFO nova.virt.hyperv.vmops [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Creating config drive at C:\openstack\instances\instance-0000005c\configdrive.iso 2021-09-10 17:04:24.972 4088 3038342147768 MainThread DEBUG oslo_concurrency.processutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000005c\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmprwskj761 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:04:25.150 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Waiting for WMI job: {'InstanceID': '8A63FAD2-DE8C-429D-82CC-63DB102FA023', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18724), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:25.287 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005d\' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)instance-0000005d539459E1-AB00-4513-802D-1AD68813B2BA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)instance-0000005d539459E1-AB00-4513-802D-1AD68813B2BA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)instance-0000005d539459E1-AB00-4513-802D-1AD68813B2BA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '8A63FAD2-DE8C-429D-82CC-63DB102FA023', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=125038), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 25), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 25), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005d' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)\n\nNot enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)\n\n'instance-0000005d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)", 'ErrorSummaryDescription': "'instance-0000005d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:25.287 4088 3038340492280 MainThread DEBUG os_win._utils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005d' failed to start. Not enough memory in the system to start the virtual machine instance-0000005d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005d' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Not enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) 'instance-0000005d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4532113075256348 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:25.308 4088 3038342147768 MainThread DEBUG oslo_concurrency.processutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000005c\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmprwskj761" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:04:25.657 4088 3038342256072 MainThread DEBUG nova.network.neutron [req-f7a8317c-abf0-4a31-ba28-b208bf47beaf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Updated VIF entry in instance network info cache for port 24d4280e-49cf-4219-b2c0-7ef24c1290f1. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:04:25.657 4088 3038342256072 MainThread DEBUG nova.network.neutron [req-f7a8317c-abf0-4a31-ba28-b208bf47beaf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Updating instance_info_cache with network_info: [{"id": "24d4280e-49cf-4219-b2c0-7ef24c1290f1", "address": "fa:16:3e:04:5a:5f", "network": {"id": "8a0fc2b4-bff6-4887-a969-81fb448d568f", "bridge": null, "label": "tempest-DeleteServersTestJSON-1414296899-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "eecab78b34b0468f8c42e4b7f3444918", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap24d4280e-49", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:04:25.694 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [req-f7a8317c-abf0-4a31-ba28-b208bf47beaf 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-45310242-58a0-47b9-9655-a45945084513" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:04:25.917 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.vmops [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Setting boot order for instance: instance-0000005c: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:04:26.022 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.vmops [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:04:26.100 4088 3038342147768 MainThread DEBUG os_win.utils.jobutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'D5558D8A-A54C-42FD-87F2-7225646F8BF7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16421), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:26.240 4088 3038342147768 MainThread ERROR os_win.utils.jobutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005c\' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)instance-0000005c59E854D7-AC43-49AF-BAF2-AB6154882DB412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)instance-0000005c59E854D7-AC43-49AF-BAF2-AB6154882DB410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)instance-0000005c59E854D7-AC43-49AF-BAF2-AB6154882DB4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D5558D8A-A54C-42FD-87F2-7225646F8BF7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116810), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 26), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 26), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005c' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)\n\nNot enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)\n\n'instance-0000005c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)", 'ErrorSummaryDescription': "'instance-0000005c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:26.240 4088 3038342147768 MainThread DEBUG os_win._utils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005c' failed to start. Not enough memory in the system to start the virtual machine instance-0000005c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005c' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Not enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) 'instance-0000005c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.2184758186340332 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:26.300 4088 3038342254840 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:26.300 4088 3038342254840 MainThread INFO nova.compute.manager [-] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] VM Stopped (Lifecycle Event) 2021-09-10 17:04:26.316 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:26.316 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:26.332 4088 3038342254840 MainThread DEBUG nova.compute.manager [req-5d98ad19-8364-41b3-bb75-6e09f71b4088 - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:26.332 4088 3038342254840 MainThread DEBUG nova.virt.hyperv.vmops [req-5d98ad19-8364-41b3-bb75-6e09f71b4088 - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:26.332 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Waiting for WMI job: {'InstanceID': '1C42A5F0-BF7A-4E10-B12A-43217FC61856', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16464), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:26.383 4088 3038342254840 MainThread DEBUG nova.compute.manager [req-5d98ad19-8364-41b3-bb75-6e09f71b4088 - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:26.410 4088 3038342254840 MainThread INFO nova.compute.manager [req-5d98ad19-8364-41b3-bb75-6e09f71b4088 - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:26.473 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005d\' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)instance-0000005d539459E1-AB00-4513-802D-1AD68813B2BA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)instance-0000005d539459E1-AB00-4513-802D-1AD68813B2BA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)instance-0000005d539459E1-AB00-4513-802D-1AD68813B2BA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1C42A5F0-BF7A-4E10-B12A-43217FC61856', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120538), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 26), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 26), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005d' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)\n\nNot enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)\n\n'instance-0000005d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)", 'ErrorSummaryDescription': "'instance-0000005d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:26.473 4088 3038340492280 MainThread DEBUG os_win._utils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005d' failed to start. Not enough memory in the system to start the virtual machine instance-0000005d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005d' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Not enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) 'instance-0000005d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.6387836933135986 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:26.473 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.vmops [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:04:27.255 4088 3038342147768 MainThread DEBUG os_win.utils.jobutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '49488976-6FF5-4172-85C2-4DBB88CC42A5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16186), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:27.396 4088 3038342147768 MainThread ERROR os_win.utils.jobutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005c\' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)instance-0000005c59E854D7-AC43-49AF-BAF2-AB6154882DB412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)instance-0000005c59E854D7-AC43-49AF-BAF2-AB6154882DB410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)instance-0000005c59E854D7-AC43-49AF-BAF2-AB6154882DB4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '49488976-6FF5-4172-85C2-4DBB88CC42A5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116859), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 27), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 27), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005c' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)\n\nNot enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)\n\n'instance-0000005c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)", 'ErrorSummaryDescription': "'instance-0000005c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:27.396 4088 3038342147768 MainThread DEBUG os_win._utils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005c' failed to start. Not enough memory in the system to start the virtual machine instance-0000005c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005c' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Not enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) 'instance-0000005c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3742623329162598 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:27.442 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:27.442 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:27.442 4088 3038342256072 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:27.442 4088 3038342256072 MainThread INFO nova.compute.manager [-] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] VM Stopped (Lifecycle Event) 2021-09-10 17:04:27.472 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-7be7559d-c42e-4d3b-b3b9-4bdc690713c8 - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:27.472 4088 3038342256072 MainThread DEBUG nova.virt.hyperv.vmops [req-7be7559d-c42e-4d3b-b3b9-4bdc690713c8 - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:27.492 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Waiting for WMI job: {'InstanceID': 'C9322A95-6AAE-4401-83D7-A8CA240CFA0D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16666), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:27.520 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-7be7559d-c42e-4d3b-b3b9-4bdc690713c8 - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:27.550 4088 3038342256072 MainThread INFO nova.compute.manager [req-7be7559d-c42e-4d3b-b3b9-4bdc690713c8 - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:27.647 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005d\' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)instance-0000005d539459E1-AB00-4513-802D-1AD68813B2BA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)instance-0000005d539459E1-AB00-4513-802D-1AD68813B2BA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)instance-0000005d539459E1-AB00-4513-802D-1AD68813B2BA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C9322A95-6AAE-4401-83D7-A8CA240CFA0D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119943), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 27), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 27), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005d' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)\n\nNot enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)\n\n'instance-0000005d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)", 'ErrorSummaryDescription': "'instance-0000005d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:27.647 4088 3038340492280 MainThread DEBUG os_win._utils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005d' failed to start. Not enough memory in the system to start the virtual machine instance-0000005d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005d' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Not enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) 'instance-0000005d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.8131704330444336 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:27.675 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:27.675 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:27.675 4088 3038342256072 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:27.675 4088 3038342256072 MainThread INFO nova.compute.manager [-] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] VM Stopped (Lifecycle Event) 2021-09-10 17:04:27.724 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-7b326548-8b9e-4786-99b6-0500ebbaa32d - - - - -] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:27.724 4088 3038342256072 MainThread DEBUG nova.virt.hyperv.vmops [req-7b326548-8b9e-4786-99b6-0500ebbaa32d - - - - -] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:27.770 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-7b326548-8b9e-4786-99b6-0500ebbaa32d - - - - -] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:27.803 4088 3038342256072 MainThread INFO nova.compute.manager [req-7b326548-8b9e-4786-99b6-0500ebbaa32d - - - - -] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:28.441 4088 3038342147768 MainThread DEBUG os_win.utils.jobutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '850B4F93-3301-4F15-9440-19D4094F029E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15872), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:28.583 4088 3038342147768 MainThread ERROR os_win.utils.jobutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005c\' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)instance-0000005c59E854D7-AC43-49AF-BAF2-AB6154882DB412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)instance-0000005c59E854D7-AC43-49AF-BAF2-AB6154882DB410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)instance-0000005c59E854D7-AC43-49AF-BAF2-AB6154882DB4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '850B4F93-3301-4F15-9440-19D4094F029E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111129), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 28), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 28), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005c' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)\n\nNot enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)\n\n'instance-0000005c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)", 'ErrorSummaryDescription': "'instance-0000005c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:28.583 4088 3038342147768 MainThread DEBUG os_win._utils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005c' failed to start. Not enough memory in the system to start the virtual machine instance-0000005c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005c' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Not enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) 'instance-0000005c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5611305236816406 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:28.629 4088 3038342256072 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:28.629 4088 3038342256072 MainThread INFO nova.compute.manager [-] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] VM Stopped (Lifecycle Event) 2021-09-10 17:04:28.629 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:28.629 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:28.646 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-cdfbb1b2-53bb-432c-847b-41942ee64a2d - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:28.660 4088 3038342256072 MainThread DEBUG nova.virt.hyperv.vmops [req-cdfbb1b2-53bb-432c-847b-41942ee64a2d - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:28.681 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Waiting for WMI job: {'InstanceID': '42152EB6-B11F-442D-9BB1-157BAA072FEE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18213), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:28.691 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-cdfbb1b2-53bb-432c-847b-41942ee64a2d - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:28.727 4088 3038342256072 MainThread INFO nova.compute.manager [req-cdfbb1b2-53bb-432c-847b-41942ee64a2d - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:28.833 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005d\' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)instance-0000005d539459E1-AB00-4513-802D-1AD68813B2BA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)instance-0000005d539459E1-AB00-4513-802D-1AD68813B2BA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)instance-0000005d539459E1-AB00-4513-802D-1AD68813B2BA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '42152EB6-B11F-442D-9BB1-157BAA072FEE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116613), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 28), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 28), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005d' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)\n\nNot enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)\n\n'instance-0000005d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)", 'ErrorSummaryDescription': "'instance-0000005d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:28.833 4088 3038340492280 MainThread DEBUG os_win._utils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005d' failed to start. Not enough memory in the system to start the virtual machine instance-0000005d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005d' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Not enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) 'instance-0000005d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.999364376068115 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:28.851 4088 3038342256072 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:28.851 4088 3038342256072 MainThread INFO nova.compute.manager [-] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] VM Stopped (Lifecycle Event) 2021-09-10 17:04:28.867 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:28.867 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:28.886 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-50f50e9c-f4c9-48c8-981e-caf4897a6e77 - - - - -] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:28.886 4088 3038342256072 MainThread DEBUG nova.virt.hyperv.vmops [req-50f50e9c-f4c9-48c8-981e-caf4897a6e77 - - - - -] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:28.945 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-50f50e9c-f4c9-48c8-981e-caf4897a6e77 - - - - -] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:28.957 4088 3038342256072 MainThread INFO nova.compute.manager [req-50f50e9c-f4c9-48c8-981e-caf4897a6e77 - - - - -] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:29.631 4088 3038342147768 MainThread DEBUG os_win.utils.jobutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'D1FD9BF8-CDCD-4538-BD8A-82F47DAC0445', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15788), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:29.772 4088 3038342147768 MainThread ERROR os_win.utils.jobutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005c\' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)instance-0000005c59E854D7-AC43-49AF-BAF2-AB6154882DB412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)instance-0000005c59E854D7-AC43-49AF-BAF2-AB6154882DB410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)instance-0000005c59E854D7-AC43-49AF-BAF2-AB6154882DB4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D1FD9BF8-CDCD-4538-BD8A-82F47DAC0445', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115690), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 29), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 29), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005c' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)\n\nNot enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)\n\n'instance-0000005c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)", 'ErrorSummaryDescription': "'instance-0000005c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:29.772 4088 3038342147768 MainThread DEBUG os_win._utils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005c' failed to start. Not enough memory in the system to start the virtual machine instance-0000005c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005c' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Not enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) 'instance-0000005c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7501955032348633 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:29.785 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:29.785 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:29.785 4088 3038342256072 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:29.785 4088 3038342256072 MainThread INFO nova.compute.manager [-] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] VM Stopped (Lifecycle Event) 2021-09-10 17:04:29.832 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-78e56378-4017-4f18-8983-8f25e2487bc9 - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:29.832 4088 3038342256072 MainThread DEBUG nova.virt.hyperv.vmops [req-78e56378-4017-4f18-8983-8f25e2487bc9 - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:29.866 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Waiting for WMI job: {'InstanceID': '6DCF1503-2E32-40E1-A414-1A21C918BD8A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17269), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:29.898 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-78e56378-4017-4f18-8983-8f25e2487bc9 - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:29.933 4088 3038342256072 MainThread INFO nova.compute.manager [req-78e56378-4017-4f18-8983-8f25e2487bc9 - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:30.004 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005d\' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)instance-0000005d539459E1-AB00-4513-802D-1AD68813B2BA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)instance-0000005d539459E1-AB00-4513-802D-1AD68813B2BA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)instance-0000005d539459E1-AB00-4513-802D-1AD68813B2BA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6DCF1503-2E32-40E1-A414-1A21C918BD8A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=126700), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 29), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 29), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005d' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)\n\nNot enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)\n\n'instance-0000005d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA)", 'ErrorSummaryDescription': "'instance-0000005d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:30.004 4088 3038340492280 MainThread ERROR nova.virt.hyperv.vmops [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Failed to change vm state of instance-0000005d to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000005d' failed to start. 2021-09-10 17:04:30.004 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Got request to destroy instance 2021-09-10 17:04:30.085 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:30.085 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:30.085 4088 3038342256072 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:30.085 4088 3038342256072 MainThread INFO nova.compute.manager [-] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] VM Stopped (Lifecycle Event) 2021-09-10 17:04:30.105 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-1f9baa38-3864-49ff-a32d-e969063ef40f - - - - -] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:30.105 4088 3038342256072 MainThread DEBUG nova.virt.hyperv.vmops [req-1f9baa38-3864-49ff-a32d-e969063ef40f - - - - -] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:30.177 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-1f9baa38-3864-49ff-a32d-e969063ef40f - - - - -] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:30.227 4088 3038342256072 MainThread INFO nova.compute.manager [req-1f9baa38-3864-49ff-a32d-e969063ef40f - - - - -] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:30.414 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Lock "266ed819-0d7a-461a-91d1-188f0daec6fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:30.443 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:04:30.571 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:30.582 4088 3038342256424 MainThread DEBUG nova.virt.hardware [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:04:30.582 4088 3038342256424 MainThread INFO nova.compute.claims [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Claim successful on node n-h2-808474-1 2021-09-10 17:04:30.716 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.hostops [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:04:30.731 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.hostops [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:04:30.801 4088 3038342147768 MainThread DEBUG os_win.utils.jobutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'EE93428F-0FE1-449C-8C64-A40693959F1E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15850), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:31.007 4088 3038342256424 MainThread DEBUG nova.compute.provider_tree [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:04:31.030 4088 3038342256424 MainThread DEBUG nova.scheduler.client.report [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:04:31.030 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:31.030 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:04:31.030 4088 3038342255720 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:31.030 4088 3038342255720 MainThread INFO nova.compute.manager [-] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] VM Stopped (Lifecycle Event) 2021-09-10 17:04:31.030 4088 3038342257656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:31.030 4088 3038342257656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:31.066 4088 3038342255720 MainThread DEBUG nova.compute.manager [req-52d61497-c2ed-443c-a68a-f36367905659 - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:31.066 4088 3038342255720 MainThread DEBUG nova.virt.hyperv.vmops [req-52d61497-c2ed-443c-a68a-f36367905659 - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:31.066 4088 3038342147768 MainThread ERROR os_win.utils.jobutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005c\' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)instance-0000005c59E854D7-AC43-49AF-BAF2-AB6154882DB412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)instance-0000005c59E854D7-AC43-49AF-BAF2-AB6154882DB410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)instance-0000005c59E854D7-AC43-49AF-BAF2-AB6154882DB4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'EE93428F-0FE1-449C-8C64-A40693959F1E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=146749), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 30), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 30), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005c' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)\n\nNot enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)\n\n'instance-0000005c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)", 'ErrorSummaryDescription': "'instance-0000005c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:31.066 4088 3038342147768 MainThread DEBUG os_win._utils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005c' failed to start. Not enough memory in the system to start the virtual machine instance-0000005c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005c' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Not enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) 'instance-0000005c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.044182300567627 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:31.109 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:04:31.109 4088 3038342255720 MainThread DEBUG nova.compute.manager [req-52d61497-c2ed-443c-a68a-f36367905659 - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:31.128 4088 3038342257656 GreenThread-84 DEBUG nova.compute.manager [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:04:31.129 4088 3038342257656 GreenThread-84 DEBUG nova.network.neutron [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:04:31.158 4088 3038342255720 MainThread INFO nova.compute.manager [req-52d61497-c2ed-443c-a68a-f36367905659 - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:31.285 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:04:31.285 4088 3038342257656 GreenThread-84 DEBUG nova.policy [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3cd10bcdfa0441069cf30193fce4ef96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35f4d0e56d743a8a248b3c564c45f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:04:31.310 4088 3038342256424 MainThread INFO nova.virt.hyperv.vmops [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Spawning new instance 2021-09-10 17:04:31.310 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Lock "instance-00000060" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:31.325 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Lock "instance-00000060" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:31.325 4088 3038342256424 MainThread DEBUG nova.block_device [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:04:31.325 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:31.325 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:31.334 4088 3038342256424 MainThread DEBUG os_win.utils.pathutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Creating directory: C:\openstack\instances\instance-00000060 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:04:31.334 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.vmops [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000060\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:04:31.585 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.vmops [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Resizing VHD C:\openstack\instances\instance-00000060\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:04:32.097 4088 3038342147768 MainThread DEBUG os_win.utils.jobutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '744D9185-3BDE-44F3-BF05-16EC7EE70C33', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15717), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:32.226 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:04:32.226 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "instance-0000005d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:32.226 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "instance-0000005d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:32.238 4088 3038342147768 MainThread ERROR os_win.utils.jobutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005c\' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)instance-0000005c59E854D7-AC43-49AF-BAF2-AB6154882DB412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)instance-0000005c59E854D7-AC43-49AF-BAF2-AB6154882DB410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)instance-0000005c59E854D7-AC43-49AF-BAF2-AB6154882DB4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '744D9185-3BDE-44F3-BF05-16EC7EE70C33', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118479), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 32), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 32), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005c' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)\n\nNot enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)\n\n'instance-0000005c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4)", 'ErrorSummaryDescription': "'instance-0000005c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:32.238 4088 3038342147768 MainThread ERROR nova.virt.hyperv.vmops [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Failed to change vm state of instance-0000005c to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000005c' failed to start. 2021-09-10 17:04:32.238 4088 3038342147768 MainThread INFO nova.virt.hyperv.vmops [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Got request to destroy instance 2021-09-10 17:04:32.272 4088 3038340492280 MainThread DEBUG os_win.utils.compute.vmutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Successfully changed vm state of instance-0000005d to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:04:32.272 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Successfully changed state of VM instance-0000005d to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:04:32.285 4088 3038342255720 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:32.285 4088 3038342255720 MainThread INFO nova.compute.manager [-] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] VM Stopped (Lifecycle Event) 2021-09-10 17:04:32.285 4088 3038342258536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:32.285 4088 3038342258536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:32.301 4088 3038342255720 MainThread DEBUG nova.compute.manager [req-dc3cc90c-288d-48e8-ad58-b707040a8c8c - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:32.301 4088 3038342255720 MainThread DEBUG nova.virt.hyperv.vmops [req-dc3cc90c-288d-48e8-ad58-b707040a8c8c - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:32.318 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Waiting for WMI job: {'InstanceID': '4542D367-99D6-4209-8D47-00707F982103', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17658), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:32.379 4088 3038342257656 GreenThread-84 DEBUG nova.network.neutron [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Successfully created port: d60b5537-094d-408e-8acd-b6b452e2bc13 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:04:32.453 4088 3038342255720 MainThread DEBUG nova.compute.manager [req-dc3cc90c-288d-48e8-ad58-b707040a8c8c - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:32.461 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] WMI job succeeded: {'InstanceID': '4542D367-99D6-4209-8D47-00707F982103', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=118495), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:04:32.461 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "instance-0000005d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:32.461 4088 3038340492280 MainThread DEBUG os_win.utils.pathutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Removing directory: C:\openstack\instances\instance-0000005d check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:04:32.461 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "instance-0000005d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:32.475 4088 3038340492280 MainThread ERROR nova.compute.manager [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000005d' failed to start. Not enough memory in the system to start the virtual machine instance-0000005d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005d' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Not enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) 'instance-0000005d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Error code: 32778. 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Traceback (most recent call last): 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] return function(*args, **kwargs) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] admin_password, network_info, block_device_info) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] return function(self, *args, **kwds) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self.force_reraise() 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] raise self.value 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] should_plug_vifs=False) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 'req_state': req_state}) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self.force_reraise() 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] raise self.value 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] time.sleep(sleep_time) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self.force_reraise() 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] raise self.value 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] return f(*args, **kwargs) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] return self._wait_for_job(job_path) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] error_desc=err_desc) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000005d' failed to start. 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Not enough memory in the system to start the virtual machine instance-0000005d. 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005d' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Not enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 'instance-0000005d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Error code: 32778. 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] During handling of the above exception, another exception occurred: 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Traceback (most recent call last): 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] yield resources 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] accel_info=accel_info) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] return function(*args, **kwargs) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] admin_password, network_info, block_device_info) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] return function(self, *args, **kwds) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self.force_reraise() 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] raise self.value 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] should_plug_vifs=False) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 'req_state': req_state}) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self.force_reraise() 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] raise self.value 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] time.sleep(sleep_time) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self.force_reraise() 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] raise self.value 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] return f(*args, **kwargs) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] return self._wait_for_job(job_path) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] error_desc=err_desc) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000005d' failed to start. 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Not enough memory in the system to start the virtual machine instance-0000005d. 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005d' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Not enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 'instance-0000005d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Error code: 32778. 2021-09-10 17:04:32.475 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.475 4088 3038340492280 MainThread INFO nova.compute.manager [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Terminating instance 2021-09-10 17:04:32.475 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:04:32.475 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Got request to destroy instance 2021-09-10 17:04:32.475 4088 3038342255720 MainThread INFO nova.compute.manager [req-dc3cc90c-288d-48e8-ad58-b707040a8c8c - - - - -] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:32.493 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:04:32.493 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "instance-0000005d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:32.493 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "instance-0000005d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:32.493 4088 3038340492280 MainThread INFO nova.compute.manager [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:04:32.493 4088 3038340492280 MainThread DEBUG nova.compute.claims [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:04:32.493 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:32.613 4088 3038342255720 MainThread DEBUG nova.compute.manager [req-466eae32-ecd5-4655-a3b7-43405f47767d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Received event network-vif-plugged-24d4280e-49cf-4219-b2c0-7ef24c1290f1 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:04:32.613 4088 3038342255720 MainThread DEBUG oslo_concurrency.lockutils [req-466eae32-ecd5-4655-a3b7-43405f47767d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "45310242-58a0-47b9-9655-a45945084513-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:32.613 4088 3038342255720 MainThread DEBUG oslo_concurrency.lockutils [req-466eae32-ecd5-4655-a3b7-43405f47767d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "45310242-58a0-47b9-9655-a45945084513-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:32.613 4088 3038342255720 MainThread DEBUG nova.compute.manager [req-466eae32-ecd5-4655-a3b7-43405f47767d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Processing event network-vif-plugged-24d4280e-49cf-4219-b2c0-7ef24c1290f1 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:04:32.675 4088 3038342256952 MainThread INFO nova.virt.hyperv.vmops [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Using config drive for instance 2021-09-10 17:04:32.684 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.hostops [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:04:32.694 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.hostops [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:04:32.942 4088 3038340492280 MainThread DEBUG nova.compute.provider_tree [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:04:32.960 4088 3038340492280 MainThread DEBUG nova.scheduler.client.report [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:04:32.960 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:32.960 4088 3038340492280 MainThread ERROR nova.compute.manager [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000005d' failed to start. Not enough memory in the system to start the virtual machine instance-0000005d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005d' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Not enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) 'instance-0000005d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Error code: 32778. 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Traceback (most recent call last): 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] return function(*args, **kwargs) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] admin_password, network_info, block_device_info) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] return function(self, *args, **kwds) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self.force_reraise() 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] raise self.value 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] should_plug_vifs=False) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 'req_state': req_state}) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self.force_reraise() 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] raise self.value 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] time.sleep(sleep_time) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self.force_reraise() 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] raise self.value 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] return f(*args, **kwargs) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] return self._wait_for_job(job_path) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] error_desc=err_desc) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000005d' failed to start. 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Not enough memory in the system to start the virtual machine instance-0000005d. 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005d' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Not enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 'instance-0000005d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Error code: 32778. 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] During handling of the above exception, another exception occurred: 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Traceback (most recent call last): 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] accel_info=accel_info) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] return function(*args, **kwargs) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] admin_password, network_info, block_device_info) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] return function(self, *args, **kwds) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self.force_reraise() 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] raise self.value 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] should_plug_vifs=False) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 'req_state': req_state}) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self.force_reraise() 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] raise self.value 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] time.sleep(sleep_time) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self.force_reraise() 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] raise self.value 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] return f(*args, **kwargs) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] return self._wait_for_job(job_path) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] error_desc=err_desc) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000005d' failed to start. 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Not enough memory in the system to start the virtual machine instance-0000005d. 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005d' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Not enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 'instance-0000005d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Error code: 32778. 2021-09-10 17:04:32.960 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] 2021-09-10 17:04:32.960 4088 3038340492280 MainThread DEBUG nova.compute.utils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] WMI job failed with status 10. Error summary description: 'instance-0000005d' failed to start. Not enough memory in the system to start the virtual machine instance-0000005d. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:04:32.960 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Build of instance d856fdf2-ccbb-4aa6-8dbf-c62e4989911d was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000005d' failed to start. Not enough memory in the system to start the virtual machine instance-0000005d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005d' failed to start. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Not enough memory in the system to start the virtual machine instance-0000005d with ram size 1024 megabytes. (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) 'instance-0000005d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 539459E1-AB00-4513-802D-1AD68813B2BA) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:04:32.960 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:04:32.960 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:04:32.960 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:04:32.960 4088 3038340492280 MainThread DEBUG nova.network.neutron [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:04:33.026 4088 3038342256952 MainThread INFO nova.virt.hyperv.vmops [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Creating config drive at C:\openstack\instances\instance-0000005f\configdrive.iso 2021-09-10 17:04:33.115 4088 3038342256952 MainThread DEBUG oslo_concurrency.processutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000005f\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpv8wzmaxg execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:04:33.456 4088 3038342256952 MainThread DEBUG oslo_concurrency.processutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000005f\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpv8wzmaxg" returned: 0 in 0.344s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:04:33.959 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.vmops [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Setting boot order for instance: instance-0000005f: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:04:34.050 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.vmops [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:04:34.098 4088 3038342256952 MainThread DEBUG os_win.utils.jobutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': 'ACDC7BD7-DE7C-4B3B-882F-7C475E342FDC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19725), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:34.244 4088 3038342256952 MainThread ERROR os_win.utils.jobutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005f\' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)instance-0000005fF3512A5B-95F6-4D3E-B953-F1C68180727C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)instance-0000005fF3512A5B-95F6-4D3E-B953-F1C68180727C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)instance-0000005fF3512A5B-95F6-4D3E-B953-F1C68180727C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'ACDC7BD7-DE7C-4B3B-882F-7C475E342FDC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117754), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 34), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 34), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005f' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)\n\nNot enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)\n\n'instance-0000005f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)", 'ErrorSummaryDescription': "'instance-0000005f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:34.244 4088 3038342256952 MainThread DEBUG os_win._utils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005f' failed to start. Not enough memory in the system to start the virtual machine instance-0000005f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005f' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Not enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) 'instance-0000005f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.19406628608703613 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:34.269 4088 3038342145832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:34.269 4088 3038342145832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:34.269 4088 3038342255720 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:34.269 4088 3038342255720 MainThread INFO nova.compute.manager [-] [instance: 45310242-58a0-47b9-9655-a45945084513] VM Stopped (Lifecycle Event) 2021-09-10 17:04:34.304 4088 3038342255720 MainThread DEBUG nova.compute.manager [req-5d0e8eaf-8152-4b37-bede-23d1642ffe1b - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:34.304 4088 3038342255720 MainThread DEBUG nova.virt.hyperv.vmops [req-5d0e8eaf-8152-4b37-bede-23d1642ffe1b - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:34.364 4088 3038342255720 MainThread DEBUG nova.compute.manager [req-5d0e8eaf-8152-4b37-bede-23d1642ffe1b - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:34.394 4088 3038342255720 MainThread INFO nova.compute.manager [req-5d0e8eaf-8152-4b37-bede-23d1642ffe1b - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:34.547 4088 3038342257656 GreenThread-84 DEBUG nova.network.neutron [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Successfully updated port: d60b5537-094d-408e-8acd-b6b452e2bc13 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:04:34.563 4088 3038342257656 GreenThread-84 DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Acquired lock "refresh_cache-266ed819-0d7a-461a-91d1-188f0daec6fa" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:04:34.563 4088 3038342257656 GreenThread-84 DEBUG nova.network.neutron [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:04:34.582 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.vmops [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:04:34.582 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-0000005c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:34.582 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-0000005c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:34.599 4088 3038342147768 MainThread DEBUG os_win.utils.compute.vmutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Successfully changed vm state of instance-0000005c to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:04:34.599 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.vmops [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Successfully changed state of VM instance-0000005c to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:04:34.644 4088 3038342147768 MainThread DEBUG os_win.utils.jobutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '718D5E89-95B8-480F-A21A-069233C33DCC', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15734), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:34.781 4088 3038342147768 MainThread DEBUG os_win.utils.jobutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job succeeded: {'InstanceID': '718D5E89-95B8-480F-A21A-069233C33DCC', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=103734), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:04:34.781 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-0000005c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:34.781 4088 3038342147768 MainThread DEBUG os_win.utils.pathutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Removing directory: C:\openstack\instances\instance-0000005c check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:04:34.781 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-0000005c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:34.781 4088 3038342147768 MainThread ERROR nova.compute.manager [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000005c' failed to start. Not enough memory in the system to start the virtual machine instance-0000005c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005c' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Not enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) 'instance-0000005c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Error code: 32778. 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Traceback (most recent call last): 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] return function(*args, **kwargs) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] admin_password, network_info, block_device_info) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] return function(self, *args, **kwds) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self.force_reraise() 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] raise self.value 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] should_plug_vifs=False) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 'req_state': req_state}) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self.force_reraise() 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] raise self.value 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] time.sleep(sleep_time) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self.force_reraise() 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] raise self.value 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] return f(*args, **kwargs) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] return self._wait_for_job(job_path) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] error_desc=err_desc) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000005c' failed to start. 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Not enough memory in the system to start the virtual machine instance-0000005c. 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005c' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Not enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 'instance-0000005c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Error code: 32778. 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] During handling of the above exception, another exception occurred: 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Traceback (most recent call last): 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] yield resources 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] accel_info=accel_info) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] return function(*args, **kwargs) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] admin_password, network_info, block_device_info) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] return function(self, *args, **kwds) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self.force_reraise() 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] raise self.value 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] should_plug_vifs=False) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 'req_state': req_state}) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self.force_reraise() 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] raise self.value 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] time.sleep(sleep_time) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self.force_reraise() 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] raise self.value 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] return f(*args, **kwargs) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] return self._wait_for_job(job_path) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] error_desc=err_desc) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000005c' failed to start. 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Not enough memory in the system to start the virtual machine instance-0000005c. 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005c' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Not enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 'instance-0000005c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Error code: 32778. 2021-09-10 17:04:34.781 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:34.781 4088 3038342147768 MainThread INFO nova.compute.manager [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Terminating instance 2021-09-10 17:04:34.797 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:04:34.797 4088 3038342147768 MainThread INFO nova.virt.hyperv.vmops [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Got request to destroy instance 2021-09-10 17:04:34.802 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.vmops [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:04:34.802 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-0000005c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:34.802 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-0000005c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:34.802 4088 3038342147768 MainThread INFO nova.compute.manager [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Took 0.00 seconds to destroy the instance on the hypervisor. 2021-09-10 17:04:34.802 4088 3038342147768 MainThread DEBUG nova.compute.claims [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:04:34.802 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:34.877 4088 3038342257656 GreenThread-84 DEBUG nova.network.neutron [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:04:34.946 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.hostops [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:04:34.972 4088 3038342147768 MainThread DEBUG nova.virt.hyperv.hostops [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:04:35.192 4088 3038342147768 MainThread DEBUG nova.compute.provider_tree [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:04:35.223 4088 3038342147768 MainThread DEBUG nova.scheduler.client.report [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:04:35.223 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:35.223 4088 3038342147768 MainThread ERROR nova.compute.manager [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000005c' failed to start. Not enough memory in the system to start the virtual machine instance-0000005c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005c' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Not enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) 'instance-0000005c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Error code: 32778. 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Traceback (most recent call last): 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] return function(*args, **kwargs) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] admin_password, network_info, block_device_info) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] return function(self, *args, **kwds) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self.force_reraise() 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] raise self.value 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] should_plug_vifs=False) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 'req_state': req_state}) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self.force_reraise() 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] raise self.value 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] time.sleep(sleep_time) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self.force_reraise() 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] raise self.value 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] return f(*args, **kwargs) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] return self._wait_for_job(job_path) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] error_desc=err_desc) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000005c' failed to start. 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Not enough memory in the system to start the virtual machine instance-0000005c. 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005c' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Not enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 'instance-0000005c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Error code: 32778. 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] During handling of the above exception, another exception occurred: 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Traceback (most recent call last): 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] accel_info=accel_info) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] return function(*args, **kwargs) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] admin_password, network_info, block_device_info) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] return function(self, *args, **kwds) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self.force_reraise() 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] raise self.value 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] should_plug_vifs=False) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 'req_state': req_state}) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self.force_reraise() 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] raise self.value 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] time.sleep(sleep_time) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self.force_reraise() 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] raise self.value 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] return f(*args, **kwargs) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] return self._wait_for_job(job_path) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] error_desc=err_desc) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000005c' failed to start. 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Not enough memory in the system to start the virtual machine instance-0000005c. 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005c' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Not enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 'instance-0000005c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Error code: 32778. 2021-09-10 17:04:35.223 4088 3038342147768 MainThread TRACE nova.compute.manager [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] 2021-09-10 17:04:35.223 4088 3038342147768 MainThread DEBUG nova.compute.utils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] WMI job failed with status 10. Error summary description: 'instance-0000005c' failed to start. Not enough memory in the system to start the virtual machine instance-0000005c. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:04:35.223 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Build of instance 442531a0-4fb7-4282-a436-20dfe4a05c72 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000005c' failed to start. Not enough memory in the system to start the virtual machine instance-0000005c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005c' failed to start. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Not enough memory in the system to start the virtual machine instance-0000005c with ram size 1024 megabytes. (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) 'instance-0000005c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 59E854D7-AC43-49AF-BAF2-AB6154882DB4) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:04:35.238 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:04:35.238 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:04:35.238 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:04:35.238 4088 3038342147768 MainThread DEBUG nova.network.neutron [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:04:35.238 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-3f4b7777-d408-4b1c-8f55-d909ef0c384e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Received event network-changed-d60b5537-094d-408e-8acd-b6b452e2bc13 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:04:35.238 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-3f4b7777-d408-4b1c-8f55-d909ef0c384e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Refreshing instance network info cache due to event network-changed-d60b5537-094d-408e-8acd-b6b452e2bc13. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:04:35.269 4088 3038342256952 MainThread DEBUG os_win.utils.jobutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': 'AD6709F5-6CE7-4518-967C-C9D8CAFEAFE4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16333), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:35.441 4088 3038342256952 MainThread ERROR os_win.utils.jobutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005f\' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)instance-0000005fF3512A5B-95F6-4D3E-B953-F1C68180727C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)instance-0000005fF3512A5B-95F6-4D3E-B953-F1C68180727C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)instance-0000005fF3512A5B-95F6-4D3E-B953-F1C68180727C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'AD6709F5-6CE7-4518-967C-C9D8CAFEAFE4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113735), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 35), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 35), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005f' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)\n\nNot enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)\n\n'instance-0000005f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)", 'ErrorSummaryDescription': "'instance-0000005f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:35.441 4088 3038342256952 MainThread DEBUG os_win._utils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005f' failed to start. Not enough memory in the system to start the virtual machine instance-0000005f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005f' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Not enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) 'instance-0000005f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.391101598739624 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:35.441 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:35.441 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:35.441 4088 3038338904840 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:35.441 4088 3038338904840 MainThread INFO nova.compute.manager [-] [instance: 45310242-58a0-47b9-9655-a45945084513] VM Stopped (Lifecycle Event) 2021-09-10 17:04:35.488 4088 3038338904840 MainThread DEBUG nova.compute.manager [req-472f5b0b-d8a2-40ef-ba11-c4a10a6c56e0 - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:35.488 4088 3038338904840 MainThread DEBUG nova.virt.hyperv.vmops [req-472f5b0b-d8a2-40ef-ba11-c4a10a6c56e0 - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:35.538 4088 3038338904840 MainThread DEBUG nova.compute.manager [req-472f5b0b-d8a2-40ef-ba11-c4a10a6c56e0 - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:35.568 4088 3038338904840 MainThread INFO nova.compute.manager [req-472f5b0b-d8a2-40ef-ba11-c4a10a6c56e0 - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:35.894 4088 3038340492280 MainThread DEBUG nova.network.neutron [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:04:35.926 4088 3038340492280 MainThread INFO nova.compute.manager [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] [instance: d856fdf2-ccbb-4aa6-8dbf-c62e4989911d] Took 2.97 seconds to deallocate network for instance. 2021-09-10 17:04:36.112 4088 3038340492280 MainThread INFO nova.scheduler.client.report [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Deleted allocations for instance d856fdf2-ccbb-4aa6-8dbf-c62e4989911d 2021-09-10 17:04:36.172 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-45b6e5f0-e23e-430d-8e4b-db2931e37309 206940e6bc1a478bb7f92f7778bec0e2 5283391577e14a77bbd03e5dcf9f9e5c - default default] Lock "d856fdf2-ccbb-4aa6-8dbf-c62e4989911d" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 27.312s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:36.314 4088 3038342257656 GreenThread-84 DEBUG nova.network.neutron [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Updating instance_info_cache with network_info: [{"id": "d60b5537-094d-408e-8acd-b6b452e2bc13", "address": "fa:16:3e:07:a4:54", "network": {"id": "5aedda23-2066-4b60-8615-f7279a31bfb7", "bridge": null, "label": "tempest-ServerTagsTestJSON-1743250206-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a35f4d0e56d743a8a248b3c564c45f4e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd60b5537-09", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:04:36.350 4088 3038342257656 GreenThread-84 DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Releasing lock "refresh_cache-266ed819-0d7a-461a-91d1-188f0daec6fa" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:04:36.350 4088 3038342257656 GreenThread-84 DEBUG nova.compute.manager [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Instance network_info: |[{"id": "d60b5537-094d-408e-8acd-b6b452e2bc13", "address": "fa:16:3e:07:a4:54", "network": {"id": "5aedda23-2066-4b60-8615-f7279a31bfb7", "bridge": null, "label": "tempest-ServerTagsTestJSON-1743250206-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a35f4d0e56d743a8a248b3c564c45f4e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd60b5537-09", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:04:36.350 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Preparing to wait for external event network-vif-plugged-d60b5537-094d-408e-8acd-b6b452e2bc13 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:04:36.350 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Lock "266ed819-0d7a-461a-91d1-188f0daec6fa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:36.350 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Lock "266ed819-0d7a-461a-91d1-188f0daec6fa-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:36.350 4088 3038342256424 MainThread DEBUG os_win.utils.compute.vmutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Creating VM instance-00000060 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:04:36.350 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-3f4b7777-d408-4b1c-8f55-d909ef0c384e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-266ed819-0d7a-461a-91d1-188f0daec6fa" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:04:36.350 4088 3038338906952 MainThread DEBUG nova.network.neutron [req-3f4b7777-d408-4b1c-8f55-d909ef0c384e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Refreshing network info cache for port d60b5537-094d-408e-8acd-b6b452e2bc13 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:04:36.504 4088 3038342256952 MainThread DEBUG os_win.utils.jobutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': 'E5DB40F0-DE44-4D8C-B8C3-D20832D127D4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17156), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:36.648 4088 3038342256952 MainThread ERROR os_win.utils.jobutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005f\' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)instance-0000005fF3512A5B-95F6-4D3E-B953-F1C68180727C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)instance-0000005fF3512A5B-95F6-4D3E-B953-F1C68180727C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)instance-0000005fF3512A5B-95F6-4D3E-B953-F1C68180727C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E5DB40F0-DE44-4D8C-B8C3-D20832D127D4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114952), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 36), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 36), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005f' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)\n\nNot enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)\n\n'instance-0000005f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)", 'ErrorSummaryDescription': "'instance-0000005f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:36.648 4088 3038342256952 MainThread DEBUG os_win._utils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005f' failed to start. Not enough memory in the system to start the virtual machine instance-0000005f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005f' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Not enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) 'instance-0000005f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5973215103149414 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:36.725 4088 3038342258360 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:36.725 4088 3038342258360 MainThread INFO nova.compute.manager [-] [instance: 45310242-58a0-47b9-9655-a45945084513] VM Stopped (Lifecycle Event) 2021-09-10 17:04:36.725 4088 3038342145832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:36.725 4088 3038342145832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:36.753 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-b84b7ed7-a876-4829-a12d-6049fd2f38c7 - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:36.774 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.vmops [req-b84b7ed7-a876-4829-a12d-6049fd2f38c7 - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:36.818 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-b84b7ed7-a876-4829-a12d-6049fd2f38c7 - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:36.835 4088 3038342258360 MainThread INFO nova.compute.manager [req-b84b7ed7-a876-4829-a12d-6049fd2f38c7 - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:37.552 4088 3038342147768 MainThread DEBUG nova.network.neutron [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:04:37.581 4088 3038342147768 MainThread INFO nova.compute.manager [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 442531a0-4fb7-4282-a436-20dfe4a05c72] Took 2.34 seconds to deallocate network for instance. 2021-09-10 17:04:37.677 4088 3038342256952 MainThread DEBUG os_win.utils.jobutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '55450DDF-059F-4B46-9F97-2AFEAB4F8613', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15340), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:37.677 4088 3038338906952 MainThread DEBUG nova.network.neutron [req-3f4b7777-d408-4b1c-8f55-d909ef0c384e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Updated VIF entry in instance network info cache for port d60b5537-094d-408e-8acd-b6b452e2bc13. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:04:37.677 4088 3038338906952 MainThread DEBUG nova.network.neutron [req-3f4b7777-d408-4b1c-8f55-d909ef0c384e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Updating instance_info_cache with network_info: [{"id": "d60b5537-094d-408e-8acd-b6b452e2bc13", "address": "fa:16:3e:07:a4:54", "network": {"id": "5aedda23-2066-4b60-8615-f7279a31bfb7", "bridge": null, "label": "tempest-ServerTagsTestJSON-1743250206-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a35f4d0e56d743a8a248b3c564c45f4e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd60b5537-09", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:04:37.709 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-3f4b7777-d408-4b1c-8f55-d909ef0c384e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-266ed819-0d7a-461a-91d1-188f0daec6fa" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:04:37.816 4088 3038342256952 MainThread ERROR os_win.utils.jobutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005f\' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)instance-0000005fF3512A5B-95F6-4D3E-B953-F1C68180727C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)instance-0000005fF3512A5B-95F6-4D3E-B953-F1C68180727C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)instance-0000005fF3512A5B-95F6-4D3E-B953-F1C68180727C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '55450DDF-059F-4B46-9F97-2AFEAB4F8613', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113072), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 37), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 37), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005f' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)\n\nNot enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)\n\n'instance-0000005f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)", 'ErrorSummaryDescription': "'instance-0000005f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:37.816 4088 3038342256952 MainThread DEBUG os_win._utils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005f' failed to start. Not enough memory in the system to start the virtual machine instance-0000005f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005f' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Not enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) 'instance-0000005f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.765611410140991 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:37.833 4088 3038342147768 MainThread INFO nova.scheduler.client.report [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Deleted allocations for instance 442531a0-4fb7-4282-a436-20dfe4a05c72 2021-09-10 17:04:37.884 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-7e1dec41-105b-47f2-8e36-5624ef0b408e 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "442531a0-4fb7-4282-a436-20dfe4a05c72" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 31.046s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:38.162 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.vmops [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:04:38.848 4088 3038342256952 MainThread DEBUG os_win.utils.jobutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '232D4825-27B9-4834-AB49-48A3951681BC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16433), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:38.988 4088 3038342256952 MainThread ERROR os_win.utils.jobutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005f\' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)instance-0000005fF3512A5B-95F6-4D3E-B953-F1C68180727C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)instance-0000005fF3512A5B-95F6-4D3E-B953-F1C68180727C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)instance-0000005fF3512A5B-95F6-4D3E-B953-F1C68180727C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '232D4825-27B9-4834-AB49-48A3951681BC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111755), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 38), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 38), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005f' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)\n\nNot enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)\n\n'instance-0000005f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)", 'ErrorSummaryDescription': "'instance-0000005f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:39.006 4088 3038342256952 MainThread DEBUG os_win._utils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000005f' failed to start. Not enough memory in the system to start the virtual machine instance-0000005f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005f' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Not enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) 'instance-0000005f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.955583572387695 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:39.034 4088 3038340492280 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:39.034 4088 3038340492280 MainThread INFO nova.compute.manager [-] [instance: 45310242-58a0-47b9-9655-a45945084513] VM Stopped (Lifecycle Event) 2021-09-10 17:04:39.034 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:39.034 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:39.044 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-d0db6a23-861e-464c-96ea-211c4dca2f9a - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:39.044 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-d0db6a23-861e-464c-96ea-211c4dca2f9a - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:39.086 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-d0db6a23-861e-464c-96ea-211c4dca2f9a - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:39.134 4088 3038340492280 MainThread INFO nova.compute.manager [req-d0db6a23-861e-464c-96ea-211c4dca2f9a - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:40.038 4088 3038342256952 MainThread DEBUG os_win.utils.jobutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': 'B3C86385-1BC0-43D5-959B-2BF55D8DD9FB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20320), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:40.196 4088 3038342256952 MainThread ERROR os_win.utils.jobutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000005f\' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)instance-0000005fF3512A5B-95F6-4D3E-B953-F1C68180727C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)instance-0000005fF3512A5B-95F6-4D3E-B953-F1C68180727C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000005f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)instance-0000005fF3512A5B-95F6-4D3E-B953-F1C68180727C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B3C86385-1BC0-43D5-959B-2BF55D8DD9FB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112569), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 40), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 40), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000005f' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)\n\nNot enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)\n\n'instance-0000005f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C)", 'ErrorSummaryDescription': "'instance-0000005f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000005f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:40.196 4088 3038342256952 MainThread ERROR nova.virt.hyperv.vmops [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Failed to change vm state of instance-0000005f to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000005f' failed to start. 2021-09-10 17:04:40.196 4088 3038342256952 MainThread INFO nova.virt.hyperv.vmops [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Got request to destroy instance 2021-09-10 17:04:40.223 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:40.223 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000005f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:40.223 4088 3038340492280 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:40.223 4088 3038340492280 MainThread INFO nova.compute.manager [-] [instance: 45310242-58a0-47b9-9655-a45945084513] VM Stopped (Lifecycle Event) 2021-09-10 17:04:40.253 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-2c9dc641-bb24-4848-aeb5-708ef1744f42 - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:40.253 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-2c9dc641-bb24-4848-aeb5-708ef1744f42 - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:40.300 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-2c9dc641-bb24-4848-aeb5-708ef1744f42 - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:40.354 4088 3038340492280 MainThread INFO nova.compute.manager [req-2c9dc641-bb24-4848-aeb5-708ef1744f42 - - - - -] [instance: 45310242-58a0-47b9-9655-a45945084513] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:40.989 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Lock "7bb24cc6-9fd0-42d3-8abb-a946f1ebc269" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:41.027 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:04:41.177 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:41.193 4088 3038342144600 MainThread DEBUG nova.virt.hardware [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:04:41.193 4088 3038342144600 MainThread INFO nova.compute.claims [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Claim successful on node n-h2-808474-1 2021-09-10 17:04:41.362 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:04:41.362 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:04:41.412 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.hostops [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:04:41.441 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.hostops [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:04:41.536 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:04:41.662 4088 3038342144600 MainThread DEBUG nova.compute.provider_tree [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:04:41.675 4088 3038342144600 MainThread DEBUG nova.scheduler.client.report [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:04:41.675 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:41.675 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:04:41.818 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:04:41.818 4088 3038342147064 GreenThread-85 DEBUG nova.compute.manager [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:04:41.818 4088 3038342147064 GreenThread-85 DEBUG nova.network.neutron [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:04:42.050 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:04:42.077 4088 3038342144600 MainThread INFO nova.virt.hyperv.vmops [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Spawning new instance 2021-09-10 17:04:42.077 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Lock "instance-00000061" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:42.077 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Lock "instance-00000061" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:42.077 4088 3038342144600 MainThread DEBUG nova.block_device [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:04:42.077 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:42.096 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:42.096 4088 3038342144600 MainThread DEBUG os_win.utils.pathutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Creating directory: C:\openstack\instances\instance-00000061 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:04:42.105 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000061\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:04:42.238 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.vmops [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:04:42.238 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000005f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:42.238 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000005f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:42.253 4088 3038342256952 MainThread DEBUG os_win.utils.compute.vmutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Successfully changed vm state of instance-0000005f to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:04:42.253 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.vmops [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Successfully changed state of VM instance-0000005f to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:04:42.302 4088 3038342256952 MainThread DEBUG os_win.utils.jobutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '2DD074D0-7A66-4980-8F57-7BC94688367F', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15375), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:42.352 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Resizing VHD C:\openstack\instances\instance-00000061\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:04:42.425 4088 3038342256952 MainThread DEBUG os_win.utils.jobutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job succeeded: {'InstanceID': '2DD074D0-7A66-4980-8F57-7BC94688367F', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=115721), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:04:42.425 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000005f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:42.425 4088 3038342256952 MainThread DEBUG os_win.utils.pathutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Removing directory: C:\openstack\instances\instance-0000005f check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:04:42.425 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000005f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:42.425 4088 3038342256952 MainThread ERROR nova.compute.manager [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000005f' failed to start. Not enough memory in the system to start the virtual machine instance-0000005f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005f' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Not enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) 'instance-0000005f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Error code: 32778. 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] Traceback (most recent call last): 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] return function(*args, **kwargs) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] admin_password, network_info, block_device_info) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] return function(self, *args, **kwds) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self.force_reraise() 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] raise self.value 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] should_plug_vifs=False) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 'req_state': req_state}) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self.force_reraise() 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] raise self.value 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] time.sleep(sleep_time) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self.force_reraise() 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] raise self.value 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] return f(*args, **kwargs) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] return self._wait_for_job(job_path) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] error_desc=err_desc) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000005f' failed to start. 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] Not enough memory in the system to start the virtual machine instance-0000005f. 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005f' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] Not enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 'instance-0000005f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Error code: 32778. 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] During handling of the above exception, another exception occurred: 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] Traceback (most recent call last): 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] yield resources 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] accel_info=accel_info) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] return function(*args, **kwargs) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] admin_password, network_info, block_device_info) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] return function(self, *args, **kwds) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self.force_reraise() 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] raise self.value 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] should_plug_vifs=False) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 'req_state': req_state}) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self.force_reraise() 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] raise self.value 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] time.sleep(sleep_time) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self.force_reraise() 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] raise self.value 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] return f(*args, **kwargs) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] return self._wait_for_job(job_path) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] error_desc=err_desc) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000005f' failed to start. 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] Not enough memory in the system to start the virtual machine instance-0000005f. 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005f' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] Not enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 'instance-0000005f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Error code: 32778. 2021-09-10 17:04:42.425 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.425 4088 3038342256952 MainThread INFO nova.compute.manager [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Terminating instance 2021-09-10 17:04:42.425 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:04:42.425 4088 3038342256952 MainThread INFO nova.virt.hyperv.vmops [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Got request to destroy instance 2021-09-10 17:04:42.446 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.vmops [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:04:42.446 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000005f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:42.446 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000005f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:42.446 4088 3038342256952 MainThread INFO nova.compute.manager [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:04:42.446 4088 3038342256952 MainThread DEBUG nova.compute.claims [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:04:42.446 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:42.474 4088 3038342147064 GreenThread-85 DEBUG nova.policy [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30f08d002bf64c7db4d91135559d5b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40c2b3a02a2453b8747f81262f1ddbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:04:42.606 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.hostops [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:04:42.615 4088 3038342256952 MainThread DEBUG nova.virt.hyperv.hostops [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:04:42.833 4088 3038342256952 MainThread DEBUG nova.compute.provider_tree [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:04:42.856 4088 3038342256952 MainThread DEBUG nova.scheduler.client.report [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:04:42.856 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.406s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:42.856 4088 3038342256952 MainThread ERROR nova.compute.manager [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000005f' failed to start. Not enough memory in the system to start the virtual machine instance-0000005f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005f' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Not enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) 'instance-0000005f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Error code: 32778. 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] Traceback (most recent call last): 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] return function(*args, **kwargs) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] admin_password, network_info, block_device_info) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] return function(self, *args, **kwds) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self.force_reraise() 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] raise self.value 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] should_plug_vifs=False) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 'req_state': req_state}) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self.force_reraise() 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] raise self.value 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] time.sleep(sleep_time) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self.force_reraise() 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] raise self.value 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] return f(*args, **kwargs) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] return self._wait_for_job(job_path) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] error_desc=err_desc) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000005f' failed to start. 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] Not enough memory in the system to start the virtual machine instance-0000005f. 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005f' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] Not enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 'instance-0000005f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Error code: 32778. 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] During handling of the above exception, another exception occurred: 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] Traceback (most recent call last): 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] accel_info=accel_info) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] return function(*args, **kwargs) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] admin_password, network_info, block_device_info) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] return function(self, *args, **kwds) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self.force_reraise() 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] raise self.value 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] should_plug_vifs=False) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 'req_state': req_state}) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self.force_reraise() 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] raise self.value 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] time.sleep(sleep_time) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self.force_reraise() 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] raise self.value 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] return f(*args, **kwargs) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] return self._wait_for_job(job_path) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] error_desc=err_desc) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000005f' failed to start. 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] Not enough memory in the system to start the virtual machine instance-0000005f. 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005f' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] Not enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 'instance-0000005f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Error code: 32778. 2021-09-10 17:04:42.856 4088 3038342256952 MainThread TRACE nova.compute.manager [instance: 45310242-58a0-47b9-9655-a45945084513] 2021-09-10 17:04:42.856 4088 3038342256952 MainThread DEBUG nova.compute.utils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] WMI job failed with status 10. Error summary description: 'instance-0000005f' failed to start. Not enough memory in the system to start the virtual machine instance-0000005f. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:04:42.866 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Build of instance 45310242-58a0-47b9-9655-a45945084513 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000005f' failed to start. Not enough memory in the system to start the virtual machine instance-0000005f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000005f' failed to start. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Not enough memory in the system to start the virtual machine instance-0000005f with ram size 1024 megabytes. (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) 'instance-0000005f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F3512A5B-95F6-4D3E-B953-F1C68180727C) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:04:42.866 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:04:42.866 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:04:42.866 4088 3038342256952 MainThread DEBUG nova.compute.manager [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:04:42.866 4088 3038342256952 MainThread DEBUG nova.network.neutron [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:04:44.175 4088 3038342256952 MainThread DEBUG nova.network.neutron [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:04:44.192 4088 3038342256952 MainThread INFO nova.compute.manager [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 45310242-58a0-47b9-9655-a45945084513] Took 1.33 seconds to deallocate network for instance. 2021-09-10 17:04:44.399 4088 3038342256952 MainThread INFO nova.scheduler.client.report [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Deleted allocations for instance 45310242-58a0-47b9-9655-a45945084513 2021-09-10 17:04:44.447 4088 3038342256952 MainThread DEBUG oslo_concurrency.lockutils [req-851518f1-29ec-48a0-881c-3c234ff9ede6 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "45310242-58a0-47b9-9655-a45945084513" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 26.281s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:44.534 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:04:44.754 4088 3038342147064 GreenThread-85 DEBUG nova.network.neutron [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Successfully created port: ed824d46-e93d-4c2a-ba72-4cc6c08ed999 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:04:45.333 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-fce88947-8644-4baf-9c08-380eb3825851 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Received event network-vif-plugged-d60b5537-094d-408e-8acd-b6b452e2bc13 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:04:45.333 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-fce88947-8644-4baf-9c08-380eb3825851 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "266ed819-0d7a-461a-91d1-188f0daec6fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:45.333 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [req-fce88947-8644-4baf-9c08-380eb3825851 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "266ed819-0d7a-461a-91d1-188f0daec6fa-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:45.333 4088 3038342147768 MainThread DEBUG nova.compute.manager [req-fce88947-8644-4baf-9c08-380eb3825851 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Processing event network-vif-plugged-d60b5537-094d-408e-8acd-b6b452e2bc13 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:04:45.363 4088 3038342256424 MainThread INFO nova.virt.hyperv.vmops [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Using config drive for instance 2021-09-10 17:04:45.536 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:04:45.644 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:04:45.862 4088 3038342256424 MainThread INFO nova.virt.hyperv.vmops [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Creating config drive at C:\openstack\instances\instance-00000060\configdrive.iso 2021-09-10 17:04:45.957 4088 3038342256424 MainThread DEBUG oslo_concurrency.processutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000060\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpnv_c5l0a execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:04:46.269 4088 3038342256424 MainThread DEBUG oslo_concurrency.processutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000060\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpnv_c5l0a" returned: 0 in 0.312s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:04:46.534 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:04:46.534 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:04:46.768 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.vmops [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Setting boot order for instance: instance-00000060: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:04:46.786 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-359fd482-69f5-4194-9466-f46ea31258d3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:04:46.786 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:04:46.869 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.vmops [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:04:46.901 4088 3038342256424 MainThread DEBUG os_win.utils.jobutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Waiting for WMI job: {'InstanceID': '7D668A49-44DE-4B08-8A09-667146765EDA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15472), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:47.051 4088 3038342256424 MainThread ERROR os_win.utils.jobutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] WMI job failed: {'RawErrors': (('124\'instance-00000060\' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)instance-00000060AC205625-B22A-4193-912E-EBAEA0EB17B112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)instance-00000060AC205625-B22A-4193-912E-EBAEA0EB17B110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000060\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)instance-00000060AC205625-B22A-4193-912E-EBAEA0EB17B1%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7D668A49-44DE-4B08-8A09-667146765EDA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114550), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 46), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 46), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000060' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)\n\nNot enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)\n\n'instance-00000060' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)", 'ErrorSummaryDescription': "'instance-00000060' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000060.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:47.051 4088 3038342256424 MainThread DEBUG os_win._utils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000060' failed to start. Not enough memory in the system to start the virtual machine instance-00000060. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000060' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Not enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) 'instance-00000060' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18215131759643555 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:47.084 4088 3038342145832 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:47.084 4088 3038342145832 MainThread INFO nova.compute.manager [-] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] VM Stopped (Lifecycle Event) 2021-09-10 17:04:47.084 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000060" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:47.084 4088 3038342147768 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000060" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:47.114 4088 3038342145832 MainThread DEBUG nova.compute.manager [req-39ec738f-3243-472f-9149-01a511e688e4 - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:47.114 4088 3038342145832 MainThread DEBUG nova.virt.hyperv.vmops [req-39ec738f-3243-472f-9149-01a511e688e4 - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:47.144 4088 3038342147064 GreenThread-85 DEBUG nova.network.neutron [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Successfully updated port: ed824d46-e93d-4c2a-ba72-4cc6c08ed999 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:04:47.162 4088 3038342145832 MainThread DEBUG nova.compute.manager [req-39ec738f-3243-472f-9149-01a511e688e4 - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:47.188 4088 3038342147064 GreenThread-85 DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Acquired lock "refresh_cache-7bb24cc6-9fd0-42d3-8abb-a946f1ebc269" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:04:47.188 4088 3038342147064 GreenThread-85 DEBUG nova.network.neutron [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:04:47.222 4088 3038342145832 MainThread INFO nova.compute.manager [req-39ec738f-3243-472f-9149-01a511e688e4 - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:47.285 4088 3038342145832 MainThread DEBUG nova.compute.manager [req-746c91a2-d812-45dd-862d-bd6142f140db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Received event network-changed-ed824d46-e93d-4c2a-ba72-4cc6c08ed999 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:04:47.285 4088 3038342145832 MainThread DEBUG nova.compute.manager [req-746c91a2-d812-45dd-862d-bd6142f140db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Refreshing instance network info cache due to event network-changed-ed824d46-e93d-4c2a-ba72-4cc6c08ed999. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:04:47.425 4088 3038342147064 GreenThread-85 DEBUG nova.network.neutron [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:04:48.082 4088 3038342256424 MainThread DEBUG os_win.utils.jobutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Waiting for WMI job: {'InstanceID': 'BCD52221-F1B2-450C-B7FB-C94E85E1FA83', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16378), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:48.225 4088 3038342256424 MainThread ERROR os_win.utils.jobutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] WMI job failed: {'RawErrors': (('124\'instance-00000060\' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)instance-00000060AC205625-B22A-4193-912E-EBAEA0EB17B112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)instance-00000060AC205625-B22A-4193-912E-EBAEA0EB17B110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000060\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)instance-00000060AC205625-B22A-4193-912E-EBAEA0EB17B1%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BCD52221-F1B2-450C-B7FB-C94E85E1FA83', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114109), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 48), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 48), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000060' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)\n\nNot enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)\n\n'instance-00000060' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)", 'ErrorSummaryDescription': "'instance-00000060' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000060.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:48.225 4088 3038342256424 MainThread DEBUG os_win._utils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000060' failed to start. Not enough memory in the system to start the virtual machine instance-00000060. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000060' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Not enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) 'instance-00000060' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3560841083526611 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:48.255 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000060" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:48.255 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000060" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:48.255 4088 3038342146888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:48.255 4088 3038342146888 MainThread INFO nova.compute.manager [-] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] VM Stopped (Lifecycle Event) 2021-09-10 17:04:48.285 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-3111715d-7e8d-4e83-b583-e19f9e30e814 - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:48.300 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [req-3111715d-7e8d-4e83-b583-e19f9e30e814 - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:48.332 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-3111715d-7e8d-4e83-b583-e19f9e30e814 - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:48.379 4088 3038342146888 MainThread INFO nova.compute.manager [req-3111715d-7e8d-4e83-b583-e19f9e30e814 - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:48.519 4088 3038342147064 GreenThread-85 DEBUG nova.network.neutron [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Updating instance_info_cache with network_info: [{"id": "ed824d46-e93d-4c2a-ba72-4cc6c08ed999", "address": "fa:16:3e:7d:89:b2", "network": {"id": "94fe800d-2f58-4038-bad7-4a550b92b7da", "bridge": null, "label": "tempest-ServerAddressesNegativeTestJSON-129404465-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e40c2b3a02a2453b8747f81262f1ddbd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "taped824d46-e9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:04:48.571 4088 3038342147064 GreenThread-85 DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Releasing lock "refresh_cache-7bb24cc6-9fd0-42d3-8abb-a946f1ebc269" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:04:48.571 4088 3038342147064 GreenThread-85 DEBUG nova.compute.manager [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Instance network_info: |[{"id": "ed824d46-e93d-4c2a-ba72-4cc6c08ed999", "address": "fa:16:3e:7d:89:b2", "network": {"id": "94fe800d-2f58-4038-bad7-4a550b92b7da", "bridge": null, "label": "tempest-ServerAddressesNegativeTestJSON-129404465-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e40c2b3a02a2453b8747f81262f1ddbd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "taped824d46-e9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:04:48.571 4088 3038342145832 MainThread DEBUG oslo_concurrency.lockutils [req-746c91a2-d812-45dd-862d-bd6142f140db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-7bb24cc6-9fd0-42d3-8abb-a946f1ebc269" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:04:48.571 4088 3038342145832 MainThread DEBUG nova.network.neutron [req-746c91a2-d812-45dd-862d-bd6142f140db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Refreshing network info cache for port ed824d46-e93d-4c2a-ba72-4cc6c08ed999 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:04:48.571 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Preparing to wait for external event network-vif-plugged-ed824d46-e93d-4c2a-ba72-4cc6c08ed999 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:04:48.571 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Lock "7bb24cc6-9fd0-42d3-8abb-a946f1ebc269-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:48.571 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Lock "7bb24cc6-9fd0-42d3-8abb-a946f1ebc269-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:48.571 4088 3038342144600 MainThread DEBUG os_win.utils.compute.vmutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Creating VM instance-00000061 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:04:48.972 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Updating instance_info_cache with network_info: [{"id": "43904798-2eab-4ec0-9b1b-f79a929eba99", "address": "fa:16:3e:9c:26:60", "network": {"id": "7434a41e-b78f-4cb9-8ffe-b2514d097201", "bridge": null, "label": "tempest-LiveAutoBlockMigrationV225Test-1499875764-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91237ebda1b54d2dbc761e48fdd93516", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap43904798-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:04:49.013 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-359fd482-69f5-4194-9466-f46ea31258d3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:04:49.013 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:04:49.013 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:04:49.013 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:04:49.013 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:04:49.253 4088 3038342256424 MainThread DEBUG os_win.utils.jobutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Waiting for WMI job: {'InstanceID': '3C474E9F-87BC-4E6D-B451-2191EB073E2B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15684), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:49.412 4088 3038342256424 MainThread ERROR os_win.utils.jobutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] WMI job failed: {'RawErrors': (('124\'instance-00000060\' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)instance-00000060AC205625-B22A-4193-912E-EBAEA0EB17B112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)instance-00000060AC205625-B22A-4193-912E-EBAEA0EB17B110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000060\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)instance-00000060AC205625-B22A-4193-912E-EBAEA0EB17B1%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3C474E9F-87BC-4E6D-B451-2191EB073E2B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116696), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 49), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 49), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000060' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)\n\nNot enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)\n\n'instance-00000060' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)", 'ErrorSummaryDescription': "'instance-00000060' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000060.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:49.412 4088 3038342256424 MainThread DEBUG os_win._utils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000060' failed to start. Not enough memory in the system to start the virtual machine instance-00000060. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000060' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Not enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) 'instance-00000060' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.542891025543213 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:49.412 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000060" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:49.412 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000060" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:49.412 4088 3038340491224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:49.412 4088 3038340491224 MainThread INFO nova.compute.manager [-] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] VM Stopped (Lifecycle Event) 2021-09-10 17:04:49.472 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-b45057ca-94e4-4618-810a-99830c092cdd - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:49.472 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-b45057ca-94e4-4618-810a-99830c092cdd - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:49.612 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-b45057ca-94e4-4618-810a-99830c092cdd - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:49.722 4088 3038340491224 MainThread INFO nova.compute.manager [req-b45057ca-94e4-4618-810a-99830c092cdd - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:50.081 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:50.129 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:04:50.237 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:04:50.286 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:50.306 4088 3038342146888 MainThread DEBUG nova.virt.hardware [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:04:50.306 4088 3038342146888 MainThread INFO nova.compute.claims [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Claim successful on node n-h2-808474-1 2021-09-10 17:04:50.441 4088 3038342256424 MainThread DEBUG os_win.utils.jobutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Waiting for WMI job: {'InstanceID': '51891496-6886-4CC2-8BC7-1AD7F565ED5B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16080), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:50.581 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.hostops [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:04:50.581 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.hostops [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:04:50.613 4088 3038342256424 MainThread ERROR os_win.utils.jobutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] WMI job failed: {'RawErrors': (('124\'instance-00000060\' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)instance-00000060AC205625-B22A-4193-912E-EBAEA0EB17B112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)instance-00000060AC205625-B22A-4193-912E-EBAEA0EB17B110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000060\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)instance-00000060AC205625-B22A-4193-912E-EBAEA0EB17B1%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '51891496-6886-4CC2-8BC7-1AD7F565ED5B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119623), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 50), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 50), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000060' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)\n\nNot enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)\n\n'instance-00000060' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)", 'ErrorSummaryDescription': "'instance-00000060' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000060.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:50.613 4088 3038342256424 MainThread DEBUG os_win._utils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000060' failed to start. Not enough memory in the system to start the virtual machine instance-00000060. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000060' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Not enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) 'instance-00000060' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.744044303894043 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:50.629 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000060" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:50.629 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000060" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:50.629 4088 3038340491224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:50.629 4088 3038340491224 MainThread INFO nova.compute.manager [-] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] VM Stopped (Lifecycle Event) 2021-09-10 17:04:50.644 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-ffe843fe-513c-405d-9d65-552d47183282 - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:50.644 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-ffe843fe-513c-405d-9d65-552d47183282 - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:50.708 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-ffe843fe-513c-405d-9d65-552d47183282 - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:50.738 4088 3038340491224 MainThread INFO nova.compute.manager [req-ffe843fe-513c-405d-9d65-552d47183282 - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:50.810 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:04:50.810 4088 3038342145832 MainThread DEBUG nova.network.neutron [req-746c91a2-d812-45dd-862d-bd6142f140db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Updated VIF entry in instance network info cache for port ed824d46-e93d-4c2a-ba72-4cc6c08ed999. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:04:50.810 4088 3038342145832 MainThread DEBUG nova.network.neutron [req-746c91a2-d812-45dd-862d-bd6142f140db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Updating instance_info_cache with network_info: [{"id": "ed824d46-e93d-4c2a-ba72-4cc6c08ed999", "address": "fa:16:3e:7d:89:b2", "network": {"id": "94fe800d-2f58-4038-bad7-4a550b92b7da", "bridge": null, "label": "tempest-ServerAddressesNegativeTestJSON-129404465-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e40c2b3a02a2453b8747f81262f1ddbd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "taped824d46-e9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:04:50.819 4088 3038342145832 MainThread DEBUG oslo_concurrency.lockutils [req-746c91a2-d812-45dd-862d-bd6142f140db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-7bb24cc6-9fd0-42d3-8abb-a946f1ebc269" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:04:50.819 4088 3038342146888 MainThread DEBUG nova.compute.provider_tree [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:04:50.864 4088 3038342146888 MainThread DEBUG nova.scheduler.client.report [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:04:50.864 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:50.864 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:04:50.928 4088 3038342146888 MainThread DEBUG nova.compute.utils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 17:04:50.956 4088 3038340491224 GreenThread-86 DEBUG nova.compute.manager [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:04:50.956 4088 3038340491224 GreenThread-86 DEBUG nova.network.neutron [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:04:50.973 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:04:51.113 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:04:51.113 4088 3038340491224 GreenThread-86 DEBUG nova.policy [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3b19a6ed8024fe7b99f5aa4978b5af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecab78b34b0468f8c42e4b7f3444918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:04:51.132 4088 3038342146888 MainThread INFO nova.virt.hyperv.vmops [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Spawning new instance 2021-09-10 17:04:51.146 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000063" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:51.146 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000063" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:51.146 4088 3038342146888 MainThread DEBUG nova.block_device [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:04:51.146 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:51.146 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:51.146 4088 3038342146888 MainThread DEBUG os_win.utils.pathutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Creating directory: C:\openstack\instances\instance-00000063 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:04:51.146 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000063\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:04:51.410 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Resizing VHD C:\openstack\instances\instance-00000063\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:04:51.645 4088 3038342256424 MainThread DEBUG os_win.utils.jobutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Waiting for WMI job: {'InstanceID': '0CAD7F5F-4ABA-4801-BAC7-E13C4BB8271E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17276), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:51.801 4088 3038342256424 MainThread ERROR os_win.utils.jobutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] WMI job failed: {'RawErrors': (('124\'instance-00000060\' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)instance-00000060AC205625-B22A-4193-912E-EBAEA0EB17B112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)instance-00000060AC205625-B22A-4193-912E-EBAEA0EB17B110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000060\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)instance-00000060AC205625-B22A-4193-912E-EBAEA0EB17B1%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0CAD7F5F-4ABA-4801-BAC7-E13C4BB8271E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112290), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 51), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 51), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000060' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)\n\nNot enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)\n\n'instance-00000060' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)", 'ErrorSummaryDescription': "'instance-00000060' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000060.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:51.801 4088 3038342256424 MainThread DEBUG os_win._utils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000060' failed to start. Not enough memory in the system to start the virtual machine instance-00000060. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000060' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Not enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) 'instance-00000060' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.931712627410889 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:51.801 4088 3038342147064 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:51.801 4088 3038342147064 MainThread INFO nova.compute.manager [-] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] VM Stopped (Lifecycle Event) 2021-09-10 17:04:51.801 4088 3038342145832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000060" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:51.801 4088 3038342145832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000060" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:51.831 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-a308d486-e738-4280-8ba9-f44f8390c60b - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:51.831 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.vmops [req-a308d486-e738-4280-8ba9-f44f8390c60b - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:51.863 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-a308d486-e738-4280-8ba9-f44f8390c60b - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:51.911 4088 3038342147064 MainThread INFO nova.compute.manager [req-a308d486-e738-4280-8ba9-f44f8390c60b - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:52.593 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:04:52.598 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:52.598 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:52.613 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:04:52.613 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:04:52.628 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:04:52.833 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2203MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:04:52.833 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:52.848 4088 3038342256424 MainThread DEBUG os_win.utils.jobutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Waiting for WMI job: {'InstanceID': 'F57CC9BD-B6E2-4772-A32E-4FFD75CA5421', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=28100), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:53.005 4088 3038342256424 MainThread ERROR os_win.utils.jobutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] WMI job failed: {'RawErrors': (('124\'instance-00000060\' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)instance-00000060AC205625-B22A-4193-912E-EBAEA0EB17B112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)instance-00000060AC205625-B22A-4193-912E-EBAEA0EB17B110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000060\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)instance-00000060AC205625-B22A-4193-912E-EBAEA0EB17B1%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'F57CC9BD-B6E2-4772-A32E-4FFD75CA5421', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113243), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 52), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 52), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000060' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)\n\nNot enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)\n\n'instance-00000060' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1)", 'ErrorSummaryDescription': "'instance-00000060' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000060.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:53.005 4088 3038342256424 MainThread ERROR nova.virt.hyperv.vmops [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Failed to change vm state of instance-00000060 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000060' failed to start. 2021-09-10 17:04:53.005 4088 3038342256424 MainThread INFO nova.virt.hyperv.vmops [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Got request to destroy instance 2021-09-10 17:04:53.034 4088 3038342145832 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:53.053 4088 3038342145832 MainThread INFO nova.compute.manager [-] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] VM Stopped (Lifecycle Event) 2021-09-10 17:04:53.053 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000060" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:53.053 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000060" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:53.067 4088 3038342145832 MainThread DEBUG nova.compute.manager [req-3f88759c-8ca1-4116-80b1-0de951b0abcc - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:53.067 4088 3038342145832 MainThread DEBUG nova.virt.hyperv.vmops [req-3f88759c-8ca1-4116-80b1-0de951b0abcc - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:53.067 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:04:53.067 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:04:53.067 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:04:53.067 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:04:53.067 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:04:53.067 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:04:53.067 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:04:53.067 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:04:53.067 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:04:53.067 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:04:53.067 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:04:53.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:04:53.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:04:53.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 266ed819-0d7a-461a-91d1-188f0daec6fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:04:53.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:04:53.097 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:04:53.097 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 16 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:04:53.097 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=16896MB phys_disk=79GB used_disk=16GB total_vcpus=6 used_vcpus=16 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:04:53.145 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:04:53.145 4088 3038342145832 MainThread DEBUG nova.compute.manager [req-3f88759c-8ca1-4116-80b1-0de951b0abcc - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:53.161 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:04:53.175 4088 3038342145832 MainThread INFO nova.compute.manager [req-3f88759c-8ca1-4116-80b1-0de951b0abcc - - - - -] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:53.259 4088 3038340491224 GreenThread-86 DEBUG nova.network.neutron [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Successfully created port: 3bfe31b3-97ea-4264-aafc-63a2b2a58bec _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:04:53.445 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:04:53.445 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:04:53.445 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:04:53.445 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:54.502 4088 3038340491224 GreenThread-86 DEBUG nova.network.neutron [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Successfully updated port: 3bfe31b3-97ea-4264-aafc-63a2b2a58bec _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:04:54.535 4088 3038340491224 GreenThread-86 DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Acquired lock "refresh_cache-e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:04:54.535 4088 3038340491224 GreenThread-86 DEBUG nova.network.neutron [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:04:54.559 4088 3038342144952 MainThread DEBUG nova.compute.manager [req-b936745e-ce98-468b-a2bc-e937495b3fb6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Received event network-changed-3bfe31b3-97ea-4264-aafc-63a2b2a58bec external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:04:54.559 4088 3038342144952 MainThread DEBUG nova.compute.manager [req-b936745e-ce98-468b-a2bc-e937495b3fb6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Refreshing instance network info cache due to event network-changed-3bfe31b3-97ea-4264-aafc-63a2b2a58bec. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:04:54.691 4088 3038340491224 GreenThread-86 DEBUG nova.network.neutron [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:04:55.051 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.vmops [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:04:55.051 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Lock "instance-00000060" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:55.051 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Lock "instance-00000060" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:55.067 4088 3038342256424 MainThread DEBUG os_win.utils.compute.vmutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Successfully changed vm state of instance-00000060 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:04:55.067 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.vmops [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Successfully changed state of VM instance-00000060 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:04:55.118 4088 3038342256424 MainThread DEBUG os_win.utils.jobutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Waiting for WMI job: {'InstanceID': '78A48D54-5EE0-48F2-9226-1D95D53EC7BF', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14768), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:55.222 4088 3038342256424 MainThread DEBUG os_win.utils.jobutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] WMI job succeeded: {'InstanceID': '78A48D54-5EE0-48F2-9226-1D95D53EC7BF', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=112156), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:04:55.222 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Lock "instance-00000060" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:55.222 4088 3038342256424 MainThread DEBUG os_win.utils.pathutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Removing directory: C:\openstack\instances\instance-00000060 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:04:55.222 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Lock "instance-00000060" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:55.222 4088 3038342256424 MainThread ERROR nova.compute.manager [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000060' failed to start. Not enough memory in the system to start the virtual machine instance-00000060. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000060' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Not enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) 'instance-00000060' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Error code: 32778. 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Traceback (most recent call last): 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] return function(*args, **kwargs) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] admin_password, network_info, block_device_info) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] return function(self, *args, **kwds) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self.force_reraise() 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] raise self.value 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] should_plug_vifs=False) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 'req_state': req_state}) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self.force_reraise() 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] raise self.value 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] time.sleep(sleep_time) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self.force_reraise() 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] raise self.value 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] return f(*args, **kwargs) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] return self._wait_for_job(job_path) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] error_desc=err_desc) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000060' failed to start. 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Not enough memory in the system to start the virtual machine instance-00000060. 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000060' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Not enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 'instance-00000060' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Error code: 32778. 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] During handling of the above exception, another exception occurred: 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Traceback (most recent call last): 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] yield resources 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] accel_info=accel_info) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] return function(*args, **kwargs) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] admin_password, network_info, block_device_info) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] return function(self, *args, **kwds) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self.force_reraise() 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] raise self.value 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] should_plug_vifs=False) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 'req_state': req_state}) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self.force_reraise() 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] raise self.value 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] time.sleep(sleep_time) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self.force_reraise() 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] raise self.value 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] return f(*args, **kwargs) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] return self._wait_for_job(job_path) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] error_desc=err_desc) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000060' failed to start. 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Not enough memory in the system to start the virtual machine instance-00000060. 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000060' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Not enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 'instance-00000060' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Error code: 32778. 2021-09-10 17:04:55.222 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.222 4088 3038342256424 MainThread INFO nova.compute.manager [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Terminating instance 2021-09-10 17:04:55.222 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:04:55.222 4088 3038342256424 MainThread INFO nova.virt.hyperv.vmops [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Got request to destroy instance 2021-09-10 17:04:55.274 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.vmops [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:04:55.274 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Lock "instance-00000060" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:55.274 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Lock "instance-00000060" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:55.274 4088 3038342256424 MainThread INFO nova.compute.manager [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Took 0.05 seconds to destroy the instance on the hypervisor. 2021-09-10 17:04:55.274 4088 3038342256424 MainThread DEBUG nova.compute.claims [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:04:55.274 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:55.429 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.hostops [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:04:55.456 4088 3038342256424 MainThread DEBUG nova.virt.hyperv.hostops [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:04:55.565 4088 3038340491224 GreenThread-86 DEBUG nova.network.neutron [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Updating instance_info_cache with network_info: [{"id": "3bfe31b3-97ea-4264-aafc-63a2b2a58bec", "address": "fa:16:3e:e7:45:cf", "network": {"id": "8a0fc2b4-bff6-4887-a969-81fb448d568f", "bridge": null, "label": "tempest-DeleteServersTestJSON-1414296899-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "eecab78b34b0468f8c42e4b7f3444918", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap3bfe31b3-97", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:04:55.581 4088 3038340491224 GreenThread-86 DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Releasing lock "refresh_cache-e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:04:55.581 4088 3038340491224 GreenThread-86 DEBUG nova.compute.manager [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Instance network_info: |[{"id": "3bfe31b3-97ea-4264-aafc-63a2b2a58bec", "address": "fa:16:3e:e7:45:cf", "network": {"id": "8a0fc2b4-bff6-4887-a969-81fb448d568f", "bridge": null, "label": "tempest-DeleteServersTestJSON-1414296899-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "eecab78b34b0468f8c42e4b7f3444918", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap3bfe31b3-97", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:04:55.581 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Preparing to wait for external event network-vif-plugged-3bfe31b3-97ea-4264-aafc-63a2b2a58bec prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:04:55.581 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:55.581 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:55.609 4088 3038342146888 MainThread DEBUG os_win.utils.compute.vmutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Creating VM instance-00000063 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:04:55.609 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [req-b936745e-ce98-468b-a2bc-e937495b3fb6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:04:55.609 4088 3038342144952 MainThread DEBUG nova.network.neutron [req-b936745e-ce98-468b-a2bc-e937495b3fb6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Refreshing network info cache for port 3bfe31b3-97ea-4264-aafc-63a2b2a58bec _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:04:55.660 4088 3038342256424 MainThread DEBUG nova.compute.provider_tree [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:04:55.693 4088 3038342256424 MainThread DEBUG nova.scheduler.client.report [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:04:55.693 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:55.693 4088 3038342256424 MainThread ERROR nova.compute.manager [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000060' failed to start. Not enough memory in the system to start the virtual machine instance-00000060. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000060' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Not enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) 'instance-00000060' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Error code: 32778. 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Traceback (most recent call last): 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] return function(*args, **kwargs) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] admin_password, network_info, block_device_info) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] return function(self, *args, **kwds) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self.force_reraise() 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] raise self.value 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] should_plug_vifs=False) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 'req_state': req_state}) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self.force_reraise() 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] raise self.value 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] time.sleep(sleep_time) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self.force_reraise() 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] raise self.value 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] return f(*args, **kwargs) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] return self._wait_for_job(job_path) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] error_desc=err_desc) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000060' failed to start. 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Not enough memory in the system to start the virtual machine instance-00000060. 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000060' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Not enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 'instance-00000060' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Error code: 32778. 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] During handling of the above exception, another exception occurred: 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Traceback (most recent call last): 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] accel_info=accel_info) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] return function(*args, **kwargs) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] admin_password, network_info, block_device_info) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] return function(self, *args, **kwds) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self.force_reraise() 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] raise self.value 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] should_plug_vifs=False) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 'req_state': req_state}) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self.force_reraise() 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] raise self.value 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] time.sleep(sleep_time) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self.force_reraise() 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] raise self.value 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] return f(*args, **kwargs) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] return self._wait_for_job(job_path) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] error_desc=err_desc) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000060' failed to start. 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Not enough memory in the system to start the virtual machine instance-00000060. 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000060' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Not enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 'instance-00000060' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Error code: 32778. 2021-09-10 17:04:55.693 4088 3038342256424 MainThread TRACE nova.compute.manager [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] 2021-09-10 17:04:55.693 4088 3038342256424 MainThread DEBUG nova.compute.utils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] WMI job failed with status 10. Error summary description: 'instance-00000060' failed to start. Not enough memory in the system to start the virtual machine instance-00000060. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:04:55.693 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Build of instance 266ed819-0d7a-461a-91d1-188f0daec6fa was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000060' failed to start. Not enough memory in the system to start the virtual machine instance-00000060. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000060' failed to start. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Not enough memory in the system to start the virtual machine instance-00000060 with ram size 1024 megabytes. (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) 'instance-00000060' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AC205625-B22A-4193-912E-EBAEA0EB17B1) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:04:55.709 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:04:55.709 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:04:55.709 4088 3038342256424 MainThread DEBUG nova.compute.manager [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:04:55.709 4088 3038342256424 MainThread DEBUG nova.network.neutron [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:04:56.521 4088 3038342256424 MainThread DEBUG nova.network.neutron [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:04:56.549 4088 3038342256424 MainThread INFO nova.compute.manager [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] [instance: 266ed819-0d7a-461a-91d1-188f0daec6fa] Took 0.84 seconds to deallocate network for instance. 2021-09-10 17:04:56.768 4088 3038342256424 MainThread INFO nova.scheduler.client.report [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Deleted allocations for instance 266ed819-0d7a-461a-91d1-188f0daec6fa 2021-09-10 17:04:56.802 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [req-0203215f-f540-4d7c-8ad9-e81cc8b5f1d2 3cd10bcdfa0441069cf30193fce4ef96 a35f4d0e56d743a8a248b3c564c45f4e - default default] Lock "266ed819-0d7a-461a-91d1-188f0daec6fa" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 26.390s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:57.081 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-42b13417-d247-4184-ae25-8c4df530aefb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Received event network-vif-plugged-ed824d46-e93d-4c2a-ba72-4cc6c08ed999 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:04:57.081 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-42b13417-d247-4184-ae25-8c4df530aefb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "7bb24cc6-9fd0-42d3-8abb-a946f1ebc269-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:57.081 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-42b13417-d247-4184-ae25-8c4df530aefb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "7bb24cc6-9fd0-42d3-8abb-a946f1ebc269-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:57.081 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-42b13417-d247-4184-ae25-8c4df530aefb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Processing event network-vif-plugged-ed824d46-e93d-4c2a-ba72-4cc6c08ed999 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:04:57.128 4088 3038342144600 MainThread INFO nova.virt.hyperv.vmops [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Using config drive for instance 2021-09-10 17:04:57.271 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:04:57.424 4088 3038342144600 MainThread INFO nova.virt.hyperv.vmops [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Creating config drive at C:\openstack\instances\instance-00000061\configdrive.iso 2021-09-10 17:04:57.505 4088 3038342144600 MainThread DEBUG oslo_concurrency.processutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000061\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmptxkje__r execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:04:57.818 4088 3038342144952 MainThread DEBUG nova.network.neutron [req-b936745e-ce98-468b-a2bc-e937495b3fb6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Updated VIF entry in instance network info cache for port 3bfe31b3-97ea-4264-aafc-63a2b2a58bec. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:04:57.818 4088 3038342144952 MainThread DEBUG nova.network.neutron [req-b936745e-ce98-468b-a2bc-e937495b3fb6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Updating instance_info_cache with network_info: [{"id": "3bfe31b3-97ea-4264-aafc-63a2b2a58bec", "address": "fa:16:3e:e7:45:cf", "network": {"id": "8a0fc2b4-bff6-4887-a969-81fb448d568f", "bridge": null, "label": "tempest-DeleteServersTestJSON-1414296899-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "eecab78b34b0468f8c42e4b7f3444918", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap3bfe31b3-97", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:04:57.818 4088 3038342144600 MainThread DEBUG oslo_concurrency.processutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000061\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmptxkje__r" returned: 0 in 0.313s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:04:57.848 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [req-b936745e-ce98-468b-a2bc-e937495b3fb6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:04:58.365 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Setting boot order for instance: instance-00000061: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:04:58.472 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:04:58.503 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Waiting for WMI job: {'InstanceID': 'C8394807-2A4F-4F0E-AC63-FD43A379E72D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18694), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:58.675 4088 3038342144600 MainThread ERROR os_win.utils.jobutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] WMI job failed: {'RawErrors': (('124\'instance-00000061\' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)instance-000000613783A345-D90B-4870-A2A4-E08CDE08419A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)instance-000000613783A345-D90B-4870-A2A4-E08CDE08419A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000061\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)instance-000000613783A345-D90B-4870-A2A4-E08CDE08419A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C8394807-2A4F-4F0E-AC63-FD43A379E72D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=136557), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 58), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 58), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000061' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)\n\nNot enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)\n\n'instance-00000061' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)", 'ErrorSummaryDescription': "'instance-00000061' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000061.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:58.675 4088 3038342144600 MainThread DEBUG os_win._utils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000061' failed to start. Not enough memory in the system to start the virtual machine instance-00000061. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000061' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Not enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) 'instance-00000061' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.20277714729309082 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:58.725 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000061" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:58.725 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000061" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:58.725 4088 3038340491224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:58.725 4088 3038340491224 MainThread INFO nova.compute.manager [-] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] VM Stopped (Lifecycle Event) 2021-09-10 17:04:58.768 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-ca7c0ab6-9096-4c9f-a222-fb2d5715834b - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:58.768 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-ca7c0ab6-9096-4c9f-a222-fb2d5715834b - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:58.826 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-ca7c0ab6-9096-4c9f-a222-fb2d5715834b - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:58.866 4088 3038340491224 MainThread INFO nova.compute.manager [req-ca7c0ab6-9096-4c9f-a222-fb2d5715834b - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:04:59.706 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Waiting for WMI job: {'InstanceID': 'DACC02C3-8ABD-4A07-88DA-F3A1D231FA44', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17415), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:04:59.850 4088 3038342144600 MainThread ERROR os_win.utils.jobutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] WMI job failed: {'RawErrors': (('124\'instance-00000061\' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)instance-000000613783A345-D90B-4870-A2A4-E08CDE08419A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)instance-000000613783A345-D90B-4870-A2A4-E08CDE08419A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000061\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)instance-000000613783A345-D90B-4870-A2A4-E08CDE08419A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'DACC02C3-8ABD-4A07-88DA-F3A1D231FA44', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110482), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 4, 59), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 4, 59), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000061' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)\n\nNot enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)\n\n'instance-00000061' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)", 'ErrorSummaryDescription': "'instance-00000061' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000061.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:04:59.850 4088 3038342144600 MainThread DEBUG os_win._utils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000061' failed to start. Not enough memory in the system to start the virtual machine instance-00000061. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000061' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Not enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) 'instance-00000061' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3777086734771729 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:04:59.882 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000061" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:04:59.882 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000061" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:04:59.882 4088 3038340491224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:04:59.882 4088 3038340491224 MainThread INFO nova.compute.manager [-] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] VM Stopped (Lifecycle Event) 2021-09-10 17:04:59.909 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-e0e6b267-4378-4b24-a1cf-546b30273b87 - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:04:59.909 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-e0e6b267-4378-4b24-a1cf-546b30273b87 - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:04:59.957 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-e0e6b267-4378-4b24-a1cf-546b30273b87 - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:04:59.977 4088 3038340491224 MainThread INFO nova.compute.manager [req-e0e6b267-4378-4b24-a1cf-546b30273b87 - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:00.888 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Waiting for WMI job: {'InstanceID': '672C79E3-7B2B-4398-9A21-7320EE5117A9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15742), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:01.034 4088 3038342144600 MainThread ERROR os_win.utils.jobutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] WMI job failed: {'RawErrors': (('124\'instance-00000061\' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)instance-000000613783A345-D90B-4870-A2A4-E08CDE08419A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)instance-000000613783A345-D90B-4870-A2A4-E08CDE08419A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000061\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)instance-000000613783A345-D90B-4870-A2A4-E08CDE08419A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '672C79E3-7B2B-4398-9A21-7320EE5117A9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114915), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000061' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)\n\nNot enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)\n\n'instance-00000061' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)", 'ErrorSummaryDescription': "'instance-00000061' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000061.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:01.034 4088 3038342144600 MainThread DEBUG os_win._utils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000061' failed to start. Not enough memory in the system to start the virtual machine instance-00000061. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000061' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Not enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) 'instance-00000061' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.561601400375366 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:01.069 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000061" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:01.069 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000061" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:01.069 4088 3038340491224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:01.069 4088 3038340491224 MainThread INFO nova.compute.manager [-] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] VM Stopped (Lifecycle Event) 2021-09-10 17:05:01.082 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-9f3c93d1-95aa-4f54-87bb-3d42bcce6d0c - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:01.103 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-9f3c93d1-95aa-4f54-87bb-3d42bcce6d0c - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:01.144 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-9f3c93d1-95aa-4f54-87bb-3d42bcce6d0c - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:01.176 4088 3038340491224 MainThread INFO nova.compute.manager [req-9f3c93d1-95aa-4f54-87bb-3d42bcce6d0c - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:02.051 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Waiting for WMI job: {'InstanceID': '99B066A5-3A32-4976-8D81-6788D98BABDF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15073), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:02.208 4088 3038342144600 MainThread ERROR os_win.utils.jobutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] WMI job failed: {'RawErrors': (('124\'instance-00000061\' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)instance-000000613783A345-D90B-4870-A2A4-E08CDE08419A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)instance-000000613783A345-D90B-4870-A2A4-E08CDE08419A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000061\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)instance-000000613783A345-D90B-4870-A2A4-E08CDE08419A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '99B066A5-3A32-4976-8D81-6788D98BABDF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118608), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 2), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 2), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000061' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)\n\nNot enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)\n\n'instance-00000061' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)", 'ErrorSummaryDescription': "'instance-00000061' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000061.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:02.208 4088 3038342144600 MainThread DEBUG os_win._utils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000061' failed to start. Not enough memory in the system to start the virtual machine instance-00000061. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000061' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Not enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) 'instance-00000061' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.735410213470459 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:02.231 4088 3038340491224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:02.231 4088 3038340491224 MainThread INFO nova.compute.manager [-] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] VM Stopped (Lifecycle Event) 2021-09-10 17:05:02.231 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000061" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:02.231 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000061" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:02.255 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-789bb4ad-2dfc-4b57-b240-a5dc00f0de47 - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:02.269 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-789bb4ad-2dfc-4b57-b240-a5dc00f0de47 - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:02.384 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-789bb4ad-2dfc-4b57-b240-a5dc00f0de47 - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:02.422 4088 3038340491224 MainThread INFO nova.compute.manager [req-789bb4ad-2dfc-4b57-b240-a5dc00f0de47 - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:03.253 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Waiting for WMI job: {'InstanceID': '5BD21B92-AB57-4466-9A02-EF89AB77F613', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15699), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:03.395 4088 3038342144600 MainThread ERROR os_win.utils.jobutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] WMI job failed: {'RawErrors': (('124\'instance-00000061\' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)instance-000000613783A345-D90B-4870-A2A4-E08CDE08419A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)instance-000000613783A345-D90B-4870-A2A4-E08CDE08419A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000061\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)instance-000000613783A345-D90B-4870-A2A4-E08CDE08419A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5BD21B92-AB57-4466-9A02-EF89AB77F613', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118272), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 3), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000061' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)\n\nNot enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)\n\n'instance-00000061' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)", 'ErrorSummaryDescription': "'instance-00000061' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000061.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:03.395 4088 3038342144600 MainThread DEBUG os_win._utils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000061' failed to start. Not enough memory in the system to start the virtual machine instance-00000061. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000061' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Not enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) 'instance-00000061' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.922717809677124 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:03.427 4088 3038340491224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:03.427 4088 3038340491224 MainThread INFO nova.compute.manager [-] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] VM Stopped (Lifecycle Event) 2021-09-10 17:05:03.427 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000061" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:03.427 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000061" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:03.442 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-4f22ec5d-2af3-42df-a7e1-f8b65d9622aa - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:03.442 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-4f22ec5d-2af3-42df-a7e1-f8b65d9622aa - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:03.507 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-4f22ec5d-2af3-42df-a7e1-f8b65d9622aa - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:03.520 4088 3038340491224 MainThread INFO nova.compute.manager [req-4f22ec5d-2af3-42df-a7e1-f8b65d9622aa - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:04.425 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Waiting for WMI job: {'InstanceID': '31239A39-E03F-4694-92CC-E65E7AF1E782', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15701), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:04.570 4088 3038342144600 MainThread ERROR os_win.utils.jobutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] WMI job failed: {'RawErrors': (('124\'instance-00000061\' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)instance-000000613783A345-D90B-4870-A2A4-E08CDE08419A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)instance-000000613783A345-D90B-4870-A2A4-E08CDE08419A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000061\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)instance-000000613783A345-D90B-4870-A2A4-E08CDE08419A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '31239A39-E03F-4694-92CC-E65E7AF1E782', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=128558), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 4), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000061' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)\n\nNot enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)\n\n'instance-00000061' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A)", 'ErrorSummaryDescription': "'instance-00000061' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000061.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:04.570 4088 3038342144600 MainThread ERROR nova.virt.hyperv.vmops [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Failed to change vm state of instance-00000061 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000061' failed to start. 2021-09-10 17:05:04.570 4088 3038342144600 MainThread INFO nova.virt.hyperv.vmops [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Got request to destroy instance 2021-09-10 17:05:04.598 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000061" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:04.614 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000061" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:04.614 4088 3038340491224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:04.614 4088 3038340491224 MainThread INFO nova.compute.manager [-] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] VM Stopped (Lifecycle Event) 2021-09-10 17:05:04.629 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-686140e1-c713-49dc-bd42-c8ef7d43848c - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:04.629 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-686140e1-c713-49dc-bd42-c8ef7d43848c - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:04.676 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-686140e1-c713-49dc-bd42-c8ef7d43848c - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:04.708 4088 3038340491224 MainThread INFO nova.compute.manager [req-686140e1-c713-49dc-bd42-c8ef7d43848c - - - - -] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:05.052 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-1b89182a-7f04-4f44-9eee-a7a9fbae5cd3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Received event network-vif-plugged-3bfe31b3-97ea-4264-aafc-63a2b2a58bec external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:05:05.052 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-1b89182a-7f04-4f44-9eee-a7a9fbae5cd3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:05.052 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-1b89182a-7f04-4f44-9eee-a7a9fbae5cd3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:05.052 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-1b89182a-7f04-4f44-9eee-a7a9fbae5cd3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Processing event network-vif-plugged-3bfe31b3-97ea-4264-aafc-63a2b2a58bec _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:05:05.098 4088 3038342146888 MainThread INFO nova.virt.hyperv.vmops [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Using config drive for instance 2021-09-10 17:05:05.520 4088 3038342146888 MainThread INFO nova.virt.hyperv.vmops [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Creating config drive at C:\openstack\instances\instance-00000063\configdrive.iso 2021-09-10 17:05:05.627 4088 3038342146888 MainThread DEBUG oslo_concurrency.processutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000063\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp1pbns1yu execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:05:05.940 4088 3038342146888 MainThread DEBUG oslo_concurrency.processutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000063\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp1pbns1yu" returned: 0 in 0.313s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:05:06.471 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Setting boot order for instance: instance-00000063: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:05:06.599 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:05:06.628 4088 3038342146888 MainThread DEBUG os_win.utils.jobutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '98CA767C-A33F-4E85-8A68-E66952A49DEA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18975), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:06.768 4088 3038342146888 MainThread ERROR os_win.utils.jobutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000063\' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)instance-000000630A833091-911B-40EB-9DB2-A9D8D1F21AEC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)instance-000000630A833091-911B-40EB-9DB2-A9D8D1F21AEC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000063\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)instance-000000630A833091-911B-40EB-9DB2-A9D8D1F21AEC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '98CA767C-A33F-4E85-8A68-E66952A49DEA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115668), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 6), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 6), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000063' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)\n\nNot enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)\n\n'instance-00000063' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)", 'ErrorSummaryDescription': "'instance-00000063' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000063.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:06.768 4088 3038342146888 MainThread DEBUG os_win._utils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000063' failed to start. Not enough memory in the system to start the virtual machine instance-00000063. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000063' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Not enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) 'instance-00000063' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1691572666168213 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:06.803 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000063" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:06.803 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000063" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:06.803 4088 3038340491224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:06.803 4088 3038340491224 MainThread INFO nova.compute.manager [-] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] VM Stopped (Lifecycle Event) 2021-09-10 17:05:06.817 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-22f3ea68-ff94-415c-a5ba-6fefa8ef2a11 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:06.817 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-22f3ea68-ff94-415c-a5ba-6fefa8ef2a11 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:06.864 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:05:06.864 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Lock "instance-00000061" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:06.864 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Lock "instance-00000061" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:06.878 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-22f3ea68-ff94-415c-a5ba-6fefa8ef2a11 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:06.878 4088 3038342144600 MainThread DEBUG os_win.utils.compute.vmutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Successfully changed vm state of instance-00000061 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:05:06.878 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Successfully changed state of VM instance-00000061 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:05:06.911 4088 3038340491224 MainThread INFO nova.compute.manager [req-22f3ea68-ff94-415c-a5ba-6fefa8ef2a11 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:06.926 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Waiting for WMI job: {'InstanceID': '25E678B2-4CFB-4B9B-B76D-FC509AA885B9', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14942), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:07.049 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] WMI job succeeded: {'InstanceID': '25E678B2-4CFB-4B9B-B76D-FC509AA885B9', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=102017), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:05:07.049 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Lock "instance-00000061" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:07.049 4088 3038342144600 MainThread DEBUG os_win.utils.pathutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Removing directory: C:\openstack\instances\instance-00000061 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:05:07.049 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Lock "instance-00000061" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:07.049 4088 3038342144600 MainThread ERROR nova.compute.manager [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000061' failed to start. Not enough memory in the system to start the virtual machine instance-00000061. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000061' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Not enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) 'instance-00000061' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Error code: 32778. 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Traceback (most recent call last): 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] return function(*args, **kwargs) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] admin_password, network_info, block_device_info) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] return function(self, *args, **kwds) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self.force_reraise() 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] raise self.value 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] should_plug_vifs=False) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 'req_state': req_state}) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self.force_reraise() 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] raise self.value 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] time.sleep(sleep_time) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self.force_reraise() 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] raise self.value 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] return f(*args, **kwargs) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] return self._wait_for_job(job_path) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] error_desc=err_desc) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000061' failed to start. 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Not enough memory in the system to start the virtual machine instance-00000061. 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000061' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Not enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 'instance-00000061' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Error code: 32778. 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] During handling of the above exception, another exception occurred: 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Traceback (most recent call last): 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] yield resources 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] accel_info=accel_info) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] return function(*args, **kwargs) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] admin_password, network_info, block_device_info) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] return function(self, *args, **kwds) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self.force_reraise() 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] raise self.value 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] should_plug_vifs=False) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 'req_state': req_state}) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self.force_reraise() 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] raise self.value 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] time.sleep(sleep_time) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self.force_reraise() 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] raise self.value 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] return f(*args, **kwargs) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] return self._wait_for_job(job_path) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] error_desc=err_desc) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000061' failed to start. 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Not enough memory in the system to start the virtual machine instance-00000061. 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000061' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Not enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 'instance-00000061' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Error code: 32778. 2021-09-10 17:05:07.049 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.049 4088 3038342144600 MainThread INFO nova.compute.manager [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Terminating instance 2021-09-10 17:05:07.049 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:05:07.049 4088 3038342144600 MainThread INFO nova.virt.hyperv.vmops [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Got request to destroy instance 2021-09-10 17:05:07.075 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:05:07.075 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Lock "instance-00000061" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:07.075 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Lock "instance-00000061" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:07.075 4088 3038342144600 MainThread INFO nova.compute.manager [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:05:07.075 4088 3038342144600 MainThread DEBUG nova.compute.claims [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:05:07.075 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:07.208 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.hostops [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:05:07.208 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.hostops [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:05:07.441 4088 3038342144600 MainThread DEBUG nova.compute.provider_tree [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:05:07.471 4088 3038342144600 MainThread DEBUG nova.scheduler.client.report [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:05:07.471 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.390s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:07.471 4088 3038342144600 MainThread ERROR nova.compute.manager [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000061' failed to start. Not enough memory in the system to start the virtual machine instance-00000061. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000061' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Not enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) 'instance-00000061' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Error code: 32778. 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Traceback (most recent call last): 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] return function(*args, **kwargs) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] admin_password, network_info, block_device_info) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] return function(self, *args, **kwds) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self.force_reraise() 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] raise self.value 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] should_plug_vifs=False) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 'req_state': req_state}) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self.force_reraise() 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] raise self.value 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] time.sleep(sleep_time) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self.force_reraise() 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] raise self.value 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] return f(*args, **kwargs) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] return self._wait_for_job(job_path) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] error_desc=err_desc) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000061' failed to start. 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Not enough memory in the system to start the virtual machine instance-00000061. 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000061' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Not enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 'instance-00000061' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Error code: 32778. 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] During handling of the above exception, another exception occurred: 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Traceback (most recent call last): 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] accel_info=accel_info) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] return function(*args, **kwargs) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] admin_password, network_info, block_device_info) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] return function(self, *args, **kwds) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self.force_reraise() 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] raise self.value 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] should_plug_vifs=False) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 'req_state': req_state}) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self.force_reraise() 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] raise self.value 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] time.sleep(sleep_time) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self.force_reraise() 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] raise self.value 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] return f(*args, **kwargs) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] return self._wait_for_job(job_path) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] error_desc=err_desc) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000061' failed to start. 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Not enough memory in the system to start the virtual machine instance-00000061. 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000061' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Not enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 'instance-00000061' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Error code: 32778. 2021-09-10 17:05:07.471 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] 2021-09-10 17:05:07.471 4088 3038342144600 MainThread DEBUG nova.compute.utils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] WMI job failed with status 10. Error summary description: 'instance-00000061' failed to start. Not enough memory in the system to start the virtual machine instance-00000061. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:05:07.471 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Build of instance 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000061' failed to start. Not enough memory in the system to start the virtual machine instance-00000061. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000061' failed to start. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Not enough memory in the system to start the virtual machine instance-00000061 with ram size 1024 megabytes. (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) 'instance-00000061' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3783A345-D90B-4870-A2A4-E08CDE08419A) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:05:07.471 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:05:07.471 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:05:07.471 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:05:07.471 4088 3038342144600 MainThread DEBUG nova.network.neutron [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:05:07.804 4088 3038342146888 MainThread DEBUG os_win.utils.jobutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '4AD12B1A-232A-4C16-B34D-FA3C979C9BF7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=22209), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:07.942 4088 3038342146888 MainThread ERROR os_win.utils.jobutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000063\' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)instance-000000630A833091-911B-40EB-9DB2-A9D8D1F21AEC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)instance-000000630A833091-911B-40EB-9DB2-A9D8D1F21AEC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000063\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)instance-000000630A833091-911B-40EB-9DB2-A9D8D1F21AEC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4AD12B1A-232A-4C16-B34D-FA3C979C9BF7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111991), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 7), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000063' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)\n\nNot enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)\n\n'instance-00000063' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)", 'ErrorSummaryDescription': "'instance-00000063' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000063.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:07.942 4088 3038342146888 MainThread DEBUG os_win._utils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000063' failed to start. Not enough memory in the system to start the virtual machine instance-00000063. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000063' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Not enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) 'instance-00000063' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3436641693115234 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:07.989 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000063" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:07.989 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000063" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:07.989 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:07.989 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] VM Stopped (Lifecycle Event) 2021-09-10 17:05:08.021 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-4ed58fd7-e6b5-4052-8982-5c967890cc5a - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:08.021 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-4ed58fd7-e6b5-4052-8982-5c967890cc5a - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:08.066 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-4ed58fd7-e6b5-4052-8982-5c967890cc5a - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:08.115 4088 3038340489992 MainThread INFO nova.compute.manager [req-4ed58fd7-e6b5-4052-8982-5c967890cc5a - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:08.973 4088 3038342146888 MainThread DEBUG os_win.utils.jobutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '3D0652D8-E25B-47F5-83A9-E90EBAF3F6A3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15426), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:09.114 4088 3038342146888 MainThread ERROR os_win.utils.jobutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000063\' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)instance-000000630A833091-911B-40EB-9DB2-A9D8D1F21AEC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)instance-000000630A833091-911B-40EB-9DB2-A9D8D1F21AEC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000063\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)instance-000000630A833091-911B-40EB-9DB2-A9D8D1F21AEC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3D0652D8-E25B-47F5-83A9-E90EBAF3F6A3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114357), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 8), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 9), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000063' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)\n\nNot enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)\n\n'instance-00000063' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)", 'ErrorSummaryDescription': "'instance-00000063' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000063.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:09.114 4088 3038342146888 MainThread DEBUG os_win._utils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000063' failed to start. Not enough memory in the system to start the virtual machine instance-00000063. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000063' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Not enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) 'instance-00000063' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5154380798339844 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:09.147 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:09.147 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] VM Stopped (Lifecycle Event) 2021-09-10 17:05:09.147 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000063" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:09.147 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000063" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:09.190 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-0f0e96fa-986c-4b4a-a43e-e3b6008a6a01 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:09.190 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-0f0e96fa-986c-4b4a-a43e-e3b6008a6a01 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:09.240 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-0f0e96fa-986c-4b4a-a43e-e3b6008a6a01 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:09.268 4088 3038340489992 MainThread INFO nova.compute.manager [req-0f0e96fa-986c-4b4a-a43e-e3b6008a6a01 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:10.147 4088 3038342146888 MainThread DEBUG os_win.utils.jobutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '2B6DC73E-9CD2-4471-B963-30201637DBC9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17690), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:10.221 4088 3038342144600 MainThread DEBUG nova.network.neutron [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:05:10.255 4088 3038342144600 MainThread INFO nova.compute.manager [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] [instance: 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269] Took 2.78 seconds to deallocate network for instance. 2021-09-10 17:05:10.284 4088 3038342146888 MainThread ERROR os_win.utils.jobutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000063\' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)instance-000000630A833091-911B-40EB-9DB2-A9D8D1F21AEC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)instance-000000630A833091-911B-40EB-9DB2-A9D8D1F21AEC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000063\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)instance-000000630A833091-911B-40EB-9DB2-A9D8D1F21AEC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '2B6DC73E-9CD2-4471-B963-30201637DBC9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112322), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 10), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 10), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000063' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)\n\nNot enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)\n\n'instance-00000063' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)", 'ErrorSummaryDescription': "'instance-00000063' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000063.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:10.284 4088 3038342146888 MainThread DEBUG os_win._utils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000063' failed to start. Not enough memory in the system to start the virtual machine instance-00000063. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000063' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Not enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) 'instance-00000063' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.6853220462799072 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:10.314 4088 3038340492280 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:10.314 4088 3038340492280 MainThread INFO nova.compute.manager [-] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] VM Stopped (Lifecycle Event) 2021-09-10 17:05:10.314 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000063" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:10.314 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000063" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:10.362 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-d30e6f2a-ff65-4267-a3b7-a53f256eeb98 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:10.362 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-d30e6f2a-ff65-4267-a3b7-a53f256eeb98 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:10.411 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-d30e6f2a-ff65-4267-a3b7-a53f256eeb98 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:10.456 4088 3038340492280 MainThread INFO nova.compute.manager [req-d30e6f2a-ff65-4267-a3b7-a53f256eeb98 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:10.503 4088 3038342144600 MainThread INFO nova.scheduler.client.report [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Deleted allocations for instance 7bb24cc6-9fd0-42d3-8abb-a946f1ebc269 2021-09-10 17:05:10.550 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-a4793500-f986-4d94-9634-c0309828872c 30f08d002bf64c7db4d91135559d5b8d e40c2b3a02a2453b8747f81262f1ddbd - default default] Lock "7bb24cc6-9fd0-42d3-8abb-a946f1ebc269" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 29.562s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:11.317 4088 3038342146888 MainThread DEBUG os_win.utils.jobutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '15BE760A-F517-4F2C-B11E-66784785B922', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15807), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:11.457 4088 3038342146888 MainThread ERROR os_win.utils.jobutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000063\' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)instance-000000630A833091-911B-40EB-9DB2-A9D8D1F21AEC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)instance-000000630A833091-911B-40EB-9DB2-A9D8D1F21AEC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000063\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)instance-000000630A833091-911B-40EB-9DB2-A9D8D1F21AEC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '15BE760A-F517-4F2C-B11E-66784785B922', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113946), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 11), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 11), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000063' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)\n\nNot enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)\n\n'instance-00000063' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)", 'ErrorSummaryDescription': "'instance-00000063' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000063.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:11.457 4088 3038342146888 MainThread DEBUG os_win._utils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000063' failed to start. Not enough memory in the system to start the virtual machine instance-00000063. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000063' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Not enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) 'instance-00000063' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.8585968017578125 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:11.489 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:11.489 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] VM Stopped (Lifecycle Event) 2021-09-10 17:05:11.489 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000063" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:11.489 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000063" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:11.614 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-47e75bf2-6b0b-4dab-b0a2-93f743c86103 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:11.614 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-47e75bf2-6b0b-4dab-b0a2-93f743c86103 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:11.666 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-47e75bf2-6b0b-4dab-b0a2-93f743c86103 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:11.691 4088 3038340489992 MainThread INFO nova.compute.manager [req-47e75bf2-6b0b-4dab-b0a2-93f743c86103 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:12.488 4088 3038342146888 MainThread DEBUG os_win.utils.jobutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': 'F8461615-659A-4E02-A497-0044D3D55626', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15105), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:12.613 4088 3038342146888 MainThread ERROR os_win.utils.jobutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000063\' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)instance-000000630A833091-911B-40EB-9DB2-A9D8D1F21AEC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)instance-000000630A833091-911B-40EB-9DB2-A9D8D1F21AEC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000063\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)instance-000000630A833091-911B-40EB-9DB2-A9D8D1F21AEC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'F8461615-659A-4E02-A497-0044D3D55626', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111641), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 12), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 12), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000063' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)\n\nNot enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)\n\n'instance-00000063' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC)", 'ErrorSummaryDescription': "'instance-00000063' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000063.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:12.641 4088 3038342146888 MainThread ERROR nova.virt.hyperv.vmops [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Failed to change vm state of instance-00000063 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000063' failed to start. 2021-09-10 17:05:12.641 4088 3038342146888 MainThread INFO nova.virt.hyperv.vmops [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Got request to destroy instance 2021-09-10 17:05:12.658 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000063" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:12.658 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000063" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:12.658 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:12.658 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] VM Stopped (Lifecycle Event) 2021-09-10 17:05:12.692 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-ef70050a-8d24-4e51-b469-25d2b4c17077 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:12.707 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-ef70050a-8d24-4e51-b469-25d2b4c17077 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:12.755 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-ef70050a-8d24-4e51-b469-25d2b4c17077 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:12.799 4088 3038340489992 MainThread INFO nova.compute.manager [req-ef70050a-8d24-4e51-b469-25d2b4c17077 - - - - -] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:14.552 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "87008c7c-0917-4c78-93e1-b929cb87a160" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:14.568 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:05:14.568 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000063" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:14.568 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000063" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:14.581 4088 3038342146888 MainThread DEBUG os_win.utils.compute.vmutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Successfully changed vm state of instance-00000063 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:05:14.581 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Successfully changed state of VM instance-00000063 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:05:14.581 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:05:14.630 4088 3038342146888 MainThread DEBUG os_win.utils.jobutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '9CA2F7E2-447C-4E81-BA7A-1B7E6F8EE993', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14523), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:14.757 4088 3038342146888 MainThread DEBUG os_win.utils.jobutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job succeeded: {'InstanceID': '9CA2F7E2-447C-4E81-BA7A-1B7E6F8EE993', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=102007), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:05:14.757 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000063" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:14.757 4088 3038342146888 MainThread DEBUG os_win.utils.pathutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Removing directory: C:\openstack\instances\instance-00000063 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:05:14.757 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000063" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:14.757 4088 3038342146888 MainThread ERROR nova.compute.manager [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000063' failed to start. Not enough memory in the system to start the virtual machine instance-00000063. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000063' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Not enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) 'instance-00000063' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Error code: 32778. 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Traceback (most recent call last): 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] return function(*args, **kwargs) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] admin_password, network_info, block_device_info) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] return function(self, *args, **kwds) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self.force_reraise() 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] raise self.value 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] should_plug_vifs=False) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 'req_state': req_state}) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self.force_reraise() 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] raise self.value 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] time.sleep(sleep_time) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self.force_reraise() 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] raise self.value 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] return f(*args, **kwargs) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] return self._wait_for_job(job_path) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] error_desc=err_desc) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000063' failed to start. 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Not enough memory in the system to start the virtual machine instance-00000063. 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000063' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Not enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 'instance-00000063' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Error code: 32778. 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] During handling of the above exception, another exception occurred: 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Traceback (most recent call last): 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] yield resources 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] accel_info=accel_info) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] return function(*args, **kwargs) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] admin_password, network_info, block_device_info) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] return function(self, *args, **kwds) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self.force_reraise() 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] raise self.value 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] should_plug_vifs=False) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 'req_state': req_state}) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self.force_reraise() 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] raise self.value 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] time.sleep(sleep_time) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self.force_reraise() 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] raise self.value 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] return f(*args, **kwargs) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] return self._wait_for_job(job_path) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] error_desc=err_desc) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000063' failed to start. 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Not enough memory in the system to start the virtual machine instance-00000063. 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000063' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Not enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 'instance-00000063' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Error code: 32778. 2021-09-10 17:05:14.757 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:14.757 4088 3038342146888 MainThread INFO nova.compute.manager [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Terminating instance 2021-09-10 17:05:14.757 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:05:14.757 4088 3038342146888 MainThread INFO nova.virt.hyperv.vmops [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Got request to destroy instance 2021-09-10 17:05:14.784 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:05:14.784 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000063" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:14.784 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000063" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:14.784 4088 3038342146888 MainThread INFO nova.compute.manager [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:05:14.784 4088 3038342146888 MainThread DEBUG nova.compute.claims [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:05:14.784 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:14.956 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.hostops [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:05:14.973 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.hostops [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:05:15.192 4088 3038342146888 MainThread DEBUG nova.compute.provider_tree [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:05:15.226 4088 3038342146888 MainThread DEBUG nova.scheduler.client.report [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:05:15.226 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.437s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:15.226 4088 3038342146888 MainThread ERROR nova.compute.manager [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000063' failed to start. Not enough memory in the system to start the virtual machine instance-00000063. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000063' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Not enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) 'instance-00000063' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Error code: 32778. 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Traceback (most recent call last): 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] return function(*args, **kwargs) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] admin_password, network_info, block_device_info) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] return function(self, *args, **kwds) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self.force_reraise() 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] raise self.value 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] should_plug_vifs=False) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 'req_state': req_state}) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self.force_reraise() 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] raise self.value 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] time.sleep(sleep_time) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self.force_reraise() 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] raise self.value 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] return f(*args, **kwargs) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] return self._wait_for_job(job_path) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] error_desc=err_desc) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000063' failed to start. 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Not enough memory in the system to start the virtual machine instance-00000063. 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000063' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Not enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 'instance-00000063' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Error code: 32778. 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] During handling of the above exception, another exception occurred: 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Traceback (most recent call last): 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] accel_info=accel_info) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] return function(*args, **kwargs) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] admin_password, network_info, block_device_info) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] return function(self, *args, **kwds) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self.force_reraise() 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] raise self.value 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] should_plug_vifs=False) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 'req_state': req_state}) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self.force_reraise() 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] raise self.value 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] time.sleep(sleep_time) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self.force_reraise() 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] raise self.value 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] return f(*args, **kwargs) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] return self._wait_for_job(job_path) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] error_desc=err_desc) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000063' failed to start. 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Not enough memory in the system to start the virtual machine instance-00000063. 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000063' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Not enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 'instance-00000063' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Error code: 32778. 2021-09-10 17:05:15.226 4088 3038342146888 MainThread TRACE nova.compute.manager [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] 2021-09-10 17:05:15.226 4088 3038342146888 MainThread DEBUG nova.compute.utils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] WMI job failed with status 10. Error summary description: 'instance-00000063' failed to start. Not enough memory in the system to start the virtual machine instance-00000063. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:05:15.226 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Build of instance e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000063' failed to start. Not enough memory in the system to start the virtual machine instance-00000063. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000063' failed to start. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Not enough memory in the system to start the virtual machine instance-00000063 with ram size 1024 megabytes. (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) 'instance-00000063' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0A833091-911B-40EB-9DB2-A9D8D1F21AEC) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:05:15.226 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:05:15.226 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:05:15.226 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:05:15.226 4088 3038342146888 MainThread DEBUG nova.network.neutron [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:05:15.242 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.438s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:15.242 4088 3038342144600 MainThread DEBUG nova.virt.hardware [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:05:15.242 4088 3038342144600 MainThread INFO nova.compute.claims [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Claim successful on node n-h2-808474-1 2021-09-10 17:05:15.423 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.hostops [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:05:15.428 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.hostops [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:05:15.629 4088 3038342144600 MainThread DEBUG nova.compute.provider_tree [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:05:15.658 4088 3038342144600 MainThread DEBUG nova.scheduler.client.report [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:05:15.658 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:15.673 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:05:15.776 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:05:15.783 4088 3038342254840 GreenThread-87 DEBUG nova.compute.manager [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:05:15.783 4088 3038342254840 GreenThread-87 DEBUG nova.network.neutron [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:05:15.991 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:05:16.007 4088 3038342144600 MainThread INFO nova.virt.hyperv.vmops [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Spawning new instance 2021-09-10 17:05:16.018 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000062" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:16.018 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000062" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:16.018 4088 3038342144600 MainThread DEBUG nova.block_device [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:05:16.018 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:16.018 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:16.034 4088 3038342144600 MainThread DEBUG os_win.utils.pathutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Creating directory: C:\openstack\instances\instance-00000062 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:05:16.034 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000062\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:05:16.222 4088 3038342254840 GreenThread-87 DEBUG nova.policy [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f286737f0e6452bbe04f42184b6d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df662acac0f043bb8be9c87490878d93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:05:16.298 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Resizing VHD C:\openstack\instances\instance-00000062\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:05:18.346 4088 3038342146888 MainThread DEBUG nova.network.neutron [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:05:18.370 4088 3038342146888 MainThread INFO nova.compute.manager [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca] Took 3.16 seconds to deallocate network for instance. 2021-09-10 17:05:18.814 4088 3038342146888 MainThread INFO nova.scheduler.client.report [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Deleted allocations for instance e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca 2021-09-10 17:05:18.852 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-4d67209d-a5d7-49d6-a37b-004d9f98c900 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "e7ea83ca-2fbc-4678-85d8-8dd8f348c7ca" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 28.765s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:19.346 4088 3038342254840 GreenThread-87 DEBUG nova.network.neutron [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Successfully created port: baf10e2f-b660-45af-8303-a90bf80c7feb _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:05:22.251 4088 3038342254840 GreenThread-87 DEBUG nova.network.neutron [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Successfully updated port: baf10e2f-b660-45af-8303-a90bf80c7feb _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:05:22.275 4088 3038342254840 GreenThread-87 DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Acquired lock "refresh_cache-87008c7c-0917-4c78-93e1-b929cb87a160" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:05:22.275 4088 3038342254840 GreenThread-87 DEBUG nova.network.neutron [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:05:22.642 4088 3038342254840 GreenThread-87 DEBUG nova.network.neutron [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:05:23.167 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-7f72d27f-b0a4-41c4-90f4-8d78f03d5808 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Received event network-changed-baf10e2f-b660-45af-8303-a90bf80c7feb external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:05:23.167 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-7f72d27f-b0a4-41c4-90f4-8d78f03d5808 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Refreshing instance network info cache due to event network-changed-baf10e2f-b660-45af-8303-a90bf80c7feb. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:05:24.988 4088 3038342254840 GreenThread-87 DEBUG nova.network.neutron [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Updating instance_info_cache with network_info: [{"id": "baf10e2f-b660-45af-8303-a90bf80c7feb", "address": "fa:16:3e:4d:be:d0", "network": {"id": "5b608de7-ebcb-494c-bcfe-060ce4426ed6", "bridge": null, "label": "tempest-ServersTestJSON-497725561-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "df662acac0f043bb8be9c87490878d93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapbaf10e2f-b6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:05:25.004 4088 3038342254840 GreenThread-87 DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Releasing lock "refresh_cache-87008c7c-0917-4c78-93e1-b929cb87a160" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:05:25.032 4088 3038342254840 GreenThread-87 DEBUG nova.compute.manager [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Instance network_info: |[{"id": "baf10e2f-b660-45af-8303-a90bf80c7feb", "address": "fa:16:3e:4d:be:d0", "network": {"id": "5b608de7-ebcb-494c-bcfe-060ce4426ed6", "bridge": null, "label": "tempest-ServersTestJSON-497725561-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "df662acac0f043bb8be9c87490878d93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapbaf10e2f-b6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:05:25.032 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [req-7f72d27f-b0a4-41c4-90f4-8d78f03d5808 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-87008c7c-0917-4c78-93e1-b929cb87a160" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:05:25.032 4088 3038342256072 MainThread DEBUG nova.network.neutron [req-7f72d27f-b0a4-41c4-90f4-8d78f03d5808 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Refreshing network info cache for port baf10e2f-b660-45af-8303-a90bf80c7feb _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:05:25.032 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Preparing to wait for external event network-vif-plugged-baf10e2f-b660-45af-8303-a90bf80c7feb prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:05:25.032 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "87008c7c-0917-4c78-93e1-b929cb87a160-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:25.032 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "87008c7c-0917-4c78-93e1-b929cb87a160-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:25.032 4088 3038342144600 MainThread DEBUG os_win.utils.compute.vmutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Creating VM instance-00000062 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:05:26.820 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:05:27.205 4088 3038342256072 MainThread DEBUG nova.network.neutron [req-7f72d27f-b0a4-41c4-90f4-8d78f03d5808 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Updated VIF entry in instance network info cache for port baf10e2f-b660-45af-8303-a90bf80c7feb. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:05:27.205 4088 3038342256072 MainThread DEBUG nova.network.neutron [req-7f72d27f-b0a4-41c4-90f4-8d78f03d5808 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Updating instance_info_cache with network_info: [{"id": "baf10e2f-b660-45af-8303-a90bf80c7feb", "address": "fa:16:3e:4d:be:d0", "network": {"id": "5b608de7-ebcb-494c-bcfe-060ce4426ed6", "bridge": null, "label": "tempest-ServersTestJSON-497725561-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "df662acac0f043bb8be9c87490878d93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapbaf10e2f-b6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:05:27.236 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [req-7f72d27f-b0a4-41c4-90f4-8d78f03d5808 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-87008c7c-0917-4c78-93e1-b929cb87a160" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:05:27.374 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:27.395 4088 3038338905368 MainThread DEBUG nova.compute.manager [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:05:27.518 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:27.518 4088 3038338905368 MainThread DEBUG nova.virt.hardware [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:05:27.518 4088 3038338905368 MainThread INFO nova.compute.claims [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Claim successful on node n-h2-808474-1 2021-09-10 17:05:27.698 4088 3038338905368 MainThread DEBUG nova.virt.hyperv.hostops [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:05:27.710 4088 3038338905368 MainThread DEBUG nova.virt.hyperv.hostops [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:05:27.939 4088 3038338905368 MainThread DEBUG nova.compute.provider_tree [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:05:27.939 4088 3038338905368 MainThread DEBUG nova.scheduler.client.report [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:05:27.961 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:27.961 4088 3038338905368 MainThread DEBUG nova.compute.manager [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:05:28.020 4088 3038338905368 MainThread DEBUG nova.compute.manager [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:05:28.020 4088 3038342256072 GreenThread-88 DEBUG nova.compute.manager [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:05:28.020 4088 3038342256072 GreenThread-88 DEBUG nova.network.neutron [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:05:28.161 4088 3038338905368 MainThread DEBUG nova.compute.manager [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:05:28.161 4088 3038338905368 MainThread INFO nova.virt.hyperv.vmops [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Spawning new instance 2021-09-10 17:05:28.188 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-00000064" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:28.188 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-00000064" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:28.190 4088 3038338905368 MainThread DEBUG nova.block_device [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:05:28.190 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:28.190 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:28.190 4088 3038338905368 MainThread DEBUG os_win.utils.pathutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Creating directory: C:\openstack\instances\instance-00000064 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:05:28.190 4088 3038338905368 MainThread DEBUG nova.virt.hyperv.vmops [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000064\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:05:28.284 4088 3038342256072 GreenThread-88 DEBUG nova.policy [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6da982fe4daa44b998cd4ae6900212fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0928f57ccc9245e28c79dd9cce7e395b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:05:28.461 4088 3038338905368 MainThread DEBUG nova.virt.hyperv.vmops [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Resizing VHD C:\openstack\instances\instance-00000064\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:05:29.611 4088 3038342256072 GreenThread-88 DEBUG nova.network.neutron [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Successfully created port: 7fa85bcd-649a-4a55-bc7e-90dd6eebea1f _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:05:30.550 4088 3038342256072 GreenThread-88 DEBUG nova.network.neutron [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Successfully updated port: 7fa85bcd-649a-4a55-bc7e-90dd6eebea1f _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:05:30.564 4088 3038342256072 GreenThread-88 DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Acquired lock "refresh_cache-d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:05:30.564 4088 3038342256072 GreenThread-88 DEBUG nova.network.neutron [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:05:30.657 4088 3038342256072 GreenThread-88 DEBUG nova.network.neutron [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:05:30.923 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-e77ad867-4a4c-4f57-8a83-0c277b7c0230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Received event network-changed-7fa85bcd-649a-4a55-bc7e-90dd6eebea1f external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:05:30.923 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-e77ad867-4a4c-4f57-8a83-0c277b7c0230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Refreshing instance network info cache due to event network-changed-7fa85bcd-649a-4a55-bc7e-90dd6eebea1f. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:05:31.845 4088 3038342256072 GreenThread-88 DEBUG nova.network.neutron [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Updating instance_info_cache with network_info: [{"id": "7fa85bcd-649a-4a55-bc7e-90dd6eebea1f", "address": "fa:16:3e:78:bf:76", "network": {"id": "f84be94a-cbca-4401-b34e-c0e01bb632c9", "bridge": null, "label": "tempest-AttachVolumeNegativeTest-2088231271-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0928f57ccc9245e28c79dd9cce7e395b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap7fa85bcd-64", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:05:31.877 4088 3038342256072 GreenThread-88 DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Releasing lock "refresh_cache-d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:05:31.877 4088 3038342256072 GreenThread-88 DEBUG nova.compute.manager [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Instance network_info: |[{"id": "7fa85bcd-649a-4a55-bc7e-90dd6eebea1f", "address": "fa:16:3e:78:bf:76", "network": {"id": "f84be94a-cbca-4401-b34e-c0e01bb632c9", "bridge": null, "label": "tempest-AttachVolumeNegativeTest-2088231271-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0928f57ccc9245e28c79dd9cce7e395b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap7fa85bcd-64", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:05:31.877 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-e77ad867-4a4c-4f57-8a83-0c277b7c0230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:05:31.877 4088 3038342146888 MainThread DEBUG nova.network.neutron [req-e77ad867-4a4c-4f57-8a83-0c277b7c0230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Refreshing network info cache for port 7fa85bcd-649a-4a55-bc7e-90dd6eebea1f _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:05:31.877 4088 3038338905368 MainThread DEBUG nova.compute.manager [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Preparing to wait for external event network-vif-plugged-7fa85bcd-649a-4a55-bc7e-90dd6eebea1f prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:05:31.877 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:31.877 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:31.877 4088 3038338905368 MainThread DEBUG os_win.utils.compute.vmutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Creating VM instance-00000064 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:05:33.329 4088 3038342146888 MainThread DEBUG nova.network.neutron [req-e77ad867-4a4c-4f57-8a83-0c277b7c0230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Updated VIF entry in instance network info cache for port 7fa85bcd-649a-4a55-bc7e-90dd6eebea1f. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:05:33.329 4088 3038342146888 MainThread DEBUG nova.network.neutron [req-e77ad867-4a4c-4f57-8a83-0c277b7c0230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Updating instance_info_cache with network_info: [{"id": "7fa85bcd-649a-4a55-bc7e-90dd6eebea1f", "address": "fa:16:3e:78:bf:76", "network": {"id": "f84be94a-cbca-4401-b34e-c0e01bb632c9", "bridge": null, "label": "tempest-AttachVolumeNegativeTest-2088231271-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0928f57ccc9245e28c79dd9cce7e395b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap7fa85bcd-64", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:05:33.362 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-e77ad867-4a4c-4f57-8a83-0c277b7c0230 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:05:33.636 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-452edec8-c4f3-4168-8aac-ca08df244914 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Received event network-vif-plugged-baf10e2f-b660-45af-8303-a90bf80c7feb external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:05:33.636 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-452edec8-c4f3-4168-8aac-ca08df244914 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "87008c7c-0917-4c78-93e1-b929cb87a160-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:33.636 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-452edec8-c4f3-4168-8aac-ca08df244914 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "87008c7c-0917-4c78-93e1-b929cb87a160-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:33.636 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-452edec8-c4f3-4168-8aac-ca08df244914 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Processing event network-vif-plugged-baf10e2f-b660-45af-8303-a90bf80c7feb _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:05:33.636 4088 3038338905368 MainThread DEBUG nova.virt.hyperv.vmops [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:05:33.690 4088 3038342144600 MainThread INFO nova.virt.hyperv.vmops [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Using config drive for instance 2021-09-10 17:05:33.886 4088 3038342144600 MainThread INFO nova.virt.hyperv.vmops [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Creating config drive at C:\openstack\instances\instance-00000062\configdrive.iso 2021-09-10 17:05:33.960 4088 3038342144600 MainThread DEBUG oslo_concurrency.processutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000062\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpb9ek4igv execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:05:34.113 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "94d2efe1-0d5a-49bf-ba29-3c312237f77d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:34.143 4088 3038338906424 MainThread DEBUG nova.compute.manager [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:05:34.252 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:34.252 4088 3038338906424 MainThread DEBUG nova.virt.hardware [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:05:34.267 4088 3038338906424 MainThread INFO nova.compute.claims [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Claim successful on node n-h2-808474-1 2021-09-10 17:05:34.282 4088 3038342144600 MainThread DEBUG oslo_concurrency.processutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000062\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpb9ek4igv" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:05:34.405 4088 3038338906424 MainThread DEBUG nova.virt.hyperv.hostops [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:05:34.414 4088 3038338906424 MainThread DEBUG nova.virt.hyperv.hostops [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:05:34.640 4088 3038338906424 MainThread DEBUG nova.compute.provider_tree [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:05:34.673 4088 3038338906424 MainThread DEBUG nova.scheduler.client.report [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:05:34.673 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:34.673 4088 3038338906424 MainThread DEBUG nova.compute.manager [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:05:34.780 4088 3038338906424 MainThread DEBUG nova.compute.manager [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:05:34.780 4088 3038342146888 GreenThread-89 DEBUG nova.compute.manager [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Not allocating networking since 'none' was specified. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1752 2021-09-10 17:05:34.808 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Setting boot order for instance: instance-00000062: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:05:34.908 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:05:34.939 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'BE2567FA-1638-4EAE-A96B-0B7F55A5506D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15438), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:34.971 4088 3038338906424 MainThread DEBUG nova.compute.manager [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:05:34.971 4088 3038338906424 MainThread INFO nova.virt.hyperv.vmops [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Spawning new instance 2021-09-10 17:05:34.985 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "instance-00000065" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:34.985 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "instance-00000065" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:34.985 4088 3038338906424 MainThread DEBUG nova.block_device [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:05:34.985 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:34.985 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:35.001 4088 3038338906424 MainThread DEBUG os_win.utils.pathutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Creating directory: C:\openstack\instances\instance-00000065 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:05:35.001 4088 3038338906424 MainThread DEBUG nova.virt.hyperv.vmops [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000065\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:05:35.032 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "d9d8c32a-f534-4f8f-a1ba-5b0b5452598e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:35.066 4088 3038341411064 MainThread DEBUG nova.compute.manager [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:05:35.096 4088 3038342144600 MainThread ERROR os_win.utils.jobutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000062\' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)instance-00000062A01DE318-43C6-4A96-960E-E3CF1D7442D212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)instance-00000062A01DE318-43C6-4A96-960E-E3CF1D7442D210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000062\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)instance-00000062A01DE318-43C6-4A96-960E-E3CF1D7442D2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BE2567FA-1638-4EAE-A96B-0B7F55A5506D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118411), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 34), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 35), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000062' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)\n\nNot enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)\n\n'instance-00000062' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)", 'ErrorSummaryDescription': "'instance-00000062' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000062.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:35.096 4088 3038342144600 MainThread DEBUG os_win._utils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000062' failed to start. Not enough memory in the system to start the virtual machine instance-00000062. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000062' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Not enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) 'instance-00000062' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18868017196655273 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:35.142 4088 3038341411240 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000062" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:35.142 4088 3038341411240 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000062" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:35.142 4088 3038341410888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:35.142 4088 3038341410888 MainThread INFO nova.compute.manager [-] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] VM Stopped (Lifecycle Event) 2021-09-10 17:05:35.163 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:35.163 4088 3038341411064 MainThread DEBUG nova.virt.hardware [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:05:35.163 4088 3038341411064 MainThread INFO nova.compute.claims [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Claim successful on node n-h2-808474-1 2021-09-10 17:05:35.174 4088 3038341410888 MainThread DEBUG nova.compute.manager [req-11c0754f-3b2b-43df-9aae-32eab02a9fd9 - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:35.174 4088 3038341410888 MainThread DEBUG nova.virt.hyperv.vmops [req-11c0754f-3b2b-43df-9aae-32eab02a9fd9 - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:35.236 4088 3038341410888 MainThread DEBUG nova.compute.manager [req-11c0754f-3b2b-43df-9aae-32eab02a9fd9 - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:35.236 4088 3038338906424 MainThread DEBUG nova.virt.hyperv.vmops [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Resizing VHD C:\openstack\instances\instance-00000065\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:05:35.272 4088 3038341410888 MainThread INFO nova.compute.manager [req-11c0754f-3b2b-43df-9aae-32eab02a9fd9 - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:35.350 4088 3038341411064 MainThread DEBUG nova.virt.hyperv.hostops [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:05:35.370 4088 3038341411064 MainThread DEBUG nova.virt.hyperv.hostops [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:05:35.418 4088 3038338906424 MainThread DEBUG os_win.utils.compute.vmutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Creating VM instance-00000065 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:05:35.844 4088 3038341411064 MainThread DEBUG nova.compute.provider_tree [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:05:35.862 4088 3038341411064 MainThread DEBUG nova.scheduler.client.report [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:05:35.862 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.703s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:35.862 4088 3038341411064 MainThread DEBUG nova.compute.manager [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:05:35.987 4088 3038341411064 MainThread DEBUG nova.compute.manager [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:05:35.987 4088 3038342146888 GreenThread-90 DEBUG nova.compute.manager [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Not allocating networking since 'none' was specified. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1752 2021-09-10 17:05:36.126 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '901D793F-AD9A-47F4-8762-F0579B7B5D8B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16629), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:36.180 4088 3038341411064 MainThread DEBUG nova.compute.manager [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:05:36.180 4088 3038341411064 MainThread INFO nova.virt.hyperv.vmops [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Spawning new instance 2021-09-10 17:05:36.208 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "instance-00000066" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:36.208 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "instance-00000066" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:36.208 4088 3038341411064 MainThread DEBUG nova.block_device [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:05:36.208 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:36.208 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:36.208 4088 3038341411064 MainThread DEBUG os_win.utils.pathutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Creating directory: C:\openstack\instances\instance-00000066 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:05:36.208 4088 3038341411064 MainThread DEBUG nova.virt.hyperv.vmops [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000066\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:05:36.269 4088 3038342144600 MainThread ERROR os_win.utils.jobutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000062\' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)instance-00000062A01DE318-43C6-4A96-960E-E3CF1D7442D212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)instance-00000062A01DE318-43C6-4A96-960E-E3CF1D7442D210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000062\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)instance-00000062A01DE318-43C6-4A96-960E-E3CF1D7442D2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '901D793F-AD9A-47F4-8762-F0579B7B5D8B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118635), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 36), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 36), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000062' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)\n\nNot enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)\n\n'instance-00000062' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)", 'ErrorSummaryDescription': "'instance-00000062' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000062.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:36.269 4088 3038342144600 MainThread DEBUG os_win._utils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000062' failed to start. Not enough memory in the system to start the virtual machine instance-00000062. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000062' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Not enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) 'instance-00000062' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3617243766784668 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:36.361 4088 3038341411416 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000062" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:36.361 4088 3038341411416 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000062" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:36.361 4088 3038341410888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:36.361 4088 3038341410888 MainThread INFO nova.compute.manager [-] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] VM Stopped (Lifecycle Event) 2021-09-10 17:05:36.402 4088 3038341410888 MainThread DEBUG nova.compute.manager [req-23574c15-f754-4e04-a7f5-715a320ed721 - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:36.402 4088 3038341410888 MainThread DEBUG nova.virt.hyperv.vmops [req-23574c15-f754-4e04-a7f5-715a320ed721 - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:36.454 4088 3038341410888 MainThread DEBUG nova.compute.manager [req-23574c15-f754-4e04-a7f5-715a320ed721 - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:36.496 4088 3038341411064 MainThread DEBUG nova.virt.hyperv.vmops [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Resizing VHD C:\openstack\instances\instance-00000066\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:05:36.496 4088 3038341410888 MainThread INFO nova.compute.manager [req-23574c15-f754-4e04-a7f5-715a320ed721 - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:36.696 4088 3038341411064 MainThread DEBUG os_win.utils.compute.vmutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Creating VM instance-00000066 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:05:37.340 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'A2C0F22B-3EBE-46D7-A474-2152C349B040', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15475), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:37.485 4088 3038342144600 MainThread ERROR os_win.utils.jobutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000062\' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)instance-00000062A01DE318-43C6-4A96-960E-E3CF1D7442D212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)instance-00000062A01DE318-43C6-4A96-960E-E3CF1D7442D210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000062\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)instance-00000062A01DE318-43C6-4A96-960E-E3CF1D7442D2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A2C0F22B-3EBE-46D7-A474-2152C349B040', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116757), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 37), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 37), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000062' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)\n\nNot enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)\n\n'instance-00000062' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)", 'ErrorSummaryDescription': "'instance-00000062' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000062.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:37.501 4088 3038342144600 MainThread DEBUG os_win._utils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000062' failed to start. Not enough memory in the system to start the virtual machine instance-00000062. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000062' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Not enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) 'instance-00000062' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5936481952667236 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:38.329 4088 3038338906424 MainThread INFO nova.virt.hyperv.vmops [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Using config drive for instance 2021-09-10 17:05:38.426 4088 3038338906424 MainThread INFO nova.virt.hyperv.vmops [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Creating config drive at C:\openstack\instances\instance-00000065\configdrive.iso 2021-09-10 17:05:38.524 4088 3038338906424 MainThread DEBUG oslo_concurrency.processutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000065\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpgcu86hlu execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:05:38.688 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'C05BE485-363B-4089-A788-0888C48068A7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16012), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:38.829 4088 3038338906424 MainThread DEBUG oslo_concurrency.processutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000065\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpgcu86hlu" returned: 0 in 0.313s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:05:38.862 4088 3038342144600 MainThread ERROR os_win.utils.jobutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000062\' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)instance-00000062A01DE318-43C6-4A96-960E-E3CF1D7442D212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)instance-00000062A01DE318-43C6-4A96-960E-E3CF1D7442D210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000062\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)instance-00000062A01DE318-43C6-4A96-960E-E3CF1D7442D2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C05BE485-363B-4089-A788-0888C48068A7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117538), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 38), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 38), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000062' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)\n\nNot enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)\n\n'instance-00000062' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)", 'ErrorSummaryDescription': "'instance-00000062' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000062.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:38.862 4088 3038342144600 MainThread DEBUG os_win._utils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000062' failed to start. Not enough memory in the system to start the virtual machine instance-00000062. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000062' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Not enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) 'instance-00000062' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.954775094985962 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:38.880 4088 3038342146888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:38.907 4088 3038342146888 MainThread INFO nova.compute.manager [-] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] VM Stopped (Lifecycle Event) 2021-09-10 17:05:38.907 4088 3038341411240 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000062" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:38.907 4088 3038341411240 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000062" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:38.914 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-3e26321c-ff71-448f-8cf4-f1d734bcac00 - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:38.914 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [req-3e26321c-ff71-448f-8cf4-f1d734bcac00 - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:38.960 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-3e26321c-ff71-448f-8cf4-f1d734bcac00 - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:39.001 4088 3038342146888 MainThread INFO nova.compute.manager [req-3e26321c-ff71-448f-8cf4-f1d734bcac00 - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:39.458 4088 3038338906424 MainThread DEBUG nova.virt.hyperv.vmops [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Setting boot order for instance: instance-00000065: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:05:39.555 4088 3038338906424 MainThread DEBUG nova.virt.hyperv.vmops [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:05:39.580 4088 3038338906424 MainThread DEBUG os_win.utils.jobutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Waiting for WMI job: {'InstanceID': 'A6793248-2E55-4C87-9776-D55C175C205C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16341), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:39.643 4088 3038341411064 MainThread INFO nova.virt.hyperv.vmops [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Using config drive for instance 2021-09-10 17:05:39.717 4088 3038338906424 MainThread ERROR os_win.utils.jobutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000065\' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)instance-0000006508BF2C62-D5A9-4455-AF45-A7D6E94E1D1112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)instance-0000006508BF2C62-D5A9-4455-AF45-A7D6E94E1D1110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000065\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)instance-0000006508BF2C62-D5A9-4455-AF45-A7D6E94E1D11%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A6793248-2E55-4C87-9776-D55C175C205C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=98782), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 39), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 39), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000065' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)\n\nNot enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)\n\n'instance-00000065' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)", 'ErrorSummaryDescription': "'instance-00000065' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000065.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:39.717 4088 3038338906424 MainThread DEBUG os_win._utils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000065' failed to start. Not enough memory in the system to start the virtual machine instance-00000065. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000065' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Not enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) 'instance-00000065' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1616213321685791 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:39.731 4088 3038341411064 MainThread INFO nova.virt.hyperv.vmops [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Creating config drive at C:\openstack\instances\instance-00000066\configdrive.iso 2021-09-10 17:05:39.817 4088 3038341411064 MainThread DEBUG oslo_concurrency.processutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000066\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmph97dx34x execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:05:39.971 4088 3038341410888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:39.971 4088 3038341410888 MainThread INFO nova.compute.manager [-] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] VM Stopped (Lifecycle Event) 2021-09-10 17:05:39.971 4088 3038341411592 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000065" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:39.971 4088 3038341411592 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000065" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:40.001 4088 3038341410888 MainThread DEBUG nova.compute.manager [req-17d5d179-b7ce-4e38-b550-bd2c94266fe2 - - - - -] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:40.001 4088 3038341410888 MainThread DEBUG nova.virt.hyperv.vmops [req-17d5d179-b7ce-4e38-b550-bd2c94266fe2 - - - - -] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:40.040 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'B7036A7A-4042-46EE-850A-ADD9AE2BA0BD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=22693), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:40.069 4088 3038341410888 MainThread DEBUG nova.compute.manager [req-17d5d179-b7ce-4e38-b550-bd2c94266fe2 - - - - -] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:40.095 4088 3038341410888 MainThread INFO nova.compute.manager [req-17d5d179-b7ce-4e38-b550-bd2c94266fe2 - - - - -] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:40.120 4088 3038341411064 MainThread DEBUG oslo_concurrency.processutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000066\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmph97dx34x" returned: 0 in 0.312s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:05:40.189 4088 3038342144600 MainThread ERROR os_win.utils.jobutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000062\' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)instance-00000062A01DE318-43C6-4A96-960E-E3CF1D7442D212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)instance-00000062A01DE318-43C6-4A96-960E-E3CF1D7442D210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000062\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)instance-00000062A01DE318-43C6-4A96-960E-E3CF1D7442D2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B7036A7A-4042-46EE-850A-ADD9AE2BA0BD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=122249), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 40), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 40), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000062' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)\n\nNot enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)\n\n'instance-00000062' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)", 'ErrorSummaryDescription': "'instance-00000062' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000062.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:40.189 4088 3038342144600 MainThread DEBUG os_win._utils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000062' failed to start. Not enough memory in the system to start the virtual machine instance-00000062. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000062' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Not enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) 'instance-00000062' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.281662702560425 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:40.236 4088 3038341411240 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000062" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:40.236 4088 3038341411240 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000062" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:40.236 4088 3038341410888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:40.236 4088 3038341410888 MainThread INFO nova.compute.manager [-] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] VM Stopped (Lifecycle Event) 2021-09-10 17:05:40.267 4088 3038341410888 MainThread DEBUG nova.compute.manager [req-9850953a-1363-4e84-82a0-43cab48e823e - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:40.267 4088 3038341410888 MainThread DEBUG nova.virt.hyperv.vmops [req-9850953a-1363-4e84-82a0-43cab48e823e - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:40.323 4088 3038341410888 MainThread DEBUG nova.compute.manager [req-9850953a-1363-4e84-82a0-43cab48e823e - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:40.375 4088 3038341410888 MainThread INFO nova.compute.manager [req-9850953a-1363-4e84-82a0-43cab48e823e - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:40.752 4088 3038341411064 MainThread DEBUG nova.virt.hyperv.vmops [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Setting boot order for instance: instance-00000066: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:05:40.779 4088 3038338906424 MainThread DEBUG os_win.utils.jobutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Waiting for WMI job: {'InstanceID': '9C3D1769-CADF-4359-9014-0CA14CD71387', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16498), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:40.830 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-b0565347-c4f1-4b3f-beea-dc57ed50fadb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Received event network-vif-plugged-7fa85bcd-649a-4a55-bc7e-90dd6eebea1f external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:05:40.830 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-b0565347-c4f1-4b3f-beea-dc57ed50fadb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:40.830 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-b0565347-c4f1-4b3f-beea-dc57ed50fadb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:40.830 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-b0565347-c4f1-4b3f-beea-dc57ed50fadb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Processing event network-vif-plugged-7fa85bcd-649a-4a55-bc7e-90dd6eebea1f _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:05:40.856 4088 3038341411064 MainThread DEBUG nova.virt.hyperv.vmops [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:05:40.877 4088 3038338905368 MainThread INFO nova.virt.hyperv.vmops [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Using config drive for instance 2021-09-10 17:05:40.943 4088 3038341411064 MainThread DEBUG os_win.utils.jobutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Waiting for WMI job: {'InstanceID': '448536C5-5645-4134-A7D5-15CFEA0AB61B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=28666), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:40.943 4088 3038338906424 MainThread ERROR os_win.utils.jobutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000065\' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)instance-0000006508BF2C62-D5A9-4455-AF45-A7D6E94E1D1112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)instance-0000006508BF2C62-D5A9-4455-AF45-A7D6E94E1D1110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000065\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)instance-0000006508BF2C62-D5A9-4455-AF45-A7D6E94E1D11%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9C3D1769-CADF-4359-9014-0CA14CD71387', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=95934), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 40), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 40), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000065' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)\n\nNot enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)\n\n'instance-00000065' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)", 'ErrorSummaryDescription': "'instance-00000065' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000065.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:40.943 4088 3038338906424 MainThread DEBUG os_win._utils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000065' failed to start. Not enough memory in the system to start the virtual machine instance-00000065. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000065' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Not enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) 'instance-00000065' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3873975276947021 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:41.087 4088 3038341411064 MainThread ERROR os_win.utils.jobutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000066\' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)instance-000000660723DD3F-DA6C-4065-9CBC-DA5B4C9AE17712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)instance-000000660723DD3F-DA6C-4065-9CBC-DA5B4C9AE17710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000066\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)instance-000000660723DD3F-DA6C-4065-9CBC-DA5B4C9AE177%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '448536C5-5645-4134-A7D5-15CFEA0AB61B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=96496), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 40), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 41), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000066' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)\n\nNot enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)\n\n'instance-00000066' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)", 'ErrorSummaryDescription': "'instance-00000066' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000066.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:41.087 4088 3038341411064 MainThread DEBUG os_win._utils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000066' failed to start. Not enough memory in the system to start the virtual machine instance-00000066. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000066' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Not enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) 'instance-00000066' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.21010351181030273 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:41.087 4088 3038341410888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:41.104 4088 3038341410888 MainThread INFO nova.compute.manager [-] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] VM Stopped (Lifecycle Event) 2021-09-10 17:05:41.104 4088 3038341411240 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000066" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:41.104 4088 3038341411240 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000066" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:41.125 4088 3038341410888 MainThread DEBUG nova.compute.manager [req-0f63dce0-dc4a-4f76-8eaa-72536dcd8193 - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:41.126 4088 3038341410888 MainThread DEBUG nova.virt.hyperv.vmops [req-0f63dce0-dc4a-4f76-8eaa-72536dcd8193 - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:41.165 4088 3038341410888 MainThread DEBUG nova.compute.manager [req-0f63dce0-dc4a-4f76-8eaa-72536dcd8193 - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:41.219 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'C1DB6567-3EB5-49F1-A46F-7E280D63ADD1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15004), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:41.236 4088 3038341410888 MainThread INFO nova.compute.manager [req-0f63dce0-dc4a-4f76-8eaa-72536dcd8193 - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:41.236 4088 3038338905368 MainThread INFO nova.virt.hyperv.vmops [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Creating config drive at C:\openstack\instances\instance-00000064\configdrive.iso 2021-09-10 17:05:41.311 4088 3038338905368 MainThread DEBUG oslo_concurrency.processutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000064\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp5uysxpq9 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:05:41.455 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:05:41.455 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:05:41.470 4088 3038341411592 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000062" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:41.486 4088 3038341411592 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000062" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:41.486 4088 3038341411416 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:41.486 4088 3038341411416 MainThread INFO nova.compute.manager [-] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] VM Stopped (Lifecycle Event) 2021-09-10 17:05:41.501 4088 3038342144600 MainThread ERROR os_win.utils.jobutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000062\' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)instance-00000062A01DE318-43C6-4A96-960E-E3CF1D7442D212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)instance-00000062A01DE318-43C6-4A96-960E-E3CF1D7442D210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000062\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)instance-00000062A01DE318-43C6-4A96-960E-E3CF1D7442D2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C1DB6567-3EB5-49F1-A46F-7E280D63ADD1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=122403), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 41), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 41), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000062' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)\n\nNot enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)\n\n'instance-00000062' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2)", 'ErrorSummaryDescription': "'instance-00000062' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000062.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:41.501 4088 3038342144600 MainThread ERROR nova.virt.hyperv.vmops [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Failed to change vm state of instance-00000062 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000062' failed to start. 2021-09-10 17:05:41.501 4088 3038342144600 MainThread INFO nova.virt.hyperv.vmops [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Got request to destroy instance 2021-09-10 17:05:41.501 4088 3038341411416 MainThread DEBUG nova.compute.manager [req-d9bb9125-df28-4d09-bdaf-5c7cf4f6361e - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:41.501 4088 3038341411416 MainThread DEBUG nova.virt.hyperv.vmops [req-d9bb9125-df28-4d09-bdaf-5c7cf4f6361e - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:41.532 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:05:41.554 4088 3038341411416 MainThread DEBUG nova.compute.manager [req-d9bb9125-df28-4d09-bdaf-5c7cf4f6361e - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:41.592 4088 3038341411416 MainThread INFO nova.compute.manager [req-d9bb9125-df28-4d09-bdaf-5c7cf4f6361e - - - - -] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:41.646 4088 3038338905368 MainThread DEBUG oslo_concurrency.processutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000064\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp5uysxpq9" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:05:41.964 4088 3038338906424 MainThread DEBUG os_win.utils.jobutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Waiting for WMI job: {'InstanceID': '19E0D362-8344-4138-AE99-A99266F464FE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20205), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:42.127 4088 3038341411064 MainThread DEBUG os_win.utils.jobutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Waiting for WMI job: {'InstanceID': 'A803F187-5E61-434B-AAAB-96F338ED48EA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17283), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:42.127 4088 3038338906424 MainThread ERROR os_win.utils.jobutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000065\' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)instance-0000006508BF2C62-D5A9-4455-AF45-A7D6E94E1D1112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)instance-0000006508BF2C62-D5A9-4455-AF45-A7D6E94E1D1110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000065\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)instance-0000006508BF2C62-D5A9-4455-AF45-A7D6E94E1D11%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '19E0D362-8344-4138-AE99-A99266F464FE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=96981), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 41), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 42), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000065' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)\n\nNot enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)\n\n'instance-00000065' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)", 'ErrorSummaryDescription': "'instance-00000065' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000065.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:42.127 4088 3038338906424 MainThread DEBUG os_win._utils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000065' failed to start. Not enough memory in the system to start the virtual machine instance-00000065. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000065' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Not enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) 'instance-00000065' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5712523460388184 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:42.253 4088 3038338905368 MainThread DEBUG nova.virt.hyperv.vmops [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Setting boot order for instance: instance-00000064: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:05:42.278 4088 3038341411064 MainThread ERROR os_win.utils.jobutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000066\' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)instance-000000660723DD3F-DA6C-4065-9CBC-DA5B4C9AE17712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)instance-000000660723DD3F-DA6C-4065-9CBC-DA5B4C9AE17710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000066\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)instance-000000660723DD3F-DA6C-4065-9CBC-DA5B4C9AE177%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A803F187-5E61-434B-AAAB-96F338ED48EA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=100076), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 42), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 42), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000066' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)\n\nNot enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)\n\n'instance-00000066' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)", 'ErrorSummaryDescription': "'instance-00000066' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000066.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:42.287 4088 3038341411064 MainThread DEBUG os_win._utils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000066' failed to start. Not enough memory in the system to start the virtual machine instance-00000066. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000066' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Not enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) 'instance-00000066' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.410346269607544 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:42.357 4088 3038338905368 MainThread DEBUG nova.virt.hyperv.vmops [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:05:42.391 4088 3038338905368 MainThread DEBUG os_win.utils.jobutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': '901330D7-D278-49CA-82B3-C40B15AC5A0E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15684), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:42.534 4088 3038338905368 MainThread ERROR os_win.utils.jobutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000064\' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)instance-000000641141FF2C-78FF-4E76-877A-B68B69200D0B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)instance-000000641141FF2C-78FF-4E76-877A-B68B69200D0B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000064\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)instance-000000641141FF2C-78FF-4E76-877A-B68B69200D0B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '901330D7-D278-49CA-82B3-C40B15AC5A0E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116336), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 42), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 42), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000064' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)\n\nNot enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)\n\n'instance-00000064' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)", 'ErrorSummaryDescription': "'instance-00000064' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000064.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:42.534 4088 3038338905368 MainThread DEBUG os_win._utils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000064' failed to start. Not enough memory in the system to start the virtual machine instance-00000064. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000064' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Not enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) 'instance-00000064' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.17655086517333984 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:42.558 4088 3038341411416 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000064" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:42.558 4088 3038341411416 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000064" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:42.558 4088 3038342146888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:42.558 4088 3038342146888 MainThread INFO nova.compute.manager [-] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] VM Stopped (Lifecycle Event) 2021-09-10 17:05:42.589 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-4adbb107-cbad-4668-85cc-08ec041a1f80 - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:42.589 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [req-4adbb107-cbad-4668-85cc-08ec041a1f80 - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:42.641 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-4adbb107-cbad-4668-85cc-08ec041a1f80 - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:42.677 4088 3038342146888 MainThread INFO nova.compute.manager [req-4adbb107-cbad-4668-85cc-08ec041a1f80 - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:43.143 4088 3038338906424 MainThread DEBUG os_win.utils.jobutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Waiting for WMI job: {'InstanceID': '170A0157-24C2-470A-A2EB-AC5E7A637F11', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17715), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:43.285 4088 3038338906424 MainThread ERROR os_win.utils.jobutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000065\' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)instance-0000006508BF2C62-D5A9-4455-AF45-A7D6E94E1D1112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)instance-0000006508BF2C62-D5A9-4455-AF45-A7D6E94E1D1110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000065\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)instance-0000006508BF2C62-D5A9-4455-AF45-A7D6E94E1D11%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '170A0157-24C2-470A-A2EB-AC5E7A637F11', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=94884), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 43), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 43), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000065' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)\n\nNot enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)\n\n'instance-00000065' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)", 'ErrorSummaryDescription': "'instance-00000065' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000065.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:43.285 4088 3038338906424 MainThread DEBUG os_win._utils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000065' failed to start. Not enough memory in the system to start the virtual machine instance-00000065. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000065' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Not enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) 'instance-00000065' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.729759931564331 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:43.314 4088 3038342146888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:43.314 4088 3038342146888 MainThread INFO nova.compute.manager [-] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] VM Stopped (Lifecycle Event) 2021-09-10 17:05:43.314 4088 3038341411416 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000065" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:43.314 4088 3038341411416 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000065" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:43.314 4088 3038341411064 MainThread DEBUG os_win.utils.jobutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Waiting for WMI job: {'InstanceID': 'FD1B3695-3D16-4FD3-BE50-74C0E41B3754', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17989), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:43.332 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-3d4b7dee-46ab-4ca6-9ab4-da23cfa8cb5a - - - - -] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:43.332 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [req-3d4b7dee-46ab-4ca6-9ab4-da23cfa8cb5a - - - - -] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:43.399 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-3d4b7dee-46ab-4ca6-9ab4-da23cfa8cb5a - - - - -] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:43.455 4088 3038342146888 MainThread INFO nova.compute.manager [req-3d4b7dee-46ab-4ca6-9ab4-da23cfa8cb5a - - - - -] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:43.478 4088 3038341411064 MainThread ERROR os_win.utils.jobutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000066\' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)instance-000000660723DD3F-DA6C-4065-9CBC-DA5B4C9AE17712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)instance-000000660723DD3F-DA6C-4065-9CBC-DA5B4C9AE17710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000066\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)instance-000000660723DD3F-DA6C-4065-9CBC-DA5B4C9AE177%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'FD1B3695-3D16-4FD3-BE50-74C0E41B3754', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=94984), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 43), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 43), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000066' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)\n\nNot enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)\n\n'instance-00000066' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)", 'ErrorSummaryDescription': "'instance-00000066' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000066.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:43.478 4088 3038341411064 MainThread DEBUG os_win._utils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000066' failed to start. Not enough memory in the system to start the virtual machine instance-00000066. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000066' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Not enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) 'instance-00000066' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.601156234741211 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:43.478 4088 3038342146888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:43.478 4088 3038342146888 MainThread INFO nova.compute.manager [-] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] VM Stopped (Lifecycle Event) 2021-09-10 17:05:43.478 4088 3038341411416 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000066" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:43.478 4088 3038341411416 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000066" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:43.502 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-7af6a4a2-a745-4ad0-bafe-8df1ae9cb5c6 - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:43.502 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [req-7af6a4a2-a745-4ad0-bafe-8df1ae9cb5c6 - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:43.502 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:05:43.502 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000062" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:43.502 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000062" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:43.537 4088 3038342144600 MainThread DEBUG os_win.utils.compute.vmutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Successfully changed vm state of instance-00000062 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:05:43.537 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Successfully changed state of VM instance-00000062 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:05:43.553 4088 3038338905368 MainThread DEBUG os_win.utils.jobutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': 'B0E6B906-544B-43E5-9D35-F95128E6AB28', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17988), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:43.566 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-7af6a4a2-a745-4ad0-bafe-8df1ae9cb5c6 - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:43.596 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'B5B24FCC-40FA-48FE-8515-CF46A388F2DB', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18647), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:43.596 4088 3038342146888 MainThread INFO nova.compute.manager [req-7af6a4a2-a745-4ad0-bafe-8df1ae9cb5c6 - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:43.705 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job succeeded: {'InstanceID': 'B5B24FCC-40FA-48FE-8515-CF46A388F2DB', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=102423), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:05:43.722 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000062" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:43.722 4088 3038342144600 MainThread DEBUG os_win.utils.pathutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Removing directory: C:\openstack\instances\instance-00000062 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:05:43.722 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000062" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:43.722 4088 3038342144600 MainThread ERROR nova.compute.manager [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000062' failed to start. Not enough memory in the system to start the virtual machine instance-00000062. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000062' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Not enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) 'instance-00000062' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Error code: 32778. 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Traceback (most recent call last): 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] return function(*args, **kwargs) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] admin_password, network_info, block_device_info) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] return function(self, *args, **kwds) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self.force_reraise() 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] raise self.value 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] should_plug_vifs=False) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 'req_state': req_state}) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self.force_reraise() 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] raise self.value 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] time.sleep(sleep_time) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self.force_reraise() 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] raise self.value 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] return f(*args, **kwargs) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] return self._wait_for_job(job_path) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] error_desc=err_desc) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000062' failed to start. 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Not enough memory in the system to start the virtual machine instance-00000062. 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000062' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Not enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 'instance-00000062' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Error code: 32778. 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] During handling of the above exception, another exception occurred: 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Traceback (most recent call last): 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] yield resources 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] accel_info=accel_info) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] return function(*args, **kwargs) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] admin_password, network_info, block_device_info) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] return function(self, *args, **kwds) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self.force_reraise() 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] raise self.value 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] should_plug_vifs=False) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 'req_state': req_state}) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self.force_reraise() 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] raise self.value 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] time.sleep(sleep_time) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self.force_reraise() 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] raise self.value 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] return f(*args, **kwargs) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] return self._wait_for_job(job_path) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] error_desc=err_desc) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000062' failed to start. 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Not enough memory in the system to start the virtual machine instance-00000062. 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000062' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Not enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 'instance-00000062' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Error code: 32778. 2021-09-10 17:05:43.722 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:43.722 4088 3038342144600 MainThread INFO nova.compute.manager [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Terminating instance 2021-09-10 17:05:43.722 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:05:43.722 4088 3038342144600 MainThread INFO nova.virt.hyperv.vmops [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Got request to destroy instance 2021-09-10 17:05:43.754 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:05:43.754 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000062" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:43.754 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000062" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:43.754 4088 3038342144600 MainThread INFO nova.compute.manager [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:05:43.754 4088 3038342144600 MainThread DEBUG nova.compute.claims [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:05:43.754 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:43.771 4088 3038342146888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:43.771 4088 3038342146888 MainThread INFO nova.compute.manager [-] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] VM Stopped (Lifecycle Event) 2021-09-10 17:05:43.771 4088 3038341411416 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000064" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:43.771 4088 3038341411416 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000064" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:43.771 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-9dad5522-ebe5-4ef2-8225-807f06b2007b - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:43.796 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [req-9dad5522-ebe5-4ef2-8225-807f06b2007b - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:43.829 4088 3038338905368 MainThread ERROR os_win.utils.jobutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000064\' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)instance-000000641141FF2C-78FF-4E76-877A-B68B69200D0B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)instance-000000641141FF2C-78FF-4E76-877A-B68B69200D0B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000064\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)instance-000000641141FF2C-78FF-4E76-877A-B68B69200D0B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B0E6B906-544B-43E5-9D35-F95128E6AB28', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=146664), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 43), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 43), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000064' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)\n\nNot enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)\n\n'instance-00000064' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)", 'ErrorSummaryDescription': "'instance-00000064' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000064.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:43.829 4088 3038338905368 MainThread DEBUG os_win._utils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000064' failed to start. Not enough memory in the system to start the virtual machine instance-00000064. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000064' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Not enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) 'instance-00000064' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.471961259841919 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:43.844 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-9dad5522-ebe5-4ef2-8225-807f06b2007b - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:43.925 4088 3038342146888 MainThread INFO nova.compute.manager [req-9dad5522-ebe5-4ef2-8225-807f06b2007b - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:43.925 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.hostops [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:05:43.953 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.hostops [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:05:44.182 4088 3038342144600 MainThread DEBUG nova.compute.provider_tree [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:05:44.182 4088 3038342144600 MainThread DEBUG nova.scheduler.client.report [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:05:44.182 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.438s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:44.202 4088 3038342144600 MainThread ERROR nova.compute.manager [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000062' failed to start. Not enough memory in the system to start the virtual machine instance-00000062. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000062' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Not enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) 'instance-00000062' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Error code: 32778. 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Traceback (most recent call last): 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] return function(*args, **kwargs) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] admin_password, network_info, block_device_info) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] return function(self, *args, **kwds) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self.force_reraise() 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] raise self.value 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] should_plug_vifs=False) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 'req_state': req_state}) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self.force_reraise() 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] raise self.value 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] time.sleep(sleep_time) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self.force_reraise() 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] raise self.value 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] return f(*args, **kwargs) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] return self._wait_for_job(job_path) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] error_desc=err_desc) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000062' failed to start. 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Not enough memory in the system to start the virtual machine instance-00000062. 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000062' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Not enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 'instance-00000062' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Error code: 32778. 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] During handling of the above exception, another exception occurred: 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Traceback (most recent call last): 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] accel_info=accel_info) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] return function(*args, **kwargs) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] admin_password, network_info, block_device_info) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] return function(self, *args, **kwds) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self.force_reraise() 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] raise self.value 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] should_plug_vifs=False) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 'req_state': req_state}) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self.force_reraise() 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] raise self.value 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] time.sleep(sleep_time) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self.force_reraise() 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] raise self.value 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] return f(*args, **kwargs) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] return self._wait_for_job(job_path) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] error_desc=err_desc) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000062' failed to start. 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Not enough memory in the system to start the virtual machine instance-00000062. 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000062' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Not enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 'instance-00000062' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Error code: 32778. 2021-09-10 17:05:44.202 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] 2021-09-10 17:05:44.206 4088 3038342144600 MainThread DEBUG nova.compute.utils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] WMI job failed with status 10. Error summary description: 'instance-00000062' failed to start. Not enough memory in the system to start the virtual machine instance-00000062. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:05:44.206 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Build of instance 87008c7c-0917-4c78-93e1-b929cb87a160 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000062' failed to start. Not enough memory in the system to start the virtual machine instance-00000062. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000062' failed to start. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Not enough memory in the system to start the virtual machine instance-00000062 with ram size 1024 megabytes. (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) 'instance-00000062' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A01DE318-43C6-4A96-960E-E3CF1D7442D2) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:05:44.206 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:05:44.206 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:05:44.206 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:05:44.206 4088 3038342144600 MainThread DEBUG nova.network.neutron [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:05:44.330 4088 3038338906424 MainThread DEBUG os_win.utils.jobutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Waiting for WMI job: {'InstanceID': '55326371-2020-4A07-BFC5-73B3B534A274', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16904), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:44.485 4088 3038338906424 MainThread ERROR os_win.utils.jobutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000065\' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)instance-0000006508BF2C62-D5A9-4455-AF45-A7D6E94E1D1112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)instance-0000006508BF2C62-D5A9-4455-AF45-A7D6E94E1D1110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000065\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)instance-0000006508BF2C62-D5A9-4455-AF45-A7D6E94E1D11%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '55326371-2020-4A07-BFC5-73B3B534A274', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=94430), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 44), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 44), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000065' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)\n\nNot enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)\n\n'instance-00000065' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)", 'ErrorSummaryDescription': "'instance-00000065' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000065.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:44.485 4088 3038338906424 MainThread DEBUG os_win._utils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000065' failed to start. Not enough memory in the system to start the virtual machine instance-00000065. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000065' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Not enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) 'instance-00000065' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.929625511169434 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:44.485 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000065" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:44.485 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000065" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:44.485 4088 3038340491224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:44.485 4088 3038340491224 MainThread INFO nova.compute.manager [-] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] VM Stopped (Lifecycle Event) 2021-09-10 17:05:44.501 4088 3038341411064 MainThread DEBUG os_win.utils.jobutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Waiting for WMI job: {'InstanceID': 'AB06BBF2-31D0-44F5-873D-7BBCD603FEF3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16431), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:44.531 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:05:44.538 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-9443677b-3ae2-4085-92f9-2f8f20e23c28 - - - - -] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:44.538 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-9443677b-3ae2-4085-92f9-2f8f20e23c28 - - - - -] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:44.581 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-9443677b-3ae2-4085-92f9-2f8f20e23c28 - - - - -] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:44.629 4088 3038340491224 MainThread INFO nova.compute.manager [req-9443677b-3ae2-4085-92f9-2f8f20e23c28 - - - - -] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:44.629 4088 3038341411064 MainThread ERROR os_win.utils.jobutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000066\' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)instance-000000660723DD3F-DA6C-4065-9CBC-DA5B4C9AE17712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)instance-000000660723DD3F-DA6C-4065-9CBC-DA5B4C9AE17710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000066\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)instance-000000660723DD3F-DA6C-4065-9CBC-DA5B4C9AE177%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'AB06BBF2-31D0-44F5-873D-7BBCD603FEF3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=95820), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 44), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 44), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000066' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)\n\nNot enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)\n\n'instance-00000066' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)", 'ErrorSummaryDescription': "'instance-00000066' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000066.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:44.629 4088 3038341411064 MainThread DEBUG os_win._utils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000066' failed to start. Not enough memory in the system to start the virtual machine instance-00000066. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000066' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Not enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) 'instance-00000066' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.752458333969116 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:44.672 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000066" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:44.672 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000066" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:44.672 4088 3038340491224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:44.672 4088 3038340491224 MainThread INFO nova.compute.manager [-] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] VM Stopped (Lifecycle Event) 2021-09-10 17:05:44.721 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-f0df80ec-8442-457a-b50e-8a27abc146d5 - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:44.721 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-f0df80ec-8442-457a-b50e-8a27abc146d5 - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:44.765 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-f0df80ec-8442-457a-b50e-8a27abc146d5 - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:44.797 4088 3038340491224 MainThread INFO nova.compute.manager [req-f0df80ec-8442-457a-b50e-8a27abc146d5 - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:44.860 4088 3038338905368 MainThread DEBUG os_win.utils.jobutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': '507CFA41-644A-4493-B886-74FFC907D307', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15745), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:45.004 4088 3038338905368 MainThread ERROR os_win.utils.jobutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000064\' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)instance-000000641141FF2C-78FF-4E76-877A-B68B69200D0B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)instance-000000641141FF2C-78FF-4E76-877A-B68B69200D0B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000064\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)instance-000000641141FF2C-78FF-4E76-877A-B68B69200D0B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '507CFA41-644A-4493-B886-74FFC907D307', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112102), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 44), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 44), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000064' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)\n\nNot enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)\n\n'instance-00000064' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)", 'ErrorSummaryDescription': "'instance-00000064' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000064.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:45.004 4088 3038338905368 MainThread DEBUG os_win._utils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000064' failed to start. Not enough memory in the system to start the virtual machine instance-00000064. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000064' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Not enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) 'instance-00000064' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.646601676940918 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:45.037 4088 3038340491224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:45.037 4088 3038340491224 MainThread INFO nova.compute.manager [-] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] VM Stopped (Lifecycle Event) 2021-09-10 17:05:45.037 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000064" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:45.037 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000064" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:45.063 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-18a1c9c0-abc9-4b89-8e5e-6e2b7354840e - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:45.063 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-18a1c9c0-abc9-4b89-8e5e-6e2b7354840e - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:45.102 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-18a1c9c0-abc9-4b89-8e5e-6e2b7354840e - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:45.141 4088 3038340491224 MainThread INFO nova.compute.manager [req-18a1c9c0-abc9-4b89-8e5e-6e2b7354840e - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:45.522 4088 3038338906424 MainThread DEBUG os_win.utils.jobutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Waiting for WMI job: {'InstanceID': '6E20592C-2A8B-4B40-80B4-0E5C16FC1F28', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20036), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:45.536 4088 3038342144600 MainThread DEBUG nova.network.neutron [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:05:45.578 4088 3038342144600 MainThread INFO nova.compute.manager [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 87008c7c-0917-4c78-93e1-b929cb87a160] Took 1.38 seconds to deallocate network for instance. 2021-09-10 17:05:45.673 4088 3038338906424 MainThread ERROR os_win.utils.jobutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000065\' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)instance-0000006508BF2C62-D5A9-4455-AF45-A7D6E94E1D1112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)instance-0000006508BF2C62-D5A9-4455-AF45-A7D6E94E1D1110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000065\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)instance-0000006508BF2C62-D5A9-4455-AF45-A7D6E94E1D11%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6E20592C-2A8B-4B40-80B4-0E5C16FC1F28', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=97210), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 45), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 45), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000065' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)\n\nNot enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)\n\n'instance-00000065' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11)", 'ErrorSummaryDescription': "'instance-00000065' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000065.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:45.673 4088 3038338906424 MainThread ERROR nova.virt.hyperv.vmops [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Failed to change vm state of instance-00000065 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000065' failed to start. 2021-09-10 17:05:45.673 4088 3038338906424 MainThread INFO nova.virt.hyperv.vmops [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Got request to destroy instance 2021-09-10 17:05:45.673 4088 3038337403192 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:45.673 4088 3038337403192 MainThread INFO nova.compute.manager [-] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] VM Stopped (Lifecycle Event) 2021-09-10 17:05:45.673 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000065" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:45.673 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000065" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:45.673 4088 3038341411064 MainThread DEBUG os_win.utils.jobutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Waiting for WMI job: {'InstanceID': 'B59C4118-FEAE-4C7F-B930-AC7289A60609', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16344), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:45.709 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-7a68db0e-4ab0-4920-a296-d2612dcea51a - - - - -] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:45.709 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.vmops [req-7a68db0e-4ab0-4920-a296-d2612dcea51a - - - - -] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:45.752 4088 3038342144600 MainThread INFO nova.scheduler.client.report [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Deleted allocations for instance 87008c7c-0917-4c78-93e1-b929cb87a160 2021-09-10 17:05:45.786 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-7a68db0e-4ab0-4920-a296-d2612dcea51a - - - - -] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:45.819 4088 3038337403192 MainThread INFO nova.compute.manager [req-7a68db0e-4ab0-4920-a296-d2612dcea51a - - - - -] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:45.819 4088 3038341411064 MainThread ERROR os_win.utils.jobutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000066\' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)instance-000000660723DD3F-DA6C-4065-9CBC-DA5B4C9AE17712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)instance-000000660723DD3F-DA6C-4065-9CBC-DA5B4C9AE17710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000066\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)instance-000000660723DD3F-DA6C-4065-9CBC-DA5B4C9AE177%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B59C4118-FEAE-4C7F-B930-AC7289A60609', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=98844), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 45), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 45), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000066' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)\n\nNot enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)\n\n'instance-00000066' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)", 'ErrorSummaryDescription': "'instance-00000066' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000066.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:45.819 4088 3038341411064 MainThread DEBUG os_win._utils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000066' failed to start. Not enough memory in the system to start the virtual machine instance-00000066. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000066' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Not enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) 'instance-00000066' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.941904067993164 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:45.819 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000066" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:45.819 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000066" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:45.819 4088 3038337403192 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:45.819 4088 3038337403192 MainThread INFO nova.compute.manager [-] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] VM Stopped (Lifecycle Event) 2021-09-10 17:05:45.865 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-54531d03-6024-4b86-963e-4131151242da - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:45.865 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.vmops [req-54531d03-6024-4b86-963e-4131151242da - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:45.879 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-568e6b8a-d4c0-4bb1-b65e-847f9db34869 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "87008c7c-0917-4c78-93e1-b929cb87a160" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 31.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:45.906 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-54531d03-6024-4b86-963e-4131151242da - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:45.938 4088 3038337403192 MainThread INFO nova.compute.manager [req-54531d03-6024-4b86-963e-4131151242da - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:46.032 4088 3038338905368 MainThread DEBUG os_win.utils.jobutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': '9C59F78F-9AF2-40C5-A7E2-31F0C8EC001C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18037), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:46.188 4088 3038338905368 MainThread ERROR os_win.utils.jobutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000064\' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)instance-000000641141FF2C-78FF-4E76-877A-B68B69200D0B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)instance-000000641141FF2C-78FF-4E76-877A-B68B69200D0B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000064\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)instance-000000641141FF2C-78FF-4E76-877A-B68B69200D0B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9C59F78F-9AF2-40C5-A7E2-31F0C8EC001C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118888), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 46), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 46), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000064' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)\n\nNot enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)\n\n'instance-00000064' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)", 'ErrorSummaryDescription': "'instance-00000064' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000064.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:46.188 4088 3038338905368 MainThread DEBUG os_win._utils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000064' failed to start. Not enough memory in the system to start the virtual machine instance-00000064. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000064' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Not enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) 'instance-00000064' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.830958366394043 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:46.221 4088 3038337403192 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:46.221 4088 3038337403192 MainThread INFO nova.compute.manager [-] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] VM Stopped (Lifecycle Event) 2021-09-10 17:05:46.221 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000064" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:46.221 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000064" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:46.221 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-fce347ab-534d-4d34-940c-ac5deb873240 - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:46.221 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.vmops [req-fce347ab-534d-4d34-940c-ac5deb873240 - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:46.298 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-fce347ab-534d-4d34-940c-ac5deb873240 - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:46.313 4088 3038337403192 MainThread INFO nova.compute.manager [req-fce347ab-534d-4d34-940c-ac5deb873240 - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:46.534 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:05:46.846 4088 3038341411064 MainThread DEBUG os_win.utils.jobutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Waiting for WMI job: {'InstanceID': '3132D741-D47E-4C0C-865A-98B9D26D7B30', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16071), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:46.992 4088 3038341411064 MainThread ERROR os_win.utils.jobutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000066\' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)instance-000000660723DD3F-DA6C-4065-9CBC-DA5B4C9AE17712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)instance-000000660723DD3F-DA6C-4065-9CBC-DA5B4C9AE17710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000066\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)instance-000000660723DD3F-DA6C-4065-9CBC-DA5B4C9AE177%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3132D741-D47E-4C0C-865A-98B9D26D7B30', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=95317), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 46), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 46), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000066' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)\n\nNot enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)\n\n'instance-00000066' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177)", 'ErrorSummaryDescription': "'instance-00000066' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000066.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:46.992 4088 3038341411064 MainThread ERROR nova.virt.hyperv.vmops [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Failed to change vm state of instance-00000066 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000066' failed to start. 2021-09-10 17:05:46.992 4088 3038341411064 MainThread INFO nova.virt.hyperv.vmops [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Got request to destroy instance 2021-09-10 17:05:47.016 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000066" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:47.016 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000066" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:47.016 4088 3038337403192 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:47.016 4088 3038337403192 MainThread INFO nova.compute.manager [-] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] VM Stopped (Lifecycle Event) 2021-09-10 17:05:47.050 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-6f9f1fea-ead1-40ab-a0b7-c47078ae42fa - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:47.066 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.vmops [req-6f9f1fea-ead1-40ab-a0b7-c47078ae42fa - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:47.114 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-6f9f1fea-ead1-40ab-a0b7-c47078ae42fa - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:47.144 4088 3038337403192 MainThread INFO nova.compute.manager [req-6f9f1fea-ead1-40ab-a0b7-c47078ae42fa - - - - -] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:47.223 4088 3038338905368 MainThread DEBUG os_win.utils.jobutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': '94C4DC86-2E45-4E39-984E-B1831D78AFB8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17015), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:47.251 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "a891198b-c066-46f2-bcbd-290a870d60bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:47.297 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:05:47.363 4088 3038338905368 MainThread ERROR os_win.utils.jobutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000064\' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)instance-000000641141FF2C-78FF-4E76-877A-B68B69200D0B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)instance-000000641141FF2C-78FF-4E76-877A-B68B69200D0B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000064\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)instance-000000641141FF2C-78FF-4E76-877A-B68B69200D0B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '94C4DC86-2E45-4E39-984E-B1831D78AFB8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117629), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 47), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 47), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000064' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)\n\nNot enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)\n\n'instance-00000064' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)", 'ErrorSummaryDescription': "'instance-00000064' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000064.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:47.363 4088 3038338905368 MainThread DEBUG os_win._utils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000064' failed to start. Not enough memory in the system to start the virtual machine instance-00000064. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000064' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Not enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) 'instance-00000064' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.005461692810059 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:05:47.393 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000064" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:47.393 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000064" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:47.393 4088 3038337403192 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:47.393 4088 3038337403192 MainThread INFO nova.compute.manager [-] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] VM Stopped (Lifecycle Event) 2021-09-10 17:05:47.456 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-013fd3e3-2f38-4c4f-9fd1-6a0dac9d63dc - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:47.456 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.vmops [req-013fd3e3-2f38-4c4f-9fd1-6a0dac9d63dc - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:47.517 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-013fd3e3-2f38-4c4f-9fd1-6a0dac9d63dc - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:47.534 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:05:47.548 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:47.548 4088 3038340491224 MainThread DEBUG nova.virt.hardware [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:05:47.548 4088 3038340491224 MainThread INFO nova.compute.claims [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Claim successful on node n-h2-808474-1 2021-09-10 17:05:47.563 4088 3038337403192 MainThread INFO nova.compute.manager [req-013fd3e3-2f38-4c4f-9fd1-6a0dac9d63dc - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:47.613 4088 3038338906424 MainThread DEBUG nova.virt.hyperv.vmops [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:05:47.613 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "instance-00000065" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:47.613 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "instance-00000065" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:47.634 4088 3038338906424 MainThread DEBUG os_win.utils.compute.vmutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Successfully changed vm state of instance-00000065 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:05:47.634 4088 3038338906424 MainThread DEBUG nova.virt.hyperv.vmops [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Successfully changed state of VM instance-00000065 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:05:47.674 4088 3038338906424 MainThread DEBUG os_win.utils.jobutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Waiting for WMI job: {'InstanceID': '5AF6F819-1323-44B0-B881-5FDFFE7CED12', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15634), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:47.739 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.hostops [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:05:47.757 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.hostops [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:05:47.802 4088 3038338906424 MainThread DEBUG os_win.utils.jobutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] WMI job succeeded: {'InstanceID': '5AF6F819-1323-44B0-B881-5FDFFE7CED12', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=110388), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:05:47.802 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "instance-00000065" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:47.802 4088 3038338906424 MainThread DEBUG os_win.utils.pathutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Removing directory: C:\openstack\instances\instance-00000065 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:05:47.802 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "instance-00000065" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:47.802 4088 3038338906424 MainThread ERROR nova.compute.manager [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000065' failed to start. Not enough memory in the system to start the virtual machine instance-00000065. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000065' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Not enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) 'instance-00000065' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Error code: 32778. 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Traceback (most recent call last): 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] return function(*args, **kwargs) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] admin_password, network_info, block_device_info) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] return function(self, *args, **kwds) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self.force_reraise() 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] raise self.value 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] should_plug_vifs=False) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 'req_state': req_state}) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self.force_reraise() 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] raise self.value 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] time.sleep(sleep_time) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self.force_reraise() 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] raise self.value 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] return f(*args, **kwargs) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] return self._wait_for_job(job_path) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] error_desc=err_desc) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000065' failed to start. 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Not enough memory in the system to start the virtual machine instance-00000065. 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000065' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Not enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 'instance-00000065' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Error code: 32778. 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] During handling of the above exception, another exception occurred: 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Traceback (most recent call last): 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] yield resources 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] accel_info=accel_info) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] return function(*args, **kwargs) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] admin_password, network_info, block_device_info) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] return function(self, *args, **kwds) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self.force_reraise() 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] raise self.value 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] should_plug_vifs=False) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 'req_state': req_state}) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self.force_reraise() 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] raise self.value 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] time.sleep(sleep_time) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self.force_reraise() 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] raise self.value 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] return f(*args, **kwargs) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] return self._wait_for_job(job_path) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] error_desc=err_desc) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000065' failed to start. 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Not enough memory in the system to start the virtual machine instance-00000065. 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000065' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Not enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 'instance-00000065' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Error code: 32778. 2021-09-10 17:05:47.802 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:47.802 4088 3038338906424 MainThread INFO nova.compute.manager [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Terminating instance 2021-09-10 17:05:47.802 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Acquired lock "refresh_cache-94d2efe1-0d5a-49bf-ba29-3c312237f77d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:05:47.802 4088 3038338906424 MainThread DEBUG nova.network.neutron [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:05:47.864 4088 3038338906424 MainThread DEBUG nova.network.neutron [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:05:48.002 4088 3038340491224 MainThread DEBUG nova.compute.provider_tree [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:05:48.031 4088 3038340491224 MainThread DEBUG nova.scheduler.client.report [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:05:48.033 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:48.033 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:05:48.113 4088 3038340491224 MainThread DEBUG nova.compute.utils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 17:05:48.113 4088 3038340489992 GreenThread-91 DEBUG nova.compute.manager [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:05:48.113 4088 3038340489992 GreenThread-91 DEBUG nova.network.neutron [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:05:48.113 4088 3038338906424 MainThread DEBUG nova.network.neutron [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:05:48.142 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:05:48.142 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Releasing lock "refresh_cache-94d2efe1-0d5a-49bf-ba29-3c312237f77d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:05:48.142 4088 3038338906424 MainThread DEBUG nova.compute.manager [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:05:48.142 4088 3038338906424 MainThread INFO nova.virt.hyperv.vmops [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Got request to destroy instance 2021-09-10 17:05:48.162 4088 3038338906424 MainThread DEBUG nova.virt.hyperv.vmops [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:05:48.162 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "instance-00000065" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:48.162 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "instance-00000065" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:48.162 4088 3038338906424 MainThread INFO nova.compute.manager [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:05:48.162 4088 3038338906424 MainThread DEBUG oslo.service.loopingcall [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. func c:\python37\lib\site-packages\oslo_service\loopingcall.py:435 2021-09-10 17:05:48.162 4088 3038342146888 GreenThread-92 DEBUG nova.compute.manager [-] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Skipping network deallocation for instance since networking was not requested. _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2054 2021-09-10 17:05:48.162 4088 3038338906424 MainThread DEBUG nova.compute.claims [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:05:48.176 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:48.332 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:05:48.360 4088 3038340491224 MainThread INFO nova.virt.hyperv.vmops [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Spawning new instance 2021-09-10 17:05:48.369 4088 3038338906424 MainThread DEBUG nova.virt.hyperv.hostops [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:05:48.369 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000068" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:48.369 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000068" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:48.369 4088 3038340491224 MainThread DEBUG nova.block_device [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:05:48.369 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:48.369 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:48.384 4088 3038338906424 MainThread DEBUG nova.virt.hyperv.hostops [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:05:48.396 4088 3038340491224 MainThread DEBUG os_win.utils.pathutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Creating directory: C:\openstack\instances\instance-00000068 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:05:48.396 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000068\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:05:48.396 4088 3038338905368 MainThread DEBUG os_win.utils.jobutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': 'AAB25B43-81A3-4C18-9292-6E9A1375423E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18858), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:48.501 4088 3038340489992 GreenThread-91 DEBUG nova.policy [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3b19a6ed8024fe7b99f5aa4978b5af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecab78b34b0468f8c42e4b7f3444918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:05:48.536 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:05:48.536 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:05:48.536 4088 3038338905368 MainThread ERROR os_win.utils.jobutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000064\' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)instance-000000641141FF2C-78FF-4E76-877A-B68B69200D0B12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)instance-000000641141FF2C-78FF-4E76-877A-B68B69200D0B10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000064\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)instance-000000641141FF2C-78FF-4E76-877A-B68B69200D0B%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'AAB25B43-81A3-4C18-9292-6E9A1375423E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=122327), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 5, 48), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 5, 48), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000064' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)\n\nNot enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)\n\n'instance-00000064' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B)", 'ErrorSummaryDescription': "'instance-00000064' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000064.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:05:48.536 4088 3038338905368 MainThread ERROR nova.virt.hyperv.vmops [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Failed to change vm state of instance-00000064 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000064' failed to start. 2021-09-10 17:05:48.553 4088 3038338905368 MainThread INFO nova.virt.hyperv.vmops [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Got request to destroy instance 2021-09-10 17:05:48.583 4088 3038342146888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:05:48.583 4088 3038342146888 MainThread INFO nova.compute.manager [-] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] VM Stopped (Lifecycle Event) 2021-09-10 17:05:48.583 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000064" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:48.583 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000064" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:48.630 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-a5015282-648f-44fb-ac59-d4c92b0f3bbd - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:05:48.630 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [req-a5015282-648f-44fb-ac59-d4c92b0f3bbd - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:05:48.630 4088 3038338906424 MainThread DEBUG nova.compute.provider_tree [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:05:48.644 4088 3038338906424 MainThread DEBUG nova.scheduler.client.report [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:05:48.644 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:48.644 4088 3038338906424 MainThread ERROR nova.compute.manager [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000065' failed to start. Not enough memory in the system to start the virtual machine instance-00000065. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000065' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Not enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) 'instance-00000065' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Error code: 32778. 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Traceback (most recent call last): 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] return function(*args, **kwargs) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] admin_password, network_info, block_device_info) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] return function(self, *args, **kwds) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self.force_reraise() 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] raise self.value 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] should_plug_vifs=False) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 'req_state': req_state}) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self.force_reraise() 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] raise self.value 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] time.sleep(sleep_time) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self.force_reraise() 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] raise self.value 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] return f(*args, **kwargs) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] return self._wait_for_job(job_path) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] error_desc=err_desc) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000065' failed to start. 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Not enough memory in the system to start the virtual machine instance-00000065. 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000065' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Not enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 'instance-00000065' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Error code: 32778. 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] During handling of the above exception, another exception occurred: 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Traceback (most recent call last): 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] accel_info=accel_info) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] return function(*args, **kwargs) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] admin_password, network_info, block_device_info) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] return function(self, *args, **kwds) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self.force_reraise() 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] raise self.value 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] should_plug_vifs=False) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 'req_state': req_state}) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self.force_reraise() 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] raise self.value 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] time.sleep(sleep_time) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self.force_reraise() 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] raise self.value 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] return f(*args, **kwargs) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] return self._wait_for_job(job_path) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] error_desc=err_desc) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000065' failed to start. 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Not enough memory in the system to start the virtual machine instance-00000065. 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000065' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Not enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 'instance-00000065' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Error code: 32778. 2021-09-10 17:05:48.644 4088 3038338906424 MainThread TRACE nova.compute.manager [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] 2021-09-10 17:05:48.659 4088 3038338906424 MainThread DEBUG nova.compute.utils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] WMI job failed with status 10. Error summary description: 'instance-00000065' failed to start. Not enough memory in the system to start the virtual machine instance-00000065. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:05:48.659 4088 3038338906424 MainThread DEBUG nova.compute.manager [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Build of instance 94d2efe1-0d5a-49bf-ba29-3c312237f77d was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000065' failed to start. Not enough memory in the system to start the virtual machine instance-00000065. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000065' failed to start. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Not enough memory in the system to start the virtual machine instance-00000065 with ram size 1024 megabytes. (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) 'instance-00000065' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 08BF2C62-D5A9-4455-AF45-A7D6E94E1D11) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:05:48.659 4088 3038338906424 MainThread DEBUG nova.compute.manager [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:05:48.659 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Acquired lock "refresh_cache-94d2efe1-0d5a-49bf-ba29-3c312237f77d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:05:48.659 4088 3038338906424 MainThread DEBUG nova.network.neutron [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:05:48.677 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Resizing VHD C:\openstack\instances\instance-00000068\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:05:48.677 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-a5015282-648f-44fb-ac59-d4c92b0f3bbd - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:05:48.706 4088 3038342146888 MainThread INFO nova.compute.manager [req-a5015282-648f-44fb-ac59-d4c92b0f3bbd - - - - -] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:05:48.803 4088 3038338906424 MainThread DEBUG nova.network.neutron [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:05:49.047 4088 3038341411064 MainThread DEBUG nova.virt.hyperv.vmops [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:05:49.047 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "instance-00000066" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:49.047 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "instance-00000066" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:49.081 4088 3038341411064 MainThread DEBUG os_win.utils.compute.vmutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Successfully changed vm state of instance-00000066 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:05:49.081 4088 3038341411064 MainThread DEBUG nova.virt.hyperv.vmops [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Successfully changed state of VM instance-00000066 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:05:49.128 4088 3038341411064 MainThread DEBUG os_win.utils.jobutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Waiting for WMI job: {'InstanceID': 'E33B0E04-615E-45C9-975D-B9BDDBB41E4E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15786), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:49.154 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-6a33a253-c7b1-44b1-bdc0-eca64733ab55" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:05:49.154 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:05:49.253 4088 3038341411064 MainThread DEBUG os_win.utils.jobutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] WMI job succeeded: {'InstanceID': 'E33B0E04-615E-45C9-975D-B9BDDBB41E4E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=125327), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:05:49.253 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "instance-00000066" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:49.253 4088 3038341411064 MainThread DEBUG os_win.utils.pathutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Removing directory: C:\openstack\instances\instance-00000066 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:05:49.253 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "instance-00000066" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:49.253 4088 3038341411064 MainThread ERROR nova.compute.manager [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000066' failed to start. Not enough memory in the system to start the virtual machine instance-00000066. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000066' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Not enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) 'instance-00000066' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Error code: 32778. 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Traceback (most recent call last): 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] return function(*args, **kwargs) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] admin_password, network_info, block_device_info) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] return function(self, *args, **kwds) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self.force_reraise() 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] raise self.value 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] should_plug_vifs=False) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 'req_state': req_state}) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self.force_reraise() 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] raise self.value 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] time.sleep(sleep_time) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self.force_reraise() 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] raise self.value 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] return f(*args, **kwargs) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] return self._wait_for_job(job_path) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] error_desc=err_desc) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000066' failed to start. 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Not enough memory in the system to start the virtual machine instance-00000066. 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000066' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Not enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 'instance-00000066' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Error code: 32778. 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] During handling of the above exception, another exception occurred: 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Traceback (most recent call last): 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] yield resources 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] accel_info=accel_info) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] return function(*args, **kwargs) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] admin_password, network_info, block_device_info) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] return function(self, *args, **kwds) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self.force_reraise() 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] raise self.value 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] should_plug_vifs=False) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 'req_state': req_state}) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self.force_reraise() 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] raise self.value 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] time.sleep(sleep_time) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self.force_reraise() 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] raise self.value 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] return f(*args, **kwargs) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] return self._wait_for_job(job_path) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] error_desc=err_desc) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000066' failed to start. 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Not enough memory in the system to start the virtual machine instance-00000066. 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000066' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Not enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 'instance-00000066' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Error code: 32778. 2021-09-10 17:05:49.253 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:49.253 4088 3038341411064 MainThread INFO nova.compute.manager [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Terminating instance 2021-09-10 17:05:49.253 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Acquired lock "refresh_cache-d9d8c32a-f534-4f8f-a1ba-5b0b5452598e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:05:49.253 4088 3038341411064 MainThread DEBUG nova.network.neutron [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:05:49.563 4088 3038341411064 MainThread DEBUG nova.network.neutron [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:05:49.722 4088 3038338906424 MainThread DEBUG nova.network.neutron [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:05:49.735 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Releasing lock "refresh_cache-94d2efe1-0d5a-49bf-ba29-3c312237f77d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:05:49.735 4088 3038338906424 MainThread DEBUG nova.compute.manager [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:05:49.735 4088 3038338906424 MainThread DEBUG nova.compute.manager [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: 94d2efe1-0d5a-49bf-ba29-3c312237f77d] Skipping network deallocation for instance since networking was not requested. _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2054 2021-09-10 17:05:50.019 4088 3038338906424 MainThread INFO nova.scheduler.client.report [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Deleted allocations for instance 94d2efe1-0d5a-49bf-ba29-3c312237f77d 2021-09-10 17:05:50.068 4088 3038338906424 MainThread DEBUG oslo_concurrency.lockutils [req-0a0e5936-e6a2-4bd5-b010-7960f41d2c13 ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "94d2efe1-0d5a-49bf-ba29-3c312237f77d" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.953s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:50.441 4088 3038341411064 MainThread DEBUG nova.network.neutron [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:05:50.441 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Releasing lock "refresh_cache-d9d8c32a-f534-4f8f-a1ba-5b0b5452598e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:05:50.469 4088 3038341411064 MainThread DEBUG nova.compute.manager [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:05:50.469 4088 3038341411064 MainThread INFO nova.virt.hyperv.vmops [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Got request to destroy instance 2021-09-10 17:05:50.473 4088 3038341411064 MainThread DEBUG nova.virt.hyperv.vmops [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:05:50.488 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "instance-00000066" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:50.488 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "instance-00000066" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:50.488 4088 3038341411064 MainThread INFO nova.compute.manager [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:05:50.488 4088 3038341411064 MainThread DEBUG oslo.service.loopingcall [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. func c:\python37\lib\site-packages\oslo_service\loopingcall.py:435 2021-09-10 17:05:50.488 4088 3038340492280 GreenThread-93 DEBUG nova.compute.manager [-] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Skipping network deallocation for instance since networking was not requested. _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2054 2021-09-10 17:05:50.488 4088 3038341411064 MainThread DEBUG nova.compute.claims [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:05:50.488 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:50.680 4088 3038338905368 MainThread DEBUG nova.virt.hyperv.vmops [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:05:50.680 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-00000064" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:50.680 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-00000064" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:50.698 4088 3038338905368 MainThread DEBUG os_win.utils.compute.vmutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Successfully changed vm state of instance-00000064 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:05:50.698 4088 3038338905368 MainThread DEBUG nova.virt.hyperv.vmops [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Successfully changed state of VM instance-00000064 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:05:50.719 4088 3038341411064 MainThread DEBUG nova.virt.hyperv.hostops [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:05:50.738 4088 3038341411064 MainThread DEBUG nova.virt.hyperv.hostops [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:05:50.755 4088 3038338905368 MainThread DEBUG os_win.utils.jobutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': 'C104982A-9B0C-43F8-898D-D715B8D4B6AC', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16088), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:05:50.881 4088 3038338905368 MainThread DEBUG os_win.utils.jobutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job succeeded: {'InstanceID': 'C104982A-9B0C-43F8-898D-D715B8D4B6AC', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=105493), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:05:50.881 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-00000064" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:50.881 4088 3038338905368 MainThread DEBUG os_win.utils.pathutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Removing directory: C:\openstack\instances\instance-00000064 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:05:50.881 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-00000064" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:50.881 4088 3038338905368 MainThread ERROR nova.compute.manager [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000064' failed to start. Not enough memory in the system to start the virtual machine instance-00000064. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000064' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Not enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) 'instance-00000064' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Error code: 32778. 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Traceback (most recent call last): 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] return function(*args, **kwargs) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] admin_password, network_info, block_device_info) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] return function(self, *args, **kwds) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self.force_reraise() 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] raise self.value 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] should_plug_vifs=False) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 'req_state': req_state}) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self.force_reraise() 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] raise self.value 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] time.sleep(sleep_time) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self.force_reraise() 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] raise self.value 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] return f(*args, **kwargs) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] return self._wait_for_job(job_path) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] error_desc=err_desc) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000064' failed to start. 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Not enough memory in the system to start the virtual machine instance-00000064. 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000064' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Not enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 'instance-00000064' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Error code: 32778. 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] During handling of the above exception, another exception occurred: 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Traceback (most recent call last): 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] yield resources 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] accel_info=accel_info) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] return function(*args, **kwargs) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] admin_password, network_info, block_device_info) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] return function(self, *args, **kwds) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self.force_reraise() 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] raise self.value 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] should_plug_vifs=False) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 'req_state': req_state}) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self.force_reraise() 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] raise self.value 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] time.sleep(sleep_time) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self.force_reraise() 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] raise self.value 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] return f(*args, **kwargs) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] return self._wait_for_job(job_path) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] error_desc=err_desc) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000064' failed to start. 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Not enough memory in the system to start the virtual machine instance-00000064. 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000064' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Not enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 'instance-00000064' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Error code: 32778. 2021-09-10 17:05:50.881 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:50.895 4088 3038338905368 MainThread INFO nova.compute.manager [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Terminating instance 2021-09-10 17:05:50.895 4088 3038338905368 MainThread DEBUG nova.compute.manager [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:05:50.895 4088 3038338905368 MainThread INFO nova.virt.hyperv.vmops [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Got request to destroy instance 2021-09-10 17:05:50.911 4088 3038338905368 MainThread DEBUG nova.virt.hyperv.vmops [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:05:50.911 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-00000064" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:50.911 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-00000064" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:50.911 4088 3038338905368 MainThread INFO nova.compute.manager [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:05:50.911 4088 3038338905368 MainThread DEBUG nova.compute.claims [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:05:50.911 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Updating instance_info_cache with network_info: [{"id": "d98b48f6-4cb1-44c3-9950-b42769c9d93e", "address": "fa:16:3e:44:cf:f9", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd98b48f6-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:05:50.955 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-6a33a253-c7b1-44b1-bdc0-eca64733ab55" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:05:50.955 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:05:50.955 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:05:50.955 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:05:51.066 4088 3038341411064 MainThread DEBUG nova.compute.provider_tree [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:05:51.080 4088 3038341411064 MainThread DEBUG nova.scheduler.client.report [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:05:51.080 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.594s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:51.080 4088 3038341411064 MainThread ERROR nova.compute.manager [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000066' failed to start. Not enough memory in the system to start the virtual machine instance-00000066. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000066' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Not enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) 'instance-00000066' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Error code: 32778. 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Traceback (most recent call last): 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] return function(*args, **kwargs) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] admin_password, network_info, block_device_info) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] return function(self, *args, **kwds) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self.force_reraise() 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] raise self.value 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] should_plug_vifs=False) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 'req_state': req_state}) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self.force_reraise() 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] raise self.value 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] time.sleep(sleep_time) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self.force_reraise() 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] raise self.value 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] return f(*args, **kwargs) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] return self._wait_for_job(job_path) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] error_desc=err_desc) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000066' failed to start. 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Not enough memory in the system to start the virtual machine instance-00000066. 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000066' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Not enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 'instance-00000066' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Error code: 32778. 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] During handling of the above exception, another exception occurred: 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Traceback (most recent call last): 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] accel_info=accel_info) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] return function(*args, **kwargs) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] admin_password, network_info, block_device_info) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] return function(self, *args, **kwds) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self.force_reraise() 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] raise self.value 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] should_plug_vifs=False) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 'req_state': req_state}) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self.force_reraise() 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] raise self.value 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] time.sleep(sleep_time) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self.force_reraise() 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] raise self.value 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] return f(*args, **kwargs) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] return self._wait_for_job(job_path) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] error_desc=err_desc) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000066' failed to start. 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Not enough memory in the system to start the virtual machine instance-00000066. 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000066' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Not enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 'instance-00000066' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Error code: 32778. 2021-09-10 17:05:51.080 4088 3038341411064 MainThread TRACE nova.compute.manager [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] 2021-09-10 17:05:51.080 4088 3038341411064 MainThread DEBUG nova.compute.utils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] WMI job failed with status 10. Error summary description: 'instance-00000066' failed to start. Not enough memory in the system to start the virtual machine instance-00000066. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:05:51.080 4088 3038341411064 MainThread DEBUG nova.compute.manager [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Build of instance d9d8c32a-f534-4f8f-a1ba-5b0b5452598e was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000066' failed to start. Not enough memory in the system to start the virtual machine instance-00000066. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000066' failed to start. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Not enough memory in the system to start the virtual machine instance-00000066 with ram size 1024 megabytes. (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) 'instance-00000066' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0723DD3F-DA6C-4065-9CBC-DA5B4C9AE177) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:05:51.080 4088 3038341411064 MainThread DEBUG nova.compute.manager [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:05:51.098 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Acquired lock "refresh_cache-d9d8c32a-f534-4f8f-a1ba-5b0b5452598e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:05:51.098 4088 3038341411064 MainThread DEBUG nova.network.neutron [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:05:51.098 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.187s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:51.172 4088 3038341411064 MainThread DEBUG nova.network.neutron [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:05:51.281 4088 3038338905368 MainThread DEBUG nova.virt.hyperv.hostops [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:05:51.297 4088 3038338905368 MainThread DEBUG nova.virt.hyperv.hostops [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:05:51.476 4088 3038341411064 MainThread DEBUG nova.network.neutron [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:05:51.507 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Releasing lock "refresh_cache-d9d8c32a-f534-4f8f-a1ba-5b0b5452598e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:05:51.507 4088 3038341411064 MainThread DEBUG nova.compute.manager [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:05:51.507 4088 3038341411064 MainThread DEBUG nova.compute.manager [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] [instance: d9d8c32a-f534-4f8f-a1ba-5b0b5452598e] Skipping network deallocation for instance since networking was not requested. _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2054 2021-09-10 17:05:51.507 4088 3038338905368 MainThread DEBUG nova.compute.provider_tree [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:05:51.531 4088 3038340489992 GreenThread-91 DEBUG nova.network.neutron [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Successfully created port: 587b6100-dc8d-42b4-b42b-7e2abe2d8865 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:05:51.547 4088 3038338905368 MainThread DEBUG nova.scheduler.client.report [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:05:51.547 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:51.547 4088 3038338905368 MainThread ERROR nova.compute.manager [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000064' failed to start. Not enough memory in the system to start the virtual machine instance-00000064. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000064' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Not enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) 'instance-00000064' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Error code: 32778. 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Traceback (most recent call last): 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] return function(*args, **kwargs) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] admin_password, network_info, block_device_info) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] return function(self, *args, **kwds) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self.force_reraise() 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] raise self.value 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] should_plug_vifs=False) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 'req_state': req_state}) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self.force_reraise() 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] raise self.value 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] time.sleep(sleep_time) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self.force_reraise() 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] raise self.value 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] return f(*args, **kwargs) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] return self._wait_for_job(job_path) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] error_desc=err_desc) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000064' failed to start. 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Not enough memory in the system to start the virtual machine instance-00000064. 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000064' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Not enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 'instance-00000064' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Error code: 32778. 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] During handling of the above exception, another exception occurred: 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Traceback (most recent call last): 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] accel_info=accel_info) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] return function(*args, **kwargs) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] admin_password, network_info, block_device_info) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] return function(self, *args, **kwds) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self.force_reraise() 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] raise self.value 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] should_plug_vifs=False) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 'req_state': req_state}) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self.force_reraise() 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] raise self.value 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] time.sleep(sleep_time) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self.force_reraise() 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] raise self.value 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] return f(*args, **kwargs) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] return self._wait_for_job(job_path) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] error_desc=err_desc) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000064' failed to start. 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Not enough memory in the system to start the virtual machine instance-00000064. 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000064' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Not enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 'instance-00000064' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Error code: 32778. 2021-09-10 17:05:51.547 4088 3038338905368 MainThread TRACE nova.compute.manager [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] 2021-09-10 17:05:51.573 4088 3038338905368 MainThread DEBUG nova.compute.utils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] WMI job failed with status 10. Error summary description: 'instance-00000064' failed to start. Not enough memory in the system to start the virtual machine instance-00000064. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:05:51.573 4088 3038338905368 MainThread DEBUG nova.compute.manager [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Build of instance d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000064' failed to start. Not enough memory in the system to start the virtual machine instance-00000064. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000064' failed to start. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Not enough memory in the system to start the virtual machine instance-00000064 with ram size 1024 megabytes. (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) 'instance-00000064' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1141FF2C-78FF-4E76-877A-B68B69200D0B) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:05:51.573 4088 3038338905368 MainThread DEBUG nova.compute.manager [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:05:51.573 4088 3038338905368 MainThread DEBUG nova.compute.manager [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:05:51.573 4088 3038338905368 MainThread DEBUG nova.compute.manager [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:05:51.573 4088 3038338905368 MainThread DEBUG nova.network.neutron [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:05:51.813 4088 3038341411064 MainThread INFO nova.scheduler.client.report [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Deleted allocations for instance d9d8c32a-f534-4f8f-a1ba-5b0b5452598e 2021-09-10 17:05:51.863 4088 3038341411064 MainThread DEBUG oslo_concurrency.lockutils [req-e65109f7-0377-4238-90e5-effef713f29b ea6ef73c263247479859a70f94b17060 a93cbf4dbb764c2aba80a6d873876165 - default default] Lock "d9d8c32a-f534-4f8f-a1ba-5b0b5452598e" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.828s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:54.022 4088 3038338905368 MainThread DEBUG nova.network.neutron [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:05:54.055 4088 3038338905368 MainThread INFO nova.compute.manager [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d] Took 2.47 seconds to deallocate network for instance. 2021-09-10 17:05:54.273 4088 3038338905368 MainThread INFO nova.scheduler.client.report [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Deleted allocations for instance d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d 2021-09-10 17:05:54.328 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [req-338276e3-d960-4845-be9d-42db39d9cc04 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "d2485dc8-cd44-42ec-87cb-0a2cfbe0de7d" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 26.954s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:54.539 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:05:54.567 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:54.567 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:54.567 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:05:54.567 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:05:54.585 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:05:54.798 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2209MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:05:54.798 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:55.082 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:05:55.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:05:55.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:05:55.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:05:55.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:05:55.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:05:55.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:05:55.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:05:55.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:05:55.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:05:55.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:05:55.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:05:55.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:05:55.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance a891198b-c066-46f2-bcbd-290a870d60bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:05:55.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:05:55.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=14GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:05:55.143 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:05:55.156 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:05:55.264 4088 3038340489992 GreenThread-91 DEBUG nova.network.neutron [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Successfully updated port: 587b6100-dc8d-42b4-b42b-7e2abe2d8865 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:05:55.297 4088 3038340489992 GreenThread-91 DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Acquired lock "refresh_cache-a891198b-c066-46f2-bcbd-290a870d60bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:05:55.297 4088 3038340489992 GreenThread-91 DEBUG nova.network.neutron [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:05:55.376 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:05:55.376 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:05:55.397 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:05:55.397 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:55.688 4088 3038340489992 GreenThread-91 DEBUG nova.network.neutron [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:05:56.315 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "052c4e6a-de0f-4bd4-bfb2-812601b39335" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:56.344 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:05:56.524 4088 3038341412120 MainThread DEBUG nova.compute.manager [req-45766fcd-82d1-43f0-b7e3-ff596849cc05 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Received event network-changed-587b6100-dc8d-42b4-b42b-7e2abe2d8865 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:05:56.524 4088 3038341412120 MainThread DEBUG nova.compute.manager [req-45766fcd-82d1-43f0-b7e3-ff596849cc05 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Refreshing instance network info cache due to event network-changed-587b6100-dc8d-42b4-b42b-7e2abe2d8865. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:05:56.537 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:56.537 4088 3038341411944 MainThread DEBUG nova.virt.hardware [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:05:56.537 4088 3038341411944 MainThread INFO nova.compute.claims [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Claim successful on node n-h2-808474-1 2021-09-10 17:05:56.784 4088 3038340489992 GreenThread-91 DEBUG nova.network.neutron [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Updating instance_info_cache with network_info: [{"id": "587b6100-dc8d-42b4-b42b-7e2abe2d8865", "address": "fa:16:3e:be:49:90", "network": {"id": "8a0fc2b4-bff6-4887-a969-81fb448d568f", "bridge": null, "label": "tempest-DeleteServersTestJSON-1414296899-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "eecab78b34b0468f8c42e4b7f3444918", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap587b6100-dc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:05:56.799 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.hostops [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:05:56.814 4088 3038340489992 GreenThread-91 DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Releasing lock "refresh_cache-a891198b-c066-46f2-bcbd-290a870d60bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:05:56.814 4088 3038340489992 GreenThread-91 DEBUG nova.compute.manager [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Instance network_info: |[{"id": "587b6100-dc8d-42b4-b42b-7e2abe2d8865", "address": "fa:16:3e:be:49:90", "network": {"id": "8a0fc2b4-bff6-4887-a969-81fb448d568f", "bridge": null, "label": "tempest-DeleteServersTestJSON-1414296899-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "eecab78b34b0468f8c42e4b7f3444918", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap587b6100-dc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:05:56.814 4088 3038341412120 MainThread DEBUG oslo_concurrency.lockutils [req-45766fcd-82d1-43f0-b7e3-ff596849cc05 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-a891198b-c066-46f2-bcbd-290a870d60bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:05:56.814 4088 3038341412120 MainThread DEBUG nova.network.neutron [req-45766fcd-82d1-43f0-b7e3-ff596849cc05 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Refreshing network info cache for port 587b6100-dc8d-42b4-b42b-7e2abe2d8865 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:05:56.814 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Preparing to wait for external event network-vif-plugged-587b6100-dc8d-42b4-b42b-7e2abe2d8865 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:05:56.814 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "a891198b-c066-46f2-bcbd-290a870d60bd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:56.814 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "a891198b-c066-46f2-bcbd-290a870d60bd-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:56.814 4088 3038340491224 MainThread DEBUG os_win.utils.compute.vmutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Creating VM instance-00000068 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:05:56.814 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.hostops [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:05:57.219 4088 3038341411944 MainThread DEBUG nova.compute.provider_tree [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:05:57.219 4088 3038341411944 MainThread DEBUG nova.scheduler.client.report [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:05:57.219 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.687s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:57.219 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:05:57.317 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:05:57.317 4088 3038337403192 GreenThread-94 DEBUG nova.compute.manager [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:05:57.337 4088 3038337403192 GreenThread-94 DEBUG nova.network.neutron [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:05:57.462 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:05:57.482 4088 3038341411944 MainThread INFO nova.virt.hyperv.vmops [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Spawning new instance 2021-09-10 17:05:57.515 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "instance-00000067" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:57.515 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "instance-00000067" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:57.515 4088 3038341411944 MainThread DEBUG nova.block_device [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:05:57.522 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:05:57.522 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:05:57.522 4088 3038341411944 MainThread DEBUG os_win.utils.pathutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Creating directory: C:\openstack\instances\instance-00000067 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:05:57.522 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.vmops [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000067\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:05:57.704 4088 3038337403192 GreenThread-94 DEBUG nova.policy [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e00875ca35f4501afe5474947cd0708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ea24a7b47a4f4a9015423bfcc23f3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:05:57.767 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.vmops [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Resizing VHD C:\openstack\instances\instance-00000067\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:05:58.295 4088 3038341412120 MainThread DEBUG nova.network.neutron [req-45766fcd-82d1-43f0-b7e3-ff596849cc05 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Updated VIF entry in instance network info cache for port 587b6100-dc8d-42b4-b42b-7e2abe2d8865. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:05:58.295 4088 3038341412120 MainThread DEBUG nova.network.neutron [req-45766fcd-82d1-43f0-b7e3-ff596849cc05 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Updating instance_info_cache with network_info: [{"id": "587b6100-dc8d-42b4-b42b-7e2abe2d8865", "address": "fa:16:3e:be:49:90", "network": {"id": "8a0fc2b4-bff6-4887-a969-81fb448d568f", "bridge": null, "label": "tempest-DeleteServersTestJSON-1414296899-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "eecab78b34b0468f8c42e4b7f3444918", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap587b6100-dc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:05:58.329 4088 3038341412120 MainThread DEBUG oslo_concurrency.lockutils [req-45766fcd-82d1-43f0-b7e3-ff596849cc05 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-a891198b-c066-46f2-bcbd-290a870d60bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:05:58.613 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:05:58.751 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-e1861675-af67-40f9-bb9c-a587b4076ec1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Received event network-vif-deleted-29258dff-8218-46ee-a2af-3a52e23f52ce external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:06:00.296 4088 3038337403192 GreenThread-94 DEBUG nova.network.neutron [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Successfully created port: ab511d41-0a59-4b44-aa41-0a635608bb15 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:06:01.703 4088 3038337403192 GreenThread-94 DEBUG nova.network.neutron [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Successfully updated port: ab511d41-0a59-4b44-aa41-0a635608bb15 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:06:01.735 4088 3038337403192 GreenThread-94 DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Acquired lock "refresh_cache-052c4e6a-de0f-4bd4-bfb2-812601b39335" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:06:01.735 4088 3038337403192 GreenThread-94 DEBUG nova.network.neutron [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:06:01.937 4088 3038341412296 MainThread DEBUG nova.compute.manager [req-46319b47-7f8b-4d90-8fa6-316d070fffdb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Received event network-changed-ab511d41-0a59-4b44-aa41-0a635608bb15 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:06:01.937 4088 3038341412296 MainThread DEBUG nova.compute.manager [req-46319b47-7f8b-4d90-8fa6-316d070fffdb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Refreshing instance network info cache due to event network-changed-ab511d41-0a59-4b44-aa41-0a635608bb15. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:06:01.962 4088 3038337403192 GreenThread-94 DEBUG nova.network.neutron [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:06:03.094 4088 3038337403192 GreenThread-94 DEBUG nova.network.neutron [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Updating instance_info_cache with network_info: [{"id": "ab511d41-0a59-4b44-aa41-0a635608bb15", "address": "fa:16:3e:51:f5:f5", "network": {"id": "d1d0dbf5-f2ce-4eeb-bc38-d716096517ef", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-413735321-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "89ea24a7b47a4f4a9015423bfcc23f3b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapab511d41-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:06:03.135 4088 3038337403192 GreenThread-94 DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Releasing lock "refresh_cache-052c4e6a-de0f-4bd4-bfb2-812601b39335" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:06:03.135 4088 3038337403192 GreenThread-94 DEBUG nova.compute.manager [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Instance network_info: |[{"id": "ab511d41-0a59-4b44-aa41-0a635608bb15", "address": "fa:16:3e:51:f5:f5", "network": {"id": "d1d0dbf5-f2ce-4eeb-bc38-d716096517ef", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-413735321-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "89ea24a7b47a4f4a9015423bfcc23f3b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapab511d41-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:06:03.135 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Preparing to wait for external event network-vif-plugged-ab511d41-0a59-4b44-aa41-0a635608bb15 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:06:03.135 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "052c4e6a-de0f-4bd4-bfb2-812601b39335-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:03.135 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "052c4e6a-de0f-4bd4-bfb2-812601b39335-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:03.135 4088 3038341411944 MainThread DEBUG os_win.utils.compute.vmutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Creating VM instance-00000067 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:06:03.145 4088 3038341412296 MainThread DEBUG oslo_concurrency.lockutils [req-46319b47-7f8b-4d90-8fa6-316d070fffdb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-052c4e6a-de0f-4bd4-bfb2-812601b39335" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:06:03.145 4088 3038341412296 MainThread DEBUG nova.network.neutron [req-46319b47-7f8b-4d90-8fa6-316d070fffdb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Refreshing network info cache for port ab511d41-0a59-4b44-aa41-0a635608bb15 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:06:04.868 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.vmops [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:06:04.940 4088 3038341412296 MainThread DEBUG nova.network.neutron [req-46319b47-7f8b-4d90-8fa6-316d070fffdb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Updated VIF entry in instance network info cache for port ab511d41-0a59-4b44-aa41-0a635608bb15. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:06:04.940 4088 3038341412296 MainThread DEBUG nova.network.neutron [req-46319b47-7f8b-4d90-8fa6-316d070fffdb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Updating instance_info_cache with network_info: [{"id": "ab511d41-0a59-4b44-aa41-0a635608bb15", "address": "fa:16:3e:51:f5:f5", "network": {"id": "d1d0dbf5-f2ce-4eeb-bc38-d716096517ef", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-413735321-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "89ea24a7b47a4f4a9015423bfcc23f3b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapab511d41-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:06:04.968 4088 3038341412296 MainThread DEBUG oslo_concurrency.lockutils [req-46319b47-7f8b-4d90-8fa6-316d070fffdb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-052c4e6a-de0f-4bd4-bfb2-812601b39335" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:06:06.329 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-adbe61bd-7d93-4945-af49-1d61e41357f4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Received event network-vif-plugged-587b6100-dc8d-42b4-b42b-7e2abe2d8865 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:06:06.329 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-adbe61bd-7d93-4945-af49-1d61e41357f4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "a891198b-c066-46f2-bcbd-290a870d60bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:06.329 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-adbe61bd-7d93-4945-af49-1d61e41357f4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "a891198b-c066-46f2-bcbd-290a870d60bd-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:06.329 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-adbe61bd-7d93-4945-af49-1d61e41357f4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Processing event network-vif-plugged-587b6100-dc8d-42b4-b42b-7e2abe2d8865 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:06:06.383 4088 3038340491224 MainThread INFO nova.virt.hyperv.vmops [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Using config drive for instance 2021-09-10 17:06:06.781 4088 3038340491224 MainThread INFO nova.virt.hyperv.vmops [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Creating config drive at C:\openstack\instances\instance-00000068\configdrive.iso 2021-09-10 17:06:06.877 4088 3038340491224 MainThread DEBUG oslo_concurrency.processutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000068\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpap0tp9mn execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:06:07.252 4088 3038340491224 MainThread DEBUG oslo_concurrency.processutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000068\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpap0tp9mn" returned: 0 in 0.375s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:06:07.781 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Setting boot order for instance: instance-00000068: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:06:07.924 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:06:07.942 4088 3038340491224 MainThread DEBUG os_win.utils.jobutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '1973F299-A617-4C16-B14E-6F49B5585BFF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15657), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:08.093 4088 3038340491224 MainThread ERROR os_win.utils.jobutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000068\' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)instance-000000687B01EF7D-7393-497B-BD05-B2443EAF88AB12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)instance-000000687B01EF7D-7393-497B-BD05-B2443EAF88AB10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000068\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)instance-000000687B01EF7D-7393-497B-BD05-B2443EAF88AB%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1973F299-A617-4C16-B14E-6F49B5585BFF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117672), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 8), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000068' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)\n\nNot enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)\n\n'instance-00000068' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)", 'ErrorSummaryDescription': "'instance-00000068' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000068.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:08.093 4088 3038340491224 MainThread DEBUG os_win._utils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000068' failed to start. Not enough memory in the system to start the virtual machine instance-00000068. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000068' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Not enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) 'instance-00000068' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.169783353805542 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:08.125 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:08.125 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] VM Stopped (Lifecycle Event) 2021-09-10 17:06:08.125 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000068" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:08.125 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000068" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:08.157 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-639915e6-a1c8-44f2-a603-9395ee7864a3 - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:08.157 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-639915e6-a1c8-44f2-a603-9395ee7864a3 - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:08.207 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-639915e6-a1c8-44f2-a603-9395ee7864a3 - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:08.259 4088 3038340489992 MainThread INFO nova.compute.manager [req-639915e6-a1c8-44f2-a603-9395ee7864a3 - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:09.142 4088 3038340491224 MainThread DEBUG os_win.utils.jobutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': 'BA52E5CC-747C-4E0F-9302-792FBB087384', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16934), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:09.283 4088 3038340491224 MainThread ERROR os_win.utils.jobutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000068\' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)instance-000000687B01EF7D-7393-497B-BD05-B2443EAF88AB12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)instance-000000687B01EF7D-7393-497B-BD05-B2443EAF88AB10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000068\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)instance-000000687B01EF7D-7393-497B-BD05-B2443EAF88AB%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BA52E5CC-747C-4E0F-9302-792FBB087384', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=127987), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 9), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 9), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000068' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)\n\nNot enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)\n\n'instance-00000068' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)", 'ErrorSummaryDescription': "'instance-00000068' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000068.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:09.283 4088 3038340491224 MainThread DEBUG os_win._utils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000068' failed to start. Not enough memory in the system to start the virtual machine instance-00000068. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000068' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Not enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) 'instance-00000068' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3592462539672852 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:09.328 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000068" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:09.328 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000068" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:09.328 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:09.328 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] VM Stopped (Lifecycle Event) 2021-09-10 17:06:09.359 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-57d32cbd-7c15-408b-81d7-7a24e69da6bf - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:09.359 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-57d32cbd-7c15-408b-81d7-7a24e69da6bf - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:09.393 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-57d32cbd-7c15-408b-81d7-7a24e69da6bf - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:09.438 4088 3038340489992 MainThread INFO nova.compute.manager [req-57d32cbd-7c15-408b-81d7-7a24e69da6bf - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:10.314 4088 3038340491224 MainThread DEBUG os_win.utils.jobutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '9D0360C9-3A8A-444E-AE58-4979B58B3B19', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17840), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:10.457 4088 3038340491224 MainThread ERROR os_win.utils.jobutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000068\' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)instance-000000687B01EF7D-7393-497B-BD05-B2443EAF88AB12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)instance-000000687B01EF7D-7393-497B-BD05-B2443EAF88AB10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000068\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)instance-000000687B01EF7D-7393-497B-BD05-B2443EAF88AB%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9D0360C9-3A8A-444E-AE58-4979B58B3B19', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118213), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 10), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 10), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000068' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)\n\nNot enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)\n\n'instance-00000068' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)", 'ErrorSummaryDescription': "'instance-00000068' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000068.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:10.457 4088 3038340491224 MainThread DEBUG os_win._utils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000068' failed to start. Not enough memory in the system to start the virtual machine instance-00000068. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000068' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Not enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) 'instance-00000068' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5332939624786377 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:10.484 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:10.484 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] VM Stopped (Lifecycle Event) 2021-09-10 17:06:10.484 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000068" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:10.484 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000068" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:10.524 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-b2aac6e0-f2ab-4bfa-8cf7-c2bd30dd2583 - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:10.524 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-b2aac6e0-f2ab-4bfa-8cf7-c2bd30dd2583 - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:10.578 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-b2aac6e0-f2ab-4bfa-8cf7-c2bd30dd2583 - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:10.610 4088 3038340489992 MainThread INFO nova.compute.manager [req-b2aac6e0-f2ab-4bfa-8cf7-c2bd30dd2583 - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:11.306 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-c3df1c42-bf41-4c8c-bd6f-d304d3dd148a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Received event network-vif-plugged-ab511d41-0a59-4b44-aa41-0a635608bb15 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:06:11.306 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-c3df1c42-bf41-4c8c-bd6f-d304d3dd148a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "052c4e6a-de0f-4bd4-bfb2-812601b39335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:11.306 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-c3df1c42-bf41-4c8c-bd6f-d304d3dd148a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "052c4e6a-de0f-4bd4-bfb2-812601b39335-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:11.306 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-c3df1c42-bf41-4c8c-bd6f-d304d3dd148a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Processing event network-vif-plugged-ab511d41-0a59-4b44-aa41-0a635608bb15 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:06:11.335 4088 3038341411944 MainThread INFO nova.virt.hyperv.vmops [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Using config drive for instance 2021-09-10 17:06:11.498 4088 3038340491224 MainThread DEBUG os_win.utils.jobutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '378D9F15-42EC-49FB-9438-05C695EC4775', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16628), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:11.644 4088 3038340491224 MainThread ERROR os_win.utils.jobutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000068\' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)instance-000000687B01EF7D-7393-497B-BD05-B2443EAF88AB12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)instance-000000687B01EF7D-7393-497B-BD05-B2443EAF88AB10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000068\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)instance-000000687B01EF7D-7393-497B-BD05-B2443EAF88AB%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '378D9F15-42EC-49FB-9438-05C695EC4775', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115623), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 11), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 11), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000068' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)\n\nNot enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)\n\n'instance-00000068' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)", 'ErrorSummaryDescription': "'instance-00000068' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000068.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:11.644 4088 3038340491224 MainThread DEBUG os_win._utils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000068' failed to start. Not enough memory in the system to start the virtual machine instance-00000068. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000068' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Not enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) 'instance-00000068' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7206263542175293 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:11.702 4088 3038337403192 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:11.702 4088 3038337403192 MainThread INFO nova.compute.manager [-] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] VM Stopped (Lifecycle Event) 2021-09-10 17:06:11.702 4088 3038341412120 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000068" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:11.702 4088 3038341412120 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000068" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:11.734 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-48ed0e39-58f3-49c7-afd9-3a31ba48a268 - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:11.734 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.vmops [req-48ed0e39-58f3-49c7-afd9-3a31ba48a268 - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:11.750 4088 3038341411944 MainThread INFO nova.virt.hyperv.vmops [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Creating config drive at C:\openstack\instances\instance-00000067\configdrive.iso 2021-09-10 17:06:11.844 4088 3038341411944 MainThread DEBUG oslo_concurrency.processutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000067\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpp_9h97go execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:06:12.003 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-48ed0e39-58f3-49c7-afd9-3a31ba48a268 - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:12.048 4088 3038337403192 MainThread INFO nova.compute.manager [req-48ed0e39-58f3-49c7-afd9-3a31ba48a268 - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:12.174 4088 3038341411944 MainThread DEBUG oslo_concurrency.processutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000067\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpp_9h97go" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:06:12.688 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.vmops [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Setting boot order for instance: instance-00000067: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:06:12.722 4088 3038340491224 MainThread DEBUG os_win.utils.jobutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '124DEF16-DAC5-4633-A3E0-A7D15BA06645', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19425), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:12.785 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.vmops [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:06:12.806 4088 3038341411944 MainThread DEBUG os_win.utils.jobutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Waiting for WMI job: {'InstanceID': '9C348444-4391-4108-B2A0-451D1B791387', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15285), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:12.861 4088 3038340491224 MainThread ERROR os_win.utils.jobutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000068\' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)instance-000000687B01EF7D-7393-497B-BD05-B2443EAF88AB12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)instance-000000687B01EF7D-7393-497B-BD05-B2443EAF88AB10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000068\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)instance-000000687B01EF7D-7393-497B-BD05-B2443EAF88AB%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '124DEF16-DAC5-4633-A3E0-A7D15BA06645', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119345), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 12), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 12), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000068' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)\n\nNot enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)\n\n'instance-00000068' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)", 'ErrorSummaryDescription': "'instance-00000068' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000068.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:12.861 4088 3038340491224 MainThread DEBUG os_win._utils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000068' failed to start. Not enough memory in the system to start the virtual machine instance-00000068. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000068' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Not enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) 'instance-00000068' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.9370644092559814 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:12.879 4088 3038337403192 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:12.879 4088 3038337403192 MainThread INFO nova.compute.manager [-] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] VM Stopped (Lifecycle Event) 2021-09-10 17:06:12.905 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000068" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:12.905 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000068" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:12.927 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-9e80c83c-208c-4a1a-89c5-7fdc55c92acd - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:12.927 4088 3038337403192 MainThread DEBUG nova.virt.hyperv.vmops [req-9e80c83c-208c-4a1a-89c5-7fdc55c92acd - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:13.051 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:13.051 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] VM Stopped (Lifecycle Event) 2021-09-10 17:06:13.051 4088 3038341412296 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000067" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:13.051 4088 3038341412296 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000067" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:13.051 4088 3038337403192 MainThread DEBUG nova.compute.manager [req-9e80c83c-208c-4a1a-89c5-7fdc55c92acd - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:13.079 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-bb896dd6-97b6-4f02-abea-f740275eeff2 - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:13.079 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-bb896dd6-97b6-4f02-abea-f740275eeff2 - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:13.079 4088 3038337403192 MainThread INFO nova.compute.manager [req-9e80c83c-208c-4a1a-89c5-7fdc55c92acd - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:13.079 4088 3038341411944 MainThread ERROR os_win.utils.jobutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000067\' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)instance-00000067FFE8F8F4-007E-4D02-9B66-465CFA1FDC8212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)instance-00000067FFE8F8F4-007E-4D02-9B66-465CFA1FDC8210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000067\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)instance-00000067FFE8F8F4-007E-4D02-9B66-465CFA1FDC82%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9C348444-4391-4108-B2A0-451D1B791387', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=141758), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 12), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 12), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000067' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)\n\nNot enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)\n\n'instance-00000067' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)", 'ErrorSummaryDescription': "'instance-00000067' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000067.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:13.093 4088 3038341411944 MainThread DEBUG os_win._utils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000067' failed to start. Not enough memory in the system to start the virtual machine instance-00000067. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000067' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Not enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) 'instance-00000067' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.30840563774108887 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:13.126 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-bb896dd6-97b6-4f02-abea-f740275eeff2 - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:13.164 4088 3038340489992 MainThread INFO nova.compute.manager [req-bb896dd6-97b6-4f02-abea-f740275eeff2 - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:13.899 4088 3038340491224 MainThread DEBUG os_win.utils.jobutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': 'D072E2BC-0AAA-4F0E-9F25-D610DC6DAC66', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17732), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:14.040 4088 3038340491224 MainThread ERROR os_win.utils.jobutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000068\' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)instance-000000687B01EF7D-7393-497B-BD05-B2443EAF88AB12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)instance-000000687B01EF7D-7393-497B-BD05-B2443EAF88AB10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000068\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)instance-000000687B01EF7D-7393-497B-BD05-B2443EAF88AB%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D072E2BC-0AAA-4F0E-9F25-D610DC6DAC66', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113997), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 13), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 13), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000068' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)\n\nNot enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)\n\n'instance-00000068' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB)", 'ErrorSummaryDescription': "'instance-00000068' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000068.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:14.040 4088 3038340491224 MainThread ERROR nova.virt.hyperv.vmops [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Failed to change vm state of instance-00000068 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000068' failed to start. 2021-09-10 17:06:14.040 4088 3038340491224 MainThread INFO nova.virt.hyperv.vmops [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Got request to destroy instance 2021-09-10 17:06:14.100 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:14.100 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] VM Stopped (Lifecycle Event) 2021-09-10 17:06:14.100 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000068" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:14.100 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000068" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:14.110 4088 3038341411944 MainThread DEBUG os_win.utils.jobutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Waiting for WMI job: {'InstanceID': '0FB7CB1A-7641-4744-925E-FA8BFD18FA82', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18158), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:14.134 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-5539e129-ad6e-4976-9236-3729d472c673 - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:14.134 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-5539e129-ad6e-4976-9236-3729d472c673 - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:14.203 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-5539e129-ad6e-4976-9236-3729d472c673 - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:14.218 4088 3038340489992 MainThread INFO nova.compute.manager [req-5539e129-ad6e-4976-9236-3729d472c673 - - - - -] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:14.328 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000067" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:14.328 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000067" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:14.328 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:14.328 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] VM Stopped (Lifecycle Event) 2021-09-10 17:06:14.360 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-bf97555c-adc3-424e-8869-f0f7583a58a8 - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:14.360 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-bf97555c-adc3-424e-8869-f0f7583a58a8 - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:14.360 4088 3038341411944 MainThread ERROR os_win.utils.jobutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000067\' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)instance-00000067FFE8F8F4-007E-4D02-9B66-465CFA1FDC8212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)instance-00000067FFE8F8F4-007E-4D02-9B66-465CFA1FDC8210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000067\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)instance-00000067FFE8F8F4-007E-4D02-9B66-465CFA1FDC82%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0FB7CB1A-7641-4744-925E-FA8BFD18FA82', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=139365), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 14), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 14), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000067' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)\n\nNot enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)\n\n'instance-00000067' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)", 'ErrorSummaryDescription': "'instance-00000067' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000067.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:14.360 4088 3038341411944 MainThread DEBUG os_win._utils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000067' failed to start. Not enough memory in the system to start the virtual machine instance-00000067. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000067' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Not enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) 'instance-00000067' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.5752136707305908 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:14.417 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-bf97555c-adc3-424e-8869-f0f7583a58a8 - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:14.484 4088 3038340489992 MainThread INFO nova.compute.manager [req-bf97555c-adc3-424e-8869-f0f7583a58a8 - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:15.401 4088 3038341411944 MainThread DEBUG os_win.utils.jobutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Waiting for WMI job: {'InstanceID': '62801C80-6E69-4C3D-9140-ED23FF188F54', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18122), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:15.546 4088 3038341411944 MainThread ERROR os_win.utils.jobutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000067\' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)instance-00000067FFE8F8F4-007E-4D02-9B66-465CFA1FDC8212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)instance-00000067FFE8F8F4-007E-4D02-9B66-465CFA1FDC8210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000067\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)instance-00000067FFE8F8F4-007E-4D02-9B66-465CFA1FDC82%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '62801C80-6E69-4C3D-9140-ED23FF188F54', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=138169), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 15), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 15), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000067' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)\n\nNot enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)\n\n'instance-00000067' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)", 'ErrorSummaryDescription': "'instance-00000067' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000067.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:15.546 4088 3038341411944 MainThread DEBUG os_win._utils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000067' failed to start. Not enough memory in the system to start the virtual machine instance-00000067. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000067' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Not enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) 'instance-00000067' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.761631965637207 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:15.596 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:15.596 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] VM Stopped (Lifecycle Event) 2021-09-10 17:06:15.610 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000067" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:15.610 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000067" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:15.642 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-ea9afb2d-9568-480f-b078-658a2c8566ee - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:15.656 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-ea9afb2d-9568-480f-b078-658a2c8566ee - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:15.706 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-ea9afb2d-9568-480f-b078-658a2c8566ee - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:15.734 4088 3038340489992 MainThread INFO nova.compute.manager [req-ea9afb2d-9568-480f-b078-658a2c8566ee - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:16.112 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:06:16.112 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000068" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:16.128 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000068" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:16.142 4088 3038340491224 MainThread DEBUG os_win.utils.compute.vmutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Successfully changed vm state of instance-00000068 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:06:16.142 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Successfully changed state of VM instance-00000068 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:06:16.204 4088 3038340491224 MainThread DEBUG os_win.utils.jobutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '2E7FBA49-ED76-4916-BD0F-DCCE35190077', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18712), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:16.328 4088 3038340491224 MainThread DEBUG os_win.utils.jobutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job succeeded: {'InstanceID': '2E7FBA49-ED76-4916-BD0F-DCCE35190077', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=104060), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:06:16.328 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000068" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:16.328 4088 3038340491224 MainThread DEBUG os_win.utils.pathutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Removing directory: C:\openstack\instances\instance-00000068 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:06:16.328 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000068" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:16.328 4088 3038340491224 MainThread ERROR nova.compute.manager [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000068' failed to start. Not enough memory in the system to start the virtual machine instance-00000068. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000068' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Not enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) 'instance-00000068' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Error code: 32778. 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Traceback (most recent call last): 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] return function(*args, **kwargs) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] admin_password, network_info, block_device_info) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] return function(self, *args, **kwds) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self.force_reraise() 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] raise self.value 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] should_plug_vifs=False) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 'req_state': req_state}) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self.force_reraise() 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] raise self.value 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] time.sleep(sleep_time) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self.force_reraise() 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] raise self.value 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] return f(*args, **kwargs) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] return self._wait_for_job(job_path) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] error_desc=err_desc) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000068' failed to start. 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Not enough memory in the system to start the virtual machine instance-00000068. 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000068' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Not enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 'instance-00000068' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Error code: 32778. 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] During handling of the above exception, another exception occurred: 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Traceback (most recent call last): 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] yield resources 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] accel_info=accel_info) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] return function(*args, **kwargs) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] admin_password, network_info, block_device_info) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] return function(self, *args, **kwds) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self.force_reraise() 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] raise self.value 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] should_plug_vifs=False) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 'req_state': req_state}) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self.force_reraise() 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] raise self.value 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] time.sleep(sleep_time) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self.force_reraise() 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] raise self.value 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] return f(*args, **kwargs) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] return self._wait_for_job(job_path) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] error_desc=err_desc) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000068' failed to start. 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Not enough memory in the system to start the virtual machine instance-00000068. 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000068' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Not enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 'instance-00000068' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Error code: 32778. 2021-09-10 17:06:16.328 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.328 4088 3038340491224 MainThread INFO nova.compute.manager [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Terminating instance 2021-09-10 17:06:16.328 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:06:16.328 4088 3038340491224 MainThread INFO nova.virt.hyperv.vmops [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Got request to destroy instance 2021-09-10 17:06:16.346 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:06:16.346 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000068" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:16.346 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-00000068" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:16.346 4088 3038340491224 MainThread INFO nova.compute.manager [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:06:16.363 4088 3038340491224 MainThread DEBUG nova.compute.claims [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:06:16.363 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:16.520 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.hostops [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:06:16.532 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.hostops [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:06:16.579 4088 3038341411944 MainThread DEBUG os_win.utils.jobutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Waiting for WMI job: {'InstanceID': '48424A46-0B9B-40C0-B8B4-3006748FBF30', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16552), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:16.735 4088 3038341411944 MainThread ERROR os_win.utils.jobutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000067\' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)instance-00000067FFE8F8F4-007E-4D02-9B66-465CFA1FDC8212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)instance-00000067FFE8F8F4-007E-4D02-9B66-465CFA1FDC8210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000067\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)instance-00000067FFE8F8F4-007E-4D02-9B66-465CFA1FDC82%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '48424A46-0B9B-40C0-B8B4-3006748FBF30', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=122394), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 16), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 16), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000067' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)\n\nNot enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)\n\n'instance-00000067' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)", 'ErrorSummaryDescription': "'instance-00000067' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000067.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:16.735 4088 3038341411944 MainThread DEBUG os_win._utils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000067' failed to start. Not enough memory in the system to start the virtual machine instance-00000067. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000067' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Not enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) 'instance-00000067' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.9505691528320312 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:16.761 4088 3038340491224 MainThread DEBUG nova.compute.provider_tree [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:06:16.780 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:16.790 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] VM Stopped (Lifecycle Event) 2021-09-10 17:06:16.790 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000067" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:16.790 4088 3038337403192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000067" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:16.790 4088 3038340491224 MainThread DEBUG nova.scheduler.client.report [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:06:16.790 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.437s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:16.790 4088 3038340491224 MainThread ERROR nova.compute.manager [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000068' failed to start. Not enough memory in the system to start the virtual machine instance-00000068. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000068' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Not enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) 'instance-00000068' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Error code: 32778. 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Traceback (most recent call last): 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] return function(*args, **kwargs) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] admin_password, network_info, block_device_info) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] return function(self, *args, **kwds) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self.force_reraise() 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] raise self.value 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] should_plug_vifs=False) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 'req_state': req_state}) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self.force_reraise() 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] raise self.value 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] time.sleep(sleep_time) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self.force_reraise() 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] raise self.value 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] return f(*args, **kwargs) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] return self._wait_for_job(job_path) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] error_desc=err_desc) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000068' failed to start. 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Not enough memory in the system to start the virtual machine instance-00000068. 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000068' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Not enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 'instance-00000068' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Error code: 32778. 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] During handling of the above exception, another exception occurred: 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Traceback (most recent call last): 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] accel_info=accel_info) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] return function(*args, **kwargs) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] admin_password, network_info, block_device_info) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] return function(self, *args, **kwds) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self.force_reraise() 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] raise self.value 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] should_plug_vifs=False) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 'req_state': req_state}) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self.force_reraise() 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] raise self.value 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] time.sleep(sleep_time) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self.force_reraise() 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] raise self.value 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] return f(*args, **kwargs) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] return self._wait_for_job(job_path) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] error_desc=err_desc) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000068' failed to start. 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Not enough memory in the system to start the virtual machine instance-00000068. 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000068' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Not enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 'instance-00000068' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Error code: 32778. 2021-09-10 17:06:16.790 4088 3038340491224 MainThread TRACE nova.compute.manager [instance: a891198b-c066-46f2-bcbd-290a870d60bd] 2021-09-10 17:06:16.790 4088 3038340491224 MainThread DEBUG nova.compute.utils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] WMI job failed with status 10. Error summary description: 'instance-00000068' failed to start. Not enough memory in the system to start the virtual machine instance-00000068. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:06:16.802 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Build of instance a891198b-c066-46f2-bcbd-290a870d60bd was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000068' failed to start. Not enough memory in the system to start the virtual machine instance-00000068. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000068' failed to start. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Not enough memory in the system to start the virtual machine instance-00000068 with ram size 1024 megabytes. (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) 'instance-00000068' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7B01EF7D-7393-497B-BD05-B2443EAF88AB) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:06:16.802 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:06:16.802 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:06:16.802 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:06:16.802 4088 3038340491224 MainThread DEBUG nova.network.neutron [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:06:16.802 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-0b39e688-3f4a-4ad5-98db-9557b09bb866 - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:16.802 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-0b39e688-3f4a-4ad5-98db-9557b09bb866 - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:16.859 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-0b39e688-3f4a-4ad5-98db-9557b09bb866 - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:16.906 4088 3038340489992 MainThread INFO nova.compute.manager [req-0b39e688-3f4a-4ad5-98db-9557b09bb866 - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:17.782 4088 3038341411944 MainThread DEBUG os_win.utils.jobutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Waiting for WMI job: {'InstanceID': 'C6CFE7E9-6271-4BFA-A229-F81E5C7A05A4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17976), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:17.926 4088 3038341411944 MainThread ERROR os_win.utils.jobutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000067\' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)instance-00000067FFE8F8F4-007E-4D02-9B66-465CFA1FDC8212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)instance-00000067FFE8F8F4-007E-4D02-9B66-465CFA1FDC8210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000067\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)instance-00000067FFE8F8F4-007E-4D02-9B66-465CFA1FDC82%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C6CFE7E9-6271-4BFA-A229-F81E5C7A05A4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114245), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 17), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 17), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000067' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)\n\nNot enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)\n\n'instance-00000067' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)", 'ErrorSummaryDescription': "'instance-00000067' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000067.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:17.926 4088 3038341411944 MainThread DEBUG os_win._utils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000067' failed to start. Not enough memory in the system to start the virtual machine instance-00000067. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000067' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Not enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) 'instance-00000067' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.140957832336426 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:17.962 4088 3038341413000 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000067" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:17.962 4088 3038341413000 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000067" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:17.962 4088 3038341412824 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:17.962 4088 3038341412824 MainThread INFO nova.compute.manager [-] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] VM Stopped (Lifecycle Event) 2021-09-10 17:06:17.984 4088 3038341412824 MainThread DEBUG nova.compute.manager [req-c8ba4729-0076-41c0-b5c2-5688f5e9201a - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:17.984 4088 3038341412824 MainThread DEBUG nova.virt.hyperv.vmops [req-c8ba4729-0076-41c0-b5c2-5688f5e9201a - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:18.033 4088 3038341412824 MainThread DEBUG nova.compute.manager [req-c8ba4729-0076-41c0-b5c2-5688f5e9201a - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:18.093 4088 3038341412824 MainThread INFO nova.compute.manager [req-c8ba4729-0076-41c0-b5c2-5688f5e9201a - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:18.243 4088 3038340491224 MainThread DEBUG nova.network.neutron [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:06:18.274 4088 3038340491224 MainThread INFO nova.compute.manager [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: a891198b-c066-46f2-bcbd-290a870d60bd] Took 1.47 seconds to deallocate network for instance. 2021-09-10 17:06:18.718 4088 3038340491224 MainThread INFO nova.scheduler.client.report [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Deleted allocations for instance a891198b-c066-46f2-bcbd-290a870d60bd 2021-09-10 17:06:18.789 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [req-ae042bb7-1b30-4ba1-b9c5-e77425baf409 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "a891198b-c066-46f2-bcbd-290a870d60bd" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 31.532s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:18.952 4088 3038341411944 MainThread DEBUG os_win.utils.jobutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Waiting for WMI job: {'InstanceID': 'B01586BE-2E68-4717-8B10-D3C5BB0B506B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14895), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:19.093 4088 3038341411944 MainThread ERROR os_win.utils.jobutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000067\' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)instance-00000067FFE8F8F4-007E-4D02-9B66-465CFA1FDC8212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)instance-00000067FFE8F8F4-007E-4D02-9B66-465CFA1FDC8210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000067\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)instance-00000067FFE8F8F4-007E-4D02-9B66-465CFA1FDC82%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B01586BE-2E68-4717-8B10-D3C5BB0B506B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118555), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 18), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 19), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000067' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)\n\nNot enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)\n\n'instance-00000067' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82)", 'ErrorSummaryDescription': "'instance-00000067' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000067.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:19.093 4088 3038341411944 MainThread ERROR nova.virt.hyperv.vmops [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Failed to change vm state of instance-00000067 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000067' failed to start. 2021-09-10 17:06:19.093 4088 3038341411944 MainThread INFO nova.virt.hyperv.vmops [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Got request to destroy instance 2021-09-10 17:06:19.126 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000067" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:19.126 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000067" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:19.126 4088 3038340491224 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:19.126 4088 3038340491224 MainThread INFO nova.compute.manager [-] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] VM Stopped (Lifecycle Event) 2021-09-10 17:06:19.159 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-f01746f9-8d85-43c4-b991-757b9108ee8d - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:19.159 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [req-f01746f9-8d85-43c4-b991-757b9108ee8d - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:19.219 4088 3038340491224 MainThread DEBUG nova.compute.manager [req-f01746f9-8d85-43c4-b991-757b9108ee8d - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:19.250 4088 3038340491224 MainThread INFO nova.compute.manager [req-f01746f9-8d85-43c4-b991-757b9108ee8d - - - - -] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:21.078 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.vmops [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:06:21.078 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "instance-00000067" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:21.078 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "instance-00000067" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:21.108 4088 3038341411944 MainThread DEBUG os_win.utils.compute.vmutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Successfully changed vm state of instance-00000067 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:06:21.108 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.vmops [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Successfully changed state of VM instance-00000067 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:06:21.158 4088 3038341411944 MainThread DEBUG os_win.utils.jobutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Waiting for WMI job: {'InstanceID': '15DDBB79-5461-4256-A2BD-C4974E6A6300', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14700), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:21.282 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "4e15be49-462b-4156-9978-5513db0f17ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:21.282 4088 3038341411944 MainThread DEBUG os_win.utils.jobutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] WMI job succeeded: {'InstanceID': '15DDBB79-5461-4256-A2BD-C4974E6A6300', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=133330), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:06:21.282 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "instance-00000067" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:21.282 4088 3038341411944 MainThread DEBUG os_win.utils.pathutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Removing directory: C:\openstack\instances\instance-00000067 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:06:21.301 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "instance-00000067" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:21.301 4088 3038341411944 MainThread ERROR nova.compute.manager [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000067' failed to start. Not enough memory in the system to start the virtual machine instance-00000067. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000067' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Not enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) 'instance-00000067' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Error code: 32778. 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Traceback (most recent call last): 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] return function(*args, **kwargs) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] admin_password, network_info, block_device_info) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] return function(self, *args, **kwds) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self.force_reraise() 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] raise self.value 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] should_plug_vifs=False) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 'req_state': req_state}) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self.force_reraise() 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] raise self.value 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] time.sleep(sleep_time) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self.force_reraise() 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] raise self.value 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] return f(*args, **kwargs) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] return self._wait_for_job(job_path) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] error_desc=err_desc) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000067' failed to start. 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Not enough memory in the system to start the virtual machine instance-00000067. 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000067' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Not enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 'instance-00000067' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Error code: 32778. 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] During handling of the above exception, another exception occurred: 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Traceback (most recent call last): 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] yield resources 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] accel_info=accel_info) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] return function(*args, **kwargs) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] admin_password, network_info, block_device_info) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] return function(self, *args, **kwds) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self.force_reraise() 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] raise self.value 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] should_plug_vifs=False) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 'req_state': req_state}) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self.force_reraise() 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] raise self.value 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] time.sleep(sleep_time) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self.force_reraise() 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] raise self.value 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] return f(*args, **kwargs) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] return self._wait_for_job(job_path) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] error_desc=err_desc) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000067' failed to start. 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Not enough memory in the system to start the virtual machine instance-00000067. 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000067' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Not enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 'instance-00000067' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Error code: 32778. 2021-09-10 17:06:21.301 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.301 4088 3038341411944 MainThread INFO nova.compute.manager [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Terminating instance 2021-09-10 17:06:21.301 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:06:21.301 4088 3038341411944 MainThread INFO nova.virt.hyperv.vmops [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Got request to destroy instance 2021-09-10 17:06:21.316 4088 3038341413704 MainThread DEBUG nova.compute.manager [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:06:21.316 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.vmops [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:06:21.316 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "instance-00000067" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:21.316 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "instance-00000067" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:21.316 4088 3038341411944 MainThread INFO nova.compute.manager [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:06:21.316 4088 3038341411944 MainThread DEBUG nova.compute.claims [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:06:21.316 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:21.546 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.hostops [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:06:21.578 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.hostops [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:06:21.789 4088 3038341411944 MainThread DEBUG nova.compute.provider_tree [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:06:21.805 4088 3038341411944 MainThread DEBUG nova.scheduler.client.report [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:06:21.805 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.500s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:21.805 4088 3038341411944 MainThread ERROR nova.compute.manager [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000067' failed to start. Not enough memory in the system to start the virtual machine instance-00000067. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000067' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Not enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) 'instance-00000067' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Error code: 32778. 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Traceback (most recent call last): 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] return function(*args, **kwargs) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] admin_password, network_info, block_device_info) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] return function(self, *args, **kwds) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self.force_reraise() 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] raise self.value 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] should_plug_vifs=False) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 'req_state': req_state}) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self.force_reraise() 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] raise self.value 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] time.sleep(sleep_time) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self.force_reraise() 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] raise self.value 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] return f(*args, **kwargs) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] return self._wait_for_job(job_path) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] error_desc=err_desc) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000067' failed to start. 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Not enough memory in the system to start the virtual machine instance-00000067. 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000067' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Not enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 'instance-00000067' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Error code: 32778. 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] During handling of the above exception, another exception occurred: 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Traceback (most recent call last): 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] accel_info=accel_info) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] return function(*args, **kwargs) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] admin_password, network_info, block_device_info) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] return function(self, *args, **kwds) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self.force_reraise() 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] raise self.value 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] should_plug_vifs=False) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 'req_state': req_state}) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self.force_reraise() 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] raise self.value 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] time.sleep(sleep_time) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self.force_reraise() 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] raise self.value 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] return f(*args, **kwargs) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] return self._wait_for_job(job_path) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] error_desc=err_desc) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000067' failed to start. 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Not enough memory in the system to start the virtual machine instance-00000067. 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000067' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Not enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 'instance-00000067' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Error code: 32778. 2021-09-10 17:06:21.805 4088 3038341411944 MainThread TRACE nova.compute.manager [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] 2021-09-10 17:06:21.805 4088 3038341411944 MainThread DEBUG nova.compute.utils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] WMI job failed with status 10. Error summary description: 'instance-00000067' failed to start. Not enough memory in the system to start the virtual machine instance-00000067. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:06:21.805 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Build of instance 052c4e6a-de0f-4bd4-bfb2-812601b39335 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000067' failed to start. Not enough memory in the system to start the virtual machine instance-00000067. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000067' failed to start. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Not enough memory in the system to start the virtual machine instance-00000067 with ram size 1024 megabytes. (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) 'instance-00000067' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID FFE8F8F4-007E-4D02-9B66-465CFA1FDC82) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:06:21.805 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:06:21.805 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:06:21.805 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:06:21.805 4088 3038341411944 MainThread DEBUG nova.network.neutron [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:06:21.822 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.313s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:21.822 4088 3038341413704 MainThread DEBUG nova.virt.hardware [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:06:21.822 4088 3038341413704 MainThread INFO nova.compute.claims [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Claim successful on node n-h2-808474-1 2021-09-10 17:06:22.030 4088 3038341413704 MainThread DEBUG nova.virt.hyperv.hostops [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:06:22.064 4088 3038341413704 MainThread DEBUG nova.virt.hyperv.hostops [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:06:22.283 4088 3038341413704 MainThread DEBUG nova.compute.provider_tree [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:06:22.283 4088 3038341413704 MainThread DEBUG nova.scheduler.client.report [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:06:22.283 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:22.283 4088 3038341413704 MainThread DEBUG nova.compute.manager [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:06:22.405 4088 3038341413704 MainThread DEBUG nova.compute.manager [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:06:22.405 4088 3038362816584 GreenThread-95 DEBUG nova.compute.manager [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:06:22.405 4088 3038362816584 GreenThread-95 DEBUG nova.network.neutron [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:06:22.744 4088 3038341413704 MainThread DEBUG nova.compute.manager [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:06:22.776 4088 3038341413704 MainThread INFO nova.virt.hyperv.vmops [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Spawning new instance 2021-09-10 17:06:22.776 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000069" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:22.776 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000069" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:22.791 4088 3038341413704 MainThread DEBUG nova.block_device [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:06:22.791 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:22.791 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:22.796 4088 3038341413704 MainThread DEBUG os_win.utils.pathutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Creating directory: C:\openstack\instances\instance-00000069 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:06:22.796 4088 3038341413704 MainThread DEBUG nova.virt.hyperv.vmops [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000069\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:06:22.796 4088 3038362816584 GreenThread-95 DEBUG nova.policy [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f286737f0e6452bbe04f42184b6d12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df662acac0f043bb8be9c87490878d93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:06:23.036 4088 3038341413704 MainThread DEBUG nova.virt.hyperv.vmops [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Resizing VHD C:\openstack\instances\instance-00000069\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:06:24.796 4088 3038362816584 GreenThread-95 DEBUG nova.network.neutron [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Successfully created port: e5dca845-1ebe-40c1-9c35-cde0ac0538e1 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:06:25.072 4088 3038341411944 MainThread DEBUG nova.network.neutron [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:06:25.103 4088 3038341411944 MainThread INFO nova.compute.manager [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 052c4e6a-de0f-4bd4-bfb2-812601b39335] Took 3.30 seconds to deallocate network for instance. 2021-09-10 17:06:25.431 4088 3038341411944 MainThread INFO nova.scheduler.client.report [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Deleted allocations for instance 052c4e6a-de0f-4bd4-bfb2-812601b39335 2021-09-10 17:06:25.494 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-00650ea2-eede-4b29-8f6b-afdf11773bfe 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "052c4e6a-de0f-4bd4-bfb2-812601b39335" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 29.187s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:27.729 4088 3038362816584 GreenThread-95 DEBUG nova.network.neutron [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Successfully updated port: e5dca845-1ebe-40c1-9c35-cde0ac0538e1 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:06:27.749 4088 3038362816584 GreenThread-95 DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Acquired lock "refresh_cache-4e15be49-462b-4156-9978-5513db0f17ba" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:06:27.749 4088 3038362816584 GreenThread-95 DEBUG nova.network.neutron [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:06:28.198 4088 3038362816584 GreenThread-95 DEBUG nova.network.neutron [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:06:28.515 4088 3038341414760 MainThread DEBUG nova.compute.manager [req-64d94c93-dfa4-47e0-96f8-d5c2eba54ff4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Received event network-changed-e5dca845-1ebe-40c1-9c35-cde0ac0538e1 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:06:28.515 4088 3038341414760 MainThread DEBUG nova.compute.manager [req-64d94c93-dfa4-47e0-96f8-d5c2eba54ff4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Refreshing instance network info cache due to event network-changed-e5dca845-1ebe-40c1-9c35-cde0ac0538e1. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:06:28.979 4088 3038362816584 GreenThread-95 DEBUG nova.network.neutron [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Updating instance_info_cache with network_info: [{"id": "e5dca845-1ebe-40c1-9c35-cde0ac0538e1", "address": "fa:16:3e:1d:d8:d0", "network": {"id": "5b608de7-ebcb-494c-bcfe-060ce4426ed6", "bridge": null, "label": "tempest-ServersTestJSON-497725561-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "df662acac0f043bb8be9c87490878d93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape5dca845-1e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:06:29.010 4088 3038362816584 GreenThread-95 DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Releasing lock "refresh_cache-4e15be49-462b-4156-9978-5513db0f17ba" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:06:29.023 4088 3038362816584 GreenThread-95 DEBUG nova.compute.manager [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Instance network_info: |[{"id": "e5dca845-1ebe-40c1-9c35-cde0ac0538e1", "address": "fa:16:3e:1d:d8:d0", "network": {"id": "5b608de7-ebcb-494c-bcfe-060ce4426ed6", "bridge": null, "label": "tempest-ServersTestJSON-497725561-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "df662acac0f043bb8be9c87490878d93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape5dca845-1e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:06:29.023 4088 3038341414760 MainThread DEBUG oslo_concurrency.lockutils [req-64d94c93-dfa4-47e0-96f8-d5c2eba54ff4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-4e15be49-462b-4156-9978-5513db0f17ba" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:06:29.023 4088 3038341414760 MainThread DEBUG nova.network.neutron [req-64d94c93-dfa4-47e0-96f8-d5c2eba54ff4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Refreshing network info cache for port e5dca845-1ebe-40c1-9c35-cde0ac0538e1 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:06:29.023 4088 3038341413704 MainThread DEBUG nova.compute.manager [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Preparing to wait for external event network-vif-plugged-e5dca845-1ebe-40c1-9c35-cde0ac0538e1 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:06:29.023 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "4e15be49-462b-4156-9978-5513db0f17ba-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:29.023 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "4e15be49-462b-4156-9978-5513db0f17ba-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:29.023 4088 3038341413704 MainThread DEBUG os_win.utils.compute.vmutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Creating VM instance-00000069 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:06:29.362 4088 3038362817992 MainThread DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "fc38b331-efcd-4c62-aecf-3859bffff0bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:29.407 4088 3038362817992 MainThread DEBUG nova.compute.manager [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:06:29.526 4088 3038362817992 MainThread DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:29.526 4088 3038362817992 MainThread DEBUG nova.virt.hardware [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:06:29.526 4088 3038362817992 MainThread INFO nova.compute.claims [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Claim successful on node n-h2-808474-1 2021-09-10 17:06:29.694 4088 3038362817992 MainThread DEBUG nova.virt.hyperv.hostops [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:06:29.711 4088 3038362817992 MainThread DEBUG nova.virt.hyperv.hostops [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:06:29.985 4088 3038362817992 MainThread DEBUG nova.compute.provider_tree [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:06:30.005 4088 3038362817992 MainThread DEBUG nova.scheduler.client.report [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:06:30.005 4088 3038362817992 MainThread DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:30.005 4088 3038362817992 MainThread DEBUG nova.compute.manager [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:06:30.127 4088 3038362817992 MainThread DEBUG nova.compute.manager [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:06:30.127 4088 3038362818168 GreenThread-96 DEBUG nova.compute.manager [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:06:30.127 4088 3038362818168 GreenThread-96 DEBUG nova.network.neutron [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:06:30.444 4088 3038362817992 MainThread DEBUG nova.compute.manager [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:06:30.444 4088 3038362817992 MainThread INFO nova.virt.hyperv.vmops [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Spawning new instance 2021-09-10 17:06:30.464 4088 3038362817992 MainThread DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-0000006a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:30.470 4088 3038362817992 MainThread DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-0000006a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:30.470 4088 3038362817992 MainThread DEBUG nova.block_device [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:06:30.470 4088 3038362817992 MainThread DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:30.470 4088 3038362817992 MainThread DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:30.470 4088 3038362817992 MainThread DEBUG os_win.utils.pathutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Creating directory: C:\openstack\instances\instance-0000006a check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:06:30.483 4088 3038362817992 MainThread DEBUG nova.virt.hyperv.vmops [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000006a\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:06:30.483 4088 3038362818168 GreenThread-96 DEBUG nova.policy [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6da982fe4daa44b998cd4ae6900212fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0928f57ccc9245e28c79dd9cce7e395b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:06:30.574 4088 3038341414760 MainThread DEBUG nova.network.neutron [req-64d94c93-dfa4-47e0-96f8-d5c2eba54ff4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Updated VIF entry in instance network info cache for port e5dca845-1ebe-40c1-9c35-cde0ac0538e1. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:06:30.574 4088 3038341414760 MainThread DEBUG nova.network.neutron [req-64d94c93-dfa4-47e0-96f8-d5c2eba54ff4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Updating instance_info_cache with network_info: [{"id": "e5dca845-1ebe-40c1-9c35-cde0ac0538e1", "address": "fa:16:3e:1d:d8:d0", "network": {"id": "5b608de7-ebcb-494c-bcfe-060ce4426ed6", "bridge": null, "label": "tempest-ServersTestJSON-497725561-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "df662acac0f043bb8be9c87490878d93", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape5dca845-1e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:06:30.606 4088 3038341414760 MainThread DEBUG oslo_concurrency.lockutils [req-64d94c93-dfa4-47e0-96f8-d5c2eba54ff4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-4e15be49-462b-4156-9978-5513db0f17ba" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:06:30.640 4088 3038341414760 MainThread DEBUG nova.compute.manager [req-ba33213a-2ae5-4e5e-abe2-ebb95d356c46 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Received event network-vif-deleted-a41c6c93-c50a-45fb-bb0c-808b88dbfeca external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:06:30.734 4088 3038362817992 MainThread DEBUG nova.virt.hyperv.vmops [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Resizing VHD C:\openstack\instances\instance-0000006a\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:06:30.766 4088 3038341413704 MainThread DEBUG nova.virt.hyperv.vmops [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:06:32.011 4088 3038362818168 GreenThread-96 DEBUG nova.network.neutron [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Successfully created port: 4a7a7eb9-3750-4061-bb75-72a936f0e85a _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:06:34.579 4088 3038362818168 GreenThread-96 DEBUG nova.network.neutron [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Successfully updated port: 4a7a7eb9-3750-4061-bb75-72a936f0e85a _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:06:34.610 4088 3038362818168 GreenThread-96 DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Acquired lock "refresh_cache-fc38b331-efcd-4c62-aecf-3859bffff0bb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:06:34.610 4088 3038362818168 GreenThread-96 DEBUG nova.network.neutron [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:06:34.655 4088 3038362817816 MainThread DEBUG nova.compute.manager [req-ae143d9d-0586-4474-86bd-e74650de8bcb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Received event network-changed-4a7a7eb9-3750-4061-bb75-72a936f0e85a external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:06:34.655 4088 3038362817816 MainThread DEBUG nova.compute.manager [req-ae143d9d-0586-4474-86bd-e74650de8bcb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Refreshing instance network info cache due to event network-changed-4a7a7eb9-3750-4061-bb75-72a936f0e85a. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:06:34.735 4088 3038362818168 GreenThread-96 DEBUG nova.network.neutron [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:06:35.859 4088 3038362818168 GreenThread-96 DEBUG nova.network.neutron [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Updating instance_info_cache with network_info: [{"id": "4a7a7eb9-3750-4061-bb75-72a936f0e85a", "address": "fa:16:3e:eb:b5:05", "network": {"id": "f84be94a-cbca-4401-b34e-c0e01bb632c9", "bridge": null, "label": "tempest-AttachVolumeNegativeTest-2088231271-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0928f57ccc9245e28c79dd9cce7e395b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4a7a7eb9-37", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:06:35.874 4088 3038362818168 GreenThread-96 DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Releasing lock "refresh_cache-fc38b331-efcd-4c62-aecf-3859bffff0bb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:06:35.874 4088 3038362818168 GreenThread-96 DEBUG nova.compute.manager [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Instance network_info: |[{"id": "4a7a7eb9-3750-4061-bb75-72a936f0e85a", "address": "fa:16:3e:eb:b5:05", "network": {"id": "f84be94a-cbca-4401-b34e-c0e01bb632c9", "bridge": null, "label": "tempest-AttachVolumeNegativeTest-2088231271-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0928f57ccc9245e28c79dd9cce7e395b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4a7a7eb9-37", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:06:35.874 4088 3038362817816 MainThread DEBUG oslo_concurrency.lockutils [req-ae143d9d-0586-4474-86bd-e74650de8bcb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-fc38b331-efcd-4c62-aecf-3859bffff0bb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:06:35.874 4088 3038362817816 MainThread DEBUG nova.network.neutron [req-ae143d9d-0586-4474-86bd-e74650de8bcb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Refreshing network info cache for port 4a7a7eb9-3750-4061-bb75-72a936f0e85a _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:06:35.874 4088 3038362817992 MainThread DEBUG nova.compute.manager [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Preparing to wait for external event network-vif-plugged-4a7a7eb9-3750-4061-bb75-72a936f0e85a prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:06:35.874 4088 3038362817992 MainThread DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "fc38b331-efcd-4c62-aecf-3859bffff0bb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:35.874 4088 3038362817992 MainThread DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "fc38b331-efcd-4c62-aecf-3859bffff0bb-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:35.874 4088 3038362817992 MainThread DEBUG os_win.utils.compute.vmutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Creating VM instance-0000006a create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:06:36.653 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_power_states run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:06:36.736 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 18930e09-cd62-4d3e-b27f-e9541dfa3efc _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:06:36.736 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:06:36.736 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 66c5445c-c347-4833-8af8-58ba8ff6d95e _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:06:36.736 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:06:36.736 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9db39d70-5120-4de4-bb87-480a6efb8a3a _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:06:36.736 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 0e77fafa-3f8a-4513-bb64-518c77e99029 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:06:36.736 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 50586591-86ba-41be-b4e1-5004ea0d76dd _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:06:36.736 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 98da4c02-e4db-4a02-a807-c737f9038672 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:06:36.736 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 359fd482-69f5-4194-9466-f46ea31258d3 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:06:36.736 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 6a33a253-c7b1-44b1-bdc0-eca64733ab55 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:06:36.736 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 592bb39a-81cb-43f8-a643-b04092bd9e8a _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:06:36.736 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9446e666-4364-4dcd-b041-405653a856bd _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:06:36.736 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9bb2d354-2d76-40ea-8b9c-b18a21edefbb _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:06:36.736 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 4e15be49-462b-4156-9978-5513db0f17ba _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:06:36.736 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid fc38b331-efcd-4c62-aecf-3859bffff0bb _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:06:36.736 4088 3038362818168 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:36.736 4088 3038362818168 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:36.736 4088 3038362818344 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:36.736 4088 3038362818344 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:36.736 4088 3038362818520 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:36.754 4088 3038362818520 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:36.754 4088 3038362818696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:36.754 4088 3038362818696 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:36.754 4088 3038362819048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:36.754 4088 3038362819048 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:36.754 4088 3038362818872 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:36.754 4088 3038362818872 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:36.754 4088 3038362819224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:36.754 4088 3038362819224 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:36.754 4088 3038362819400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "98da4c02-e4db-4a02-a807-c737f9038672" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:36.754 4088 3038362819400 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:36.754 4088 3038362820104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9446e666-4364-4dcd-b041-405653a856bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:36.754 4088 3038362820104 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 9446e666-4364-4dcd-b041-405653a856bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:36.754 4088 3038362819576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "359fd482-69f5-4194-9466-f46ea31258d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:36.754 4088 3038362819576 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:36.754 4088 3038362819752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:36.754 4088 3038362819752 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:36.754 4088 3038362820280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:36.754 4088 3038362820280 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:36.754 4088 3038362819928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:36.754 4088 3038362819928 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:36.967 4088 3038362818344 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.234s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:36.983 4088 3038362818696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.235s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:36.983 4088 3038362819048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.235s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:37.015 4088 3038362819224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.266s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:37.015 4088 3038362820104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9446e666-4364-4dcd-b041-405653a856bd" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.266s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:37.030 4088 3038362818520 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.297s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:37.030 4088 3038362820280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.282s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:37.030 4088 3038362819928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.282s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:37.046 4088 3038362818872 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.297s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:37.061 4088 3038362819752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.313s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:37.061 4088 3038362818168 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:37.061 4088 3038362819400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "98da4c02-e4db-4a02-a807-c737f9038672" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.313s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:37.078 4088 3038362819576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "359fd482-69f5-4194-9466-f46ea31258d3" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.329s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:37.704 4088 3038362817992 MainThread DEBUG nova.virt.hyperv.vmops [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:06:37.983 4088 3038362820280 MainThread DEBUG nova.compute.manager [req-98893116-6d76-4737-b82f-abb35222b49f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Received event network-vif-plugged-e5dca845-1ebe-40c1-9c35-cde0ac0538e1 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:06:37.983 4088 3038362820280 MainThread DEBUG oslo_concurrency.lockutils [req-98893116-6d76-4737-b82f-abb35222b49f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "4e15be49-462b-4156-9978-5513db0f17ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:37.983 4088 3038362820280 MainThread DEBUG oslo_concurrency.lockutils [req-98893116-6d76-4737-b82f-abb35222b49f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "4e15be49-462b-4156-9978-5513db0f17ba-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:37.983 4088 3038362820280 MainThread DEBUG nova.compute.manager [req-98893116-6d76-4737-b82f-abb35222b49f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Processing event network-vif-plugged-e5dca845-1ebe-40c1-9c35-cde0ac0538e1 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:06:37.998 4088 3038341413704 MainThread INFO nova.virt.hyperv.vmops [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Using config drive for instance 2021-09-10 17:06:38.021 4088 3038362817816 MainThread DEBUG nova.network.neutron [req-ae143d9d-0586-4474-86bd-e74650de8bcb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Updated VIF entry in instance network info cache for port 4a7a7eb9-3750-4061-bb75-72a936f0e85a. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:06:38.021 4088 3038362817816 MainThread DEBUG nova.network.neutron [req-ae143d9d-0586-4474-86bd-e74650de8bcb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Updating instance_info_cache with network_info: [{"id": "4a7a7eb9-3750-4061-bb75-72a936f0e85a", "address": "fa:16:3e:eb:b5:05", "network": {"id": "f84be94a-cbca-4401-b34e-c0e01bb632c9", "bridge": null, "label": "tempest-AttachVolumeNegativeTest-2088231271-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0928f57ccc9245e28c79dd9cce7e395b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4a7a7eb9-37", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:06:38.052 4088 3038362817816 MainThread DEBUG oslo_concurrency.lockutils [req-ae143d9d-0586-4474-86bd-e74650de8bcb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-fc38b331-efcd-4c62-aecf-3859bffff0bb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:06:38.482 4088 3038341413704 MainThread INFO nova.virt.hyperv.vmops [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Creating config drive at C:\openstack\instances\instance-00000069\configdrive.iso 2021-09-10 17:06:38.567 4088 3038341413704 MainThread DEBUG oslo_concurrency.processutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000069\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpnzk36inh execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:06:38.881 4088 3038341413704 MainThread DEBUG oslo_concurrency.processutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000069\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpnzk36inh" returned: 0 in 0.312s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:06:39.422 4088 3038341413704 MainThread DEBUG nova.virt.hyperv.vmops [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Setting boot order for instance: instance-00000069: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:06:39.506 4088 3038341413704 MainThread DEBUG nova.virt.hyperv.vmops [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:06:39.551 4088 3038341413704 MainThread DEBUG os_win.utils.jobutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '74D540E2-4F93-4B0C-8B98-7E931AAF55D9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16345), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:39.696 4088 3038341413704 MainThread ERROR os_win.utils.jobutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000069\' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)instance-000000699C3BD8F3-9CDA-4ED9-96DD-00D0AFD3931812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)instance-000000699C3BD8F3-9CDA-4ED9-96DD-00D0AFD3931810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000069\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)instance-000000699C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '74D540E2-4F93-4B0C-8B98-7E931AAF55D9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=126330), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 39), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 39), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000069' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)\n\nNot enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)\n\n'instance-00000069' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)", 'ErrorSummaryDescription': "'instance-00000069' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000069.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:39.696 4088 3038341413704 MainThread DEBUG os_win._utils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000069' failed to start. Not enough memory in the system to start the virtual machine instance-00000069. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000069' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Not enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) 'instance-00000069' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18994498252868652 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:39.748 4088 3038362820280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000069" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:39.748 4088 3038362820280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000069" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:39.757 4088 3038341411944 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:39.757 4088 3038341411944 MainThread INFO nova.compute.manager [-] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] VM Stopped (Lifecycle Event) 2021-09-10 17:06:39.791 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-84f643cf-9997-4877-90bd-e4c20cd5592a - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:39.791 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.vmops [req-84f643cf-9997-4877-90bd-e4c20cd5592a - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:39.827 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-84f643cf-9997-4877-90bd-e4c20cd5592a - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:39.874 4088 3038341411944 MainThread INFO nova.compute.manager [req-84f643cf-9997-4877-90bd-e4c20cd5592a - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:40.748 4088 3038341413704 MainThread DEBUG os_win.utils.jobutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'C2D1869C-D9F1-4390-BB2B-5D389817F827', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21188), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:40.887 4088 3038341413704 MainThread ERROR os_win.utils.jobutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000069\' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)instance-000000699C3BD8F3-9CDA-4ED9-96DD-00D0AFD3931812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)instance-000000699C3BD8F3-9CDA-4ED9-96DD-00D0AFD3931810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000069\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)instance-000000699C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C2D1869C-D9F1-4390-BB2B-5D389817F827', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113431), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 40), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 40), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000069' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)\n\nNot enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)\n\n'instance-00000069' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)", 'ErrorSummaryDescription': "'instance-00000069' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000069.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:40.887 4088 3038341413704 MainThread DEBUG os_win._utils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000069' failed to start. Not enough memory in the system to start the virtual machine instance-00000069. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000069' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Not enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) 'instance-00000069' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3809292316436768 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:40.910 4088 3038362820280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000069" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:40.910 4088 3038362820280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000069" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:40.910 4088 3038341411944 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:40.910 4088 3038341411944 MainThread INFO nova.compute.manager [-] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] VM Stopped (Lifecycle Event) 2021-09-10 17:06:40.949 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-3e2ffea1-61aa-4ead-a8fe-fd34852facb7 - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:40.949 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.vmops [req-3e2ffea1-61aa-4ead-a8fe-fd34852facb7 - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:40.998 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-3e2ffea1-61aa-4ead-a8fe-fd34852facb7 - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:41.047 4088 3038341411944 MainThread INFO nova.compute.manager [req-3e2ffea1-61aa-4ead-a8fe-fd34852facb7 - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:41.920 4088 3038341413704 MainThread DEBUG os_win.utils.jobutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '1C51FC5B-9778-4DA3-A8EC-405259BB885A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17146), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:42.079 4088 3038341413704 MainThread ERROR os_win.utils.jobutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000069\' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)instance-000000699C3BD8F3-9CDA-4ED9-96DD-00D0AFD3931812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)instance-000000699C3BD8F3-9CDA-4ED9-96DD-00D0AFD3931810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000069\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)instance-000000699C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1C51FC5B-9778-4DA3-A8EC-405259BB885A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114788), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 41), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 42), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000069' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)\n\nNot enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)\n\n'instance-00000069' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)", 'ErrorSummaryDescription': "'instance-00000069' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000069.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:42.079 4088 3038341413704 MainThread DEBUG os_win._utils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000069' failed to start. Not enough memory in the system to start the virtual machine instance-00000069. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000069' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Not enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) 'instance-00000069' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.572488307952881 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:42.171 4088 3038341411944 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:42.171 4088 3038341411944 MainThread INFO nova.compute.manager [-] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] VM Stopped (Lifecycle Event) 2021-09-10 17:06:42.171 4088 3038362820280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000069" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:42.171 4088 3038362820280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000069" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:42.217 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-1d8e8828-58df-424d-9110-2ff819ec70f1 - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:42.217 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.vmops [req-1d8e8828-58df-424d-9110-2ff819ec70f1 - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:42.263 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-1d8e8828-58df-424d-9110-2ff819ec70f1 - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:42.300 4088 3038341411944 MainThread INFO nova.compute.manager [req-1d8e8828-58df-424d-9110-2ff819ec70f1 - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:42.529 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:06:42.529 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:06:43.096 4088 3038341413704 MainThread DEBUG os_win.utils.jobutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'A6C73581-A134-4929-865D-62B8022DD4C9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15548), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:43.237 4088 3038341413704 MainThread ERROR os_win.utils.jobutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000069\' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)instance-000000699C3BD8F3-9CDA-4ED9-96DD-00D0AFD3931812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)instance-000000699C3BD8F3-9CDA-4ED9-96DD-00D0AFD3931810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000069\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)instance-000000699C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A6C73581-A134-4929-865D-62B8022DD4C9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112950), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 43), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 43), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000069' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)\n\nNot enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)\n\n'instance-00000069' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)", 'ErrorSummaryDescription': "'instance-00000069' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000069.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:43.237 4088 3038341413704 MainThread DEBUG os_win._utils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000069' failed to start. Not enough memory in the system to start the virtual machine instance-00000069. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000069' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Not enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) 'instance-00000069' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.730442523956299 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:43.295 4088 3038362820280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000069" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:43.295 4088 3038362820280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000069" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:43.295 4088 3038341411944 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:43.295 4088 3038341411944 MainThread INFO nova.compute.manager [-] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] VM Stopped (Lifecycle Event) 2021-09-10 17:06:43.391 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-886abb0b-483c-4099-8d47-082027bb9b2f - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:43.391 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.vmops [req-886abb0b-483c-4099-8d47-082027bb9b2f - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:43.439 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-886abb0b-483c-4099-8d47-082027bb9b2f - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:43.467 4088 3038341411944 MainThread INFO nova.compute.manager [req-886abb0b-483c-4099-8d47-082027bb9b2f - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:43.525 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:06:43.545 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_incomplete_migrations run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:06:43.545 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances with incomplete migration _cleanup_incomplete_migrations c:\openstack\build\nova\nova\compute\manager.py:10640 2021-09-10 17:06:44.263 4088 3038341413704 MainThread DEBUG os_win.utils.jobutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '9B7BD16D-A1E2-4518-A915-132525D018BD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15780), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:44.422 4088 3038341413704 MainThread ERROR os_win.utils.jobutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000069\' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)instance-000000699C3BD8F3-9CDA-4ED9-96DD-00D0AFD3931812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)instance-000000699C3BD8F3-9CDA-4ED9-96DD-00D0AFD3931810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000069\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)instance-000000699C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9B7BD16D-A1E2-4518-A915-132525D018BD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117532), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 44), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 44), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000069' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)\n\nNot enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)\n\n'instance-00000069' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)", 'ErrorSummaryDescription': "'instance-00000069' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000069.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:44.422 4088 3038341413704 MainThread DEBUG os_win._utils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000069' failed to start. Not enough memory in the system to start the virtual machine instance-00000069. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000069' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Not enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) 'instance-00000069' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.915765285491943 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:44.453 4088 3038362820280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000069" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:44.453 4088 3038362820280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000069" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:44.453 4088 3038341411944 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:44.453 4088 3038341411944 MainThread INFO nova.compute.manager [-] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] VM Stopped (Lifecycle Event) 2021-09-10 17:06:44.483 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-d61c8749-90b4-40e5-9b08-5321e15a58be - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:44.483 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.vmops [req-d61c8749-90b4-40e5-9b08-5321e15a58be - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:44.533 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-d61c8749-90b4-40e5-9b08-5321e15a58be - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:44.560 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:06:44.594 4088 3038341411944 MainThread INFO nova.compute.manager [req-d61c8749-90b4-40e5-9b08-5321e15a58be - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:44.779 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-2716e27a-997d-4925-8e88-357cef4fc30f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Received event network-vif-plugged-4a7a7eb9-3750-4061-bb75-72a936f0e85a external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:06:44.779 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-2716e27a-997d-4925-8e88-357cef4fc30f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "fc38b331-efcd-4c62-aecf-3859bffff0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:44.779 4088 3038341411944 MainThread DEBUG oslo_concurrency.lockutils [req-2716e27a-997d-4925-8e88-357cef4fc30f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "fc38b331-efcd-4c62-aecf-3859bffff0bb-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:44.779 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-2716e27a-997d-4925-8e88-357cef4fc30f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Processing event network-vif-plugged-4a7a7eb9-3750-4061-bb75-72a936f0e85a _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:06:44.828 4088 3038362817992 MainThread INFO nova.virt.hyperv.vmops [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Using config drive for instance 2021-09-10 17:06:45.436 4088 3038341413704 MainThread DEBUG os_win.utils.jobutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': 'AD1CB556-2D3A-4DB5-B4EF-0200B310031E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17499), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:45.436 4088 3038362817992 MainThread INFO nova.virt.hyperv.vmops [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Creating config drive at C:\openstack\instances\instance-0000006a\configdrive.iso 2021-09-10 17:06:45.588 4088 3038362817992 MainThread DEBUG oslo_concurrency.processutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000006a\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpfsznww90 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:06:45.751 4088 3038362816760 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:45.751 4088 3038362816760 MainThread INFO nova.compute.manager [-] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] VM Stopped (Lifecycle Event) 2021-09-10 17:06:45.751 4088 3038362819576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000069" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:45.751 4088 3038362819576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000069" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:45.767 4088 3038341413704 MainThread ERROR os_win.utils.jobutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000069\' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)instance-000000699C3BD8F3-9CDA-4ED9-96DD-00D0AFD3931812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)instance-000000699C3BD8F3-9CDA-4ED9-96DD-00D0AFD3931810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000069\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)instance-000000699C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'AD1CB556-2D3A-4DB5-B4EF-0200B310031E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=162626), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 45), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 45), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000069' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)\n\nNot enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)\n\n'instance-00000069' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318)", 'ErrorSummaryDescription': "'instance-00000069' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000069.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:45.767 4088 3038341413704 MainThread ERROR nova.virt.hyperv.vmops [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Failed to change vm state of instance-00000069 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000069' failed to start. 2021-09-10 17:06:45.767 4088 3038341413704 MainThread INFO nova.virt.hyperv.vmops [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Got request to destroy instance 2021-09-10 17:06:45.781 4088 3038362816760 MainThread DEBUG nova.compute.manager [req-eb562ca4-dd01-41ee-9054-258f85256d1d - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:45.781 4088 3038362816760 MainThread DEBUG nova.virt.hyperv.vmops [req-eb562ca4-dd01-41ee-9054-258f85256d1d - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:45.827 4088 3038362816760 MainThread DEBUG nova.compute.manager [req-eb562ca4-dd01-41ee-9054-258f85256d1d - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:45.842 4088 3038362816760 MainThread INFO nova.compute.manager [req-eb562ca4-dd01-41ee-9054-258f85256d1d - - - - -] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:45.920 4088 3038362817992 MainThread DEBUG oslo_concurrency.processutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000006a\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpfsznww90" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:06:46.437 4088 3038362817992 MainThread DEBUG nova.virt.hyperv.vmops [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Setting boot order for instance: instance-0000006a: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:06:46.531 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:06:46.531 4088 3038362817992 MainThread DEBUG nova.virt.hyperv.vmops [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:06:46.565 4088 3038362817992 MainThread DEBUG os_win.utils.jobutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': '9E630599-6BAB-406A-8FE5-5A255CDCC9B6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15261), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:46.717 4088 3038362817992 MainThread ERROR os_win.utils.jobutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006a\' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)instance-0000006a2A5EBE9F-CC77-4218-BA49-FD9383B8435812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)instance-0000006a2A5EBE9F-CC77-4218-BA49-FD9383B8435810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)instance-0000006a2A5EBE9F-CC77-4218-BA49-FD9383B84358%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9E630599-6BAB-406A-8FE5-5A255CDCC9B6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120291), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 46), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 46), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006a' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)\n\nNot enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)\n\n'instance-0000006a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)", 'ErrorSummaryDescription': "'instance-0000006a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:46.717 4088 3038362817992 MainThread DEBUG os_win._utils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006a' failed to start. Not enough memory in the system to start the virtual machine instance-0000006a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006a' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Not enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) 'instance-0000006a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18669700622558594 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:46.755 4088 3038362817816 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:46.755 4088 3038362817816 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:46.755 4088 3038362816760 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:46.755 4088 3038362816760 MainThread INFO nova.compute.manager [-] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] VM Stopped (Lifecycle Event) 2021-09-10 17:06:46.767 4088 3038362816760 MainThread DEBUG nova.compute.manager [req-d4ccf757-6d6e-4bdc-a538-cc42903f7ead - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:46.767 4088 3038362816760 MainThread DEBUG nova.virt.hyperv.vmops [req-d4ccf757-6d6e-4bdc-a538-cc42903f7ead - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:46.824 4088 3038362816760 MainThread DEBUG nova.compute.manager [req-d4ccf757-6d6e-4bdc-a538-cc42903f7ead - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:46.843 4088 3038362816760 MainThread INFO nova.compute.manager [req-d4ccf757-6d6e-4bdc-a538-cc42903f7ead - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:47.530 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:06:47.546 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:06:47.740 4088 3038341413704 MainThread DEBUG nova.virt.hyperv.vmops [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:06:47.740 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000069" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:47.740 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000069" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:47.752 4088 3038362817992 MainThread DEBUG os_win.utils.jobutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': 'DE5A6F67-CAD1-4E64-9C32-FAC175EF4300', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15133), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:47.752 4088 3038341413704 MainThread DEBUG os_win.utils.compute.vmutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Successfully changed vm state of instance-00000069 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:06:47.752 4088 3038341413704 MainThread DEBUG nova.virt.hyperv.vmops [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Successfully changed state of VM instance-00000069 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:06:47.813 4088 3038341413704 MainThread DEBUG os_win.utils.jobutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Waiting for WMI job: {'InstanceID': '5533334B-D376-4FD1-A577-0C063EBD17EB', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15110), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:47.937 4088 3038341413704 MainThread DEBUG os_win.utils.jobutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] WMI job succeeded: {'InstanceID': '5533334B-D376-4FD1-A577-0C063EBD17EB', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=106886), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:06:47.937 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000069" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:47.937 4088 3038341413704 MainThread DEBUG os_win.utils.pathutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Removing directory: C:\openstack\instances\instance-00000069 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:06:47.952 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000069" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:47.952 4088 3038341413704 MainThread ERROR nova.compute.manager [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000069' failed to start. Not enough memory in the system to start the virtual machine instance-00000069. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000069' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Not enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) 'instance-00000069' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Error code: 32778. 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Traceback (most recent call last): 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] return function(*args, **kwargs) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] admin_password, network_info, block_device_info) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] return function(self, *args, **kwds) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self.force_reraise() 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] raise self.value 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] should_plug_vifs=False) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 'req_state': req_state}) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self.force_reraise() 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] raise self.value 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] time.sleep(sleep_time) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self.force_reraise() 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] raise self.value 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] return f(*args, **kwargs) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] return self._wait_for_job(job_path) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] error_desc=err_desc) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000069' failed to start. 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Not enough memory in the system to start the virtual machine instance-00000069. 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000069' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Not enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 'instance-00000069' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Error code: 32778. 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] During handling of the above exception, another exception occurred: 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Traceback (most recent call last): 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] yield resources 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] accel_info=accel_info) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] return function(*args, **kwargs) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] admin_password, network_info, block_device_info) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] return function(self, *args, **kwds) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self.force_reraise() 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] raise self.value 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] should_plug_vifs=False) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 'req_state': req_state}) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self.force_reraise() 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] raise self.value 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] time.sleep(sleep_time) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self.force_reraise() 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] raise self.value 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] return f(*args, **kwargs) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] return self._wait_for_job(job_path) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] error_desc=err_desc) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000069' failed to start. 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Not enough memory in the system to start the virtual machine instance-00000069. 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000069' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Not enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 'instance-00000069' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Error code: 32778. 2021-09-10 17:06:47.952 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:47.952 4088 3038341413704 MainThread INFO nova.compute.manager [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Terminating instance 2021-09-10 17:06:47.952 4088 3038341413704 MainThread DEBUG nova.compute.manager [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:06:47.952 4088 3038341413704 MainThread INFO nova.virt.hyperv.vmops [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Got request to destroy instance 2021-09-10 17:06:47.971 4088 3038341413704 MainThread DEBUG nova.virt.hyperv.vmops [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:06:47.971 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000069" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:47.971 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "instance-00000069" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:47.971 4088 3038341413704 MainThread INFO nova.compute.manager [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:06:47.971 4088 3038341413704 MainThread DEBUG nova.compute.claims [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:06:47.971 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:47.986 4088 3038341411944 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:47.986 4088 3038341411944 MainThread INFO nova.compute.manager [-] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] VM Stopped (Lifecycle Event) 2021-09-10 17:06:47.986 4088 3038362816760 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:47.986 4088 3038362816760 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:47.986 4088 3038362817992 MainThread ERROR os_win.utils.jobutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006a\' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)instance-0000006a2A5EBE9F-CC77-4218-BA49-FD9383B8435812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)instance-0000006a2A5EBE9F-CC77-4218-BA49-FD9383B8435810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)instance-0000006a2A5EBE9F-CC77-4218-BA49-FD9383B84358%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'DE5A6F67-CAD1-4E64-9C32-FAC175EF4300', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=179162), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 47), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 47), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006a' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)\n\nNot enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)\n\n'instance-0000006a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)", 'ErrorSummaryDescription': "'instance-0000006a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:47.986 4088 3038362817992 MainThread DEBUG os_win._utils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006a' failed to start. Not enough memory in the system to start the virtual machine instance-0000006a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006a' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Not enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) 'instance-0000006a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4558119773864746 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:48.016 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-3331a213-a6e0-4b0e-b1ea-c5a7c9f4d76e - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:48.016 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.vmops [req-3331a213-a6e0-4b0e-b1ea-c5a7c9f4d76e - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:48.045 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-3331a213-a6e0-4b0e-b1ea-c5a7c9f4d76e - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:48.094 4088 3038341411944 MainThread INFO nova.compute.manager [req-3331a213-a6e0-4b0e-b1ea-c5a7c9f4d76e - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:48.423 4088 3038341413704 MainThread DEBUG nova.scheduler.client.report [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Refreshing inventories for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:757 2021-09-10 17:06:48.458 4088 3038341413704 MainThread DEBUG nova.scheduler.client.report [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Updating ProviderTree inventory for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 from _refresh_and_get_inventory using data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} _refresh_and_get_inventory c:\openstack\build\nova\nova\scheduler\client\report.py:723 2021-09-10 17:06:48.458 4088 3038341413704 MainThread DEBUG nova.compute.provider_tree [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Updating inventory in ProviderTree for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 with inventory: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:176 2021-09-10 17:06:48.471 4088 3038341413704 MainThread DEBUG nova.scheduler.client.report [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Refreshing aggregate associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, aggregates: None _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:766 2021-09-10 17:06:48.522 4088 3038341413704 MainThread DEBUG nova.scheduler.client.report [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Refreshing trait associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_VHD,COMPUTE_IMAGE_TYPE_VHDX,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:778 2021-09-10 17:06:48.522 4088 3038341413704 MainThread DEBUG nova.virt.hyperv.hostops [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:06:48.534 4088 3038341413704 MainThread DEBUG nova.virt.hyperv.hostops [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:06:48.547 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:06:48.748 4088 3038341413704 MainThread DEBUG nova.compute.provider_tree [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:06:48.764 4088 3038341413704 MainThread DEBUG nova.scheduler.client.report [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:06:48.764 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.797s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:48.764 4088 3038341413704 MainThread ERROR nova.compute.manager [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000069' failed to start. Not enough memory in the system to start the virtual machine instance-00000069. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000069' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Not enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) 'instance-00000069' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Error code: 32778. 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Traceback (most recent call last): 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] return function(*args, **kwargs) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] admin_password, network_info, block_device_info) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] return function(self, *args, **kwds) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self.force_reraise() 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] raise self.value 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] should_plug_vifs=False) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 'req_state': req_state}) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self.force_reraise() 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] raise self.value 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] time.sleep(sleep_time) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self.force_reraise() 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] raise self.value 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] return f(*args, **kwargs) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] return self._wait_for_job(job_path) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] error_desc=err_desc) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000069' failed to start. 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Not enough memory in the system to start the virtual machine instance-00000069. 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000069' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Not enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 'instance-00000069' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Error code: 32778. 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] During handling of the above exception, another exception occurred: 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Traceback (most recent call last): 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] accel_info=accel_info) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] return function(*args, **kwargs) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] admin_password, network_info, block_device_info) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] return function(self, *args, **kwds) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self.force_reraise() 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] raise self.value 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] should_plug_vifs=False) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 'req_state': req_state}) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self.force_reraise() 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] raise self.value 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] time.sleep(sleep_time) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self.force_reraise() 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] raise self.value 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] return f(*args, **kwargs) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] return self._wait_for_job(job_path) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] error_desc=err_desc) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000069' failed to start. 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Not enough memory in the system to start the virtual machine instance-00000069. 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000069' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Not enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 'instance-00000069' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Error code: 32778. 2021-09-10 17:06:48.764 4088 3038341413704 MainThread TRACE nova.compute.manager [instance: 4e15be49-462b-4156-9978-5513db0f17ba] 2021-09-10 17:06:48.764 4088 3038341413704 MainThread DEBUG nova.compute.utils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] WMI job failed with status 10. Error summary description: 'instance-00000069' failed to start. Not enough memory in the system to start the virtual machine instance-00000069. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:06:48.764 4088 3038341413704 MainThread DEBUG nova.compute.manager [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Build of instance 4e15be49-462b-4156-9978-5513db0f17ba was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000069' failed to start. Not enough memory in the system to start the virtual machine instance-00000069. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000069' failed to start. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Not enough memory in the system to start the virtual machine instance-00000069 with ram size 1024 megabytes. (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) 'instance-00000069' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9C3BD8F3-9CDA-4ED9-96DD-00D0AFD39318) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:06:48.764 4088 3038341413704 MainThread DEBUG nova.compute.manager [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:06:48.764 4088 3038341413704 MainThread DEBUG nova.compute.manager [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:06:48.764 4088 3038341413704 MainThread DEBUG nova.compute.manager [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:06:48.764 4088 3038341413704 MainThread DEBUG nova.network.neutron [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:06:49.005 4088 3038362817992 MainThread DEBUG os_win.utils.jobutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': '9D778110-8C36-4E72-B4E6-2F91C83E6136', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15187), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:49.149 4088 3038362817992 MainThread ERROR os_win.utils.jobutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006a\' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)instance-0000006a2A5EBE9F-CC77-4218-BA49-FD9383B8435812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)instance-0000006a2A5EBE9F-CC77-4218-BA49-FD9383B8435810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)instance-0000006a2A5EBE9F-CC77-4218-BA49-FD9383B84358%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9D778110-8C36-4E72-B4E6-2F91C83E6136', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112852), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 48), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 49), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006a' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)\n\nNot enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)\n\n'instance-0000006a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)", 'ErrorSummaryDescription': "'instance-0000006a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:49.149 4088 3038362817992 MainThread DEBUG os_win._utils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006a' failed to start. Not enough memory in the system to start the virtual machine instance-0000006a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006a' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Not enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) 'instance-0000006a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.61859393119812 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:49.204 4088 3038362818872 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:49.204 4088 3038362818872 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:49.204 4088 3038362819752 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:49.204 4088 3038362819752 MainThread INFO nova.compute.manager [-] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] VM Stopped (Lifecycle Event) 2021-09-10 17:06:49.234 4088 3038362819752 MainThread DEBUG nova.compute.manager [req-c681467f-cd9f-4131-a20a-5ffee85d4730 - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:49.234 4088 3038362819752 MainThread DEBUG nova.virt.hyperv.vmops [req-c681467f-cd9f-4131-a20a-5ffee85d4730 - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:49.267 4088 3038362819752 MainThread DEBUG nova.compute.manager [req-c681467f-cd9f-4131-a20a-5ffee85d4730 - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:49.326 4088 3038362819752 MainThread INFO nova.compute.manager [req-c681467f-cd9f-4131-a20a-5ffee85d4730 - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:49.782 4088 3038341413704 MainThread DEBUG nova.network.neutron [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:06:49.812 4088 3038341413704 MainThread INFO nova.compute.manager [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] Took 1.05 seconds to deallocate network for instance. 2021-09-10 17:06:50.170 4088 3038341413704 MainThread INFO nova.scheduler.client.report [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Deleted allocations for instance 4e15be49-462b-4156-9978-5513db0f17ba 2021-09-10 17:06:50.190 4088 3038362817992 MainThread DEBUG os_win.utils.jobutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': '2E0C3BC7-0EFB-4A08-BB12-E58D9DB590FF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=25762), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:50.233 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [req-329f875d-6f00-4cfc-a3ca-59760b1061da 9f286737f0e6452bbe04f42184b6d12d df662acac0f043bb8be9c87490878d93 - default default] Lock "4e15be49-462b-4156-9978-5513db0f17ba" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 28.953s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:50.233 4088 3038362820456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "4e15be49-462b-4156-9978-5513db0f17ba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 13.485s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:50.233 4088 3038362820456 MainThread INFO nova.compute.manager [-] [instance: 4e15be49-462b-4156-9978-5513db0f17ba] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:50.233 4088 3038362820456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "4e15be49-462b-4156-9978-5513db0f17ba" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:50.347 4088 3038362817992 MainThread ERROR os_win.utils.jobutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006a\' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)instance-0000006a2A5EBE9F-CC77-4218-BA49-FD9383B8435812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)instance-0000006a2A5EBE9F-CC77-4218-BA49-FD9383B8435810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)instance-0000006a2A5EBE9F-CC77-4218-BA49-FD9383B84358%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '2E0C3BC7-0EFB-4A08-BB12-E58D9DB590FF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113608), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 50), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 50), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006a' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)\n\nNot enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)\n\n'instance-0000006a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)", 'ErrorSummaryDescription': "'instance-0000006a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:50.347 4088 3038362817992 MainThread DEBUG os_win._utils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006a' failed to start. Not enough memory in the system to start the virtual machine instance-0000006a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006a' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Not enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) 'instance-0000006a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.8167593479156494 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:50.361 4088 3038362820456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:50.361 4088 3038362820456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:50.361 4088 3038341413704 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:50.361 4088 3038341413704 MainThread INFO nova.compute.manager [-] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] VM Stopped (Lifecycle Event) 2021-09-10 17:06:50.374 4088 3038341413704 MainThread DEBUG nova.compute.manager [req-6516d9f9-df5a-4f56-aba5-086daaeea5e5 - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:50.374 4088 3038341413704 MainThread DEBUG nova.virt.hyperv.vmops [req-6516d9f9-df5a-4f56-aba5-086daaeea5e5 - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:50.435 4088 3038341413704 MainThread DEBUG nova.compute.manager [req-6516d9f9-df5a-4f56-aba5-086daaeea5e5 - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:50.467 4088 3038341413704 MainThread INFO nova.compute.manager [req-6516d9f9-df5a-4f56-aba5-086daaeea5e5 - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:50.533 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:06:50.533 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:06:50.638 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-592bb39a-81cb-43f8-a643-b04092bd9e8a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:06:50.638 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:06:51.374 4088 3038362817992 MainThread DEBUG os_win.utils.jobutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': '299B60B2-4D76-4CCC-8044-E7CDE992C02F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14919), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:51.531 4088 3038362817992 MainThread ERROR os_win.utils.jobutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006a\' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)instance-0000006a2A5EBE9F-CC77-4218-BA49-FD9383B8435812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)instance-0000006a2A5EBE9F-CC77-4218-BA49-FD9383B8435810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)instance-0000006a2A5EBE9F-CC77-4218-BA49-FD9383B84358%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '299B60B2-4D76-4CCC-8044-E7CDE992C02F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115237), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 51), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 51), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006a' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)\n\nNot enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)\n\n'instance-0000006a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)", 'ErrorSummaryDescription': "'instance-0000006a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:51.531 4088 3038362817992 MainThread DEBUG os_win._utils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006a' failed to start. Not enough memory in the system to start the virtual machine instance-0000006a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006a' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Not enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) 'instance-0000006a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.999986886978149 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:06:51.546 4088 3038362820456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:51.546 4088 3038362820456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:51.546 4088 3038362818168 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:51.546 4088 3038362818168 MainThread INFO nova.compute.manager [-] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] VM Stopped (Lifecycle Event) 2021-09-10 17:06:51.578 4088 3038362818168 MainThread DEBUG nova.compute.manager [req-184122bb-45f9-405a-b2ad-91bd6b64a4e7 - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:51.578 4088 3038362818168 MainThread DEBUG nova.virt.hyperv.vmops [req-184122bb-45f9-405a-b2ad-91bd6b64a4e7 - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:51.624 4088 3038362818168 MainThread DEBUG nova.compute.manager [req-184122bb-45f9-405a-b2ad-91bd6b64a4e7 - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:51.640 4088 3038362818168 MainThread INFO nova.compute.manager [req-184122bb-45f9-405a-b2ad-91bd6b64a4e7 - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:51.750 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Updating instance_info_cache with network_info: [{"id": "2ef6a3e6-e7a5-4da7-941d-89a1d5c697b7", "address": "fa:16:3e:eb:d0:49", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2ef6a3e6-e7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:06:51.802 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-592bb39a-81cb-43f8-a643-b04092bd9e8a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:06:51.802 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:06:51.802 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:06:51.802 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:06:52.549 4088 3038362817992 MainThread DEBUG os_win.utils.jobutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': '767A345E-9C3E-4E95-8BE5-F239D72BDF08', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16202), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:52.672 4088 3038362817992 MainThread ERROR os_win.utils.jobutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006a\' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)instance-0000006a2A5EBE9F-CC77-4218-BA49-FD9383B8435812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)instance-0000006a2A5EBE9F-CC77-4218-BA49-FD9383B8435810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)instance-0000006a2A5EBE9F-CC77-4218-BA49-FD9383B84358%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '767A345E-9C3E-4E95-8BE5-F239D72BDF08', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113470), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 6, 52), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 6, 52), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006a' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)\n\nNot enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)\n\n'instance-0000006a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358)", 'ErrorSummaryDescription': "'instance-0000006a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:06:52.701 4088 3038362817992 MainThread ERROR nova.virt.hyperv.vmops [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Failed to change vm state of instance-0000006a to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000006a' failed to start. 2021-09-10 17:06:52.701 4088 3038362817992 MainThread INFO nova.virt.hyperv.vmops [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Got request to destroy instance 2021-09-10 17:06:52.723 4088 3038341411944 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:06:52.723 4088 3038341411944 MainThread INFO nova.compute.manager [-] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] VM Stopped (Lifecycle Event) 2021-09-10 17:06:52.723 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:52.723 4088 3038341413704 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:52.734 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-16ce62db-948a-4add-8edd-88141e0fd7fe - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:06:52.734 4088 3038341411944 MainThread DEBUG nova.virt.hyperv.vmops [req-16ce62db-948a-4add-8edd-88141e0fd7fe - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:06:52.795 4088 3038341411944 MainThread DEBUG nova.compute.manager [req-16ce62db-948a-4add-8edd-88141e0fd7fe - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:06:52.850 4088 3038341411944 MainThread INFO nova.compute.manager [req-16ce62db-948a-4add-8edd-88141e0fd7fe - - - - -] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:54.560 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:06:54.580 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:54.580 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:54.580 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:06:54.580 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:06:54.599 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:06:54.638 4088 3038362817992 MainThread DEBUG nova.virt.hyperv.vmops [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:06:54.654 4088 3038362817992 MainThread DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-0000006a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:54.654 4088 3038362817992 MainThread DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-0000006a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:54.654 4088 3038362817992 MainThread DEBUG os_win.utils.compute.vmutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Successfully changed vm state of instance-0000006a to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:06:54.654 4088 3038362817992 MainThread DEBUG nova.virt.hyperv.vmops [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Successfully changed state of VM instance-0000006a to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:06:54.705 4088 3038362817992 MainThread DEBUG os_win.utils.jobutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': 'A45F0DA0-BB3E-4F4E-AACA-12A1516216F3', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17068), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:06:54.830 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2206MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:06:54.830 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:54.857 4088 3038362817992 MainThread DEBUG os_win.utils.jobutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job succeeded: {'InstanceID': 'A45F0DA0-BB3E-4F4E-AACA-12A1516216F3', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=116265), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:06:54.857 4088 3038362817992 MainThread DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-0000006a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:54.857 4088 3038362817992 MainThread DEBUG os_win.utils.pathutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Removing directory: C:\openstack\instances\instance-0000006a check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:06:54.857 4088 3038362817992 MainThread DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-0000006a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:54.857 4088 3038362817992 MainThread ERROR nova.compute.manager [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006a' failed to start. Not enough memory in the system to start the virtual machine instance-0000006a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006a' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Not enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) 'instance-0000006a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Error code: 32778. 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Traceback (most recent call last): 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] return function(*args, **kwargs) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] admin_password, network_info, block_device_info) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] return function(self, *args, **kwds) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self.force_reraise() 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] raise self.value 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] should_plug_vifs=False) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 'req_state': req_state}) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self.force_reraise() 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] raise self.value 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] time.sleep(sleep_time) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self.force_reraise() 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] raise self.value 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] return f(*args, **kwargs) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] return self._wait_for_job(job_path) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] error_desc=err_desc) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000006a' failed to start. 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Not enough memory in the system to start the virtual machine instance-0000006a. 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006a' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Not enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 'instance-0000006a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Error code: 32778. 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] During handling of the above exception, another exception occurred: 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Traceback (most recent call last): 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] yield resources 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] accel_info=accel_info) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] return function(*args, **kwargs) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] admin_password, network_info, block_device_info) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] return function(self, *args, **kwds) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self.force_reraise() 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] raise self.value 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] should_plug_vifs=False) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 'req_state': req_state}) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self.force_reraise() 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] raise self.value 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] time.sleep(sleep_time) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self.force_reraise() 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] raise self.value 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] return f(*args, **kwargs) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] return self._wait_for_job(job_path) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] error_desc=err_desc) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006a' failed to start. 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Not enough memory in the system to start the virtual machine instance-0000006a. 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006a' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Not enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 'instance-0000006a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Error code: 32778. 2021-09-10 17:06:54.857 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:54.873 4088 3038362817992 MainThread INFO nova.compute.manager [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Terminating instance 2021-09-10 17:06:54.873 4088 3038362817992 MainThread DEBUG nova.compute.manager [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:06:54.873 4088 3038362817992 MainThread INFO nova.virt.hyperv.vmops [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Got request to destroy instance 2021-09-10 17:06:54.889 4088 3038362817992 MainThread DEBUG nova.virt.hyperv.vmops [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:06:54.889 4088 3038362817992 MainThread DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-0000006a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:54.889 4088 3038362817992 MainThread DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-0000006a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:54.889 4088 3038362817992 MainThread INFO nova.compute.manager [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:06:54.889 4088 3038362817992 MainThread DEBUG nova.compute.claims [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:06:55.119 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:06:55.119 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:06:55.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:06:55.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:06:55.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:06:55.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:06:55.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:06:55.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:06:55.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:06:55.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:06:55.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:06:55.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:06:55.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:06:55.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance fc38b331-efcd-4c62-aecf-3859bffff0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:06:55.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:06:55.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=14GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:06:55.187 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:06:55.187 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:06:55.419 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:06:55.419 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:06:55.419 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:06:55.419 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:55.419 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:06:55.419 4088 3038362817992 MainThread DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.531s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:55.471 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._run_pending_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:06:55.471 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10602 2021-09-10 17:06:55.576 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] There are 0 instances to clean _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10611 2021-09-10 17:06:55.626 4088 3038362817992 MainThread DEBUG nova.virt.hyperv.hostops [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:06:55.647 4088 3038362817992 MainThread DEBUG nova.virt.hyperv.hostops [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:06:55.845 4088 3038362817992 MainThread DEBUG nova.compute.provider_tree [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:06:55.876 4088 3038362817992 MainThread DEBUG nova.scheduler.client.report [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:06:55.876 4088 3038362817992 MainThread DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:55.876 4088 3038362817992 MainThread ERROR nova.compute.manager [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006a' failed to start. Not enough memory in the system to start the virtual machine instance-0000006a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006a' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Not enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) 'instance-0000006a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Error code: 32778. 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Traceback (most recent call last): 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] return function(*args, **kwargs) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] admin_password, network_info, block_device_info) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] return function(self, *args, **kwds) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self.force_reraise() 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] raise self.value 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] should_plug_vifs=False) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 'req_state': req_state}) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self.force_reraise() 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] raise self.value 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] time.sleep(sleep_time) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self.force_reraise() 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] raise self.value 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] return f(*args, **kwargs) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] return self._wait_for_job(job_path) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] error_desc=err_desc) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000006a' failed to start. 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Not enough memory in the system to start the virtual machine instance-0000006a. 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006a' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Not enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 'instance-0000006a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Error code: 32778. 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] During handling of the above exception, another exception occurred: 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Traceback (most recent call last): 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] accel_info=accel_info) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] return function(*args, **kwargs) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] admin_password, network_info, block_device_info) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] return function(self, *args, **kwds) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self.force_reraise() 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] raise self.value 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] should_plug_vifs=False) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 'req_state': req_state}) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self.force_reraise() 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] raise self.value 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] time.sleep(sleep_time) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self.force_reraise() 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] raise self.value 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] return f(*args, **kwargs) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] return self._wait_for_job(job_path) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] error_desc=err_desc) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006a' failed to start. 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Not enough memory in the system to start the virtual machine instance-0000006a. 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006a' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Not enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 'instance-0000006a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Error code: 32778. 2021-09-10 17:06:55.876 4088 3038362817992 MainThread TRACE nova.compute.manager [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] 2021-09-10 17:06:55.892 4088 3038362817992 MainThread DEBUG nova.compute.utils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] WMI job failed with status 10. Error summary description: 'instance-0000006a' failed to start. Not enough memory in the system to start the virtual machine instance-0000006a. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:06:55.892 4088 3038362817992 MainThread DEBUG nova.compute.manager [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Build of instance fc38b331-efcd-4c62-aecf-3859bffff0bb was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000006a' failed to start. Not enough memory in the system to start the virtual machine instance-0000006a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006a' failed to start. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Not enough memory in the system to start the virtual machine instance-0000006a with ram size 1024 megabytes. (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) 'instance-0000006a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2A5EBE9F-CC77-4218-BA49-FD9383B84358) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:06:55.892 4088 3038362817992 MainThread DEBUG nova.compute.manager [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:06:55.892 4088 3038362817992 MainThread DEBUG nova.compute.manager [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:06:55.892 4088 3038362817992 MainThread DEBUG nova.compute.manager [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:06:55.892 4088 3038362817992 MainThread DEBUG nova.network.neutron [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:06:58.345 4088 3038362817992 MainThread DEBUG nova.network.neutron [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:06:58.405 4088 3038362817992 MainThread INFO nova.compute.manager [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] Took 2.52 seconds to deallocate network for instance. 2021-09-10 17:06:58.707 4088 3038362817992 MainThread INFO nova.scheduler.client.report [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Deleted allocations for instance fc38b331-efcd-4c62-aecf-3859bffff0bb 2021-09-10 17:06:58.754 4088 3038362817992 MainThread DEBUG oslo_concurrency.lockutils [req-2a837ba2-9334-4c35-8b06-a41b8373d5ca 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "fc38b331-efcd-4c62-aecf-3859bffff0bb" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 29.390s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:06:58.754 4088 3038363045960 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "fc38b331-efcd-4c62-aecf-3859bffff0bb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 22.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:06:58.754 4088 3038363045960 MainThread INFO nova.compute.manager [-] [instance: fc38b331-efcd-4c62-aecf-3859bffff0bb] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:06:58.754 4088 3038363045960 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "fc38b331-efcd-4c62-aecf-3859bffff0bb" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:08.180 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "1e1ed6b3-ce50-4c81-bc0f-08b715541c7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:08.240 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:07:08.499 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:08.513 4088 3038363047896 MainThread DEBUG nova.virt.hardware [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:07:08.513 4088 3038363047896 MainThread INFO nova.compute.claims [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Claim successful on node n-h2-808474-1 2021-09-10 17:07:08.717 4088 3038363047896 MainThread DEBUG nova.virt.hyperv.hostops [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:07:08.748 4088 3038363047896 MainThread DEBUG nova.virt.hyperv.hostops [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:07:08.962 4088 3038363047896 MainThread DEBUG nova.compute.provider_tree [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:07:08.989 4088 3038363047896 MainThread DEBUG nova.scheduler.client.report [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:07:08.989 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:08.989 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:07:09.190 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:07:09.190 4088 3038363047720 GreenThread-97 DEBUG nova.compute.manager [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:07:09.190 4088 3038363047720 GreenThread-97 DEBUG nova.network.neutron [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:07:09.544 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:07:09.551 4088 3038363047896 MainThread INFO nova.virt.hyperv.vmops [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Spawning new instance 2021-09-10 17:07:09.551 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "instance-0000006b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:09.551 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "instance-0000006b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:09.551 4088 3038363047896 MainThread DEBUG nova.block_device [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:07:09.551 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:09.551 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:09.592 4088 3038363047896 MainThread DEBUG os_win.utils.pathutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Creating directory: C:\openstack\instances\instance-0000006b check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:07:09.592 4088 3038363047896 MainThread DEBUG nova.virt.hyperv.vmops [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000006b\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:07:09.731 4088 3038363047720 GreenThread-97 DEBUG nova.policy [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e00875ca35f4501afe5474947cd0708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ea24a7b47a4f4a9015423bfcc23f3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:07:09.829 4088 3038363047896 MainThread DEBUG nova.virt.hyperv.vmops [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Resizing VHD C:\openstack\instances\instance-0000006b\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:07:13.122 4088 3038363047720 GreenThread-97 DEBUG nova.network.neutron [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Successfully created port: 9a014db2-d69e-4581-a8db-018367f3bd14 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:07:17.325 4088 3038363047720 GreenThread-97 DEBUG nova.network.neutron [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Successfully updated port: 9a014db2-d69e-4581-a8db-018367f3bd14 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:07:17.345 4088 3038363047720 GreenThread-97 DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Acquired lock "refresh_cache-1e1ed6b3-ce50-4c81-bc0f-08b715541c7a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:07:17.345 4088 3038363047720 GreenThread-97 DEBUG nova.network.neutron [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:07:17.439 4088 3038363048600 MainThread DEBUG nova.compute.manager [req-8f9b3360-84da-4da6-b711-1f018739f47d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Received event network-changed-9a014db2-d69e-4581-a8db-018367f3bd14 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:07:17.439 4088 3038363048600 MainThread DEBUG nova.compute.manager [req-8f9b3360-84da-4da6-b711-1f018739f47d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Refreshing instance network info cache due to event network-changed-9a014db2-d69e-4581-a8db-018367f3bd14. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:07:17.892 4088 3038363047720 GreenThread-97 DEBUG nova.network.neutron [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:07:19.127 4088 3038363047720 GreenThread-97 DEBUG nova.network.neutron [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Updating instance_info_cache with network_info: [{"id": "9a014db2-d69e-4581-a8db-018367f3bd14", "address": "fa:16:3e:3a:18:e5", "network": {"id": "d1d0dbf5-f2ce-4eeb-bc38-d716096517ef", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-413735321-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "89ea24a7b47a4f4a9015423bfcc23f3b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9a014db2-d6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:07:19.158 4088 3038363047720 GreenThread-97 DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Releasing lock "refresh_cache-1e1ed6b3-ce50-4c81-bc0f-08b715541c7a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:07:19.158 4088 3038363047720 GreenThread-97 DEBUG nova.compute.manager [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Instance network_info: |[{"id": "9a014db2-d69e-4581-a8db-018367f3bd14", "address": "fa:16:3e:3a:18:e5", "network": {"id": "d1d0dbf5-f2ce-4eeb-bc38-d716096517ef", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-413735321-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "89ea24a7b47a4f4a9015423bfcc23f3b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9a014db2-d6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:07:19.158 4088 3038363048600 MainThread DEBUG oslo_concurrency.lockutils [req-8f9b3360-84da-4da6-b711-1f018739f47d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-1e1ed6b3-ce50-4c81-bc0f-08b715541c7a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:07:19.158 4088 3038363048600 MainThread DEBUG nova.network.neutron [req-8f9b3360-84da-4da6-b711-1f018739f47d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Refreshing network info cache for port 9a014db2-d69e-4581-a8db-018367f3bd14 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:07:19.158 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Preparing to wait for external event network-vif-plugged-9a014db2-d69e-4581-a8db-018367f3bd14 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:07:19.158 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "1e1ed6b3-ce50-4c81-bc0f-08b715541c7a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:19.158 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "1e1ed6b3-ce50-4c81-bc0f-08b715541c7a-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:19.158 4088 3038363047896 MainThread DEBUG os_win.utils.compute.vmutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Creating VM instance-0000006b create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:07:20.982 4088 3038363047896 MainThread DEBUG nova.virt.hyperv.vmops [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:07:21.201 4088 3038363048600 MainThread DEBUG nova.network.neutron [req-8f9b3360-84da-4da6-b711-1f018739f47d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Updated VIF entry in instance network info cache for port 9a014db2-d69e-4581-a8db-018367f3bd14. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:07:21.201 4088 3038363048600 MainThread DEBUG nova.network.neutron [req-8f9b3360-84da-4da6-b711-1f018739f47d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Updating instance_info_cache with network_info: [{"id": "9a014db2-d69e-4581-a8db-018367f3bd14", "address": "fa:16:3e:3a:18:e5", "network": {"id": "d1d0dbf5-f2ce-4eeb-bc38-d716096517ef", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-413735321-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "89ea24a7b47a4f4a9015423bfcc23f3b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9a014db2-d6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:07:21.231 4088 3038363048600 MainThread DEBUG oslo_concurrency.lockutils [req-8f9b3360-84da-4da6-b711-1f018739f47d 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-1e1ed6b3-ce50-4c81-bc0f-08b715541c7a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:07:25.904 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "1a16a862-5759-43b6-88bb-d0ce8a7434da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:25.935 4088 3038363049128 MainThread DEBUG nova.compute.manager [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:07:26.127 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:26.127 4088 3038363049128 MainThread DEBUG nova.virt.hardware [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:07:26.127 4088 3038363049128 MainThread INFO nova.compute.claims [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Claim successful on node n-h2-808474-1 2021-09-10 17:07:26.390 4088 3038363049128 MainThread DEBUG nova.virt.hyperv.hostops [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:07:26.390 4088 3038363049128 MainThread DEBUG nova.virt.hyperv.hostops [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:07:26.484 4088 3038363048952 MainThread DEBUG nova.compute.manager [req-e35dd4cd-548b-43d5-97ec-5973f66bc8dc 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Received event network-vif-plugged-9a014db2-d69e-4581-a8db-018367f3bd14 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:07:26.484 4088 3038363048952 MainThread DEBUG oslo_concurrency.lockutils [req-e35dd4cd-548b-43d5-97ec-5973f66bc8dc 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "1e1ed6b3-ce50-4c81-bc0f-08b715541c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:26.484 4088 3038363048952 MainThread DEBUG oslo_concurrency.lockutils [req-e35dd4cd-548b-43d5-97ec-5973f66bc8dc 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "1e1ed6b3-ce50-4c81-bc0f-08b715541c7a-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:26.484 4088 3038363048952 MainThread DEBUG nova.compute.manager [req-e35dd4cd-548b-43d5-97ec-5973f66bc8dc 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Processing event network-vif-plugged-9a014db2-d69e-4581-a8db-018367f3bd14 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:07:26.546 4088 3038363047896 MainThread INFO nova.virt.hyperv.vmops [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Using config drive for instance 2021-09-10 17:07:26.641 4088 3038363049128 MainThread DEBUG nova.compute.provider_tree [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:07:26.659 4088 3038363049128 MainThread DEBUG nova.scheduler.client.report [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:07:26.659 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:26.659 4088 3038363049128 MainThread DEBUG nova.compute.manager [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:07:26.771 4088 3038363049128 MainThread DEBUG nova.compute.manager [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:07:26.784 4088 3038363049304 GreenThread-98 DEBUG nova.compute.manager [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:07:26.784 4088 3038363049304 GreenThread-98 DEBUG nova.network.neutron [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:07:27.004 4088 3038363049128 MainThread DEBUG nova.compute.manager [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:07:27.028 4088 3038363049128 MainThread INFO nova.virt.hyperv.vmops [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Spawning new instance 2021-09-10 17:07:27.028 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000006c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:27.028 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000006c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:27.028 4088 3038363049128 MainThread DEBUG nova.block_device [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:07:27.028 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:27.028 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:27.028 4088 3038363047896 MainThread INFO nova.virt.hyperv.vmops [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Creating config drive at C:\openstack\instances\instance-0000006b\configdrive.iso 2021-09-10 17:07:27.160 4088 3038363047896 MainThread DEBUG oslo_concurrency.processutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000006b\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpy5oxz5bo execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:07:27.301 4088 3038363049304 GreenThread-98 DEBUG nova.policy [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3b19a6ed8024fe7b99f5aa4978b5af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecab78b34b0468f8c42e4b7f3444918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:07:27.317 4088 3038363049128 MainThread DEBUG os_win.utils.pathutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Creating directory: C:\openstack\instances\instance-0000006c check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:07:27.317 4088 3038363049128 MainThread DEBUG nova.virt.hyperv.vmops [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000006c\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:07:27.484 4088 3038363047896 MainThread DEBUG oslo_concurrency.processutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000006b\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpy5oxz5bo" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:07:27.575 4088 3038363049128 MainThread DEBUG nova.virt.hyperv.vmops [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Resizing VHD C:\openstack\instances\instance-0000006c\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:07:28.020 4088 3038363047896 MainThread DEBUG nova.virt.hyperv.vmops [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Setting boot order for instance: instance-0000006b: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:07:28.129 4088 3038363047896 MainThread DEBUG nova.virt.hyperv.vmops [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:07:28.160 4088 3038363047896 MainThread DEBUG os_win.utils.jobutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Waiting for WMI job: {'InstanceID': '1ED56909-F48E-451A-80F2-0742F3B9F9A9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16100), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:07:28.300 4088 3038363047896 MainThread ERROR os_win.utils.jobutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006b\' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)instance-0000006b2D9B047F-2525-4C00-8556-A354640FB9E712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)instance-0000006b2D9B047F-2525-4C00-8556-A354640FB9E710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)instance-0000006b2D9B047F-2525-4C00-8556-A354640FB9E7%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1ED56909-F48E-451A-80F2-0742F3B9F9A9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117981), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 7, 28), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 7, 28), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006b' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)\n\nNot enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)\n\n'instance-0000006b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)", 'ErrorSummaryDescription': "'instance-0000006b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:07:28.300 4088 3038363047896 MainThread DEBUG os_win._utils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006b' failed to start. Not enough memory in the system to start the virtual machine instance-0000006b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006b' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Not enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) 'instance-0000006b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.17136764526367188 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:07:28.363 4088 3038363049832 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:07:28.363 4088 3038363049832 MainThread INFO nova.compute.manager [-] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] VM Stopped (Lifecycle Event) 2021-09-10 17:07:28.363 4088 3038363048952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:28.363 4088 3038363048952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:28.410 4088 3038363049832 MainThread DEBUG nova.compute.manager [req-2c3e7d07-0a2f-43ec-a772-ea8b2ce5e020 - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:07:28.410 4088 3038363049832 MainThread DEBUG nova.virt.hyperv.vmops [req-2c3e7d07-0a2f-43ec-a772-ea8b2ce5e020 - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:07:28.468 4088 3038363049832 MainThread DEBUG nova.compute.manager [req-2c3e7d07-0a2f-43ec-a772-ea8b2ce5e020 - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:07:28.496 4088 3038363049832 MainThread INFO nova.compute.manager [req-2c3e7d07-0a2f-43ec-a772-ea8b2ce5e020 - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:07:28.991 4088 3038363049304 GreenThread-98 DEBUG nova.network.neutron [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Successfully created port: 3dba4285-b82b-4eaf-8f72-fef2defd6c6d _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:07:29.329 4088 3038363047896 MainThread DEBUG os_win.utils.jobutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Waiting for WMI job: {'InstanceID': '5C108129-DDDE-457A-AD1F-F980116DFCC8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16246), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:07:29.482 4088 3038363047896 MainThread ERROR os_win.utils.jobutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006b\' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)instance-0000006b2D9B047F-2525-4C00-8556-A354640FB9E712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)instance-0000006b2D9B047F-2525-4C00-8556-A354640FB9E710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)instance-0000006b2D9B047F-2525-4C00-8556-A354640FB9E7%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5C108129-DDDE-457A-AD1F-F980116DFCC8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116092), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 7, 29), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 7, 29), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006b' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)\n\nNot enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)\n\n'instance-0000006b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)", 'ErrorSummaryDescription': "'instance-0000006b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:07:29.482 4088 3038363047896 MainThread DEBUG os_win._utils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006b' failed to start. Not enough memory in the system to start the virtual machine instance-0000006b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006b' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Not enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) 'instance-0000006b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3538084030151367 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:07:29.553 4088 3038363048952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:29.553 4088 3038363048952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:29.553 4088 3038363049832 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:07:29.553 4088 3038363049832 MainThread INFO nova.compute.manager [-] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] VM Stopped (Lifecycle Event) 2021-09-10 17:07:29.575 4088 3038363049832 MainThread DEBUG nova.compute.manager [req-255f6a61-1900-4914-ba6b-2aeedf4be7d9 - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:07:29.575 4088 3038363049832 MainThread DEBUG nova.virt.hyperv.vmops [req-255f6a61-1900-4914-ba6b-2aeedf4be7d9 - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:07:29.638 4088 3038363049832 MainThread DEBUG nova.compute.manager [req-255f6a61-1900-4914-ba6b-2aeedf4be7d9 - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:07:29.653 4088 3038363049832 MainThread INFO nova.compute.manager [req-255f6a61-1900-4914-ba6b-2aeedf4be7d9 - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:07:30.512 4088 3038363047896 MainThread DEBUG os_win.utils.jobutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Waiting for WMI job: {'InstanceID': '509AF25F-60E6-4F1E-A16C-92B85B799EFD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14899), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:07:30.642 4088 3038363047896 MainThread ERROR os_win.utils.jobutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006b\' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)instance-0000006b2D9B047F-2525-4C00-8556-A354640FB9E712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)instance-0000006b2D9B047F-2525-4C00-8556-A354640FB9E710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)instance-0000006b2D9B047F-2525-4C00-8556-A354640FB9E7%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '509AF25F-60E6-4F1E-A16C-92B85B799EFD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116558), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 7, 30), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 7, 30), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006b' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)\n\nNot enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)\n\n'instance-0000006b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)", 'ErrorSummaryDescription': "'instance-0000006b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:07:30.642 4088 3038363047896 MainThread DEBUG os_win._utils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006b' failed to start. Not enough memory in the system to start the virtual machine instance-0000006b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006b' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Not enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) 'instance-0000006b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.512979507446289 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:07:30.686 4088 3038363048952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:30.686 4088 3038363048952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:30.686 4088 3038363049832 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:07:30.686 4088 3038363049832 MainThread INFO nova.compute.manager [-] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] VM Stopped (Lifecycle Event) 2021-09-10 17:07:30.762 4088 3038363049832 MainThread DEBUG nova.compute.manager [req-0b94ab3c-e7cc-443a-8f6b-7845ba615b93 - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:07:30.762 4088 3038363049832 MainThread DEBUG nova.virt.hyperv.vmops [req-0b94ab3c-e7cc-443a-8f6b-7845ba615b93 - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:07:30.813 4088 3038363049832 MainThread DEBUG nova.compute.manager [req-0b94ab3c-e7cc-443a-8f6b-7845ba615b93 - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:07:30.842 4088 3038363049832 MainThread INFO nova.compute.manager [req-0b94ab3c-e7cc-443a-8f6b-7845ba615b93 - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:07:31.012 4088 3038363049304 GreenThread-98 DEBUG nova.network.neutron [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Successfully updated port: 3dba4285-b82b-4eaf-8f72-fef2defd6c6d _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:07:31.044 4088 3038363049304 GreenThread-98 DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Acquired lock "refresh_cache-1a16a862-5759-43b6-88bb-d0ce8a7434da" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:07:31.044 4088 3038363049304 GreenThread-98 DEBUG nova.network.neutron [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:07:31.138 4088 3038363049656 MainThread DEBUG nova.compute.manager [req-35f0bb4c-f2af-4eb2-a891-74b51de44774 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Received event network-changed-3dba4285-b82b-4eaf-8f72-fef2defd6c6d external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:07:31.138 4088 3038363049656 MainThread DEBUG nova.compute.manager [req-35f0bb4c-f2af-4eb2-a891-74b51de44774 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Refreshing instance network info cache due to event network-changed-3dba4285-b82b-4eaf-8f72-fef2defd6c6d. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:07:31.281 4088 3038363049304 GreenThread-98 DEBUG nova.network.neutron [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:07:31.643 4088 3038363047896 MainThread DEBUG os_win.utils.jobutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Waiting for WMI job: {'InstanceID': 'C0BB8C0A-9C12-445C-B7CF-DE4AFF660E71', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15043), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:07:31.835 4088 3038363049832 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:07:31.835 4088 3038363049832 MainThread INFO nova.compute.manager [-] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] VM Stopped (Lifecycle Event) 2021-09-10 17:07:31.850 4088 3038363279432 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:31.850 4088 3038363279432 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:31.857 4088 3038363049832 MainThread DEBUG nova.compute.manager [req-b8370f12-c431-436b-98dc-a349fb99261e - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:07:31.875 4088 3038363049832 MainThread DEBUG nova.virt.hyperv.vmops [req-b8370f12-c431-436b-98dc-a349fb99261e - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:07:31.912 4088 3038363047896 MainThread ERROR os_win.utils.jobutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006b\' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)instance-0000006b2D9B047F-2525-4C00-8556-A354640FB9E712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)instance-0000006b2D9B047F-2525-4C00-8556-A354640FB9E710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)instance-0000006b2D9B047F-2525-4C00-8556-A354640FB9E7%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C0BB8C0A-9C12-445C-B7CF-DE4AFF660E71', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118005), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 7, 31), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 7, 31), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006b' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)\n\nNot enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)\n\n'instance-0000006b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)", 'ErrorSummaryDescription': "'instance-0000006b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:07:31.912 4088 3038363047896 MainThread DEBUG os_win._utils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006b' failed to start. Not enough memory in the system to start the virtual machine instance-0000006b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006b' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Not enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) 'instance-0000006b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7832350730895996 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:07:31.912 4088 3038363049832 MainThread DEBUG nova.compute.manager [req-b8370f12-c431-436b-98dc-a349fb99261e - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:07:31.950 4088 3038363049832 MainThread INFO nova.compute.manager [req-b8370f12-c431-436b-98dc-a349fb99261e - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:07:32.940 4088 3038363047896 MainThread DEBUG os_win.utils.jobutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Waiting for WMI job: {'InstanceID': '0B44AE3F-1940-4137-8E37-700B14C0FADA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15739), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:07:32.951 4088 3038363049304 GreenThread-98 DEBUG nova.network.neutron [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Updating instance_info_cache with network_info: [{"id": "3dba4285-b82b-4eaf-8f72-fef2defd6c6d", "address": "fa:16:3e:fd:e9:4c", "network": {"id": "8a0fc2b4-bff6-4887-a969-81fb448d568f", "bridge": null, "label": "tempest-DeleteServersTestJSON-1414296899-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "eecab78b34b0468f8c42e4b7f3444918", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap3dba4285-b8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:07:32.997 4088 3038363049304 GreenThread-98 DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Releasing lock "refresh_cache-1a16a862-5759-43b6-88bb-d0ce8a7434da" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:07:32.997 4088 3038363049304 GreenThread-98 DEBUG nova.compute.manager [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Instance network_info: |[{"id": "3dba4285-b82b-4eaf-8f72-fef2defd6c6d", "address": "fa:16:3e:fd:e9:4c", "network": {"id": "8a0fc2b4-bff6-4887-a969-81fb448d568f", "bridge": null, "label": "tempest-DeleteServersTestJSON-1414296899-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "eecab78b34b0468f8c42e4b7f3444918", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap3dba4285-b8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:07:32.997 4088 3038363049128 MainThread DEBUG nova.compute.manager [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Preparing to wait for external event network-vif-plugged-3dba4285-b82b-4eaf-8f72-fef2defd6c6d prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:07:32.997 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "1a16a862-5759-43b6-88bb-d0ce8a7434da-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:32.997 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "1a16a862-5759-43b6-88bb-d0ce8a7434da-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:32.997 4088 3038363049128 MainThread DEBUG os_win.utils.compute.vmutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Creating VM instance-0000006c create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:07:32.997 4088 3038363049656 MainThread DEBUG oslo_concurrency.lockutils [req-35f0bb4c-f2af-4eb2-a891-74b51de44774 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-1a16a862-5759-43b6-88bb-d0ce8a7434da" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:07:32.997 4088 3038363049656 MainThread DEBUG nova.network.neutron [req-35f0bb4c-f2af-4eb2-a891-74b51de44774 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Refreshing network info cache for port 3dba4285-b82b-4eaf-8f72-fef2defd6c6d _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:07:33.076 4088 3038363047896 MainThread ERROR os_win.utils.jobutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006b\' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)instance-0000006b2D9B047F-2525-4C00-8556-A354640FB9E712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)instance-0000006b2D9B047F-2525-4C00-8556-A354640FB9E710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)instance-0000006b2D9B047F-2525-4C00-8556-A354640FB9E7%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0B44AE3F-1940-4137-8E37-700B14C0FADA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116949), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 7, 32), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 7, 33), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006b' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)\n\nNot enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)\n\n'instance-0000006b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)", 'ErrorSummaryDescription': "'instance-0000006b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:07:33.076 4088 3038363047896 MainThread DEBUG os_win._utils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006b' failed to start. Not enough memory in the system to start the virtual machine instance-0000006b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006b' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Not enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) 'instance-0000006b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.947734832763672 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:07:33.132 4088 3038363049832 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:07:33.132 4088 3038363049832 MainThread INFO nova.compute.manager [-] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] VM Stopped (Lifecycle Event) 2021-09-10 17:07:33.132 4088 3038363279432 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:33.132 4088 3038363279432 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:33.169 4088 3038363049832 MainThread DEBUG nova.compute.manager [req-ff6ade85-acf9-4482-8a8e-69e5249038fc - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:07:33.169 4088 3038363049832 MainThread DEBUG nova.virt.hyperv.vmops [req-ff6ade85-acf9-4482-8a8e-69e5249038fc - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:07:33.392 4088 3038363049832 MainThread DEBUG nova.compute.manager [req-ff6ade85-acf9-4482-8a8e-69e5249038fc - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:07:33.424 4088 3038363049832 MainThread INFO nova.compute.manager [req-ff6ade85-acf9-4482-8a8e-69e5249038fc - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:07:34.115 4088 3038363047896 MainThread DEBUG os_win.utils.jobutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Waiting for WMI job: {'InstanceID': 'F5F19DA2-ED18-42C3-929F-0EC9BD80DBDE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15300), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:07:34.278 4088 3038363047896 MainThread ERROR os_win.utils.jobutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006b\' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)instance-0000006b2D9B047F-2525-4C00-8556-A354640FB9E712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)instance-0000006b2D9B047F-2525-4C00-8556-A354640FB9E710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)instance-0000006b2D9B047F-2525-4C00-8556-A354640FB9E7%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'F5F19DA2-ED18-42C3-929F-0EC9BD80DBDE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120507), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 7, 34), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 7, 34), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006b' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)\n\nNot enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)\n\n'instance-0000006b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7)", 'ErrorSummaryDescription': "'instance-0000006b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:07:34.278 4088 3038363047896 MainThread ERROR nova.virt.hyperv.vmops [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Failed to change vm state of instance-0000006b to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000006b' failed to start. 2021-09-10 17:07:34.278 4088 3038363047896 MainThread INFO nova.virt.hyperv.vmops [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Got request to destroy instance 2021-09-10 17:07:34.309 4088 3038363048952 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:07:34.309 4088 3038363048952 MainThread INFO nova.compute.manager [-] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] VM Stopped (Lifecycle Event) 2021-09-10 17:07:34.309 4088 3038363049832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:34.309 4088 3038363049832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:34.324 4088 3038363321448 MainThread DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "8ef051ab-9f0f-4693-a09a-0b85b471b851" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:34.343 4088 3038363321448 MainThread DEBUG nova.compute.manager [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:07:34.405 4088 3038363048952 MainThread DEBUG nova.compute.manager [req-abb4c9c5-12e7-4cd9-b5ee-d51a551efa73 - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:07:34.420 4088 3038363048952 MainThread DEBUG nova.virt.hyperv.vmops [req-abb4c9c5-12e7-4cd9-b5ee-d51a551efa73 - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:07:34.520 4088 3038363048952 MainThread DEBUG nova.compute.manager [req-abb4c9c5-12e7-4cd9-b5ee-d51a551efa73 - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:07:34.576 4088 3038363048952 MainThread INFO nova.compute.manager [req-abb4c9c5-12e7-4cd9-b5ee-d51a551efa73 - - - - -] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:07:34.668 4088 3038363321448 MainThread DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:34.688 4088 3038363321448 MainThread DEBUG nova.virt.hardware [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:07:34.688 4088 3038363321448 MainThread INFO nova.compute.claims [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Claim successful on node n-h2-808474-1 2021-09-10 17:07:34.748 4088 3038363049656 MainThread DEBUG nova.network.neutron [req-35f0bb4c-f2af-4eb2-a891-74b51de44774 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Updated VIF entry in instance network info cache for port 3dba4285-b82b-4eaf-8f72-fef2defd6c6d. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:07:34.748 4088 3038363049656 MainThread DEBUG nova.network.neutron [req-35f0bb4c-f2af-4eb2-a891-74b51de44774 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Updating instance_info_cache with network_info: [{"id": "3dba4285-b82b-4eaf-8f72-fef2defd6c6d", "address": "fa:16:3e:fd:e9:4c", "network": {"id": "8a0fc2b4-bff6-4887-a969-81fb448d568f", "bridge": null, "label": "tempest-DeleteServersTestJSON-1414296899-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "eecab78b34b0468f8c42e4b7f3444918", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap3dba4285-b8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:07:34.772 4088 3038363049656 MainThread DEBUG oslo_concurrency.lockutils [req-35f0bb4c-f2af-4eb2-a891-74b51de44774 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-1a16a862-5759-43b6-88bb-d0ce8a7434da" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:07:34.869 4088 3038363049128 MainThread DEBUG nova.virt.hyperv.vmops [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:07:34.926 4088 3038363321448 MainThread DEBUG nova.virt.hyperv.hostops [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:07:34.935 4088 3038363321448 MainThread DEBUG nova.virt.hyperv.hostops [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:07:35.246 4088 3038363321448 MainThread DEBUG nova.compute.provider_tree [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:07:35.278 4088 3038363321448 MainThread DEBUG nova.scheduler.client.report [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:07:35.278 4088 3038363321448 MainThread DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.610s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:35.294 4088 3038363321448 MainThread DEBUG nova.compute.manager [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:07:35.404 4088 3038363321448 MainThread DEBUG nova.compute.manager [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:07:35.404 4088 3038363049656 GreenThread-99 DEBUG nova.compute.manager [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:07:35.404 4088 3038363049656 GreenThread-99 DEBUG nova.network.neutron [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:07:35.669 4088 3038363321448 MainThread DEBUG nova.compute.manager [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:07:35.685 4088 3038363321448 MainThread INFO nova.virt.hyperv.vmops [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Spawning new instance 2021-09-10 17:07:35.700 4088 3038363321448 MainThread DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-0000006d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:35.700 4088 3038363321448 MainThread DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-0000006d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:35.700 4088 3038363321448 MainThread DEBUG nova.block_device [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:07:35.700 4088 3038363321448 MainThread DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:35.700 4088 3038363321448 MainThread DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:35.700 4088 3038363321448 MainThread DEBUG os_win.utils.pathutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Creating directory: C:\openstack\instances\instance-0000006d check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:07:35.730 4088 3038363321448 MainThread DEBUG nova.virt.hyperv.vmops [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000006d\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:07:35.747 4088 3038363049656 GreenThread-99 DEBUG nova.policy [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6da982fe4daa44b998cd4ae6900212fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0928f57ccc9245e28c79dd9cce7e395b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:07:35.981 4088 3038363321448 MainThread DEBUG nova.virt.hyperv.vmops [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Resizing VHD C:\openstack\instances\instance-0000006d\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:07:36.371 4088 3038363047896 MainThread DEBUG nova.virt.hyperv.vmops [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:07:36.371 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "instance-0000006b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:36.371 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "instance-0000006b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:36.404 4088 3038363047896 MainThread DEBUG os_win.utils.compute.vmutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Successfully changed vm state of instance-0000006b to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:07:36.404 4088 3038363047896 MainThread DEBUG nova.virt.hyperv.vmops [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Successfully changed state of VM instance-0000006b to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:07:36.454 4088 3038363047896 MainThread DEBUG os_win.utils.jobutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Waiting for WMI job: {'InstanceID': '40CF6084-8069-479F-9C37-A2D7C37B402C', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15366), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:07:36.559 4088 3038363047896 MainThread DEBUG os_win.utils.jobutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] WMI job succeeded: {'InstanceID': '40CF6084-8069-479F-9C37-A2D7C37B402C', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=101015), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:07:36.559 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "instance-0000006b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:36.559 4088 3038363047896 MainThread DEBUG os_win.utils.pathutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Removing directory: C:\openstack\instances\instance-0000006b check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:07:36.559 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "instance-0000006b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:36.559 4088 3038363047896 MainThread ERROR nova.compute.manager [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006b' failed to start. Not enough memory in the system to start the virtual machine instance-0000006b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006b' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Not enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) 'instance-0000006b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Error code: 32778. 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Traceback (most recent call last): 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] return function(*args, **kwargs) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] admin_password, network_info, block_device_info) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] return function(self, *args, **kwds) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self.force_reraise() 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] raise self.value 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] should_plug_vifs=False) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 'req_state': req_state}) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self.force_reraise() 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] raise self.value 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] time.sleep(sleep_time) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self.force_reraise() 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] raise self.value 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] return f(*args, **kwargs) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] return self._wait_for_job(job_path) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] error_desc=err_desc) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000006b' failed to start. 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Not enough memory in the system to start the virtual machine instance-0000006b. 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006b' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Not enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 'instance-0000006b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Error code: 32778. 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] During handling of the above exception, another exception occurred: 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Traceback (most recent call last): 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] yield resources 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] accel_info=accel_info) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] return function(*args, **kwargs) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] admin_password, network_info, block_device_info) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] return function(self, *args, **kwds) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self.force_reraise() 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] raise self.value 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] should_plug_vifs=False) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 'req_state': req_state}) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self.force_reraise() 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] raise self.value 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] time.sleep(sleep_time) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self.force_reraise() 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] raise self.value 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] return f(*args, **kwargs) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] return self._wait_for_job(job_path) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] error_desc=err_desc) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006b' failed to start. 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Not enough memory in the system to start the virtual machine instance-0000006b. 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006b' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Not enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 'instance-0000006b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Error code: 32778. 2021-09-10 17:07:36.559 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:36.586 4088 3038363047896 MainThread INFO nova.compute.manager [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Terminating instance 2021-09-10 17:07:36.586 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:07:36.586 4088 3038363047896 MainThread INFO nova.virt.hyperv.vmops [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Got request to destroy instance 2021-09-10 17:07:36.591 4088 3038363047896 MainThread DEBUG nova.virt.hyperv.vmops [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:07:36.591 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "instance-0000006b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:36.591 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "instance-0000006b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:36.591 4088 3038363047896 MainThread INFO nova.compute.manager [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Took 0.00 seconds to destroy the instance on the hypervisor. 2021-09-10 17:07:36.591 4088 3038363047896 MainThread DEBUG nova.compute.claims [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:07:36.591 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:36.815 4088 3038363047896 MainThread DEBUG nova.virt.hyperv.hostops [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:07:36.824 4088 3038363047896 MainThread DEBUG nova.virt.hyperv.hostops [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:07:37.045 4088 3038363047896 MainThread DEBUG nova.compute.provider_tree [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:07:37.045 4088 3038363047896 MainThread DEBUG nova.scheduler.client.report [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:07:37.045 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:37.045 4088 3038363047896 MainThread ERROR nova.compute.manager [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006b' failed to start. Not enough memory in the system to start the virtual machine instance-0000006b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006b' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Not enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) 'instance-0000006b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Error code: 32778. 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Traceback (most recent call last): 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] return function(*args, **kwargs) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] admin_password, network_info, block_device_info) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] return function(self, *args, **kwds) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self.force_reraise() 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] raise self.value 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] should_plug_vifs=False) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 'req_state': req_state}) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self.force_reraise() 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] raise self.value 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] time.sleep(sleep_time) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self.force_reraise() 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] raise self.value 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] return f(*args, **kwargs) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] return self._wait_for_job(job_path) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] error_desc=err_desc) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000006b' failed to start. 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Not enough memory in the system to start the virtual machine instance-0000006b. 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006b' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Not enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 'instance-0000006b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Error code: 32778. 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] During handling of the above exception, another exception occurred: 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Traceback (most recent call last): 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] accel_info=accel_info) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] return function(*args, **kwargs) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] admin_password, network_info, block_device_info) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] return function(self, *args, **kwds) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self.force_reraise() 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] raise self.value 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] should_plug_vifs=False) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 'req_state': req_state}) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self.force_reraise() 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] raise self.value 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] time.sleep(sleep_time) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self.force_reraise() 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] raise self.value 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] return f(*args, **kwargs) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] return self._wait_for_job(job_path) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] error_desc=err_desc) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006b' failed to start. 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Not enough memory in the system to start the virtual machine instance-0000006b. 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006b' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Not enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 'instance-0000006b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Error code: 32778. 2021-09-10 17:07:37.045 4088 3038363047896 MainThread TRACE nova.compute.manager [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] 2021-09-10 17:07:37.070 4088 3038363047896 MainThread DEBUG nova.compute.utils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] WMI job failed with status 10. Error summary description: 'instance-0000006b' failed to start. Not enough memory in the system to start the virtual machine instance-0000006b. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:07:37.070 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Build of instance 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000006b' failed to start. Not enough memory in the system to start the virtual machine instance-0000006b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006b' failed to start. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Not enough memory in the system to start the virtual machine instance-0000006b with ram size 1024 megabytes. (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) 'instance-0000006b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2D9B047F-2525-4C00-8556-A354640FB9E7) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:07:37.070 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:07:37.070 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:07:37.070 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:07:37.070 4088 3038363047896 MainThread DEBUG nova.network.neutron [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:07:38.399 4088 3038363047896 MainThread DEBUG nova.network.neutron [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:07:38.418 4088 3038363047896 MainThread INFO nova.compute.manager [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] [instance: 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a] Took 1.34 seconds to deallocate network for instance. 2021-09-10 17:07:38.684 4088 3038363047896 MainThread INFO nova.scheduler.client.report [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Deleted allocations for instance 1e1ed6b3-ce50-4c81-bc0f-08b715541c7a 2021-09-10 17:07:38.715 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-7fab1e2d-1ec8-46b6-9074-201b562b5ab0 5e00875ca35f4501afe5474947cd0708 89ea24a7b47a4f4a9015423bfcc23f3b - default default] Lock "1e1ed6b3-ce50-4c81-bc0f-08b715541c7a" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 30.531s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:38.900 4088 3038363049656 GreenThread-99 DEBUG nova.network.neutron [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Successfully created port: 15d3233c-90a9-4899-b2a9-477a9e1079f1 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:07:41.621 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-5f9b2909-994c-4192-a090-048cee325db0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Received event network-vif-plugged-3dba4285-b82b-4eaf-8f72-fef2defd6c6d external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:07:41.621 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-5f9b2909-994c-4192-a090-048cee325db0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "1a16a862-5759-43b6-88bb-d0ce8a7434da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:41.621 4088 3038363047896 MainThread DEBUG oslo_concurrency.lockutils [req-5f9b2909-994c-4192-a090-048cee325db0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "1a16a862-5759-43b6-88bb-d0ce8a7434da-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:41.621 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-5f9b2909-994c-4192-a090-048cee325db0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Processing event network-vif-plugged-3dba4285-b82b-4eaf-8f72-fef2defd6c6d _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:07:41.653 4088 3038363049128 MainThread INFO nova.virt.hyperv.vmops [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Using config drive for instance 2021-09-10 17:07:42.232 4088 3038363049128 MainThread INFO nova.virt.hyperv.vmops [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Creating config drive at C:\openstack\instances\instance-0000006c\configdrive.iso 2021-09-10 17:07:42.341 4088 3038363049128 MainThread DEBUG oslo_concurrency.processutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000006c\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpuug346ya execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:07:42.482 4088 3038363049656 GreenThread-99 DEBUG nova.network.neutron [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Successfully updated port: 15d3233c-90a9-4899-b2a9-477a9e1079f1 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:07:42.482 4088 3038363049480 MainThread DEBUG nova.compute.manager [req-f291f1b2-8b39-4206-858c-96619ac168e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Received event network-changed-15d3233c-90a9-4899-b2a9-477a9e1079f1 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:07:42.482 4088 3038363049480 MainThread DEBUG nova.compute.manager [req-f291f1b2-8b39-4206-858c-96619ac168e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Refreshing instance network info cache due to event network-changed-15d3233c-90a9-4899-b2a9-477a9e1079f1. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:07:42.482 4088 3038363049480 MainThread DEBUG oslo_concurrency.lockutils [req-f291f1b2-8b39-4206-858c-96619ac168e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-8ef051ab-9f0f-4693-a09a-0b85b471b851" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:07:42.482 4088 3038363049480 MainThread DEBUG nova.network.neutron [req-f291f1b2-8b39-4206-858c-96619ac168e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Refreshing network info cache for port 15d3233c-90a9-4899-b2a9-477a9e1079f1 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:07:42.642 4088 3038363049128 MainThread DEBUG oslo_concurrency.processutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000006c\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpuug346ya" returned: 0 in 0.297s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:07:42.762 4088 3038363049480 MainThread DEBUG nova.network.neutron [req-f291f1b2-8b39-4206-858c-96619ac168e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:07:43.136 4088 3038363049128 MainThread DEBUG nova.virt.hyperv.vmops [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Setting boot order for instance: instance-0000006c: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:07:43.232 4088 3038363049128 MainThread DEBUG nova.virt.hyperv.vmops [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:07:43.262 4088 3038363049128 MainThread DEBUG os_win.utils.jobutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': 'D49916DC-6104-4E3F-80B8-5B528238B409', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20466), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:07:43.388 4088 3038363049128 MainThread ERROR os_win.utils.jobutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006c\' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)instance-0000006cA70854AF-5F7E-4737-9B9D-290E08EAF6BC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)instance-0000006cA70854AF-5F7E-4737-9B9D-290E08EAF6BC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)instance-0000006cA70854AF-5F7E-4737-9B9D-290E08EAF6BC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D49916DC-6104-4E3F-80B8-5B528238B409', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113384), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 7, 43), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 7, 43), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006c' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)\n\nNot enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)\n\n'instance-0000006c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)", 'ErrorSummaryDescription': "'instance-0000006c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:07:43.388 4088 3038363049128 MainThread DEBUG os_win._utils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006c' failed to start. Not enough memory in the system to start the virtual machine instance-0000006c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006c' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Not enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) 'instance-0000006c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1559438705444336 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:07:43.422 4088 3038363047896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:07:43.422 4088 3038363047896 MainThread INFO nova.compute.manager [-] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] VM Stopped (Lifecycle Event) 2021-09-10 17:07:43.422 4088 3038363322680 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:43.422 4088 3038363322680 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:43.465 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-3fdab4e1-81a8-4c6a-810c-75418320391f - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:07:43.465 4088 3038363047896 MainThread DEBUG nova.virt.hyperv.vmops [req-3fdab4e1-81a8-4c6a-810c-75418320391f - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:07:43.521 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-3fdab4e1-81a8-4c6a-810c-75418320391f - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:07:43.570 4088 3038363047896 MainThread INFO nova.compute.manager [req-3fdab4e1-81a8-4c6a-810c-75418320391f - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:07:44.043 4088 3038363049480 MainThread DEBUG nova.network.neutron [req-f291f1b2-8b39-4206-858c-96619ac168e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:07:44.075 4088 3038363049480 MainThread DEBUG oslo_concurrency.lockutils [req-f291f1b2-8b39-4206-858c-96619ac168e1 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-8ef051ab-9f0f-4693-a09a-0b85b471b851" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:07:44.075 4088 3038363049656 GreenThread-99 DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Acquired lock "refresh_cache-8ef051ab-9f0f-4693-a09a-0b85b471b851" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:07:44.075 4088 3038363049656 GreenThread-99 DEBUG nova.network.neutron [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:07:44.371 4088 3038363049656 GreenThread-99 DEBUG nova.network.neutron [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:07:44.419 4088 3038363049128 MainThread DEBUG os_win.utils.jobutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '9C4F3280-B4A4-4D72-9106-EF9587AD4080', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16478), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:07:44.561 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:07:44.561 4088 3038363049128 MainThread ERROR os_win.utils.jobutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006c\' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)instance-0000006cA70854AF-5F7E-4737-9B9D-290E08EAF6BC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)instance-0000006cA70854AF-5F7E-4737-9B9D-290E08EAF6BC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)instance-0000006cA70854AF-5F7E-4737-9B9D-290E08EAF6BC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9C4F3280-B4A4-4D72-9106-EF9587AD4080', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116052), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 7, 44), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 7, 44), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006c' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)\n\nNot enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)\n\n'instance-0000006c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)", 'ErrorSummaryDescription': "'instance-0000006c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:07:44.561 4088 3038363049128 MainThread DEBUG os_win._utils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006c' failed to start. Not enough memory in the system to start the virtual machine instance-0000006c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006c' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Not enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) 'instance-0000006c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.329035758972168 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:07:44.561 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:07:44.561 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:07:44.590 4088 3038363322504 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:44.590 4088 3038363322504 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:44.590 4088 3038363047896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:07:44.590 4088 3038363047896 MainThread INFO nova.compute.manager [-] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] VM Stopped (Lifecycle Event) 2021-09-10 17:07:44.622 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-c066f198-60cf-4d05-93c4-15b66ae22aab - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:07:44.622 4088 3038363047896 MainThread DEBUG nova.virt.hyperv.vmops [req-c066f198-60cf-4d05-93c4-15b66ae22aab - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:07:44.669 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-c066f198-60cf-4d05-93c4-15b66ae22aab - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:07:44.699 4088 3038363047896 MainThread INFO nova.compute.manager [req-c066f198-60cf-4d05-93c4-15b66ae22aab - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:07:45.593 4088 3038363049128 MainThread DEBUG os_win.utils.jobutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': 'CA86465A-52CF-487F-A3B0-605F58951A83', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16425), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:07:45.730 4088 3038363049128 MainThread ERROR os_win.utils.jobutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006c\' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)instance-0000006cA70854AF-5F7E-4737-9B9D-290E08EAF6BC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)instance-0000006cA70854AF-5F7E-4737-9B9D-290E08EAF6BC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)instance-0000006cA70854AF-5F7E-4737-9B9D-290E08EAF6BC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'CA86465A-52CF-487F-A3B0-605F58951A83', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112395), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 7, 45), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 7, 45), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006c' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)\n\nNot enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)\n\n'instance-0000006c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)", 'ErrorSummaryDescription': "'instance-0000006c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:07:45.730 4088 3038363049128 MainThread DEBUG os_win._utils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006c' failed to start. Not enough memory in the system to start the virtual machine instance-0000006c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006c' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Not enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) 'instance-0000006c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.4978785514831543 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:07:45.794 4088 3038363322504 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:45.794 4088 3038363322504 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:45.794 4088 3038363047896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:07:45.794 4088 3038363047896 MainThread INFO nova.compute.manager [-] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] VM Stopped (Lifecycle Event) 2021-09-10 17:07:45.829 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-3eed5d00-10cb-4558-9154-05d278cb4262 - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:07:45.829 4088 3038363047896 MainThread DEBUG nova.virt.hyperv.vmops [req-3eed5d00-10cb-4558-9154-05d278cb4262 - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:07:45.890 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-3eed5d00-10cb-4558-9154-05d278cb4262 - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:07:45.930 4088 3038363047896 MainThread INFO nova.compute.manager [req-3eed5d00-10cb-4558-9154-05d278cb4262 - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:07:46.042 4088 3038363049656 GreenThread-99 DEBUG nova.network.neutron [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Updating instance_info_cache with network_info: [{"id": "15d3233c-90a9-4899-b2a9-477a9e1079f1", "address": "fa:16:3e:e5:ab:30", "network": {"id": "f84be94a-cbca-4401-b34e-c0e01bb632c9", "bridge": null, "label": "tempest-AttachVolumeNegativeTest-2088231271-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0928f57ccc9245e28c79dd9cce7e395b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap15d3233c-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:07:46.059 4088 3038363049656 GreenThread-99 DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Releasing lock "refresh_cache-8ef051ab-9f0f-4693-a09a-0b85b471b851" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:07:46.059 4088 3038363049656 GreenThread-99 DEBUG nova.compute.manager [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Instance network_info: |[{"id": "15d3233c-90a9-4899-b2a9-477a9e1079f1", "address": "fa:16:3e:e5:ab:30", "network": {"id": "f84be94a-cbca-4401-b34e-c0e01bb632c9", "bridge": null, "label": "tempest-AttachVolumeNegativeTest-2088231271-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0928f57ccc9245e28c79dd9cce7e395b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap15d3233c-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:07:46.078 4088 3038363321448 MainThread DEBUG nova.compute.manager [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Preparing to wait for external event network-vif-plugged-15d3233c-90a9-4899-b2a9-477a9e1079f1 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:07:46.078 4088 3038363321448 MainThread DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "8ef051ab-9f0f-4693-a09a-0b85b471b851-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:46.078 4088 3038363321448 MainThread DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "8ef051ab-9f0f-4693-a09a-0b85b471b851-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:46.078 4088 3038363321448 MainThread DEBUG os_win.utils.compute.vmutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Creating VM instance-0000006d create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:07:46.527 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:07:46.762 4088 3038363049128 MainThread DEBUG os_win.utils.jobutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '465866AE-51FB-46B0-9C51-AAF731121BC3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16948), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:07:46.888 4088 3038363049128 MainThread ERROR os_win.utils.jobutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006c\' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)instance-0000006cA70854AF-5F7E-4737-9B9D-290E08EAF6BC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)instance-0000006cA70854AF-5F7E-4737-9B9D-290E08EAF6BC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)instance-0000006cA70854AF-5F7E-4737-9B9D-290E08EAF6BC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '465866AE-51FB-46B0-9C51-AAF731121BC3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118170), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 7, 46), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 7, 46), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006c' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)\n\nNot enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)\n\n'instance-0000006c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)", 'ErrorSummaryDescription': "'instance-0000006c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:07:46.917 4088 3038363049128 MainThread DEBUG os_win._utils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006c' failed to start. Not enough memory in the system to start the virtual machine instance-0000006c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006c' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Not enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) 'instance-0000006c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.6846706867218018 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:07:46.949 4088 3038363049480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:46.949 4088 3038363049480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:46.949 4088 3038363049656 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:07:46.949 4088 3038363049656 MainThread INFO nova.compute.manager [-] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] VM Stopped (Lifecycle Event) 2021-09-10 17:07:46.976 4088 3038363049656 MainThread DEBUG nova.compute.manager [req-f8deb9d8-60f6-4a84-8560-8a1915cff58d - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:07:46.976 4088 3038363049656 MainThread DEBUG nova.virt.hyperv.vmops [req-f8deb9d8-60f6-4a84-8560-8a1915cff58d - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:07:47.043 4088 3038363049656 MainThread DEBUG nova.compute.manager [req-f8deb9d8-60f6-4a84-8560-8a1915cff58d - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:07:47.076 4088 3038363049656 MainThread INFO nova.compute.manager [req-f8deb9d8-60f6-4a84-8560-8a1915cff58d - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:07:47.527 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:07:47.778 4088 3038363321448 MainThread DEBUG nova.virt.hyperv.vmops [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:07:47.938 4088 3038363049128 MainThread DEBUG os_win.utils.jobutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': 'BCA456D9-247B-4A66-B1B2-26AB626815C2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15971), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:07:48.091 4088 3038363049128 MainThread ERROR os_win.utils.jobutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006c\' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)instance-0000006cA70854AF-5F7E-4737-9B9D-290E08EAF6BC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)instance-0000006cA70854AF-5F7E-4737-9B9D-290E08EAF6BC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)instance-0000006cA70854AF-5F7E-4737-9B9D-290E08EAF6BC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BCA456D9-247B-4A66-B1B2-26AB626815C2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=126305), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 7, 47), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 7, 48), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006c' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)\n\nNot enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)\n\n'instance-0000006c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)", 'ErrorSummaryDescription': "'instance-0000006c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:07:48.106 4088 3038363049128 MainThread DEBUG os_win._utils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006c' failed to start. Not enough memory in the system to start the virtual machine instance-0000006c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006c' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Not enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) 'instance-0000006c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.873222827911377 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:07:48.137 4088 3038363049480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:48.137 4088 3038363049480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:48.137 4088 3038363049656 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:07:48.137 4088 3038363049656 MainThread INFO nova.compute.manager [-] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] VM Stopped (Lifecycle Event) 2021-09-10 17:07:48.169 4088 3038363049656 MainThread DEBUG nova.compute.manager [req-967dd27f-8fd6-4aab-bb68-09785a0291b6 - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:07:48.169 4088 3038363049656 MainThread DEBUG nova.virt.hyperv.vmops [req-967dd27f-8fd6-4aab-bb68-09785a0291b6 - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:07:48.219 4088 3038363049656 MainThread DEBUG nova.compute.manager [req-967dd27f-8fd6-4aab-bb68-09785a0291b6 - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:07:48.277 4088 3038363049656 MainThread INFO nova.compute.manager [req-967dd27f-8fd6-4aab-bb68-09785a0291b6 - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:07:48.531 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:07:49.135 4088 3038363049128 MainThread DEBUG os_win.utils.jobutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '0F010E89-9727-4618-A026-A779F364B109', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15729), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:07:49.289 4088 3038363049128 MainThread ERROR os_win.utils.jobutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006c\' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)instance-0000006cA70854AF-5F7E-4737-9B9D-290E08EAF6BC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)instance-0000006cA70854AF-5F7E-4737-9B9D-290E08EAF6BC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)instance-0000006cA70854AF-5F7E-4737-9B9D-290E08EAF6BC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0F010E89-9727-4618-A026-A779F364B109', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113485), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 7, 49), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 7, 49), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006c' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)\n\nNot enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)\n\n'instance-0000006c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC)", 'ErrorSummaryDescription': "'instance-0000006c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:07:49.289 4088 3038363049128 MainThread ERROR nova.virt.hyperv.vmops [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Failed to change vm state of instance-0000006c to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000006c' failed to start. 2021-09-10 17:07:49.289 4088 3038363049128 MainThread INFO nova.virt.hyperv.vmops [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Got request to destroy instance 2021-09-10 17:07:49.295 4088 3038363047896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:07:49.309 4088 3038363047896 MainThread INFO nova.compute.manager [-] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] VM Stopped (Lifecycle Event) 2021-09-10 17:07:49.309 4088 3038363049480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:49.309 4088 3038363049480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:49.339 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-c2b179aa-2331-41cb-ae33-72f75cd8f991 - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:07:49.339 4088 3038363047896 MainThread DEBUG nova.virt.hyperv.vmops [req-c2b179aa-2331-41cb-ae33-72f75cd8f991 - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:07:49.385 4088 3038363047896 MainThread DEBUG nova.compute.manager [req-c2b179aa-2331-41cb-ae33-72f75cd8f991 - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:07:49.433 4088 3038363047896 MainThread INFO nova.compute.manager [req-c2b179aa-2331-41cb-ae33-72f75cd8f991 - - - - -] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:07:49.552 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:07:51.183 4088 3038363049128 MainThread DEBUG nova.virt.hyperv.vmops [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:07:51.183 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000006c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:51.183 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000006c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:51.183 4088 3038363049128 MainThread DEBUG os_win.utils.compute.vmutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Successfully changed vm state of instance-0000006c to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:07:51.183 4088 3038363049128 MainThread DEBUG nova.virt.hyperv.vmops [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Successfully changed state of VM instance-0000006c to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:07:51.234 4088 3038363049128 MainThread DEBUG os_win.utils.jobutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Waiting for WMI job: {'InstanceID': '64D81966-E5E8-4B68-9DC5-7574FCCFBA6E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15827), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:07:51.369 4088 3038363049128 MainThread DEBUG os_win.utils.jobutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] WMI job succeeded: {'InstanceID': '64D81966-E5E8-4B68-9DC5-7574FCCFBA6E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=109428), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:07:51.369 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000006c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:51.369 4088 3038363049128 MainThread DEBUG os_win.utils.pathutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Removing directory: C:\openstack\instances\instance-0000006c check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:07:51.374 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000006c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:51.374 4088 3038363049128 MainThread ERROR nova.compute.manager [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006c' failed to start. Not enough memory in the system to start the virtual machine instance-0000006c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006c' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Not enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) 'instance-0000006c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Error code: 32778. 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Traceback (most recent call last): 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] return function(*args, **kwargs) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] admin_password, network_info, block_device_info) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] return function(self, *args, **kwds) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self.force_reraise() 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] raise self.value 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] should_plug_vifs=False) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 'req_state': req_state}) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self.force_reraise() 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] raise self.value 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] time.sleep(sleep_time) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self.force_reraise() 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] raise self.value 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] return f(*args, **kwargs) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] return self._wait_for_job(job_path) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] error_desc=err_desc) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000006c' failed to start. 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Not enough memory in the system to start the virtual machine instance-0000006c. 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006c' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Not enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 'instance-0000006c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Error code: 32778. 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] During handling of the above exception, another exception occurred: 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Traceback (most recent call last): 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] yield resources 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] accel_info=accel_info) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] return function(*args, **kwargs) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] admin_password, network_info, block_device_info) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] return function(self, *args, **kwds) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self.force_reraise() 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] raise self.value 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] should_plug_vifs=False) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 'req_state': req_state}) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self.force_reraise() 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] raise self.value 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] time.sleep(sleep_time) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self.force_reraise() 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] raise self.value 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] return f(*args, **kwargs) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] return self._wait_for_job(job_path) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] error_desc=err_desc) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006c' failed to start. 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Not enough memory in the system to start the virtual machine instance-0000006c. 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006c' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Not enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 'instance-0000006c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Error code: 32778. 2021-09-10 17:07:51.374 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.374 4088 3038363049128 MainThread INFO nova.compute.manager [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Terminating instance 2021-09-10 17:07:51.374 4088 3038363049128 MainThread DEBUG nova.compute.manager [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:07:51.374 4088 3038363049128 MainThread INFO nova.virt.hyperv.vmops [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Got request to destroy instance 2021-09-10 17:07:51.387 4088 3038363049128 MainThread DEBUG nova.virt.hyperv.vmops [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:07:51.387 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000006c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:51.387 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "instance-0000006c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:51.387 4088 3038363049128 MainThread INFO nova.compute.manager [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:07:51.403 4088 3038363049128 MainThread DEBUG nova.compute.claims [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:07:51.403 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:51.527 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:07:51.527 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:07:51.626 4088 3038363049128 MainThread DEBUG nova.virt.hyperv.hostops [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:07:51.636 4088 3038363049128 MainThread DEBUG nova.virt.hyperv.hostops [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:07:51.861 4088 3038363049128 MainThread DEBUG nova.compute.provider_tree [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:07:51.874 4088 3038363049128 MainThread DEBUG nova.scheduler.client.report [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:07:51.874 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.468s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:51.874 4088 3038363049128 MainThread ERROR nova.compute.manager [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006c' failed to start. Not enough memory in the system to start the virtual machine instance-0000006c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006c' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Not enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) 'instance-0000006c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Error code: 32778. 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Traceback (most recent call last): 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] return function(*args, **kwargs) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] admin_password, network_info, block_device_info) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] return function(self, *args, **kwds) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self.force_reraise() 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] raise self.value 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] should_plug_vifs=False) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 'req_state': req_state}) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self.force_reraise() 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] raise self.value 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] time.sleep(sleep_time) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self.force_reraise() 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] raise self.value 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] return f(*args, **kwargs) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] return self._wait_for_job(job_path) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] error_desc=err_desc) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000006c' failed to start. 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Not enough memory in the system to start the virtual machine instance-0000006c. 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006c' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Not enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 'instance-0000006c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Error code: 32778. 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] During handling of the above exception, another exception occurred: 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Traceback (most recent call last): 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] accel_info=accel_info) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] return function(*args, **kwargs) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] admin_password, network_info, block_device_info) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] return function(self, *args, **kwds) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self.force_reraise() 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] raise self.value 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] should_plug_vifs=False) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 'req_state': req_state}) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self.force_reraise() 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] raise self.value 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] time.sleep(sleep_time) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self.force_reraise() 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] raise self.value 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] return f(*args, **kwargs) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] return self._wait_for_job(job_path) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] error_desc=err_desc) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006c' failed to start. 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Not enough memory in the system to start the virtual machine instance-0000006c. 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006c' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Not enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 'instance-0000006c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Error code: 32778. 2021-09-10 17:07:51.874 4088 3038363049128 MainThread TRACE nova.compute.manager [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] 2021-09-10 17:07:51.874 4088 3038363049128 MainThread DEBUG nova.compute.utils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] WMI job failed with status 10. Error summary description: 'instance-0000006c' failed to start. Not enough memory in the system to start the virtual machine instance-0000006c. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:07:51.874 4088 3038363049128 MainThread DEBUG nova.compute.manager [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Build of instance 1a16a862-5759-43b6-88bb-d0ce8a7434da was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000006c' failed to start. Not enough memory in the system to start the virtual machine instance-0000006c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006c' failed to start. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Not enough memory in the system to start the virtual machine instance-0000006c with ram size 1024 megabytes. (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) 'instance-0000006c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID A70854AF-5F7E-4737-9B9D-290E08EAF6BC) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:07:51.874 4088 3038363049128 MainThread DEBUG nova.compute.manager [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:07:51.874 4088 3038363049128 MainThread DEBUG nova.compute.manager [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:07:51.874 4088 3038363049128 MainThread DEBUG nova.compute.manager [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:07:51.874 4088 3038363049128 MainThread DEBUG nova.network.neutron [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:07:52.199 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-9446e666-4364-4dcd-b041-405653a856bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:07:52.199 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:07:54.501 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Updating instance_info_cache with network_info: [{"id": "f581c585-39ab-4120-a040-5d92bb401a6c", "address": "fa:16:3e:da:9a:80", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf581c585-39", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:07:54.515 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-9446e666-4364-4dcd-b041-405653a856bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:07:54.515 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:07:54.515 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:07:54.543 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:07:54.558 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:54.558 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:54.558 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:07:54.558 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:07:54.573 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:07:54.793 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2207MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:07:54.793 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:55.090 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:07:55.090 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:07:55.090 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:07:55.090 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:07:55.090 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:07:55.090 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:07:55.090 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:07:55.090 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:07:55.090 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:07:55.090 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:07:55.090 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:07:55.090 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:07:55.090 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:07:55.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 1a16a862-5759-43b6-88bb-d0ce8a7434da has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1591 2021-09-10 17:07:55.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 8ef051ab-9f0f-4693-a09a-0b85b471b851 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:07:55.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:07:55.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=14GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:07:55.153 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:07:55.199 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:07:55.417 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:07:55.451 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:07:55.451 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:07:55.451 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:55.497 4088 3038363049128 MainThread DEBUG nova.network.neutron [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:07:55.535 4088 3038363049128 MainThread INFO nova.compute.manager [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] [instance: 1a16a862-5759-43b6-88bb-d0ce8a7434da] Took 3.66 seconds to deallocate network for instance. 2021-09-10 17:07:55.795 4088 3038363049128 MainThread INFO nova.scheduler.client.report [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Deleted allocations for instance 1a16a862-5759-43b6-88bb-d0ce8a7434da 2021-09-10 17:07:55.839 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-6951f32b-9133-4589-86ef-718bb29031d2 d3b19a6ed8024fe7b99f5aa4978b5af3 eecab78b34b0468f8c42e4b7f3444918 - default default] Lock "1a16a862-5759-43b6-88bb-d0ce8a7434da" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 29.937s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:56.094 4088 3038363049128 MainThread DEBUG nova.compute.manager [req-e9a4c076-8341-4cd6-b83b-67e01ae67995 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Received event network-vif-plugged-15d3233c-90a9-4899-b2a9-477a9e1079f1 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:07:56.094 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-e9a4c076-8341-4cd6-b83b-67e01ae67995 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "8ef051ab-9f0f-4693-a09a-0b85b471b851-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:56.094 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [req-e9a4c076-8341-4cd6-b83b-67e01ae67995 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "8ef051ab-9f0f-4693-a09a-0b85b471b851-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:56.094 4088 3038363049128 MainThread DEBUG nova.compute.manager [req-e9a4c076-8341-4cd6-b83b-67e01ae67995 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Processing event network-vif-plugged-15d3233c-90a9-4899-b2a9-477a9e1079f1 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:07:56.167 4088 3038363321448 MainThread INFO nova.virt.hyperv.vmops [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Using config drive for instance 2021-09-10 17:07:56.758 4088 3038363321448 MainThread INFO nova.virt.hyperv.vmops [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Creating config drive at C:\openstack\instances\instance-0000006d\configdrive.iso 2021-09-10 17:07:56.842 4088 3038363321448 MainThread DEBUG oslo_concurrency.processutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000006d\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpkxxbp0rl execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:07:57.199 4088 3038363321448 MainThread DEBUG oslo_concurrency.processutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000006d\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpkxxbp0rl" returned: 0 in 0.360s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:07:57.716 4088 3038363321448 MainThread DEBUG nova.virt.hyperv.vmops [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Setting boot order for instance: instance-0000006d: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:07:57.811 4088 3038363321448 MainThread DEBUG nova.virt.hyperv.vmops [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:07:57.850 4088 3038363321448 MainThread DEBUG os_win.utils.jobutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': 'A5CB4941-4765-412A-9C42-EA4B4AE06215', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15183), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:07:57.998 4088 3038363321448 MainThread ERROR os_win.utils.jobutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006d\' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)instance-0000006d6BC01C06-B817-4AA8-9B98-C9DFEDF4B16112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)instance-0000006d6BC01C06-B817-4AA8-9B98-C9DFEDF4B16110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)instance-0000006d6BC01C06-B817-4AA8-9B98-C9DFEDF4B161%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A5CB4941-4765-412A-9C42-EA4B4AE06215', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114584), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 7, 57), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 7, 57), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006d' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)\n\nNot enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)\n\n'instance-0000006d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)", 'ErrorSummaryDescription': "'instance-0000006d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:07:57.998 4088 3038363321448 MainThread DEBUG os_win._utils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006d' failed to start. Not enough memory in the system to start the virtual machine instance-0000006d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006d' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Not enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) 'instance-0000006d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18647980690002441 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:07:58.027 4088 3038363048248 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:07:58.027 4088 3038363048248 MainThread INFO nova.compute.manager [-] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] VM Stopped (Lifecycle Event) 2021-09-10 17:07:58.043 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:58.043 4088 3038363049128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:58.061 4088 3038363048248 MainThread DEBUG nova.compute.manager [req-3ed08f18-ddd9-40dc-a624-f43f4718340d - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:07:58.061 4088 3038363048248 MainThread DEBUG nova.virt.hyperv.vmops [req-3ed08f18-ddd9-40dc-a624-f43f4718340d - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:07:58.105 4088 3038363048248 MainThread DEBUG nova.compute.manager [req-3ed08f18-ddd9-40dc-a624-f43f4718340d - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:07:58.137 4088 3038363048248 MainThread INFO nova.compute.manager [req-3ed08f18-ddd9-40dc-a624-f43f4718340d - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:07:59.013 4088 3038363321448 MainThread DEBUG os_win.utils.jobutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': 'A6E8E713-E653-4D2D-8DE3-4DF02C7833B9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15589), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:07:59.142 4088 3038363321448 MainThread ERROR os_win.utils.jobutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006d\' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)instance-0000006d6BC01C06-B817-4AA8-9B98-C9DFEDF4B16112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)instance-0000006d6BC01C06-B817-4AA8-9B98-C9DFEDF4B16110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)instance-0000006d6BC01C06-B817-4AA8-9B98-C9DFEDF4B161%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A6E8E713-E653-4D2D-8DE3-4DF02C7833B9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114316), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 7, 59), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 7, 59), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006d' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)\n\nNot enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)\n\n'instance-0000006d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)", 'ErrorSummaryDescription': "'instance-0000006d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:07:59.142 4088 3038363321448 MainThread DEBUG os_win._utils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006d' failed to start. Not enough memory in the system to start the virtual machine instance-0000006d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006d' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Not enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) 'instance-0000006d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.330226182937622 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:07:59.206 4088 3038363049656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:07:59.206 4088 3038363049656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:07:59.206 4088 3038363049480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:07:59.206 4088 3038363049480 MainThread INFO nova.compute.manager [-] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] VM Stopped (Lifecycle Event) 2021-09-10 17:07:59.248 4088 3038363049480 MainThread DEBUG nova.compute.manager [req-0a07eee3-9a96-4c26-bb1f-472bec5e32eb - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:07:59.248 4088 3038363049480 MainThread DEBUG nova.virt.hyperv.vmops [req-0a07eee3-9a96-4c26-bb1f-472bec5e32eb - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:07:59.296 4088 3038363049480 MainThread DEBUG nova.compute.manager [req-0a07eee3-9a96-4c26-bb1f-472bec5e32eb - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:07:59.342 4088 3038363049480 MainThread INFO nova.compute.manager [req-0a07eee3-9a96-4c26-bb1f-472bec5e32eb - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:08:00.184 4088 3038363321448 MainThread DEBUG os_win.utils.jobutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': '17010C76-9241-4592-A19E-0352DC990C60', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15611), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:08:00.326 4088 3038363321448 MainThread ERROR os_win.utils.jobutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006d\' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)instance-0000006d6BC01C06-B817-4AA8-9B98-C9DFEDF4B16112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)instance-0000006d6BC01C06-B817-4AA8-9B98-C9DFEDF4B16110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)instance-0000006d6BC01C06-B817-4AA8-9B98-C9DFEDF4B161%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '17010C76-9241-4592-A19E-0352DC990C60', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111483), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 8), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 8), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006d' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)\n\nNot enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)\n\n'instance-0000006d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)", 'ErrorSummaryDescription': "'instance-0000006d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:08:00.327 4088 3038363321448 MainThread DEBUG os_win._utils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006d' failed to start. Not enough memory in the system to start the virtual machine instance-0000006d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006d' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Not enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) 'instance-0000006d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5152554512023926 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:08:00.342 4088 3038363049480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:08:00.342 4088 3038363049480 MainThread INFO nova.compute.manager [-] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] VM Stopped (Lifecycle Event) 2021-09-10 17:08:00.342 4088 3038363049656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:00.342 4088 3038363049656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:00.377 4088 3038363049480 MainThread DEBUG nova.compute.manager [req-ee22e40d-8b7b-4291-8a9f-c8eb00dfdd52 - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:08:00.377 4088 3038363049480 MainThread DEBUG nova.virt.hyperv.vmops [req-ee22e40d-8b7b-4291-8a9f-c8eb00dfdd52 - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:08:00.435 4088 3038363049480 MainThread DEBUG nova.compute.manager [req-ee22e40d-8b7b-4291-8a9f-c8eb00dfdd52 - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:08:00.492 4088 3038363049480 MainThread INFO nova.compute.manager [req-ee22e40d-8b7b-4291-8a9f-c8eb00dfdd52 - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:08:01.342 4088 3038363321448 MainThread DEBUG os_win.utils.jobutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': '7325F110-C33B-45DF-8B4B-4905C361F31D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17477), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:08:01.512 4088 3038363321448 MainThread ERROR os_win.utils.jobutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006d\' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)instance-0000006d6BC01C06-B817-4AA8-9B98-C9DFEDF4B16112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)instance-0000006d6BC01C06-B817-4AA8-9B98-C9DFEDF4B16110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)instance-0000006d6BC01C06-B817-4AA8-9B98-C9DFEDF4B161%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7325F110-C33B-45DF-8B4B-4905C361F31D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=133917), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 8, 1), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 8, 1), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006d' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)\n\nNot enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)\n\n'instance-0000006d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)", 'ErrorSummaryDescription': "'instance-0000006d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:08:01.512 4088 3038363321448 MainThread DEBUG os_win._utils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006d' failed to start. Not enough memory in the system to start the virtual machine instance-0000006d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006d' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Not enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) 'instance-0000006d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7002201080322266 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:08:01.558 4088 3038363049480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:08:01.558 4088 3038363049480 MainThread INFO nova.compute.manager [-] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] VM Stopped (Lifecycle Event) 2021-09-10 17:08:01.558 4088 3038363049656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:01.558 4088 3038363049656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:01.591 4088 3038363049480 MainThread DEBUG nova.compute.manager [req-ddd15ae9-3121-4f41-816e-a8f22418dffa - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:08:01.591 4088 3038363049480 MainThread DEBUG nova.virt.hyperv.vmops [req-ddd15ae9-3121-4f41-816e-a8f22418dffa - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:08:01.654 4088 3038363049480 MainThread DEBUG nova.compute.manager [req-ddd15ae9-3121-4f41-816e-a8f22418dffa - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:08:01.669 4088 3038363049480 MainThread INFO nova.compute.manager [req-ddd15ae9-3121-4f41-816e-a8f22418dffa - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:08:02.563 4088 3038363321448 MainThread DEBUG os_win.utils.jobutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': 'E3411FB5-448A-41A6-A53F-1D7A0D94C36C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15249), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:08:02.684 4088 3038363321448 MainThread ERROR os_win.utils.jobutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006d\' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)instance-0000006d6BC01C06-B817-4AA8-9B98-C9DFEDF4B16112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)instance-0000006d6BC01C06-B817-4AA8-9B98-C9DFEDF4B16110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)instance-0000006d6BC01C06-B817-4AA8-9B98-C9DFEDF4B161%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E3411FB5-448A-41A6-A53F-1D7A0D94C36C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112201), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 8, 2), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 8, 2), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006d' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)\n\nNot enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)\n\n'instance-0000006d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)", 'ErrorSummaryDescription': "'instance-0000006d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:08:02.684 4088 3038363321448 MainThread DEBUG os_win._utils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006d' failed to start. Not enough memory in the system to start the virtual machine instance-0000006d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006d' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Not enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) 'instance-0000006d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.872985601425171 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:08:02.745 4088 3038363049656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:02.748 4088 3038363049656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:02.748 4088 3038363049480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:08:02.748 4088 3038363049480 MainThread INFO nova.compute.manager [-] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] VM Stopped (Lifecycle Event) 2021-09-10 17:08:02.775 4088 3038363049480 MainThread DEBUG nova.compute.manager [req-d7239551-ff30-4a3e-bb51-274ca2d99816 - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:08:02.775 4088 3038363049480 MainThread DEBUG nova.virt.hyperv.vmops [req-d7239551-ff30-4a3e-bb51-274ca2d99816 - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:08:02.826 4088 3038363049480 MainThread DEBUG nova.compute.manager [req-d7239551-ff30-4a3e-bb51-274ca2d99816 - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:08:02.878 4088 3038363049480 MainThread INFO nova.compute.manager [req-d7239551-ff30-4a3e-bb51-274ca2d99816 - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:08:03.701 4088 3038363321448 MainThread DEBUG os_win.utils.jobutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': '830BA49F-0AC7-4C33-A1F4-953DB8D5CEE8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15993), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:08:03.842 4088 3038363321448 MainThread ERROR os_win.utils.jobutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006d\' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)instance-0000006d6BC01C06-B817-4AA8-9B98-C9DFEDF4B16112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)instance-0000006d6BC01C06-B817-4AA8-9B98-C9DFEDF4B16110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)instance-0000006d6BC01C06-B817-4AA8-9B98-C9DFEDF4B161%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '830BA49F-0AC7-4C33-A1F4-953DB8D5CEE8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115575), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 8, 3), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 8, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006d' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)\n\nNot enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)\n\n'instance-0000006d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161)", 'ErrorSummaryDescription': "'instance-0000006d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:08:03.856 4088 3038363321448 MainThread ERROR nova.virt.hyperv.vmops [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Failed to change vm state of instance-0000006d to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000006d' failed to start. 2021-09-10 17:08:03.856 4088 3038363321448 MainThread INFO nova.virt.hyperv.vmops [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Got request to destroy instance 2021-09-10 17:08:03.904 4088 3038363049480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:08:03.904 4088 3038363049480 MainThread INFO nova.compute.manager [-] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] VM Stopped (Lifecycle Event) 2021-09-10 17:08:03.904 4088 3038363049656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:03.904 4088 3038363049656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:03.934 4088 3038363049480 MainThread DEBUG nova.compute.manager [req-1cf48947-1271-48ef-93b1-893121da6081 - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:08:03.934 4088 3038363049480 MainThread DEBUG nova.virt.hyperv.vmops [req-1cf48947-1271-48ef-93b1-893121da6081 - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:08:03.996 4088 3038363049480 MainThread DEBUG nova.compute.manager [req-1cf48947-1271-48ef-93b1-893121da6081 - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:08:04.044 4088 3038363049480 MainThread INFO nova.compute.manager [req-1cf48947-1271-48ef-93b1-893121da6081 - - - - -] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:08:05.761 4088 3038363321448 MainThread DEBUG nova.virt.hyperv.vmops [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:08:05.761 4088 3038363321448 MainThread DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-0000006d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:05.761 4088 3038363321448 MainThread DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-0000006d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:05.776 4088 3038363321448 MainThread DEBUG os_win.utils.compute.vmutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Successfully changed vm state of instance-0000006d to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:08:05.776 4088 3038363321448 MainThread DEBUG nova.virt.hyperv.vmops [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Successfully changed state of VM instance-0000006d to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:08:05.828 4088 3038363321448 MainThread DEBUG os_win.utils.jobutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Waiting for WMI job: {'InstanceID': '6EFC877C-35D5-4607-892E-68E49578DC7B', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14712), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:08:05.949 4088 3038363321448 MainThread DEBUG os_win.utils.jobutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] WMI job succeeded: {'InstanceID': '6EFC877C-35D5-4607-892E-68E49578DC7B', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=113701), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:08:05.949 4088 3038363321448 MainThread DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-0000006d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:05.949 4088 3038363321448 MainThread DEBUG os_win.utils.pathutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Removing directory: C:\openstack\instances\instance-0000006d check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:08:05.949 4088 3038363321448 MainThread DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-0000006d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:05.949 4088 3038363321448 MainThread ERROR nova.compute.manager [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006d' failed to start. Not enough memory in the system to start the virtual machine instance-0000006d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006d' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Not enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) 'instance-0000006d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Error code: 32778. 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Traceback (most recent call last): 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] return function(*args, **kwargs) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] admin_password, network_info, block_device_info) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] return function(self, *args, **kwds) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self.force_reraise() 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] raise self.value 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] should_plug_vifs=False) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 'req_state': req_state}) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self.force_reraise() 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] raise self.value 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] time.sleep(sleep_time) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self.force_reraise() 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] raise self.value 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] return f(*args, **kwargs) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] return self._wait_for_job(job_path) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] error_desc=err_desc) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000006d' failed to start. 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Not enough memory in the system to start the virtual machine instance-0000006d. 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006d' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Not enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 'instance-0000006d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Error code: 32778. 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] During handling of the above exception, another exception occurred: 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Traceback (most recent call last): 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] yield resources 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] accel_info=accel_info) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] return function(*args, **kwargs) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] admin_password, network_info, block_device_info) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] return function(self, *args, **kwds) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self.force_reraise() 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] raise self.value 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] should_plug_vifs=False) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 'req_state': req_state}) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self.force_reraise() 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] raise self.value 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] time.sleep(sleep_time) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self.force_reraise() 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] raise self.value 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] return f(*args, **kwargs) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] return self._wait_for_job(job_path) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] error_desc=err_desc) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006d' failed to start. 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Not enough memory in the system to start the virtual machine instance-0000006d. 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006d' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Not enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 'instance-0000006d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Error code: 32778. 2021-09-10 17:08:05.949 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:05.949 4088 3038363321448 MainThread INFO nova.compute.manager [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Terminating instance 2021-09-10 17:08:05.949 4088 3038363321448 MainThread DEBUG nova.compute.manager [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:08:05.949 4088 3038363321448 MainThread INFO nova.virt.hyperv.vmops [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Got request to destroy instance 2021-09-10 17:08:05.967 4088 3038363321448 MainThread DEBUG nova.virt.hyperv.vmops [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:08:05.967 4088 3038363321448 MainThread DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-0000006d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:05.967 4088 3038363321448 MainThread DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "instance-0000006d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:05.982 4088 3038363321448 MainThread INFO nova.compute.manager [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:08:05.982 4088 3038363321448 MainThread DEBUG nova.compute.claims [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:08:05.982 4088 3038363321448 MainThread DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:06.142 4088 3038363321448 MainThread DEBUG nova.virt.hyperv.hostops [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:08:06.154 4088 3038363321448 MainThread DEBUG nova.virt.hyperv.hostops [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:08:06.386 4088 3038363321448 MainThread DEBUG nova.compute.provider_tree [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:08:06.401 4088 3038363321448 MainThread DEBUG nova.scheduler.client.report [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:08:06.401 4088 3038363321448 MainThread DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:06.401 4088 3038363321448 MainThread ERROR nova.compute.manager [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006d' failed to start. Not enough memory in the system to start the virtual machine instance-0000006d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006d' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Not enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) 'instance-0000006d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Error code: 32778. 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Traceback (most recent call last): 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] return function(*args, **kwargs) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] admin_password, network_info, block_device_info) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] return function(self, *args, **kwds) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self.force_reraise() 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] raise self.value 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] should_plug_vifs=False) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 'req_state': req_state}) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self.force_reraise() 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] raise self.value 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] time.sleep(sleep_time) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self.force_reraise() 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] raise self.value 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] return f(*args, **kwargs) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] return self._wait_for_job(job_path) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] error_desc=err_desc) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000006d' failed to start. 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Not enough memory in the system to start the virtual machine instance-0000006d. 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006d' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Not enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 'instance-0000006d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Error code: 32778. 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] During handling of the above exception, another exception occurred: 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Traceback (most recent call last): 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] accel_info=accel_info) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] return function(*args, **kwargs) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] admin_password, network_info, block_device_info) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] return function(self, *args, **kwds) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self.force_reraise() 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] raise self.value 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] should_plug_vifs=False) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 'req_state': req_state}) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self.force_reraise() 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] raise self.value 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] time.sleep(sleep_time) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self.force_reraise() 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] raise self.value 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] return f(*args, **kwargs) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] return self._wait_for_job(job_path) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] error_desc=err_desc) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006d' failed to start. 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Not enough memory in the system to start the virtual machine instance-0000006d. 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006d' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Not enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 'instance-0000006d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Error code: 32778. 2021-09-10 17:08:06.401 4088 3038363321448 MainThread TRACE nova.compute.manager [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] 2021-09-10 17:08:06.420 4088 3038363321448 MainThread DEBUG nova.compute.utils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] WMI job failed with status 10. Error summary description: 'instance-0000006d' failed to start. Not enough memory in the system to start the virtual machine instance-0000006d. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:08:06.420 4088 3038363321448 MainThread DEBUG nova.compute.manager [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Build of instance 8ef051ab-9f0f-4693-a09a-0b85b471b851 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000006d' failed to start. Not enough memory in the system to start the virtual machine instance-0000006d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006d' failed to start. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Not enough memory in the system to start the virtual machine instance-0000006d with ram size 1024 megabytes. (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) 'instance-0000006d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6BC01C06-B817-4AA8-9B98-C9DFEDF4B161) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:08:06.420 4088 3038363321448 MainThread DEBUG nova.compute.manager [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:08:06.420 4088 3038363321448 MainThread DEBUG nova.compute.manager [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:08:06.420 4088 3038363321448 MainThread DEBUG nova.compute.manager [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:08:06.420 4088 3038363321448 MainThread DEBUG nova.network.neutron [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:08:09.387 4088 3038363321448 MainThread DEBUG nova.network.neutron [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:08:09.432 4088 3038363321448 MainThread INFO nova.compute.manager [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] [instance: 8ef051ab-9f0f-4693-a09a-0b85b471b851] Took 3.02 seconds to deallocate network for instance. 2021-09-10 17:08:09.682 4088 3038363321448 MainThread INFO nova.scheduler.client.report [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Deleted allocations for instance 8ef051ab-9f0f-4693-a09a-0b85b471b851 2021-09-10 17:08:09.731 4088 3038363321448 MainThread DEBUG oslo_concurrency.lockutils [req-02fb1f48-adc9-47c1-909c-1ba49e17f827 6da982fe4daa44b998cd4ae6900212fd 0928f57ccc9245e28c79dd9cce7e395b - default default] Lock "8ef051ab-9f0f-4693-a09a-0b85b471b851" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 35.406s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:43.509 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Lock "6e1d1124-996e-4d4c-80bd-1aab17ba5d1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:43.530 4088 3038338907128 MainThread DEBUG nova.compute.manager [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:08:43.682 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:43.682 4088 3038338907128 MainThread DEBUG nova.virt.hardware [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:08:43.682 4088 3038338907128 MainThread INFO nova.compute.claims [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Claim successful on node n-h2-808474-1 2021-09-10 17:08:43.862 4088 3038338907128 MainThread DEBUG nova.virt.hyperv.hostops [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:08:43.889 4088 3038338907128 MainThread DEBUG nova.virt.hyperv.hostops [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:08:44.105 4088 3038338907128 MainThread DEBUG nova.compute.provider_tree [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:08:44.150 4088 3038338907128 MainThread DEBUG nova.scheduler.client.report [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:08:44.150 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:44.150 4088 3038338907128 MainThread DEBUG nova.compute.manager [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:08:44.212 4088 3038338907128 MainThread DEBUG nova.compute.manager [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:08:44.231 4088 3038338908008 GreenThread-100 DEBUG nova.compute.manager [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:08:44.231 4088 3038338908008 GreenThread-100 DEBUG nova.network.neutron [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:08:44.365 4088 3038338907128 MainThread DEBUG nova.compute.manager [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:08:44.400 4088 3038338907128 MainThread INFO nova.virt.hyperv.vmops [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Spawning new instance 2021-09-10 17:08:44.400 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Lock "instance-0000006e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:44.400 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Lock "instance-0000006e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:44.400 4088 3038338907128 MainThread DEBUG nova.block_device [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:08:44.400 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:44.400 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:44.431 4088 3038338907128 MainThread DEBUG os_win.utils.pathutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Creating directory: C:\openstack\instances\instance-0000006e check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:08:44.431 4088 3038338907128 MainThread DEBUG nova.virt.hyperv.vmops [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000006e\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:08:44.462 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:08:44.572 4088 3038338908008 GreenThread-100 DEBUG nova.policy [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c63d410ca6d947fcba0acf004916fa12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203bf8c8ff8149d18d5c8dee127f7611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:08:44.694 4088 3038338907128 MainThread DEBUG nova.virt.hyperv.vmops [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Resizing VHD C:\openstack\instances\instance-0000006e\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:08:45.540 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:08:45.540 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:08:47.486 4088 3038338908008 GreenThread-100 DEBUG nova.network.neutron [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Successfully created port: 761bfb9a-0896-4a27-97e2-9273d4feaa73 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:08:47.529 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:08:47.529 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:08:49.530 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:08:49.978 4088 3038338908008 GreenThread-100 DEBUG nova.network.neutron [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Successfully updated port: 761bfb9a-0896-4a27-97e2-9273d4feaa73 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:08:49.996 4088 3038338908008 GreenThread-100 DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Acquired lock "refresh_cache-6e1d1124-996e-4d4c-80bd-1aab17ba5d1a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:08:50.010 4088 3038338908008 GreenThread-100 DEBUG nova.network.neutron [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:08:50.103 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-7ed0747b-ab18-4ffc-a5ee-cb0b800f6713 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Received event network-changed-761bfb9a-0896-4a27-97e2-9273d4feaa73 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:08:50.103 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-7ed0747b-ab18-4ffc-a5ee-cb0b800f6713 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Refreshing instance network info cache due to event network-changed-761bfb9a-0896-4a27-97e2-9273d4feaa73. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:08:50.525 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:08:50.525 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:08:51.000 4088 3038338908008 GreenThread-100 DEBUG nova.network.neutron [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:08:51.998 4088 3038338908008 GreenThread-100 DEBUG nova.network.neutron [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Updating instance_info_cache with network_info: [{"id": "761bfb9a-0896-4a27-97e2-9273d4feaa73", "address": "fa:16:3e:f9:6a:65", "network": {"id": "393fb198-540a-475c-bfd1-6196803512b9", "bridge": null, "label": "tempest-InstanceActionsTestJSON-162631977-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "203bf8c8ff8149d18d5c8dee127f7611", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap761bfb9a-08", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:08:52.061 4088 3038338908008 GreenThread-100 DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Releasing lock "refresh_cache-6e1d1124-996e-4d4c-80bd-1aab17ba5d1a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:08:52.061 4088 3038338908008 GreenThread-100 DEBUG nova.compute.manager [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Instance network_info: |[{"id": "761bfb9a-0896-4a27-97e2-9273d4feaa73", "address": "fa:16:3e:f9:6a:65", "network": {"id": "393fb198-540a-475c-bfd1-6196803512b9", "bridge": null, "label": "tempest-InstanceActionsTestJSON-162631977-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "203bf8c8ff8149d18d5c8dee127f7611", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap761bfb9a-08", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:08:52.061 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-7ed0747b-ab18-4ffc-a5ee-cb0b800f6713 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-6e1d1124-996e-4d4c-80bd-1aab17ba5d1a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:08:52.061 4088 3038338906600 MainThread DEBUG nova.network.neutron [req-7ed0747b-ab18-4ffc-a5ee-cb0b800f6713 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Refreshing network info cache for port 761bfb9a-0896-4a27-97e2-9273d4feaa73 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:08:52.061 4088 3038338907128 MainThread DEBUG nova.compute.manager [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Preparing to wait for external event network-vif-plugged-761bfb9a-0896-4a27-97e2-9273d4feaa73 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:08:52.061 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Lock "6e1d1124-996e-4d4c-80bd-1aab17ba5d1a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:52.061 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Lock "6e1d1124-996e-4d4c-80bd-1aab17ba5d1a-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:52.061 4088 3038338907128 MainThread DEBUG os_win.utils.compute.vmutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Creating VM instance-0000006e create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:08:52.542 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:08:52.542 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:08:52.984 4088 3038338906600 MainThread DEBUG nova.network.neutron [req-7ed0747b-ab18-4ffc-a5ee-cb0b800f6713 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Updated VIF entry in instance network info cache for port 761bfb9a-0896-4a27-97e2-9273d4feaa73. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:08:52.984 4088 3038338906600 MainThread DEBUG nova.network.neutron [req-7ed0747b-ab18-4ffc-a5ee-cb0b800f6713 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Updating instance_info_cache with network_info: [{"id": "761bfb9a-0896-4a27-97e2-9273d4feaa73", "address": "fa:16:3e:f9:6a:65", "network": {"id": "393fb198-540a-475c-bfd1-6196803512b9", "bridge": null, "label": "tempest-InstanceActionsTestJSON-162631977-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "203bf8c8ff8149d18d5c8dee127f7611", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap761bfb9a-08", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:08:53.003 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-7ed0747b-ab18-4ffc-a5ee-cb0b800f6713 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-6e1d1124-996e-4d4c-80bd-1aab17ba5d1a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:08:53.188 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "92438189-b8db-4465-b432-47722bf0d84c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:53.218 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:08:53.261 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-9bb2d354-2d76-40ea-8b9c-b18a21edefbb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:08:53.261 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:08:53.314 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:53.333 4088 3038296678248 MainThread DEBUG nova.virt.hardware [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:08:53.333 4088 3038296678248 MainThread INFO nova.compute.claims [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Claim successful on node n-h2-808474-1 2021-09-10 17:08:53.468 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.hostops [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:08:53.486 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.hostops [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:08:53.778 4088 3038338907128 MainThread DEBUG nova.virt.hyperv.vmops [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:08:53.814 4088 3038296678248 MainThread DEBUG nova.compute.provider_tree [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:08:53.838 4088 3038296678248 MainThread DEBUG nova.scheduler.client.report [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:08:53.853 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:53.853 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:08:53.946 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:08:53.946 4088 3038338906600 GreenThread-101 DEBUG nova.compute.manager [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:08:53.956 4088 3038338906600 GreenThread-101 DEBUG nova.network.neutron [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:08:54.095 4088 3038338906600 GreenThread-101 DEBUG nova.policy [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '95e49dab1ffa48cfb40576e8646baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ebc509414a41b9890ca144a70c816d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:08:54.167 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:08:54.183 4088 3038296678248 MainThread INFO nova.virt.hyperv.vmops [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Spawning new instance 2021-09-10 17:08:54.183 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "instance-0000006f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:54.183 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "instance-0000006f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:54.183 4088 3038296678248 MainThread DEBUG nova.block_device [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:08:54.183 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:54.183 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:54.243 4088 3038296678248 MainThread DEBUG os_win.utils.pathutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Creating directory: C:\openstack\instances\instance-0000006f check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:08:54.243 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000006f\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:08:54.544 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Resizing VHD C:\openstack\instances\instance-0000006f\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:08:55.680 4088 3038338906600 GreenThread-101 DEBUG nova.network.neutron [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Successfully created port: 8f21ce3f-9459-4e6f-9f64-9dcc79feb3ba _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:08:56.514 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Updating instance_info_cache with network_info: [{"id": "cffb92ec-4239-478b-a7e3-533da175c554", "address": "fa:16:3e:61:8a:33", "network": {"id": "6762dff9-0e3f-42c6-a0d6-ae3571e9fc82", "bridge": null, "label": "tempest-AttachSCSIVolumeTestJSON-1567357011-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "10c929df49a24fb798e1b2d3f7414211", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcffb92ec-42", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:08:56.529 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-9bb2d354-2d76-40ea-8b9c-b18a21edefbb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:08:56.529 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:08:56.529 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:08:56.556 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:08:56.571 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:56.571 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:56.571 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:08:56.571 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:08:56.587 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:08:56.837 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2222MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:08:56.837 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:57.040 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:08:57.040 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:08:57.040 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:08:57.040 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:08:57.040 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:08:57.040 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:08:57.040 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:08:57.040 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:08:57.040 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:08:57.040 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:08:57.040 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:08:57.056 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:08:57.056 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:08:57.056 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:08:57.071 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 92438189-b8db-4465-b432-47722bf0d84c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:08:57.071 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 15 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:08:57.071 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=15872MB phys_disk=79GB used_disk=15GB total_vcpus=6 used_vcpus=15 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:08:57.103 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:08:57.121 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:08:57.321 4088 3038338906600 GreenThread-101 DEBUG nova.network.neutron [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Successfully updated port: 8f21ce3f-9459-4e6f-9f64-9dcc79feb3ba _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:08:57.343 4088 3038338906600 GreenThread-101 DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Acquired lock "refresh_cache-92438189-b8db-4465-b432-47722bf0d84c" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:08:57.343 4088 3038338906600 GreenThread-101 DEBUG nova.network.neutron [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:08:57.362 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:08:57.384 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:08:57.384 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:08:57.384 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.547s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:57.905 4088 3038338906600 GreenThread-101 DEBUG nova.network.neutron [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:08:58.041 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-d5167560-3302-4685-b774-effb6b2da3aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Received event network-changed-8f21ce3f-9459-4e6f-9f64-9dcc79feb3ba external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:08:58.041 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-d5167560-3302-4685-b774-effb6b2da3aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Refreshing instance network info cache due to event network-changed-8f21ce3f-9459-4e6f-9f64-9dcc79feb3ba. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:08:58.790 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:08:58.918 4088 3038338906600 GreenThread-101 DEBUG nova.network.neutron [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Updating instance_info_cache with network_info: [{"id": "8f21ce3f-9459-4e6f-9f64-9dcc79feb3ba", "address": "fa:16:3e:78:c7:3b", "network": {"id": "d6df0583-126e-43a0-b521-6e515b4cb0f8", "bridge": null, "label": "tempest-network-smoke--1432540075", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f4ebc509414a41b9890ca144a70c816d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8f21ce3f-94", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:08:58.947 4088 3038338906600 GreenThread-101 DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Releasing lock "refresh_cache-92438189-b8db-4465-b432-47722bf0d84c" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:08:58.947 4088 3038338906600 GreenThread-101 DEBUG nova.compute.manager [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Instance network_info: |[{"id": "8f21ce3f-9459-4e6f-9f64-9dcc79feb3ba", "address": "fa:16:3e:78:c7:3b", "network": {"id": "d6df0583-126e-43a0-b521-6e515b4cb0f8", "bridge": null, "label": "tempest-network-smoke--1432540075", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f4ebc509414a41b9890ca144a70c816d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8f21ce3f-94", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:08:58.947 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Preparing to wait for external event network-vif-plugged-8f21ce3f-9459-4e6f-9f64-9dcc79feb3ba prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:08:58.947 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "92438189-b8db-4465-b432-47722bf0d84c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:08:58.947 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "92438189-b8db-4465-b432-47722bf0d84c-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:08:58.947 4088 3038296678248 MainThread DEBUG os_win.utils.compute.vmutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Creating VM instance-0000006f create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:08:58.947 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [req-d5167560-3302-4685-b774-effb6b2da3aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-92438189-b8db-4465-b432-47722bf0d84c" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:08:58.947 4088 3038342256072 MainThread DEBUG nova.network.neutron [req-d5167560-3302-4685-b774-effb6b2da3aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Refreshing network info cache for port 8f21ce3f-9459-4e6f-9f64-9dcc79feb3ba _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:08:59.884 4088 3038342256072 MainThread DEBUG nova.network.neutron [req-d5167560-3302-4685-b774-effb6b2da3aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Updated VIF entry in instance network info cache for port 8f21ce3f-9459-4e6f-9f64-9dcc79feb3ba. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:08:59.884 4088 3038342256072 MainThread DEBUG nova.network.neutron [req-d5167560-3302-4685-b774-effb6b2da3aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Updating instance_info_cache with network_info: [{"id": "8f21ce3f-9459-4e6f-9f64-9dcc79feb3ba", "address": "fa:16:3e:78:c7:3b", "network": {"id": "d6df0583-126e-43a0-b521-6e515b4cb0f8", "bridge": null, "label": "tempest-network-smoke--1432540075", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f4ebc509414a41b9890ca144a70c816d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8f21ce3f-94", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:08:59.918 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [req-d5167560-3302-4685-b774-effb6b2da3aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-92438189-b8db-4465-b432-47722bf0d84c" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:09:00.159 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-17622a47-e1e6-42f5-aa28-2a373e169696 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Received event network-vif-plugged-761bfb9a-0896-4a27-97e2-9273d4feaa73 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:09:00.159 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [req-17622a47-e1e6-42f5-aa28-2a373e169696 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "6e1d1124-996e-4d4c-80bd-1aab17ba5d1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:00.180 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [req-17622a47-e1e6-42f5-aa28-2a373e169696 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "6e1d1124-996e-4d4c-80bd-1aab17ba5d1a-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:00.180 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-17622a47-e1e6-42f5-aa28-2a373e169696 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Processing event network-vif-plugged-761bfb9a-0896-4a27-97e2-9273d4feaa73 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:09:00.216 4088 3038338907128 MainThread INFO nova.virt.hyperv.vmops [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Using config drive for instance 2021-09-10 17:09:00.462 4088 3038338907128 MainThread INFO nova.virt.hyperv.vmops [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Creating config drive at C:\openstack\instances\instance-0000006e\configdrive.iso 2021-09-10 17:09:00.542 4088 3038338907128 MainThread DEBUG oslo_concurrency.processutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000006e\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmppye9bqr_ execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:09:00.870 4088 3038338907128 MainThread DEBUG oslo_concurrency.processutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000006e\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmppye9bqr_" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:09:01.012 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:09:01.525 4088 3038338907128 MainThread DEBUG nova.virt.hyperv.vmops [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Setting boot order for instance: instance-0000006e: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:09:01.653 4088 3038338907128 MainThread DEBUG nova.virt.hyperv.vmops [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:09:01.682 4088 3038338907128 MainThread DEBUG os_win.utils.jobutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Waiting for WMI job: {'InstanceID': '4A7C37B5-B34A-4EB6-988C-7B29E5F18B9F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=23611), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:09:01.884 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:01.884 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:01.884 4088 3038296677544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:09:01.884 4088 3038296677544 MainThread INFO nova.compute.manager [-] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] VM Stopped (Lifecycle Event) 2021-09-10 17:09:01.917 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-79d2614e-f5de-48eb-8c64-0e2c6e6c3153 - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:09:01.917 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-79d2614e-f5de-48eb-8c64-0e2c6e6c3153 - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:09:01.963 4088 3038338907128 MainThread ERROR os_win.utils.jobutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006e\' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)instance-0000006e52F6348F-EB4F-4E70-8096-34DCB0D9484512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)instance-0000006e52F6348F-EB4F-4E70-8096-34DCB0D9484510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)instance-0000006e52F6348F-EB4F-4E70-8096-34DCB0D94845%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4A7C37B5-B34A-4EB6-988C-7B29E5F18B9F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=140585), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 9, 1), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 9, 1), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006e' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)\n\nNot enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)\n\n'instance-0000006e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)", 'ErrorSummaryDescription': "'instance-0000006e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:09:01.963 4088 3038338907128 MainThread DEBUG os_win._utils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006e' failed to start. Not enough memory in the system to start the virtual machine instance-0000006e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006e' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Not enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) 'instance-0000006e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.3100731372833252 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:09:01.963 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-79d2614e-f5de-48eb-8c64-0e2c6e6c3153 - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:09:02.029 4088 3038296677544 MainThread INFO nova.compute.manager [req-79d2614e-f5de-48eb-8c64-0e2c6e6c3153 - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:09:02.993 4088 3038338907128 MainThread DEBUG os_win.utils.jobutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Waiting for WMI job: {'InstanceID': '83F6673D-A952-405E-B765-57BEF6230302', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16419), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:09:03.134 4088 3038338907128 MainThread ERROR os_win.utils.jobutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006e\' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)instance-0000006e52F6348F-EB4F-4E70-8096-34DCB0D9484512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)instance-0000006e52F6348F-EB4F-4E70-8096-34DCB0D9484510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)instance-0000006e52F6348F-EB4F-4E70-8096-34DCB0D94845%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '83F6673D-A952-405E-B765-57BEF6230302', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114676), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 9, 2), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 9, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006e' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)\n\nNot enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)\n\n'instance-0000006e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)", 'ErrorSummaryDescription': "'instance-0000006e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:09:03.134 4088 3038338907128 MainThread DEBUG os_win._utils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006e' failed to start. Not enough memory in the system to start the virtual machine instance-0000006e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006e' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Not enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) 'instance-0000006e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4814257621765137 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:09:03.165 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:03.165 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:03.165 4088 3038296677544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:09:03.184 4088 3038296677544 MainThread INFO nova.compute.manager [-] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] VM Stopped (Lifecycle Event) 2021-09-10 17:09:03.213 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-c750513c-8509-455c-b4c8-468f0d62df3a - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:09:03.213 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-c750513c-8509-455c-b4c8-468f0d62df3a - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:09:03.264 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-c750513c-8509-455c-b4c8-468f0d62df3a - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:09:03.321 4088 3038296677544 MainThread INFO nova.compute.manager [req-c750513c-8509-455c-b4c8-468f0d62df3a - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:09:04.154 4088 3038338907128 MainThread DEBUG os_win.utils.jobutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Waiting for WMI job: {'InstanceID': 'A4E044E8-CBA6-4C3E-8B91-51ADA13931F2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16613), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:09:04.275 4088 3038338907128 MainThread ERROR os_win.utils.jobutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006e\' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)instance-0000006e52F6348F-EB4F-4E70-8096-34DCB0D9484512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)instance-0000006e52F6348F-EB4F-4E70-8096-34DCB0D9484510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)instance-0000006e52F6348F-EB4F-4E70-8096-34DCB0D94845%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A4E044E8-CBA6-4C3E-8B91-51ADA13931F2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112728), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 9, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 9, 4), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006e' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)\n\nNot enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)\n\n'instance-0000006e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)", 'ErrorSummaryDescription': "'instance-0000006e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:09:04.275 4088 3038338907128 MainThread DEBUG os_win._utils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006e' failed to start. Not enough memory in the system to start the virtual machine instance-0000006e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006e' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Not enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) 'instance-0000006e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.62271785736084 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:09:04.343 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:04.343 4088 3038342254840 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:04.343 4088 3038296677544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:09:04.343 4088 3038296677544 MainThread INFO nova.compute.manager [-] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] VM Stopped (Lifecycle Event) 2021-09-10 17:09:04.368 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-a4bdcef0-9689-405d-9b55-64c8c8934b72 - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:09:04.368 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-a4bdcef0-9689-405d-9b55-64c8c8934b72 - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:09:04.418 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-a4bdcef0-9689-405d-9b55-64c8c8934b72 - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:09:04.453 4088 3038296677544 MainThread INFO nova.compute.manager [req-a4bdcef0-9689-405d-9b55-64c8c8934b72 - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:09:05.306 4088 3038338907128 MainThread DEBUG os_win.utils.jobutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Waiting for WMI job: {'InstanceID': '7184DE0F-2FFB-44B7-944C-A03DB890CED4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15606), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:09:05.451 4088 3038338907128 MainThread ERROR os_win.utils.jobutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006e\' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)instance-0000006e52F6348F-EB4F-4E70-8096-34DCB0D9484512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)instance-0000006e52F6348F-EB4F-4E70-8096-34DCB0D9484510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)instance-0000006e52F6348F-EB4F-4E70-8096-34DCB0D94845%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7184DE0F-2FFB-44B7-944C-A03DB890CED4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115484), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 9, 5), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 9, 5), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006e' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)\n\nNot enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)\n\n'instance-0000006e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)", 'ErrorSummaryDescription': "'instance-0000006e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:09:05.451 4088 3038338907128 MainThread DEBUG os_win._utils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006e' failed to start. Not enough memory in the system to start the virtual machine instance-0000006e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006e' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Not enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) 'instance-0000006e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.798557758331299 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:09:05.478 4088 3038296677544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:09:05.478 4088 3038296677544 MainThread INFO nova.compute.manager [-] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] VM Stopped (Lifecycle Event) 2021-09-10 17:09:05.478 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:05.478 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:05.508 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-6b9b4d59-a034-4d6a-9f1c-1a454ea84a1d - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:09:05.508 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-6b9b4d59-a034-4d6a-9f1c-1a454ea84a1d - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:09:05.555 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-6b9b4d59-a034-4d6a-9f1c-1a454ea84a1d - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:09:05.593 4088 3038296677544 MainThread INFO nova.compute.manager [req-6b9b4d59-a034-4d6a-9f1c-1a454ea84a1d - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:09:06.462 4088 3038338907128 MainThread DEBUG os_win.utils.jobutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Waiting for WMI job: {'InstanceID': '8008AFB0-A372-45B2-AC32-59C624DDFFF3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15510), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:09:06.607 4088 3038338907128 MainThread ERROR os_win.utils.jobutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006e\' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)instance-0000006e52F6348F-EB4F-4E70-8096-34DCB0D9484512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)instance-0000006e52F6348F-EB4F-4E70-8096-34DCB0D9484510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)instance-0000006e52F6348F-EB4F-4E70-8096-34DCB0D94845%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '8008AFB0-A372-45B2-AC32-59C624DDFFF3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118693), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 9, 6), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 9, 6), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006e' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)\n\nNot enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)\n\n'instance-0000006e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)", 'ErrorSummaryDescription': "'instance-0000006e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:09:06.607 4088 3038338907128 MainThread DEBUG os_win._utils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006e' failed to start. Not enough memory in the system to start the virtual machine instance-0000006e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006e' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Not enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) 'instance-0000006e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.954360008239746 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:09:06.700 4088 3038296677544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:09:06.700 4088 3038296677544 MainThread INFO nova.compute.manager [-] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] VM Stopped (Lifecycle Event) 2021-09-10 17:09:06.700 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:06.700 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:06.713 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-a4511f75-a9e6-4e05-b150-4226b109d968 - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:09:06.713 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-a4511f75-a9e6-4e05-b150-4226b109d968 - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:09:06.761 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-a4511f75-a9e6-4e05-b150-4226b109d968 - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:09:06.812 4088 3038296677544 MainThread INFO nova.compute.manager [req-a4511f75-a9e6-4e05-b150-4226b109d968 - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:09:07.617 4088 3038338907128 MainThread DEBUG os_win.utils.jobutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Waiting for WMI job: {'InstanceID': '5FDA3E91-E0DA-4744-8509-E7CF4A86F98D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15910), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:09:07.774 4088 3038338907128 MainThread ERROR os_win.utils.jobutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006e\' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)instance-0000006e52F6348F-EB4F-4E70-8096-34DCB0D9484512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)instance-0000006e52F6348F-EB4F-4E70-8096-34DCB0D9484510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)instance-0000006e52F6348F-EB4F-4E70-8096-34DCB0D94845%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5FDA3E91-E0DA-4744-8509-E7CF4A86F98D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115743), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 9, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 9, 7), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006e' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)\n\nNot enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)\n\n'instance-0000006e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845)", 'ErrorSummaryDescription': "'instance-0000006e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:09:07.774 4088 3038338907128 MainThread ERROR nova.virt.hyperv.vmops [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Failed to change vm state of instance-0000006e to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000006e' failed to start. 2021-09-10 17:09:07.774 4088 3038338907128 MainThread INFO nova.virt.hyperv.vmops [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Got request to destroy instance 2021-09-10 17:09:07.805 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:07.805 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:07.805 4088 3038296677544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:09:07.805 4088 3038296677544 MainThread INFO nova.compute.manager [-] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] VM Stopped (Lifecycle Event) 2021-09-10 17:09:07.843 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-8240f1f5-c7b5-4e66-b508-0e67eb5a8aca - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:09:07.843 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-8240f1f5-c7b5-4e66-b508-0e67eb5a8aca - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:09:07.905 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-4632bfea-a054-4ad1-afc1-5980da027e58 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Received event network-vif-plugged-8f21ce3f-9459-4e6f-9f64-9dcc79feb3ba external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:09:07.905 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-4632bfea-a054-4ad1-afc1-5980da027e58 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "92438189-b8db-4465-b432-47722bf0d84c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:07.905 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [req-4632bfea-a054-4ad1-afc1-5980da027e58 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "92438189-b8db-4465-b432-47722bf0d84c-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:07.905 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-4632bfea-a054-4ad1-afc1-5980da027e58 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Processing event network-vif-plugged-8f21ce3f-9459-4e6f-9f64-9dcc79feb3ba _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:09:07.905 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-8240f1f5-c7b5-4e66-b508-0e67eb5a8aca - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:09:07.937 4088 3038296677544 MainThread INFO nova.compute.manager [req-8240f1f5-c7b5-4e66-b508-0e67eb5a8aca - - - - -] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:09:07.948 4088 3038296678248 MainThread INFO nova.virt.hyperv.vmops [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Using config drive for instance 2021-09-10 17:09:08.497 4088 3038296678248 MainThread INFO nova.virt.hyperv.vmops [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Creating config drive at C:\openstack\instances\instance-0000006f\configdrive.iso 2021-09-10 17:09:08.587 4088 3038296678248 MainThread DEBUG oslo_concurrency.processutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000006f\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmphm9pvkhn execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:09:08.900 4088 3038296678248 MainThread DEBUG oslo_concurrency.processutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000006f\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmphm9pvkhn" returned: 0 in 0.313s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:09:09.431 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Setting boot order for instance: instance-0000006f: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:09:09.546 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:09:09.571 4088 3038296678248 MainThread DEBUG os_win.utils.jobutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Waiting for WMI job: {'InstanceID': 'DB8F87D4-5DCD-43B3-8A8C-6F90A8EB5287', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15342), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:09:09.727 4088 3038296678248 MainThread ERROR os_win.utils.jobutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006f\' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)instance-0000006f6050CF18-4F92-48C4-AEF8-D52090EED65812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)instance-0000006f6050CF18-4F92-48C4-AEF8-D52090EED65810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)instance-0000006f6050CF18-4F92-48C4-AEF8-D52090EED658%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'DB8F87D4-5DCD-43B3-8A8C-6F90A8EB5287', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=122075), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 9, 9), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 9, 9), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006f' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)\n\nNot enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)\n\n'instance-0000006f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)", 'ErrorSummaryDescription': "'instance-0000006f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:09:09.727 4088 3038296678248 MainThread DEBUG os_win._utils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006f' failed to start. Not enough memory in the system to start the virtual machine instance-0000006f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006f' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Not enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) 'instance-0000006f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18122291564941406 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:09:09.760 4088 3038296677544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:09:09.760 4088 3038296677544 MainThread INFO nova.compute.manager [-] [instance: 92438189-b8db-4465-b432-47722bf0d84c] VM Stopped (Lifecycle Event) 2021-09-10 17:09:09.760 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:09.760 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:09.790 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-4375aa8a-a177-4ae5-8a5b-6f9c1f7accc8 - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:09:09.790 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-4375aa8a-a177-4ae5-8a5b-6f9c1f7accc8 - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:09:09.843 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-4375aa8a-a177-4ae5-8a5b-6f9c1f7accc8 - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:09:09.869 4088 3038296677544 MainThread INFO nova.compute.manager [req-4375aa8a-a177-4ae5-8a5b-6f9c1f7accc8 - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:09:09.969 4088 3038338907128 MainThread DEBUG nova.virt.hyperv.vmops [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:09:09.979 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Lock "instance-0000006e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:09.979 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Lock "instance-0000006e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:09.979 4088 3038338907128 MainThread DEBUG os_win.utils.compute.vmutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Successfully changed vm state of instance-0000006e to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:09:09.979 4088 3038338907128 MainThread DEBUG nova.virt.hyperv.vmops [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Successfully changed state of VM instance-0000006e to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:09:10.046 4088 3038338907128 MainThread DEBUG os_win.utils.jobutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Waiting for WMI job: {'InstanceID': 'EAB0586E-53D6-41DA-9D55-7CFAD87A8FB6', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17174), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:09:10.171 4088 3038338907128 MainThread DEBUG os_win.utils.jobutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] WMI job succeeded: {'InstanceID': 'EAB0586E-53D6-41DA-9D55-7CFAD87A8FB6', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=130561), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:09:10.171 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Lock "instance-0000006e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:10.171 4088 3038338907128 MainThread DEBUG os_win.utils.pathutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Removing directory: C:\openstack\instances\instance-0000006e check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:09:10.171 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Lock "instance-0000006e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:10.171 4088 3038338907128 MainThread ERROR nova.compute.manager [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006e' failed to start. Not enough memory in the system to start the virtual machine instance-0000006e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006e' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Not enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) 'instance-0000006e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Error code: 32778. 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Traceback (most recent call last): 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] return function(*args, **kwargs) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] admin_password, network_info, block_device_info) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] return function(self, *args, **kwds) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self.force_reraise() 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] raise self.value 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] should_plug_vifs=False) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 'req_state': req_state}) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self.force_reraise() 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] raise self.value 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] time.sleep(sleep_time) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self.force_reraise() 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] raise self.value 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] return f(*args, **kwargs) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] return self._wait_for_job(job_path) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] error_desc=err_desc) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000006e' failed to start. 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Not enough memory in the system to start the virtual machine instance-0000006e. 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006e' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Not enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 'instance-0000006e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Error code: 32778. 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] During handling of the above exception, another exception occurred: 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Traceback (most recent call last): 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] yield resources 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] accel_info=accel_info) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] return function(*args, **kwargs) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] admin_password, network_info, block_device_info) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] return function(self, *args, **kwds) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self.force_reraise() 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] raise self.value 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] should_plug_vifs=False) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 'req_state': req_state}) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self.force_reraise() 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] raise self.value 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] time.sleep(sleep_time) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self.force_reraise() 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] raise self.value 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] return f(*args, **kwargs) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] return self._wait_for_job(job_path) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] error_desc=err_desc) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006e' failed to start. 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Not enough memory in the system to start the virtual machine instance-0000006e. 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006e' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Not enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 'instance-0000006e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Error code: 32778. 2021-09-10 17:09:10.171 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.193 4088 3038338907128 MainThread INFO nova.compute.manager [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Terminating instance 2021-09-10 17:09:10.193 4088 3038338907128 MainThread DEBUG nova.compute.manager [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:09:10.193 4088 3038338907128 MainThread INFO nova.virt.hyperv.vmops [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Got request to destroy instance 2021-09-10 17:09:10.202 4088 3038338907128 MainThread DEBUG nova.virt.hyperv.vmops [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:09:10.202 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Lock "instance-0000006e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:10.202 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Lock "instance-0000006e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:10.202 4088 3038338907128 MainThread INFO nova.compute.manager [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Took 0.00 seconds to destroy the instance on the hypervisor. 2021-09-10 17:09:10.202 4088 3038338907128 MainThread DEBUG nova.compute.claims [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:09:10.202 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:10.400 4088 3038338907128 MainThread DEBUG nova.virt.hyperv.hostops [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:09:10.400 4088 3038338907128 MainThread DEBUG nova.virt.hyperv.hostops [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:09:10.634 4088 3038338907128 MainThread DEBUG nova.compute.provider_tree [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:09:10.634 4088 3038338907128 MainThread DEBUG nova.scheduler.client.report [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:09:10.634 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.437s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:10.634 4088 3038338907128 MainThread ERROR nova.compute.manager [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006e' failed to start. Not enough memory in the system to start the virtual machine instance-0000006e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006e' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Not enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) 'instance-0000006e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Error code: 32778. 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Traceback (most recent call last): 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] return function(*args, **kwargs) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] admin_password, network_info, block_device_info) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] return function(self, *args, **kwds) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self.force_reraise() 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] raise self.value 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] should_plug_vifs=False) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 'req_state': req_state}) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self.force_reraise() 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] raise self.value 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] time.sleep(sleep_time) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self.force_reraise() 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] raise self.value 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] return f(*args, **kwargs) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] return self._wait_for_job(job_path) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] error_desc=err_desc) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000006e' failed to start. 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Not enough memory in the system to start the virtual machine instance-0000006e. 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006e' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Not enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 'instance-0000006e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Error code: 32778. 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] During handling of the above exception, another exception occurred: 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Traceback (most recent call last): 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] accel_info=accel_info) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] return function(*args, **kwargs) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] admin_password, network_info, block_device_info) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] return function(self, *args, **kwds) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self.force_reraise() 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] raise self.value 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] should_plug_vifs=False) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 'req_state': req_state}) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self.force_reraise() 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] raise self.value 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] time.sleep(sleep_time) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self.force_reraise() 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] raise self.value 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] return f(*args, **kwargs) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] return self._wait_for_job(job_path) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] error_desc=err_desc) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006e' failed to start. 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Not enough memory in the system to start the virtual machine instance-0000006e. 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006e' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Not enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 'instance-0000006e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Error code: 32778. 2021-09-10 17:09:10.634 4088 3038338907128 MainThread TRACE nova.compute.manager [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] 2021-09-10 17:09:10.634 4088 3038338907128 MainThread DEBUG nova.compute.utils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] WMI job failed with status 10. Error summary description: 'instance-0000006e' failed to start. Not enough memory in the system to start the virtual machine instance-0000006e. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:09:10.634 4088 3038338907128 MainThread DEBUG nova.compute.manager [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Build of instance 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000006e' failed to start. Not enough memory in the system to start the virtual machine instance-0000006e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006e' failed to start. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Not enough memory in the system to start the virtual machine instance-0000006e with ram size 1024 megabytes. (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) 'instance-0000006e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 52F6348F-EB4F-4E70-8096-34DCB0D94845) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:09:10.664 4088 3038338907128 MainThread DEBUG nova.compute.manager [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:09:10.664 4088 3038338907128 MainThread DEBUG nova.compute.manager [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:09:10.664 4088 3038338907128 MainThread DEBUG nova.compute.manager [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:09:10.664 4088 3038338907128 MainThread DEBUG nova.network.neutron [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:09:10.745 4088 3038296678248 MainThread DEBUG os_win.utils.jobutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Waiting for WMI job: {'InstanceID': 'B6170FB4-5F46-471F-A79E-E9AFA4534754', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15553), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:09:10.884 4088 3038296678248 MainThread ERROR os_win.utils.jobutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006f\' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)instance-0000006f6050CF18-4F92-48C4-AEF8-D52090EED65812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)instance-0000006f6050CF18-4F92-48C4-AEF8-D52090EED65810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)instance-0000006f6050CF18-4F92-48C4-AEF8-D52090EED658%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B6170FB4-5F46-471F-A79E-E9AFA4534754', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115134), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 9, 10), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 9, 10), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006f' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)\n\nNot enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)\n\n'instance-0000006f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)", 'ErrorSummaryDescription': "'instance-0000006f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:09:10.884 4088 3038296678248 MainThread DEBUG os_win._utils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006f' failed to start. Not enough memory in the system to start the virtual machine instance-0000006f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006f' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Not enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) 'instance-0000006f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3380842208862305 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:09:10.931 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:10.931 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:10.931 4088 3038342255896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:09:10.931 4088 3038342255896 MainThread INFO nova.compute.manager [-] [instance: 92438189-b8db-4465-b432-47722bf0d84c] VM Stopped (Lifecycle Event) 2021-09-10 17:09:10.963 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-f9be5d57-5bc0-4bef-8aa7-7bd525bf8369 - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:09:10.963 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.vmops [req-f9be5d57-5bc0-4bef-8aa7-7bd525bf8369 - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:09:11.011 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-f9be5d57-5bc0-4bef-8aa7-7bd525bf8369 - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:09:11.056 4088 3038342255896 MainThread INFO nova.compute.manager [req-f9be5d57-5bc0-4bef-8aa7-7bd525bf8369 - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:09:11.907 4088 3038296678248 MainThread DEBUG os_win.utils.jobutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Waiting for WMI job: {'InstanceID': '234E00FB-5E53-4A08-B16B-1DB7295705BE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15157), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:09:12.071 4088 3038296678248 MainThread ERROR os_win.utils.jobutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006f\' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)instance-0000006f6050CF18-4F92-48C4-AEF8-D52090EED65812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)instance-0000006f6050CF18-4F92-48C4-AEF8-D52090EED65810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)instance-0000006f6050CF18-4F92-48C4-AEF8-D52090EED658%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '234E00FB-5E53-4A08-B16B-1DB7295705BE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115381), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 9, 11), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 9, 12), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006f' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)\n\nNot enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)\n\n'instance-0000006f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)", 'ErrorSummaryDescription': "'instance-0000006f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:09:12.071 4088 3038296678248 MainThread DEBUG os_win._utils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006f' failed to start. Not enough memory in the system to start the virtual machine instance-0000006f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006f' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Not enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) 'instance-0000006f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5255188941955566 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:09:12.071 4088 3038342255896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:09:12.071 4088 3038342255896 MainThread INFO nova.compute.manager [-] [instance: 92438189-b8db-4465-b432-47722bf0d84c] VM Stopped (Lifecycle Event) 2021-09-10 17:09:12.071 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:12.071 4088 3038342256424 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:12.105 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-22f3153e-acdf-4bab-890a-2cb67cd0ba98 - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:09:12.105 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.vmops [req-22f3153e-acdf-4bab-890a-2cb67cd0ba98 - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:09:12.169 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-22f3153e-acdf-4bab-890a-2cb67cd0ba98 - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:09:12.182 4088 3038342255896 MainThread INFO nova.compute.manager [req-22f3153e-acdf-4bab-890a-2cb67cd0ba98 - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:09:12.621 4088 3038338907128 MainThread DEBUG nova.network.neutron [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:09:12.664 4088 3038338907128 MainThread INFO nova.compute.manager [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] [instance: 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a] Took 2.00 seconds to deallocate network for instance. 2021-09-10 17:09:12.885 4088 3038338907128 MainThread INFO nova.scheduler.client.report [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Deleted allocations for instance 6e1d1124-996e-4d4c-80bd-1aab17ba5d1a 2021-09-10 17:09:12.922 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [req-7e465c70-92e6-4951-a03b-c6338d90a206 c63d410ca6d947fcba0acf004916fa12 203bf8c8ff8149d18d5c8dee127f7611 - default default] Lock "6e1d1124-996e-4d4c-80bd-1aab17ba5d1a" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 29.406s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:13.117 4088 3038296678248 MainThread DEBUG os_win.utils.jobutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Waiting for WMI job: {'InstanceID': 'E89F452E-15B7-4C6E-9325-F0E75AA92FB1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14880), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:09:13.266 4088 3038296678248 MainThread ERROR os_win.utils.jobutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006f\' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)instance-0000006f6050CF18-4F92-48C4-AEF8-D52090EED65812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)instance-0000006f6050CF18-4F92-48C4-AEF8-D52090EED65810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)instance-0000006f6050CF18-4F92-48C4-AEF8-D52090EED658%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E89F452E-15B7-4C6E-9325-F0E75AA92FB1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113113), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 9, 13), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 9, 13), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006f' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)\n\nNot enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)\n\n'instance-0000006f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)", 'ErrorSummaryDescription': "'instance-0000006f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:09:13.266 4088 3038296678248 MainThread DEBUG os_win._utils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006f' failed to start. Not enough memory in the system to start the virtual machine instance-0000006f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006f' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Not enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) 'instance-0000006f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.720879316329956 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:09:13.293 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:13.293 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:13.293 4088 3038338907128 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:09:13.293 4088 3038338907128 MainThread INFO nova.compute.manager [-] [instance: 92438189-b8db-4465-b432-47722bf0d84c] VM Stopped (Lifecycle Event) 2021-09-10 17:09:13.322 4088 3038338907128 MainThread DEBUG nova.compute.manager [req-ff881d01-2d4d-4cfa-b95b-14556f898daf - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:09:13.322 4088 3038338907128 MainThread DEBUG nova.virt.hyperv.vmops [req-ff881d01-2d4d-4cfa-b95b-14556f898daf - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:09:13.370 4088 3038338907128 MainThread DEBUG nova.compute.manager [req-ff881d01-2d4d-4cfa-b95b-14556f898daf - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:09:13.399 4088 3038338907128 MainThread INFO nova.compute.manager [req-ff881d01-2d4d-4cfa-b95b-14556f898daf - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:09:14.276 4088 3038296678248 MainThread DEBUG os_win.utils.jobutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Waiting for WMI job: {'InstanceID': '79EB1B1B-A8B8-421C-A663-C419D1FE5039', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16545), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:09:14.414 4088 3038296678248 MainThread ERROR os_win.utils.jobutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006f\' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)instance-0000006f6050CF18-4F92-48C4-AEF8-D52090EED65812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)instance-0000006f6050CF18-4F92-48C4-AEF8-D52090EED65810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)instance-0000006f6050CF18-4F92-48C4-AEF8-D52090EED658%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '79EB1B1B-A8B8-421C-A663-C419D1FE5039', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=122379), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 9, 14), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 9, 14), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006f' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)\n\nNot enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)\n\n'instance-0000006f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)", 'ErrorSummaryDescription': "'instance-0000006f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:09:14.414 4088 3038296678248 MainThread DEBUG os_win._utils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000006f' failed to start. Not enough memory in the system to start the virtual machine instance-0000006f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006f' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Not enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) 'instance-0000006f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.868859767913818 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:09:14.463 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:14.463 4088 3038342258184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:14.480 4088 3038338907128 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:09:14.480 4088 3038338907128 MainThread INFO nova.compute.manager [-] [instance: 92438189-b8db-4465-b432-47722bf0d84c] VM Stopped (Lifecycle Event) 2021-09-10 17:09:14.499 4088 3038338907128 MainThread DEBUG nova.compute.manager [req-80b67dd8-c27d-41c9-945a-d8794bf1e8fb - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:09:14.499 4088 3038338907128 MainThread DEBUG nova.virt.hyperv.vmops [req-80b67dd8-c27d-41c9-945a-d8794bf1e8fb - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:09:14.539 4088 3038338907128 MainThread DEBUG nova.compute.manager [req-80b67dd8-c27d-41c9-945a-d8794bf1e8fb - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:09:14.571 4088 3038338907128 MainThread INFO nova.compute.manager [req-80b67dd8-c27d-41c9-945a-d8794bf1e8fb - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:09:15.430 4088 3038296678248 MainThread DEBUG os_win.utils.jobutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Waiting for WMI job: {'InstanceID': '3C1F4713-3542-4CA3-B347-1820663B8215', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15141), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:09:15.586 4088 3038296678248 MainThread ERROR os_win.utils.jobutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] WMI job failed: {'RawErrors': (('124\'instance-0000006f\' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)instance-0000006f6050CF18-4F92-48C4-AEF8-D52090EED65812030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)instance-0000006f6050CF18-4F92-48C4-AEF8-D52090EED65810243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000006f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)instance-0000006f6050CF18-4F92-48C4-AEF8-D52090EED658%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3C1F4713-3542-4CA3-B347-1820663B8215', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119149), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 9, 15), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 9, 15), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000006f' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)\n\nNot enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)\n\n'instance-0000006f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658)", 'ErrorSummaryDescription': "'instance-0000006f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000006f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:09:15.586 4088 3038296678248 MainThread ERROR nova.virt.hyperv.vmops [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Failed to change vm state of instance-0000006f to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000006f' failed to start. 2021-09-10 17:09:15.586 4088 3038296678248 MainThread INFO nova.virt.hyperv.vmops [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Got request to destroy instance 2021-09-10 17:09:15.642 4088 3038296677544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:09:15.642 4088 3038296677544 MainThread INFO nova.compute.manager [-] [instance: 92438189-b8db-4465-b432-47722bf0d84c] VM Stopped (Lifecycle Event) 2021-09-10 17:09:15.642 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:15.642 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000006f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:15.665 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-bc240baf-3e1b-4fc5-899f-740af8a76374 - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:09:15.665 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-bc240baf-3e1b-4fc5-899f-740af8a76374 - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:09:15.713 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-bc240baf-3e1b-4fc5-899f-740af8a76374 - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:09:15.751 4088 3038296677544 MainThread INFO nova.compute.manager [req-bc240baf-3e1b-4fc5-899f-740af8a76374 - - - - -] [instance: 92438189-b8db-4465-b432-47722bf0d84c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:09:17.542 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:09:17.542 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "instance-0000006f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:17.542 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "instance-0000006f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:17.556 4088 3038296678248 MainThread DEBUG os_win.utils.compute.vmutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Successfully changed vm state of instance-0000006f to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:09:17.556 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Successfully changed state of VM instance-0000006f to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:09:17.605 4088 3038296678248 MainThread DEBUG os_win.utils.jobutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Waiting for WMI job: {'InstanceID': '5990748F-DC74-4A4C-B56F-7B821A38DD52', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15362), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:09:17.719 4088 3038296678248 MainThread DEBUG os_win.utils.jobutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] WMI job succeeded: {'InstanceID': '5990748F-DC74-4A4C-B56F-7B821A38DD52', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=125634), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:09:17.719 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "instance-0000006f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:17.719 4088 3038296678248 MainThread DEBUG os_win.utils.pathutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Removing directory: C:\openstack\instances\instance-0000006f check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:09:17.719 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "instance-0000006f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:17.719 4088 3038296678248 MainThread ERROR nova.compute.manager [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006f' failed to start. Not enough memory in the system to start the virtual machine instance-0000006f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006f' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Not enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) 'instance-0000006f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Error code: 32778. 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] Traceback (most recent call last): 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] return function(*args, **kwargs) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] admin_password, network_info, block_device_info) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] return function(self, *args, **kwds) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self.force_reraise() 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] raise self.value 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] should_plug_vifs=False) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 'req_state': req_state}) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self.force_reraise() 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] raise self.value 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] time.sleep(sleep_time) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self.force_reraise() 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] raise self.value 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] return f(*args, **kwargs) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] return self._wait_for_job(job_path) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] error_desc=err_desc) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000006f' failed to start. 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] Not enough memory in the system to start the virtual machine instance-0000006f. 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006f' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] Not enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 'instance-0000006f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Error code: 32778. 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] During handling of the above exception, another exception occurred: 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] Traceback (most recent call last): 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] yield resources 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] accel_info=accel_info) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] return function(*args, **kwargs) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] admin_password, network_info, block_device_info) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] return function(self, *args, **kwds) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self.force_reraise() 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] raise self.value 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] should_plug_vifs=False) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 'req_state': req_state}) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self.force_reraise() 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] raise self.value 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] time.sleep(sleep_time) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self.force_reraise() 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] raise self.value 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] return f(*args, **kwargs) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] return self._wait_for_job(job_path) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] error_desc=err_desc) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006f' failed to start. 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] Not enough memory in the system to start the virtual machine instance-0000006f. 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006f' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] Not enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 'instance-0000006f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Error code: 32778. 2021-09-10 17:09:17.719 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:17.719 4088 3038296678248 MainThread INFO nova.compute.manager [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Terminating instance 2021-09-10 17:09:17.719 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:09:17.719 4088 3038296678248 MainThread INFO nova.virt.hyperv.vmops [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Got request to destroy instance 2021-09-10 17:09:17.749 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:09:17.749 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "instance-0000006f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:17.749 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "instance-0000006f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:17.749 4088 3038296678248 MainThread INFO nova.compute.manager [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:09:17.749 4088 3038296678248 MainThread DEBUG nova.compute.claims [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:09:17.749 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:17.885 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.hostops [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:09:17.899 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.hostops [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:09:18.110 4088 3038296678248 MainThread DEBUG nova.compute.provider_tree [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:09:18.135 4088 3038296678248 MainThread DEBUG nova.scheduler.client.report [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:09:18.135 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.391s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:18.135 4088 3038296678248 MainThread ERROR nova.compute.manager [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006f' failed to start. Not enough memory in the system to start the virtual machine instance-0000006f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006f' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Not enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) 'instance-0000006f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Error code: 32778. 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] Traceback (most recent call last): 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] return function(*args, **kwargs) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] admin_password, network_info, block_device_info) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] return function(self, *args, **kwds) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self.force_reraise() 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] raise self.value 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] should_plug_vifs=False) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 'req_state': req_state}) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self.force_reraise() 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] raise self.value 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] time.sleep(sleep_time) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self.force_reraise() 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] raise self.value 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] return f(*args, **kwargs) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] return self._wait_for_job(job_path) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] error_desc=err_desc) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000006f' failed to start. 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] Not enough memory in the system to start the virtual machine instance-0000006f. 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006f' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] Not enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 'instance-0000006f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Error code: 32778. 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] During handling of the above exception, another exception occurred: 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] Traceback (most recent call last): 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] accel_info=accel_info) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] return function(*args, **kwargs) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] admin_password, network_info, block_device_info) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] return function(self, *args, **kwds) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self.force_reraise() 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] raise self.value 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] should_plug_vifs=False) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 'req_state': req_state}) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self.force_reraise() 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] raise self.value 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] time.sleep(sleep_time) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self.force_reraise() 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] raise self.value 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] return f(*args, **kwargs) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] return self._wait_for_job(job_path) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] error_desc=err_desc) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000006f' failed to start. 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] Not enough memory in the system to start the virtual machine instance-0000006f. 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006f' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] Not enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 'instance-0000006f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Error code: 32778. 2021-09-10 17:09:18.135 4088 3038296678248 MainThread TRACE nova.compute.manager [instance: 92438189-b8db-4465-b432-47722bf0d84c] 2021-09-10 17:09:18.135 4088 3038296678248 MainThread DEBUG nova.compute.utils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] WMI job failed with status 10. Error summary description: 'instance-0000006f' failed to start. Not enough memory in the system to start the virtual machine instance-0000006f. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:09:18.135 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Build of instance 92438189-b8db-4465-b432-47722bf0d84c was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000006f' failed to start. Not enough memory in the system to start the virtual machine instance-0000006f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000006f' failed to start. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Not enough memory in the system to start the virtual machine instance-0000006f with ram size 1024 megabytes. (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) 'instance-0000006f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6050CF18-4F92-48C4-AEF8-D52090EED658) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:09:18.135 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:09:18.135 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:09:18.135 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:09:18.135 4088 3038296678248 MainThread DEBUG nova.network.neutron [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:09:20.168 4088 3038296678248 MainThread DEBUG nova.network.neutron [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:09:20.196 4088 3038296678248 MainThread INFO nova.compute.manager [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 92438189-b8db-4465-b432-47722bf0d84c] Took 2.06 seconds to deallocate network for instance. 2021-09-10 17:09:20.501 4088 3038296678248 MainThread INFO nova.scheduler.client.report [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Deleted allocations for instance 92438189-b8db-4465-b432-47722bf0d84c 2021-09-10 17:09:20.556 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-de8cde5f-035f-44e3-8527-8057c740c302 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "92438189-b8db-4465-b432-47722bf0d84c" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 27.375s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:31.934 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Lock "6932cca3-947d-4279-bafa-391b541d7d9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:31.971 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:09:32.164 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:32.164 4088 3038296677544 MainThread DEBUG nova.virt.hardware [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:09:32.164 4088 3038296677544 MainThread INFO nova.compute.claims [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Claim successful on node n-h2-808474-1 2021-09-10 17:09:32.408 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.hostops [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:09:32.421 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.hostops [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:09:32.634 4088 3038296677544 MainThread DEBUG nova.compute.provider_tree [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:09:32.634 4088 3038296677544 MainThread DEBUG nova.scheduler.client.report [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:09:32.634 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:32.634 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:09:32.776 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:09:32.776 4088 3038296623592 GreenThread-102 DEBUG nova.compute.manager [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:09:32.776 4088 3038296623592 GreenThread-102 DEBUG nova.network.neutron [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:09:32.980 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:09:32.980 4088 3038296677544 MainThread INFO nova.virt.hyperv.vmops [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Spawning new instance 2021-09-10 17:09:33.007 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Lock "instance-00000070" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:33.009 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Lock "instance-00000070" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:33.009 4088 3038296677544 MainThread DEBUG nova.block_device [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:09:33.009 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:33.009 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:33.009 4088 3038296677544 MainThread DEBUG os_win.utils.pathutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Creating directory: C:\openstack\instances\instance-00000070 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:09:33.009 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000070\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:09:33.215 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Resizing VHD C:\openstack\instances\instance-00000070\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:09:33.402 4088 3038296623592 GreenThread-102 DEBUG nova.policy [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d3b9159333f49ce9b3eb8da13bb8c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacc6af2801d4a19904b570d39d5bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:09:36.954 4088 3038296623592 GreenThread-102 DEBUG nova.network.neutron [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Successfully created port: 66e0bcac-0438-42b2-9906-e2b641a45ba9 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:09:39.945 4088 3038296623592 GreenThread-102 DEBUG nova.network.neutron [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Successfully updated port: 66e0bcac-0438-42b2-9906-e2b641a45ba9 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:09:39.978 4088 3038296623592 GreenThread-102 DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Acquired lock "refresh_cache-6932cca3-947d-4279-bafa-391b541d7d9c" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:09:39.978 4088 3038296623592 GreenThread-102 DEBUG nova.network.neutron [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:09:40.054 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-8550fe8d-6f96-48ba-bb24-ef5ed7138c4e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Received event network-changed-66e0bcac-0438-42b2-9906-e2b641a45ba9 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:09:40.054 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-8550fe8d-6f96-48ba-bb24-ef5ed7138c4e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Refreshing instance network info cache due to event network-changed-66e0bcac-0438-42b2-9906-e2b641a45ba9. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:09:40.350 4088 3038296623592 GreenThread-102 DEBUG nova.network.neutron [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:09:42.756 4088 3038296623592 GreenThread-102 DEBUG nova.network.neutron [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Updating instance_info_cache with network_info: [{"id": "66e0bcac-0438-42b2-9906-e2b641a45ba9", "address": "fa:16:3e:73:4d:bb", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap66e0bcac-04", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:09:42.776 4088 3038296623592 GreenThread-102 DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Releasing lock "refresh_cache-6932cca3-947d-4279-bafa-391b541d7d9c" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:09:42.776 4088 3038296623592 GreenThread-102 DEBUG nova.compute.manager [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Instance network_info: |[{"id": "66e0bcac-0438-42b2-9906-e2b641a45ba9", "address": "fa:16:3e:73:4d:bb", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap66e0bcac-04", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:09:42.803 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-8550fe8d-6f96-48ba-bb24-ef5ed7138c4e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-6932cca3-947d-4279-bafa-391b541d7d9c" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:09:42.803 4088 3038342258008 MainThread DEBUG nova.network.neutron [req-8550fe8d-6f96-48ba-bb24-ef5ed7138c4e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Refreshing network info cache for port 66e0bcac-0438-42b2-9906-e2b641a45ba9 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:09:42.803 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Preparing to wait for external event network-vif-plugged-66e0bcac-0438-42b2-9906-e2b641a45ba9 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:09:42.803 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Lock "6932cca3-947d-4279-bafa-391b541d7d9c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:42.803 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Lock "6932cca3-947d-4279-bafa-391b541d7d9c-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:42.803 4088 3038296677544 MainThread DEBUG os_win.utils.compute.vmutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Creating VM instance-00000070 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:09:44.476 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:09:45.570 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:09:45.642 4088 3038342258008 MainThread DEBUG nova.network.neutron [req-8550fe8d-6f96-48ba-bb24-ef5ed7138c4e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Updated VIF entry in instance network info cache for port 66e0bcac-0438-42b2-9906-e2b641a45ba9. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:09:45.642 4088 3038342258008 MainThread DEBUG nova.network.neutron [req-8550fe8d-6f96-48ba-bb24-ef5ed7138c4e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Updating instance_info_cache with network_info: [{"id": "66e0bcac-0438-42b2-9906-e2b641a45ba9", "address": "fa:16:3e:73:4d:bb", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap66e0bcac-04", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:09:45.663 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-8550fe8d-6f96-48ba-bb24-ef5ed7138c4e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-6932cca3-947d-4279-bafa-391b541d7d9c" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:09:46.537 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:09:46.537 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:09:48.522 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:09:49.524 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:09:52.519 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:09:52.519 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:09:53.535 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:09:53.535 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:09:53.535 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9342 2021-09-10 17:09:53.691 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Skipping network cache update for instance because it is Building. _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9352 2021-09-10 17:09:54.054 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-18930e09-cd62-4d3e-b27f-e9541dfa3efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:09:54.054 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:09:54.054 4088 3038296676664 GreenThread-2 DEBUG nova.objects.instance [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lazy-loading 'info_cache' on Instance uuid 18930e09-cd62-4d3e-b27f-e9541dfa3efc obj_load_attr c:\openstack\build\nova\nova\objects\instance.py:1101 2021-09-10 17:09:55.245 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-5964e938-17aa-4954-85a3-77e69b11a7ef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Received event network-vif-plugged-66e0bcac-0438-42b2-9906-e2b641a45ba9 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:09:55.245 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-5964e938-17aa-4954-85a3-77e69b11a7ef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "6932cca3-947d-4279-bafa-391b541d7d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:55.245 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [req-5964e938-17aa-4954-85a3-77e69b11a7ef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "6932cca3-947d-4279-bafa-391b541d7d9c-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:55.245 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-5964e938-17aa-4954-85a3-77e69b11a7ef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Processing event network-vif-plugged-66e0bcac-0438-42b2-9906-e2b641a45ba9 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:09:55.308 4088 3038296677544 MainThread INFO nova.virt.hyperv.vmops [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Using config drive for instance 2021-09-10 17:09:55.928 4088 3038296677544 MainThread INFO nova.virt.hyperv.vmops [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Creating config drive at C:\openstack\instances\instance-00000070\configdrive.iso 2021-09-10 17:09:56.007 4088 3038296677544 MainThread DEBUG oslo_concurrency.processutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000070\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp742jl_2v execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:09:56.370 4088 3038296677544 MainThread DEBUG oslo_concurrency.processutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000070\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp742jl_2v" returned: 0 in 0.359s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:09:56.898 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Setting boot order for instance: instance-00000070: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:09:56.987 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:09:57.024 4088 3038296677544 MainThread DEBUG os_win.utils.jobutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Waiting for WMI job: {'InstanceID': '25C1B443-45C5-4351-86FF-94154CF1E727', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16477), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:09:57.168 4088 3038296677544 MainThread ERROR os_win.utils.jobutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000070\' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)instance-000000704774B2FC-50C3-4C3A-AB03-06E0570CEA2C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)instance-000000704774B2FC-50C3-4C3A-AB03-06E0570CEA2C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000070\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)instance-000000704774B2FC-50C3-4C3A-AB03-06E0570CEA2C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '25C1B443-45C5-4351-86FF-94154CF1E727', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116006), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 9, 56), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 9, 57), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000070' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)\n\nNot enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)\n\n'instance-00000070' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)", 'ErrorSummaryDescription': "'instance-00000070' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000070.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:09:57.168 4088 3038296677544 MainThread DEBUG os_win._utils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000070' failed to start. Not enough memory in the system to start the virtual machine instance-00000070. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000070' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Not enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) 'instance-00000070' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1809389591217041 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:09:57.191 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000070" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:57.191 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000070" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:57.191 4088 3038296678072 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:09:57.191 4088 3038296678072 MainThread INFO nova.compute.manager [-] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] VM Stopped (Lifecycle Event) 2021-09-10 17:09:57.222 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-ea743c7e-a094-4c74-a543-566d0246b366 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:09:57.222 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-ea743c7e-a094-4c74-a543-566d0246b366 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:09:57.269 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-ea743c7e-a094-4c74-a543-566d0246b366 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:09:57.323 4088 3038296678072 MainThread INFO nova.compute.manager [req-ea743c7e-a094-4c74-a543-566d0246b366 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:09:58.182 4088 3038296677544 MainThread DEBUG os_win.utils.jobutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Waiting for WMI job: {'InstanceID': 'A25860EE-90C1-4EE1-BD42-0888B38DB2EE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15519), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:09:58.338 4088 3038296677544 MainThread ERROR os_win.utils.jobutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000070\' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)instance-000000704774B2FC-50C3-4C3A-AB03-06E0570CEA2C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)instance-000000704774B2FC-50C3-4C3A-AB03-06E0570CEA2C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000070\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)instance-000000704774B2FC-50C3-4C3A-AB03-06E0570CEA2C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A25860EE-90C1-4EE1-BD42-0888B38DB2EE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=123352), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 9, 58), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 9, 58), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000070' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)\n\nNot enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)\n\n'instance-00000070' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)", 'ErrorSummaryDescription': "'instance-00000070' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000070.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:09:58.338 4088 3038296677544 MainThread DEBUG os_win._utils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000070' failed to start. Not enough memory in the system to start the virtual machine instance-00000070. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000070' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Not enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) 'instance-00000070' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3505334854125977 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:09:58.391 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000070" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:58.391 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000070" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:58.391 4088 3038296678072 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:09:58.391 4088 3038296678072 MainThread INFO nova.compute.manager [-] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] VM Stopped (Lifecycle Event) 2021-09-10 17:09:58.429 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-6381fbd4-2d59-454b-9541-adcb68f2c209 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:09:58.429 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [req-6381fbd4-2d59-454b-9541-adcb68f2c209 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:09:58.475 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-6381fbd4-2d59-454b-9541-adcb68f2c209 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:09:58.508 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Updating instance_info_cache with network_info: [{"id": "829c891f-1877-4967-a719-113170bb7add", "address": "fa:16:3e:5d:ef:74", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap829c891f-18", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:09:58.524 4088 3038296678072 MainThread INFO nova.compute.manager [req-6381fbd4-2d59-454b-9541-adcb68f2c209 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:09:58.550 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-18930e09-cd62-4d3e-b27f-e9541dfa3efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:09:58.550 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:09:58.553 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:09:58.553 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:09:58.571 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:58.571 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:58.571 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:09:58.571 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:09:58.571 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:09:58.805 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2218MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:09:58.805 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:59.057 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:09:59.057 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:09:59.070 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:09:59.070 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:09:59.070 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:09:59.070 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:09:59.070 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:09:59.070 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:09:59.070 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:09:59.070 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:09:59.070 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:09:59.070 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:09:59.070 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:09:59.070 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6932cca3-947d-4279-bafa-391b541d7d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:09:59.070 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:09:59.070 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=14GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:09:59.118 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:09:59.133 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:09:59.347 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:09:59.363 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:09:59.363 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:09:59.363 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:59.371 4088 3038296677544 MainThread DEBUG os_win.utils.jobutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Waiting for WMI job: {'InstanceID': '2F7F23D6-B24C-4A4B-B796-5A04ABDB5167', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17330), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:09:59.525 4088 3038296677544 MainThread ERROR os_win.utils.jobutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000070\' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)instance-000000704774B2FC-50C3-4C3A-AB03-06E0570CEA2C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)instance-000000704774B2FC-50C3-4C3A-AB03-06E0570CEA2C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000070\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)instance-000000704774B2FC-50C3-4C3A-AB03-06E0570CEA2C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '2F7F23D6-B24C-4A4B-B796-5A04ABDB5167', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113143), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 9, 59), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 9, 59), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000070' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)\n\nNot enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)\n\n'instance-00000070' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)", 'ErrorSummaryDescription': "'instance-00000070' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000070.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:09:59.525 4088 3038296677544 MainThread DEBUG os_win._utils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000070' failed to start. Not enough memory in the system to start the virtual machine instance-00000070. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000070' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Not enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) 'instance-00000070' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.537795305252075 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:09:59.525 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000070" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:09:59.525 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000070" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:09:59.525 4088 3038296623592 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:09:59.525 4088 3038296623592 MainThread INFO nova.compute.manager [-] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] VM Stopped (Lifecycle Event) 2021-09-10 17:09:59.591 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-a92d7a0e-96c0-4751-9792-1e4ca47e0364 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:09:59.591 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-a92d7a0e-96c0-4751-9792-1e4ca47e0364 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:09:59.645 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-a92d7a0e-96c0-4751-9792-1e4ca47e0364 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:09:59.678 4088 3038296623592 MainThread INFO nova.compute.manager [req-a92d7a0e-96c0-4751-9792-1e4ca47e0364 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:10:00.558 4088 3038296677544 MainThread DEBUG os_win.utils.jobutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Waiting for WMI job: {'InstanceID': '572CB8EF-DBBA-4C85-8A6A-2B7E2579085F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15298), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:10:00.708 4088 3038296677544 MainThread ERROR os_win.utils.jobutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000070\' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)instance-000000704774B2FC-50C3-4C3A-AB03-06E0570CEA2C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)instance-000000704774B2FC-50C3-4C3A-AB03-06E0570CEA2C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000070\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)instance-000000704774B2FC-50C3-4C3A-AB03-06E0570CEA2C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '572CB8EF-DBBA-4C85-8A6A-2B7E2579085F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117073), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 10), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 10), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000070' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)\n\nNot enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)\n\n'instance-00000070' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)", 'ErrorSummaryDescription': "'instance-00000070' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000070.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:10:00.708 4088 3038296677544 MainThread DEBUG os_win._utils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000070' failed to start. Not enough memory in the system to start the virtual machine instance-00000070. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000070' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Not enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) 'instance-00000070' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.72074556350708 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:10:00.763 4088 3038296623592 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:10:00.763 4088 3038296623592 MainThread INFO nova.compute.manager [-] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] VM Stopped (Lifecycle Event) 2021-09-10 17:10:00.763 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000070" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:10:00.763 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000070" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:10:00.788 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-121033b3-973e-43a8-a082-1da995fe32d9 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:10:00.788 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-121033b3-973e-43a8-a082-1da995fe32d9 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:10:00.835 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-121033b3-973e-43a8-a082-1da995fe32d9 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:10:00.850 4088 3038296623592 MainThread INFO nova.compute.manager [req-121033b3-973e-43a8-a082-1da995fe32d9 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:10:01.743 4088 3038296677544 MainThread DEBUG os_win.utils.jobutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Waiting for WMI job: {'InstanceID': '2A780406-BE4D-4FF2-9F7C-F413EE91EED0', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19232), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:10:01.900 4088 3038296677544 MainThread ERROR os_win.utils.jobutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000070\' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)instance-000000704774B2FC-50C3-4C3A-AB03-06E0570CEA2C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)instance-000000704774B2FC-50C3-4C3A-AB03-06E0570CEA2C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000070\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)instance-000000704774B2FC-50C3-4C3A-AB03-06E0570CEA2C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '2A780406-BE4D-4FF2-9F7C-F413EE91EED0', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114852), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 10, 1), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 10, 1), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000070' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)\n\nNot enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)\n\n'instance-00000070' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)", 'ErrorSummaryDescription': "'instance-00000070' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000070.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:10:01.900 4088 3038296677544 MainThread DEBUG os_win._utils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000070' failed to start. Not enough memory in the system to start the virtual machine instance-00000070. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000070' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Not enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) 'instance-00000070' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.912691831588745 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:10:01.946 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000070" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:10:01.946 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000070" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:10:01.946 4088 3038296623592 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:10:01.946 4088 3038296623592 MainThread INFO nova.compute.manager [-] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] VM Stopped (Lifecycle Event) 2021-09-10 17:10:01.975 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-ebadbe1f-6186-4948-880c-17df14abac7b - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:10:01.975 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-ebadbe1f-6186-4948-880c-17df14abac7b - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:10:02.022 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-ebadbe1f-6186-4948-880c-17df14abac7b - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:10:02.053 4088 3038296623592 MainThread INFO nova.compute.manager [req-ebadbe1f-6186-4948-880c-17df14abac7b - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:10:02.939 4088 3038296677544 MainThread DEBUG os_win.utils.jobutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Waiting for WMI job: {'InstanceID': '6D926C6A-1211-4EE3-8B28-1EB4373351A9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16056), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:10:03.079 4088 3038296677544 MainThread ERROR os_win.utils.jobutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000070\' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)instance-000000704774B2FC-50C3-4C3A-AB03-06E0570CEA2C12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)instance-000000704774B2FC-50C3-4C3A-AB03-06E0570CEA2C10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000070\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)instance-000000704774B2FC-50C3-4C3A-AB03-06E0570CEA2C%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6D926C6A-1211-4EE3-8B28-1EB4373351A9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113141), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 10, 2), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 10, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000070' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)\n\nNot enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)\n\n'instance-00000070' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C)", 'ErrorSummaryDescription': "'instance-00000070' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000070.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:10:03.079 4088 3038296677544 MainThread ERROR nova.virt.hyperv.vmops [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Failed to change vm state of instance-00000070 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000070' failed to start. 2021-09-10 17:10:03.079 4088 3038296677544 MainThread INFO nova.virt.hyperv.vmops [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Got request to destroy instance 2021-09-10 17:10:03.118 4088 3038296623592 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:10:03.118 4088 3038296623592 MainThread INFO nova.compute.manager [-] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] VM Stopped (Lifecycle Event) 2021-09-10 17:10:03.118 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000070" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:10:03.118 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000070" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:10:03.147 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-ae1b4e77-8738-4871-b467-ba2bf5e97233 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:10:03.147 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-ae1b4e77-8738-4871-b467-ba2bf5e97233 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:10:03.195 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-ae1b4e77-8738-4871-b467-ba2bf5e97233 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:10:03.242 4088 3038296623592 MainThread INFO nova.compute.manager [req-ae1b4e77-8738-4871-b467-ba2bf5e97233 - - - - -] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:10:05.070 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:10:05.084 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Lock "instance-00000070" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:10:05.084 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Lock "instance-00000070" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:10:05.084 4088 3038296677544 MainThread DEBUG os_win.utils.compute.vmutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Successfully changed vm state of instance-00000070 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:10:05.101 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Successfully changed state of VM instance-00000070 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:10:05.134 4088 3038296677544 MainThread DEBUG os_win.utils.jobutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Waiting for WMI job: {'InstanceID': '1104B794-96C4-47DA-A7E7-E1A43773DE64', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15490), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:10:05.241 4088 3038296677544 MainThread DEBUG os_win.utils.jobutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] WMI job succeeded: {'InstanceID': '1104B794-96C4-47DA-A7E7-E1A43773DE64', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=106532), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:10:05.259 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Lock "instance-00000070" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:10:05.259 4088 3038296677544 MainThread DEBUG os_win.utils.pathutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Removing directory: C:\openstack\instances\instance-00000070 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:10:05.259 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Lock "instance-00000070" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:10:05.259 4088 3038296677544 MainThread ERROR nova.compute.manager [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000070' failed to start. Not enough memory in the system to start the virtual machine instance-00000070. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000070' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Not enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) 'instance-00000070' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Error code: 32778. 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Traceback (most recent call last): 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] return function(*args, **kwargs) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] admin_password, network_info, block_device_info) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] return function(self, *args, **kwds) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self.force_reraise() 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] raise self.value 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] should_plug_vifs=False) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 'req_state': req_state}) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self.force_reraise() 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] raise self.value 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] time.sleep(sleep_time) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self.force_reraise() 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] raise self.value 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] return f(*args, **kwargs) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] return self._wait_for_job(job_path) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] error_desc=err_desc) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000070' failed to start. 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Not enough memory in the system to start the virtual machine instance-00000070. 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000070' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Not enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 'instance-00000070' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Error code: 32778. 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] During handling of the above exception, another exception occurred: 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Traceback (most recent call last): 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] yield resources 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] accel_info=accel_info) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] return function(*args, **kwargs) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] admin_password, network_info, block_device_info) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] return function(self, *args, **kwds) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self.force_reraise() 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] raise self.value 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] should_plug_vifs=False) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 'req_state': req_state}) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self.force_reraise() 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] raise self.value 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] time.sleep(sleep_time) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self.force_reraise() 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] raise self.value 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] return f(*args, **kwargs) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] return self._wait_for_job(job_path) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] error_desc=err_desc) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000070' failed to start. 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Not enough memory in the system to start the virtual machine instance-00000070. 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000070' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Not enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 'instance-00000070' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Error code: 32778. 2021-09-10 17:10:05.259 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.259 4088 3038296677544 MainThread INFO nova.compute.manager [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Terminating instance 2021-09-10 17:10:05.259 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:10:05.259 4088 3038296677544 MainThread INFO nova.virt.hyperv.vmops [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Got request to destroy instance 2021-09-10 17:10:05.288 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:10:05.288 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Lock "instance-00000070" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:10:05.288 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Lock "instance-00000070" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:10:05.288 4088 3038296677544 MainThread INFO nova.compute.manager [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:10:05.288 4088 3038296677544 MainThread DEBUG nova.compute.claims [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:10:05.288 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:10:05.460 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.hostops [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:10:05.475 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.hostops [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:10:05.689 4088 3038296677544 MainThread DEBUG nova.compute.provider_tree [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:10:05.709 4088 3038296677544 MainThread DEBUG nova.scheduler.client.report [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:10:05.709 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:10:05.709 4088 3038296677544 MainThread ERROR nova.compute.manager [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000070' failed to start. Not enough memory in the system to start the virtual machine instance-00000070. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000070' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Not enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) 'instance-00000070' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Error code: 32778. 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Traceback (most recent call last): 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] return function(*args, **kwargs) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] admin_password, network_info, block_device_info) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] return function(self, *args, **kwds) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self.force_reraise() 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] raise self.value 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] should_plug_vifs=False) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 'req_state': req_state}) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self.force_reraise() 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] raise self.value 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] time.sleep(sleep_time) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self.force_reraise() 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] raise self.value 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] return f(*args, **kwargs) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] return self._wait_for_job(job_path) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] error_desc=err_desc) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000070' failed to start. 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Not enough memory in the system to start the virtual machine instance-00000070. 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000070' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Not enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 'instance-00000070' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Error code: 32778. 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] During handling of the above exception, another exception occurred: 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Traceback (most recent call last): 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] accel_info=accel_info) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] return function(*args, **kwargs) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] admin_password, network_info, block_device_info) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] return function(self, *args, **kwds) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self.force_reraise() 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] raise self.value 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] should_plug_vifs=False) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 'req_state': req_state}) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self.force_reraise() 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] raise self.value 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] time.sleep(sleep_time) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self.force_reraise() 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] raise self.value 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] return f(*args, **kwargs) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] return self._wait_for_job(job_path) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] error_desc=err_desc) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000070' failed to start. 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Not enough memory in the system to start the virtual machine instance-00000070. 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000070' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Not enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 'instance-00000070' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Error code: 32778. 2021-09-10 17:10:05.709 4088 3038296677544 MainThread TRACE nova.compute.manager [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] 2021-09-10 17:10:05.709 4088 3038296677544 MainThread DEBUG nova.compute.utils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] WMI job failed with status 10. Error summary description: 'instance-00000070' failed to start. Not enough memory in the system to start the virtual machine instance-00000070. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:10:05.709 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Build of instance 6932cca3-947d-4279-bafa-391b541d7d9c was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000070' failed to start. Not enough memory in the system to start the virtual machine instance-00000070. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000070' failed to start. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Not enough memory in the system to start the virtual machine instance-00000070 with ram size 1024 megabytes. (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) 'instance-00000070' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4774B2FC-50C3-4C3A-AB03-06E0570CEA2C) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:10:05.709 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:10:05.709 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:10:05.709 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:10:05.725 4088 3038296677544 MainThread DEBUG nova.network.neutron [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:10:07.932 4088 3038296677544 MainThread DEBUG nova.network.neutron [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:10:07.991 4088 3038296677544 MainThread INFO nova.compute.manager [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] [instance: 6932cca3-947d-4279-bafa-391b541d7d9c] Took 2.27 seconds to deallocate network for instance. 2021-09-10 17:10:08.228 4088 3038296677544 MainThread INFO nova.scheduler.client.report [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Deleted allocations for instance 6932cca3-947d-4279-bafa-391b541d7d9c 2021-09-10 17:10:08.271 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-feaaa612-de03-49c4-9474-8b5fcd86216d 2d3b9159333f49ce9b3eb8da13bb8c09 cacc6af2801d4a19904b570d39d5bf31 - default default] Lock "6932cca3-947d-4279-bafa-391b541d7d9c" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 36.344s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:10:35.708 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "9f6a1261-e291-45ef-a4fd-539e3f9f4044" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:10:35.763 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:10:36.037 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:10:36.053 4088 3038342258360 MainThread DEBUG nova.virt.hardware [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:10:36.053 4088 3038342258360 MainThread INFO nova.compute.claims [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Claim successful on node n-h2-808474-1 2021-09-10 17:10:36.320 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.hostops [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:10:36.335 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.hostops [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:10:36.537 4088 3038342258360 MainThread DEBUG nova.compute.provider_tree [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:10:36.571 4088 3038342258360 MainThread DEBUG nova.scheduler.client.report [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:10:36.571 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:10:36.571 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:10:36.756 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:10:36.756 4088 3038342257656 GreenThread-103 DEBUG nova.compute.manager [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:10:36.756 4088 3038342257656 GreenThread-103 DEBUG nova.network.neutron [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:10:37.036 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:10:37.051 4088 3038342258360 MainThread INFO nova.virt.hyperv.vmops [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Spawning new instance 2021-09-10 17:10:37.067 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "instance-00000071" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:10:37.067 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "instance-00000071" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:10:37.067 4088 3038342258360 MainThread DEBUG nova.block_device [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:10:37.067 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:10:37.067 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:10:37.084 4088 3038342258360 MainThread DEBUG os_win.utils.pathutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Creating directory: C:\openstack\instances\instance-00000071 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:10:37.084 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.vmops [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000071\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:10:37.319 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.vmops [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Resizing VHD C:\openstack\instances\instance-00000071\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:10:37.749 4088 3038342257656 GreenThread-103 DEBUG nova.policy [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '95e49dab1ffa48cfb40576e8646baad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ebc509414a41b9890ca144a70c816d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:10:42.115 4088 3038342257656 GreenThread-103 DEBUG nova.network.neutron [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Successfully created port: c997e14d-9a51-41ef-82ca-997491c1194d _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:10:45.010 4088 3038342257656 GreenThread-103 DEBUG nova.network.neutron [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Successfully updated port: c997e14d-9a51-41ef-82ca-997491c1194d _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:10:45.036 4088 3038342257656 GreenThread-103 DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Acquired lock "refresh_cache-9f6a1261-e291-45ef-a4fd-539e3f9f4044" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:10:45.036 4088 3038342257656 GreenThread-103 DEBUG nova.network.neutron [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:10:45.083 4088 3038342255192 MainThread DEBUG nova.compute.manager [req-684c8df9-3735-49f5-948c-14eba5eba281 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Received event network-changed-c997e14d-9a51-41ef-82ca-997491c1194d external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:10:45.083 4088 3038342255192 MainThread DEBUG nova.compute.manager [req-684c8df9-3735-49f5-948c-14eba5eba281 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Refreshing instance network info cache due to event network-changed-c997e14d-9a51-41ef-82ca-997491c1194d. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:10:45.271 4088 3038342257656 GreenThread-103 DEBUG nova.network.neutron [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:10:46.866 4088 3038342257656 GreenThread-103 DEBUG nova.network.neutron [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Updating instance_info_cache with network_info: [{"id": "c997e14d-9a51-41ef-82ca-997491c1194d", "address": "fa:16:3e:4f:a3:74", "network": {"id": "eb29e349-1649-4448-aead-199cc5a35342", "bridge": null, "label": "tempest-network-smoke--1956885507", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f4ebc509414a41b9890ca144a70c816d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapc997e14d-9a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:10:46.887 4088 3038342257656 GreenThread-103 DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Releasing lock "refresh_cache-9f6a1261-e291-45ef-a4fd-539e3f9f4044" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:10:46.887 4088 3038342257656 GreenThread-103 DEBUG nova.compute.manager [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Instance network_info: |[{"id": "c997e14d-9a51-41ef-82ca-997491c1194d", "address": "fa:16:3e:4f:a3:74", "network": {"id": "eb29e349-1649-4448-aead-199cc5a35342", "bridge": null, "label": "tempest-network-smoke--1956885507", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f4ebc509414a41b9890ca144a70c816d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapc997e14d-9a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:10:46.887 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [req-684c8df9-3735-49f5-948c-14eba5eba281 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-9f6a1261-e291-45ef-a4fd-539e3f9f4044" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:10:46.887 4088 3038342255192 MainThread DEBUG nova.network.neutron [req-684c8df9-3735-49f5-948c-14eba5eba281 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Refreshing network info cache for port c997e14d-9a51-41ef-82ca-997491c1194d _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:10:46.887 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Preparing to wait for external event network-vif-plugged-c997e14d-9a51-41ef-82ca-997491c1194d prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:10:46.887 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "9f6a1261-e291-45ef-a4fd-539e3f9f4044-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:10:46.887 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "9f6a1261-e291-45ef-a4fd-539e3f9f4044-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:10:46.887 4088 3038342258360 MainThread DEBUG os_win.utils.compute.vmutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Creating VM instance-00000071 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:10:47.332 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:10:48.474 4088 3038342255192 MainThread DEBUG nova.network.neutron [req-684c8df9-3735-49f5-948c-14eba5eba281 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Updated VIF entry in instance network info cache for port c997e14d-9a51-41ef-82ca-997491c1194d. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:10:48.474 4088 3038342255192 MainThread DEBUG nova.network.neutron [req-684c8df9-3735-49f5-948c-14eba5eba281 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Updating instance_info_cache with network_info: [{"id": "c997e14d-9a51-41ef-82ca-997491c1194d", "address": "fa:16:3e:4f:a3:74", "network": {"id": "eb29e349-1649-4448-aead-199cc5a35342", "bridge": null, "label": "tempest-network-smoke--1956885507", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f4ebc509414a41b9890ca144a70c816d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapc997e14d-9a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:10:48.474 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [req-684c8df9-3735-49f5-948c-14eba5eba281 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-9f6a1261-e291-45ef-a4fd-539e3f9f4044" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:10:48.523 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:10:48.523 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:10:48.582 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.vmops [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:10:50.518 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:10:51.517 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:10:53.519 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:10:53.599 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:10:53.599 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:10:54.551 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:10:55.525 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:10:55.525 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:10:55.961 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:10:55.961 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:10:56.745 4088 3038342256776 MainThread DEBUG nova.compute.manager [req-b7c85e94-81a5-4327-a784-3a3ccf3db25e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Received event network-vif-plugged-c997e14d-9a51-41ef-82ca-997491c1194d external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:10:56.745 4088 3038342256776 MainThread DEBUG oslo_concurrency.lockutils [req-b7c85e94-81a5-4327-a784-3a3ccf3db25e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9f6a1261-e291-45ef-a4fd-539e3f9f4044-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:10:56.745 4088 3038342256776 MainThread DEBUG oslo_concurrency.lockutils [req-b7c85e94-81a5-4327-a784-3a3ccf3db25e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "9f6a1261-e291-45ef-a4fd-539e3f9f4044-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:10:56.745 4088 3038342256776 MainThread DEBUG nova.compute.manager [req-b7c85e94-81a5-4327-a784-3a3ccf3db25e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Processing event network-vif-plugged-c997e14d-9a51-41ef-82ca-997491c1194d _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:10:56.777 4088 3038342258360 MainThread INFO nova.virt.hyperv.vmops [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Using config drive for instance 2021-09-10 17:10:57.507 4088 3038342258360 MainThread INFO nova.virt.hyperv.vmops [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Creating config drive at C:\openstack\instances\instance-00000071\configdrive.iso 2021-09-10 17:10:57.600 4088 3038342258360 MainThread DEBUG oslo_concurrency.processutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000071\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp40hkt1gp execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:10:57.961 4088 3038342258360 MainThread DEBUG oslo_concurrency.processutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000071\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp40hkt1gp" returned: 0 in 0.359s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:10:58.540 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Updating instance_info_cache with network_info: [{"id": "e94d3f34-4aa5-46a2-9cf3-221c28446067", "address": "fa:16:3e:bd:9b:a0", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape94d3f34-4a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:10:58.552 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.vmops [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Setting boot order for instance: instance-00000071: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:10:58.552 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:10:58.571 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:10:58.571 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:10:58.597 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:10:58.597 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:10:58.597 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:10:58.597 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:10:58.614 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:10:58.646 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.vmops [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:10:58.692 4088 3038342258360 MainThread DEBUG os_win.utils.jobutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Waiting for WMI job: {'InstanceID': '469E239D-F277-413A-9833-0789AEFD52F3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=29233), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:10:58.844 4088 3038342258360 MainThread ERROR os_win.utils.jobutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] WMI job failed: {'RawErrors': (('124\'instance-00000071\' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)instance-00000071318CC17B-631C-4E85-8E42-3098B42F2A5A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)instance-00000071318CC17B-631C-4E85-8E42-3098B42F2A5A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000071\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)instance-00000071318CC17B-631C-4E85-8E42-3098B42F2A5A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '469E239D-F277-413A-9833-0789AEFD52F3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=134657), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 10, 58), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 10, 58), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000071' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)\n\nNot enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)\n\n'instance-00000071' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)", 'ErrorSummaryDescription': "'instance-00000071' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000071.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:10:58.844 4088 3038342258360 MainThread DEBUG os_win._utils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000071' failed to start. Not enough memory in the system to start the virtual machine instance-00000071. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000071' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Not enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) 'instance-00000071' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.19780707359313965 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:10:58.882 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2218MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:10:58.882 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:10:58.895 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000071" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:10:58.895 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000071" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:10:58.895 4088 3038342257656 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:10:58.895 4088 3038342257656 MainThread INFO nova.compute.manager [-] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] VM Stopped (Lifecycle Event) 2021-09-10 17:10:58.926 4088 3038342257656 MainThread DEBUG nova.compute.manager [req-c775f30a-caf4-44fe-8283-082f29937a10 - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:10:58.926 4088 3038342257656 MainThread DEBUG nova.virt.hyperv.vmops [req-c775f30a-caf4-44fe-8283-082f29937a10 - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:10:58.989 4088 3038342257656 MainThread DEBUG nova.compute.manager [req-c775f30a-caf4-44fe-8283-082f29937a10 - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:10:59.098 4088 3038342257656 MainThread INFO nova.compute.manager [req-c775f30a-caf4-44fe-8283-082f29937a10 - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:10:59.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:10:59.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:10:59.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:10:59.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:10:59.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:10:59.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:10:59.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:10:59.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:10:59.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:10:59.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:10:59.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:10:59.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:10:59.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:10:59.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9f6a1261-e291-45ef-a4fd-539e3f9f4044 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:10:59.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:10:59.256 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=14GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:10:59.316 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:10:59.330 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:10:59.558 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:10:59.558 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:10:59.558 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:10:59.558 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.672s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:10:59.879 4088 3038342258360 MainThread DEBUG os_win.utils.jobutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Waiting for WMI job: {'InstanceID': '158EA04F-30B2-41D4-9DA1-6C52569900F7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16293), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:11:00.019 4088 3038342258360 MainThread ERROR os_win.utils.jobutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] WMI job failed: {'RawErrors': (('124\'instance-00000071\' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)instance-00000071318CC17B-631C-4E85-8E42-3098B42F2A5A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)instance-00000071318CC17B-631C-4E85-8E42-3098B42F2A5A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000071\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)instance-00000071318CC17B-631C-4E85-8E42-3098B42F2A5A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '158EA04F-30B2-41D4-9DA1-6C52569900F7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115742), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 10, 59), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 10, 59), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000071' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)\n\nNot enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)\n\n'instance-00000071' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)", 'ErrorSummaryDescription': "'instance-00000071' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000071.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:11:00.019 4088 3038342258360 MainThread DEBUG os_win._utils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000071' failed to start. Not enough memory in the system to start the virtual machine instance-00000071. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000071' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Not enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) 'instance-00000071' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3731677532196045 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:11:00.052 4088 3038342257656 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:11:00.052 4088 3038342257656 MainThread INFO nova.compute.manager [-] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] VM Stopped (Lifecycle Event) 2021-09-10 17:11:00.052 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000071" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:11:00.052 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000071" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:11:00.084 4088 3038342257656 MainThread DEBUG nova.compute.manager [req-081932c8-6233-41b7-8b0a-acea57a81bc3 - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:11:00.084 4088 3038342257656 MainThread DEBUG nova.virt.hyperv.vmops [req-081932c8-6233-41b7-8b0a-acea57a81bc3 - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:11:00.146 4088 3038342257656 MainThread DEBUG nova.compute.manager [req-081932c8-6233-41b7-8b0a-acea57a81bc3 - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:11:00.223 4088 3038342257656 MainThread INFO nova.compute.manager [req-081932c8-6233-41b7-8b0a-acea57a81bc3 - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:11:01.052 4088 3038342258360 MainThread DEBUG os_win.utils.jobutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Waiting for WMI job: {'InstanceID': '1637A86E-F763-44E6-9793-6F97A6540A80', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16192), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:11:01.215 4088 3038342258360 MainThread ERROR os_win.utils.jobutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] WMI job failed: {'RawErrors': (('124\'instance-00000071\' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)instance-00000071318CC17B-631C-4E85-8E42-3098B42F2A5A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)instance-00000071318CC17B-631C-4E85-8E42-3098B42F2A5A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000071\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)instance-00000071318CC17B-631C-4E85-8E42-3098B42F2A5A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1637A86E-F763-44E6-9793-6F97A6540A80', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115247), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 11, 1), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 11, 1), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000071' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)\n\nNot enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)\n\n'instance-00000071' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)", 'ErrorSummaryDescription': "'instance-00000071' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000071.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:11:01.215 4088 3038342258360 MainThread DEBUG os_win._utils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000071' failed to start. Not enough memory in the system to start the virtual machine instance-00000071. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000071' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Not enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) 'instance-00000071' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.568509817123413 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:11:01.244 4088 3038342257656 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:11:01.244 4088 3038342257656 MainThread INFO nova.compute.manager [-] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] VM Stopped (Lifecycle Event) 2021-09-10 17:11:01.244 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000071" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:11:01.244 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000071" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:11:01.269 4088 3038342257656 MainThread DEBUG nova.compute.manager [req-f58c2164-9d4c-467e-a3ef-5c220f5b7546 - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:11:01.269 4088 3038342257656 MainThread DEBUG nova.virt.hyperv.vmops [req-f58c2164-9d4c-467e-a3ef-5c220f5b7546 - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:11:01.323 4088 3038342257656 MainThread DEBUG nova.compute.manager [req-f58c2164-9d4c-467e-a3ef-5c220f5b7546 - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:11:01.396 4088 3038342257656 MainThread INFO nova.compute.manager [req-f58c2164-9d4c-467e-a3ef-5c220f5b7546 - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:11:01.785 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:11:02.245 4088 3038342258360 MainThread DEBUG os_win.utils.jobutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Waiting for WMI job: {'InstanceID': '7ECDEDD4-1BD4-4BC1-9509-D69B447D421F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=22333), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:11:02.395 4088 3038342258360 MainThread ERROR os_win.utils.jobutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] WMI job failed: {'RawErrors': (('124\'instance-00000071\' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)instance-00000071318CC17B-631C-4E85-8E42-3098B42F2A5A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)instance-00000071318CC17B-631C-4E85-8E42-3098B42F2A5A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000071\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)instance-00000071318CC17B-631C-4E85-8E42-3098B42F2A5A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7ECDEDD4-1BD4-4BC1-9509-D69B447D421F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=125062), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 11, 2), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 11, 2), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000071' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)\n\nNot enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)\n\n'instance-00000071' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)", 'ErrorSummaryDescription': "'instance-00000071' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000071.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:11:02.395 4088 3038342258360 MainThread DEBUG os_win._utils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000071' failed to start. Not enough memory in the system to start the virtual machine instance-00000071. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000071' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Not enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) 'instance-00000071' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7489893436431885 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:11:02.427 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000071" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:11:02.427 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000071" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:11:02.427 4088 3038342257656 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:11:02.427 4088 3038342257656 MainThread INFO nova.compute.manager [-] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] VM Stopped (Lifecycle Event) 2021-09-10 17:11:02.457 4088 3038342257656 MainThread DEBUG nova.compute.manager [req-a698da97-a61f-436c-8196-a2e7c7895bdb - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:11:02.457 4088 3038342257656 MainThread DEBUG nova.virt.hyperv.vmops [req-a698da97-a61f-436c-8196-a2e7c7895bdb - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:11:02.535 4088 3038342257656 MainThread DEBUG nova.compute.manager [req-a698da97-a61f-436c-8196-a2e7c7895bdb - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:11:02.559 4088 3038342257656 MainThread INFO nova.compute.manager [req-a698da97-a61f-436c-8196-a2e7c7895bdb - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:11:03.437 4088 3038342258360 MainThread DEBUG os_win.utils.jobutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Waiting for WMI job: {'InstanceID': 'B069189D-0141-4947-987B-C1F3DD8FDF0F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19148), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:11:03.585 4088 3038342258360 MainThread ERROR os_win.utils.jobutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] WMI job failed: {'RawErrors': (('124\'instance-00000071\' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)instance-00000071318CC17B-631C-4E85-8E42-3098B42F2A5A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)instance-00000071318CC17B-631C-4E85-8E42-3098B42F2A5A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000071\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)instance-00000071318CC17B-631C-4E85-8E42-3098B42F2A5A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B069189D-0141-4947-987B-C1F3DD8FDF0F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=128199), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 11, 3), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 11, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000071' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)\n\nNot enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)\n\n'instance-00000071' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)", 'ErrorSummaryDescription': "'instance-00000071' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000071.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:11:03.585 4088 3038342258360 MainThread DEBUG os_win._utils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000071' failed to start. Not enough memory in the system to start the virtual machine instance-00000071. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000071' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Not enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) 'instance-00000071' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.939208507537842 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:11:03.644 4088 3038342257656 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:11:03.644 4088 3038342257656 MainThread INFO nova.compute.manager [-] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] VM Stopped (Lifecycle Event) 2021-09-10 17:11:03.644 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000071" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:11:03.644 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000071" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:11:03.644 4088 3038342257656 MainThread DEBUG nova.compute.manager [req-6596323d-8053-4442-add1-946c07d7da94 - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:11:03.644 4088 3038342257656 MainThread DEBUG nova.virt.hyperv.vmops [req-6596323d-8053-4442-add1-946c07d7da94 - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:11:03.722 4088 3038342257656 MainThread DEBUG nova.compute.manager [req-6596323d-8053-4442-add1-946c07d7da94 - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:11:03.787 4088 3038342257656 MainThread INFO nova.compute.manager [req-6596323d-8053-4442-add1-946c07d7da94 - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:11:04.632 4088 3038342258360 MainThread DEBUG os_win.utils.jobutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Waiting for WMI job: {'InstanceID': '44556E3B-7325-4502-A80C-16C31BB16BAB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=22547), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:11:04.850 4088 3038342257656 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:11:04.850 4088 3038342257656 MainThread INFO nova.compute.manager [-] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] VM Stopped (Lifecycle Event) 2021-09-10 17:11:04.850 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000071" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:11:04.850 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000071" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:11:04.880 4088 3038342257656 MainThread DEBUG nova.compute.manager [req-23b59222-d1bd-407e-b564-bacbf4501f7f - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:11:04.880 4088 3038342257656 MainThread DEBUG nova.virt.hyperv.vmops [req-23b59222-d1bd-407e-b564-bacbf4501f7f - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:11:04.927 4088 3038342258360 MainThread ERROR os_win.utils.jobutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] WMI job failed: {'RawErrors': (('124\'instance-00000071\' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)instance-00000071318CC17B-631C-4E85-8E42-3098B42F2A5A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)instance-00000071318CC17B-631C-4E85-8E42-3098B42F2A5A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000071\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)instance-00000071318CC17B-631C-4E85-8E42-3098B42F2A5A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '44556E3B-7325-4502-A80C-16C31BB16BAB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=165397), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 11, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 11, 4), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000071' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)\n\nNot enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)\n\n'instance-00000071' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A)", 'ErrorSummaryDescription': "'instance-00000071' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000071.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:11:04.941 4088 3038342258360 MainThread ERROR nova.virt.hyperv.vmops [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Failed to change vm state of instance-00000071 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000071' failed to start. 2021-09-10 17:11:04.941 4088 3038342258360 MainThread INFO nova.virt.hyperv.vmops [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Got request to destroy instance 2021-09-10 17:11:04.941 4088 3038342257656 MainThread DEBUG nova.compute.manager [req-23b59222-d1bd-407e-b564-bacbf4501f7f - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:11:04.980 4088 3038342257656 MainThread INFO nova.compute.manager [req-23b59222-d1bd-407e-b564-bacbf4501f7f - - - - -] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:11:07.198 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.vmops [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:11:07.198 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "instance-00000071" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:11:07.198 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "instance-00000071" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:11:07.228 4088 3038342258360 MainThread DEBUG os_win.utils.compute.vmutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Successfully changed vm state of instance-00000071 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:11:07.228 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.vmops [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Successfully changed state of VM instance-00000071 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:11:07.270 4088 3038342258360 MainThread DEBUG os_win.utils.jobutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Waiting for WMI job: {'InstanceID': 'EE00EA39-3432-47A6-90A9-ED1299DEF7A8', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18078), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:11:07.405 4088 3038342258360 MainThread DEBUG os_win.utils.jobutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] WMI job succeeded: {'InstanceID': 'EE00EA39-3432-47A6-90A9-ED1299DEF7A8', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=107812), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:11:07.405 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "instance-00000071" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:11:07.405 4088 3038342258360 MainThread DEBUG os_win.utils.pathutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Removing directory: C:\openstack\instances\instance-00000071 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:11:07.405 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "instance-00000071" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:11:07.405 4088 3038342258360 MainThread ERROR nova.compute.manager [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000071' failed to start. Not enough memory in the system to start the virtual machine instance-00000071. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000071' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Not enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) 'instance-00000071' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Error code: 32778. 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Traceback (most recent call last): 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] return function(*args, **kwargs) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] admin_password, network_info, block_device_info) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] return function(self, *args, **kwds) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self.force_reraise() 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] raise self.value 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] should_plug_vifs=False) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 'req_state': req_state}) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self.force_reraise() 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] raise self.value 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] time.sleep(sleep_time) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self.force_reraise() 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] raise self.value 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] return f(*args, **kwargs) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] return self._wait_for_job(job_path) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] error_desc=err_desc) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000071' failed to start. 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Not enough memory in the system to start the virtual machine instance-00000071. 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000071' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Not enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 'instance-00000071' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Error code: 32778. 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] During handling of the above exception, another exception occurred: 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Traceback (most recent call last): 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] yield resources 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] accel_info=accel_info) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] return function(*args, **kwargs) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] admin_password, network_info, block_device_info) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] return function(self, *args, **kwds) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self.force_reraise() 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] raise self.value 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] should_plug_vifs=False) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 'req_state': req_state}) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self.force_reraise() 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] raise self.value 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] time.sleep(sleep_time) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self.force_reraise() 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] raise self.value 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] return f(*args, **kwargs) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] return self._wait_for_job(job_path) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] error_desc=err_desc) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000071' failed to start. 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Not enough memory in the system to start the virtual machine instance-00000071. 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000071' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Not enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 'instance-00000071' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Error code: 32778. 2021-09-10 17:11:07.405 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.405 4088 3038342258360 MainThread INFO nova.compute.manager [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Terminating instance 2021-09-10 17:11:07.405 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:11:07.405 4088 3038342258360 MainThread INFO nova.virt.hyperv.vmops [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Got request to destroy instance 2021-09-10 17:11:07.425 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.vmops [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:11:07.425 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "instance-00000071" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:11:07.425 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "instance-00000071" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:11:07.441 4088 3038342258360 MainThread INFO nova.compute.manager [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:11:07.442 4088 3038342258360 MainThread DEBUG nova.compute.claims [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:11:07.442 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:11:07.698 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.hostops [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:11:07.707 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.hostops [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:11:07.977 4088 3038342258360 MainThread DEBUG nova.compute.provider_tree [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:11:07.988 4088 3038342258360 MainThread DEBUG nova.scheduler.client.report [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:11:07.988 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.546s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:11:07.988 4088 3038342258360 MainThread ERROR nova.compute.manager [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000071' failed to start. Not enough memory in the system to start the virtual machine instance-00000071. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000071' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Not enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) 'instance-00000071' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Error code: 32778. 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Traceback (most recent call last): 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] return function(*args, **kwargs) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] admin_password, network_info, block_device_info) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] return function(self, *args, **kwds) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self.force_reraise() 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] raise self.value 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] should_plug_vifs=False) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 'req_state': req_state}) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self.force_reraise() 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] raise self.value 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] time.sleep(sleep_time) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self.force_reraise() 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] raise self.value 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] return f(*args, **kwargs) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] return self._wait_for_job(job_path) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] error_desc=err_desc) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000071' failed to start. 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Not enough memory in the system to start the virtual machine instance-00000071. 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000071' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Not enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 'instance-00000071' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Error code: 32778. 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] During handling of the above exception, another exception occurred: 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Traceback (most recent call last): 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] accel_info=accel_info) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] return function(*args, **kwargs) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] admin_password, network_info, block_device_info) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] return function(self, *args, **kwds) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self.force_reraise() 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] raise self.value 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] should_plug_vifs=False) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 'req_state': req_state}) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self.force_reraise() 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] raise self.value 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] time.sleep(sleep_time) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self.force_reraise() 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] raise self.value 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] return f(*args, **kwargs) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] return self._wait_for_job(job_path) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] error_desc=err_desc) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000071' failed to start. 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Not enough memory in the system to start the virtual machine instance-00000071. 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000071' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Not enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 'instance-00000071' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Error code: 32778. 2021-09-10 17:11:07.988 4088 3038342258360 MainThread TRACE nova.compute.manager [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] 2021-09-10 17:11:08.010 4088 3038342258360 MainThread DEBUG nova.compute.utils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] WMI job failed with status 10. Error summary description: 'instance-00000071' failed to start. Not enough memory in the system to start the virtual machine instance-00000071. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:11:08.010 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Build of instance 9f6a1261-e291-45ef-a4fd-539e3f9f4044 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000071' failed to start. Not enough memory in the system to start the virtual machine instance-00000071. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000071' failed to start. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Not enough memory in the system to start the virtual machine instance-00000071 with ram size 1024 megabytes. (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) 'instance-00000071' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 318CC17B-631C-4E85-8E42-3098B42F2A5A) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:11:08.010 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:11:08.010 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:11:08.010 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:11:08.010 4088 3038342258360 MainThread DEBUG nova.network.neutron [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:11:09.223 4088 3038342258360 MainThread DEBUG nova.network.neutron [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:11:09.264 4088 3038342258360 MainThread INFO nova.compute.manager [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] [instance: 9f6a1261-e291-45ef-a4fd-539e3f9f4044] Took 1.27 seconds to deallocate network for instance. 2021-09-10 17:11:09.590 4088 3038342258360 MainThread INFO nova.scheduler.client.report [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Deleted allocations for instance 9f6a1261-e291-45ef-a4fd-539e3f9f4044 2021-09-10 17:11:09.672 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-a1e16595-e3ef-4589-a335-8a077525d0ae 95e49dab1ffa48cfb40576e8646baad3 f4ebc509414a41b9890ca144a70c816d - default default] Lock "9f6a1261-e291-45ef-a4fd-539e3f9f4044" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 33.969s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:11:47.567 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:11:50.529 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:11:50.529 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:11:51.513 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:11:52.521 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:11:53.530 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_incomplete_migrations run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:11:53.530 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances with incomplete migration _cleanup_incomplete_migrations c:\openstack\build\nova\nova\compute\manager.py:10640 2021-09-10 17:11:54.514 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:11:54.514 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:11:55.529 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:11:57.515 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:11:57.517 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:11:57.916 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-66c5445c-c347-4833-8af8-58ba8ff6d95e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:11:57.916 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:12:02.219 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Updating instance_info_cache with network_info: [{"id": "fecb5a04-48f6-4c8b-bb0f-748b812daefa", "address": "fa:16:3e:2d:da:04", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfecb5a04-48", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:12:02.246 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-66c5445c-c347-4833-8af8-58ba8ff6d95e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:12:02.246 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:12:02.246 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:12:02.268 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:12:02.268 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:12:02.268 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:12:02.268 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:12:02.290 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:12:02.506 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2222MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:12:02.506 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:12:03.238 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:12:03.238 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:12:03.238 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:12:03.238 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:12:03.238 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:12:03.238 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:12:03.238 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:12:03.251 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:12:03.251 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:12:03.251 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:12:03.251 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:12:03.251 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:12:03.251 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:12:03.251 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:12:03.251 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:12:03.362 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing inventories for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:757 2021-09-10 17:12:03.396 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Updating ProviderTree inventory for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 from _refresh_and_get_inventory using data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} _refresh_and_get_inventory c:\openstack\build\nova\nova\scheduler\client\report.py:723 2021-09-10 17:12:03.396 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Updating inventory in ProviderTree for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 with inventory: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:176 2021-09-10 17:12:03.423 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing aggregate associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, aggregates: None _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:766 2021-09-10 17:12:03.489 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing trait associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_VHD,COMPUTE_IMAGE_TYPE_VHDX,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:778 2021-09-10 17:12:03.489 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:12:03.518 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:12:03.722 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:12:03.735 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:12:03.735 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:12:03.735 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.234s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:12:03.735 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:12:05.559 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._run_pending_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:12:05.559 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10602 2021-09-10 17:12:05.579 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] There are 0 instances to clean _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10611 2021-09-10 17:12:49.546 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:12:51.515 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:12:51.516 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:12:52.515 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:12:53.518 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:12:53.627 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:12:55.518 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:12:56.515 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:12:56.515 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:12:58.518 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:12:58.518 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:12:59.908 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:12:59.908 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:13:02.848 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Updating instance_info_cache with network_info: [{"id": "83b451dc-a198-4ccd-9f65-c8fe6343aea3", "address": "fa:16:3e:44:7f:92", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap83b451dc-a1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:13:02.878 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:13:02.878 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:13:02.878 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:13:02.921 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:13:02.921 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:13:02.921 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:13:02.921 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:13:02.955 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:13:03.189 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2234MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:13:03.189 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:13:03.499 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:13:03.499 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:13:03.499 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:13:03.499 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:13:03.499 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:13:03.499 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:13:03.514 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:13:03.514 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:13:03.514 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:13:03.514 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:13:03.514 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:13:03.514 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:13:03.518 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:13:03.518 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:13:03.518 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:13:03.562 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:13:03.582 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:13:03.798 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:13:03.798 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:13:03.798 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:13:03.798 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:13:06.782 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:13:51.559 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:13:52.512 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:13:53.513 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:13:53.513 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:13:54.528 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:13:55.512 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:13:56.512 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:13:57.528 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:13:58.556 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:13:58.556 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:13:59.090 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-9db39d70-5120-4de4-bb87-480a6efb8a3a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:13:59.090 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:14:00.954 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Updating instance_info_cache with network_info: [{"id": "66953b8a-00d2-4045-8dae-abe4c015822d", "address": "fa:16:3e:7a:90:37", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap66953b8a-00", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:14:00.965 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-9db39d70-5120-4de4-bb87-480a6efb8a3a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:14:00.965 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:14:01.527 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:14:01.559 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:14:01.559 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:14:01.559 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:14:01.559 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:14:01.575 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:14:01.793 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2237MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:14:01.793 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:14:02.184 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:14:02.184 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:14:02.184 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:14:02.184 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:14:02.184 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:14:02.184 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:14:02.184 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:14:02.184 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:14:02.184 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:14:02.184 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:14:02.184 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:14:02.184 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:14:02.184 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:14:02.184 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:14:02.184 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:14:02.229 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:14:02.250 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:14:02.464 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:14:02.479 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:14:02.479 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:14:02.479 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.687s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:14:54.471 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:14:54.623 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:14:54.635 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:14:54.635 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:14:54.635 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:14:54.682 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:14:57.510 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:14:57.510 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:14:58.525 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:15:00.525 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:15:00.525 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:15:01.265 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-0e77fafa-3f8a-4513-bb64-518c77e99029" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:15:01.265 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:15:02.841 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Updating instance_info_cache with network_info: [{"id": "a8d3d6fd-c535-4f42-b11d-348191f22a38", "address": "fa:16:3e:61:e8:c4", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa8d3d6fd-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:15:02.871 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-0e77fafa-3f8a-4513-bb64-518c77e99029" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:15:02.871 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:15:02.871 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:15:02.886 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:15:02.886 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:15:02.886 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:15:02.902 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:15:02.939 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:15:03.164 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2238MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:15:03.164 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:15:03.510 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:15:03.510 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:15:03.510 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:15:03.510 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:15:03.510 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:15:03.510 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:15:03.510 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:15:03.510 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:15:03.510 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:15:03.510 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:15:03.510 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:15:03.510 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:15:03.510 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:15:03.510 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:15:03.510 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:15:03.573 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:15:03.573 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:15:03.792 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:15:03.822 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:15:03.822 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:15:03.822 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.656s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:15:11.775 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:15:54.565 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:15:56.005 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "236a5f41-195e-4bd9-9c70-230e5a1cf40f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:15:56.007 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:15:56.268 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:15:56.273 4088 3038342257832 MainThread DEBUG nova.virt.hardware [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:15:56.273 4088 3038342257832 MainThread INFO nova.compute.claims [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Claim successful on node n-h2-808474-1 2021-09-10 17:15:56.477 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.hostops [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:15:56.477 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.hostops [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:15:56.523 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:15:56.523 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:15:56.523 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:15:56.523 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:15:56.687 4088 3038342257832 MainThread DEBUG nova.compute.provider_tree [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:15:56.718 4088 3038342257832 MainThread DEBUG nova.scheduler.client.report [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:15:56.718 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:15:56.718 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:15:56.867 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:15:56.867 4088 3038342258360 GreenThread-104 DEBUG nova.compute.manager [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:15:56.867 4088 3038342258360 GreenThread-104 DEBUG nova.network.neutron [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:15:57.159 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:15:57.190 4088 3038342257832 MainThread INFO nova.virt.hyperv.vmops [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Spawning new instance 2021-09-10 17:15:57.195 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000072" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:15:57.195 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000072" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:15:57.195 4088 3038342257832 MainThread DEBUG nova.block_device [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:15:57.195 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:15:57.195 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:15:57.231 4088 3038342257832 MainThread DEBUG os_win.utils.pathutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Creating directory: C:\openstack\instances\instance-00000072 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:15:57.231 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000072\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:15:57.231 4088 3038342258360 GreenThread-104 DEBUG nova.policy [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '799e4a49be0e448b9d6d54d57b7d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf483b0ac5349bca4c898bb3b806d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:15:57.525 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Resizing VHD C:\openstack\instances\instance-00000072\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:15:58.501 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:15:58.501 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:15:58.617 4088 3038342258360 GreenThread-104 DEBUG nova.network.neutron [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Successfully created port: dc130e9d-8191-4a6b-9564-3c8ebb5fb539 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:15:59.523 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:16:00.332 4088 3038342258360 GreenThread-104 DEBUG nova.network.neutron [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Successfully updated port: dc130e9d-8191-4a6b-9564-3c8ebb5fb539 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:16:00.361 4088 3038342258360 GreenThread-104 DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Acquired lock "refresh_cache-236a5f41-195e-4bd9-9c70-230e5a1cf40f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:16:00.361 4088 3038342258360 GreenThread-104 DEBUG nova.network.neutron [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:16:00.445 4088 3038342257480 MainThread DEBUG nova.compute.manager [req-9f457a63-e733-4779-9f2e-ad937ca93529 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Received event network-changed-dc130e9d-8191-4a6b-9564-3c8ebb5fb539 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:16:00.445 4088 3038342257480 MainThread DEBUG nova.compute.manager [req-9f457a63-e733-4779-9f2e-ad937ca93529 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Refreshing instance network info cache due to event network-changed-dc130e9d-8191-4a6b-9564-3c8ebb5fb539. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:16:00.617 4088 3038342258360 GreenThread-104 DEBUG nova.network.neutron [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:16:01.509 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:16:01.509 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:16:01.726 4088 3038342258360 GreenThread-104 DEBUG nova.network.neutron [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Updating instance_info_cache with network_info: [{"id": "dc130e9d-8191-4a6b-9564-3c8ebb5fb539", "address": "fa:16:3e:d0:6a:5f", "network": {"id": "a847bbb1-95d3-4aab-8de0-ad5d3af60dc3", "bridge": null, "label": "tempest-network-smoke--1228547857", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5cf483b0ac5349bca4c898bb3b806d21", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapdc130e9d-81", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:16:01.758 4088 3038342258360 GreenThread-104 DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Releasing lock "refresh_cache-236a5f41-195e-4bd9-9c70-230e5a1cf40f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:16:01.758 4088 3038342258360 GreenThread-104 DEBUG nova.compute.manager [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Instance network_info: |[{"id": "dc130e9d-8191-4a6b-9564-3c8ebb5fb539", "address": "fa:16:3e:d0:6a:5f", "network": {"id": "a847bbb1-95d3-4aab-8de0-ad5d3af60dc3", "bridge": null, "label": "tempest-network-smoke--1228547857", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5cf483b0ac5349bca4c898bb3b806d21", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapdc130e9d-81", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:16:01.758 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Preparing to wait for external event network-vif-plugged-dc130e9d-8191-4a6b-9564-3c8ebb5fb539 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:16:01.758 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "236a5f41-195e-4bd9-9c70-230e5a1cf40f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:01.758 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "236a5f41-195e-4bd9-9c70-230e5a1cf40f-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:01.758 4088 3038342257832 MainThread DEBUG os_win.utils.compute.vmutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Creating VM instance-00000072 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:16:01.758 4088 3038342257480 MainThread DEBUG oslo_concurrency.lockutils [req-9f457a63-e733-4779-9f2e-ad937ca93529 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-236a5f41-195e-4bd9-9c70-230e5a1cf40f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:16:01.758 4088 3038342257480 MainThread DEBUG nova.network.neutron [req-9f457a63-e733-4779-9f2e-ad937ca93529 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Refreshing network info cache for port dc130e9d-8191-4a6b-9564-3c8ebb5fb539 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:16:01.978 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-50586591-86ba-41be-b4e1-5004ea0d76dd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:16:01.978 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:16:02.701 4088 3038342257480 MainThread DEBUG nova.network.neutron [req-9f457a63-e733-4779-9f2e-ad937ca93529 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Updated VIF entry in instance network info cache for port dc130e9d-8191-4a6b-9564-3c8ebb5fb539. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:16:02.701 4088 3038342257480 MainThread DEBUG nova.network.neutron [req-9f457a63-e733-4779-9f2e-ad937ca93529 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Updating instance_info_cache with network_info: [{"id": "dc130e9d-8191-4a6b-9564-3c8ebb5fb539", "address": "fa:16:3e:d0:6a:5f", "network": {"id": "a847bbb1-95d3-4aab-8de0-ad5d3af60dc3", "bridge": null, "label": "tempest-network-smoke--1228547857", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5cf483b0ac5349bca4c898bb3b806d21", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapdc130e9d-81", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:16:02.727 4088 3038342257480 MainThread DEBUG oslo_concurrency.lockutils [req-9f457a63-e733-4779-9f2e-ad937ca93529 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-236a5f41-195e-4bd9-9c70-230e5a1cf40f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:16:03.476 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:16:03.769 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Updating instance_info_cache with network_info: [{"id": "ad57189e-6845-4bd3-a7d1-681004b754a9", "address": "fa:16:3e:7f:ee:91", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapad57189e-68", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:16:03.791 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-50586591-86ba-41be-b4e1-5004ea0d76dd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:16:03.791 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:16:03.791 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:16:03.828 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:03.828 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:03.828 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:16:03.828 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:16:03.850 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:16:04.087 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2238MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:16:04.087 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:04.367 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:16:04.367 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:16:04.367 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:16:04.367 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:16:04.367 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:16:04.367 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:16:04.367 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:16:04.367 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:16:04.367 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:16:04.367 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:16:04.367 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:16:04.367 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:16:04.367 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:16:04.367 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 236a5f41-195e-4bd9-9c70-230e5a1cf40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:16:04.367 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:16:04.367 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=14GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:16:04.414 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:16:04.429 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:16:04.636 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:16:04.664 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:16:04.664 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:16:04.664 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.578s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:09.975 4088 3038342257480 MainThread DEBUG nova.compute.manager [req-1e1ce5e0-e07e-4345-a86c-fa0ea2285c9f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Received event network-vif-plugged-dc130e9d-8191-4a6b-9564-3c8ebb5fb539 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:16:09.975 4088 3038342257480 MainThread DEBUG oslo_concurrency.lockutils [req-1e1ce5e0-e07e-4345-a86c-fa0ea2285c9f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "236a5f41-195e-4bd9-9c70-230e5a1cf40f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:09.975 4088 3038342257480 MainThread DEBUG oslo_concurrency.lockutils [req-1e1ce5e0-e07e-4345-a86c-fa0ea2285c9f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "236a5f41-195e-4bd9-9c70-230e5a1cf40f-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:09.975 4088 3038342257480 MainThread DEBUG nova.compute.manager [req-1e1ce5e0-e07e-4345-a86c-fa0ea2285c9f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Processing event network-vif-plugged-dc130e9d-8191-4a6b-9564-3c8ebb5fb539 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:16:10.032 4088 3038342257832 MainThread INFO nova.virt.hyperv.vmops [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Using config drive for instance 2021-09-10 17:16:10.336 4088 3038342257832 MainThread INFO nova.virt.hyperv.vmops [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Creating config drive at C:\openstack\instances\instance-00000072\configdrive.iso 2021-09-10 17:16:10.445 4088 3038342257832 MainThread DEBUG oslo_concurrency.processutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000072\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp2jzcnjs9 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:16:10.757 4088 3038342257832 MainThread DEBUG oslo_concurrency.processutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000072\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp2jzcnjs9" returned: 0 in 0.313s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:16:11.288 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Setting boot order for instance: instance-00000072: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:16:11.384 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:16:11.415 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '9B107E9F-F4CE-40B5-A392-65F23B8CAA28', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19513), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:16:11.573 4088 3038342257832 MainThread ERROR os_win.utils.jobutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000072\' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)instance-00000072138D272C-09DC-46D4-B309-C447E7D767D112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)instance-00000072138D272C-09DC-46D4-B309-C447E7D767D110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000072\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)instance-00000072138D272C-09DC-46D4-B309-C447E7D767D1%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9B107E9F-F4CE-40B5-A392-65F23B8CAA28', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117130), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 16, 11), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 16, 11), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000072' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)\n\nNot enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)\n\n'instance-00000072' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)", 'ErrorSummaryDescription': "'instance-00000072' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000072.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:16:11.573 4088 3038342257832 MainThread DEBUG os_win._utils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000072' failed to start. Not enough memory in the system to start the virtual machine instance-00000072. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000072' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Not enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) 'instance-00000072' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1888878345489502 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:16:11.586 4088 3038342257480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000072" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:11.586 4088 3038342257480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000072" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:11.586 4088 3038342255368 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:16:11.586 4088 3038342255368 MainThread INFO nova.compute.manager [-] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] VM Stopped (Lifecycle Event) 2021-09-10 17:16:11.617 4088 3038342255368 MainThread DEBUG nova.compute.manager [req-237b2522-5596-49b3-98a6-cfe01058612a - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:16:11.617 4088 3038342255368 MainThread DEBUG nova.virt.hyperv.vmops [req-237b2522-5596-49b3-98a6-cfe01058612a - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:11.680 4088 3038342255368 MainThread DEBUG nova.compute.manager [req-237b2522-5596-49b3-98a6-cfe01058612a - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:16:11.716 4088 3038342255368 MainThread INFO nova.compute.manager [req-237b2522-5596-49b3-98a6-cfe01058612a - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:16:12.587 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': 'D2E26054-E488-4E22-83A9-C1BA42DC2831', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20139), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:16:12.804 4088 3038342255368 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:16:12.804 4088 3038342255368 MainThread INFO nova.compute.manager [-] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] VM Stopped (Lifecycle Event) 2021-09-10 17:16:12.804 4088 3038342257480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000072" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:12.804 4088 3038342257480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000072" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:12.835 4088 3038342255368 MainThread DEBUG nova.compute.manager [req-9ae7a547-b130-4513-a84b-711098e06a2c - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:16:12.835 4088 3038342255368 MainThread DEBUG nova.virt.hyperv.vmops [req-9ae7a547-b130-4513-a84b-711098e06a2c - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:12.871 4088 3038342257832 MainThread ERROR os_win.utils.jobutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000072\' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)instance-00000072138D272C-09DC-46D4-B309-C447E7D767D112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)instance-00000072138D272C-09DC-46D4-B309-C447E7D767D110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000072\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)instance-00000072138D272C-09DC-46D4-B309-C447E7D767D1%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D2E26054-E488-4E22-83A9-C1BA42DC2831', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=132908), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 16, 12), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 16, 12), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000072' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)\n\nNot enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)\n\n'instance-00000072' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)", 'ErrorSummaryDescription': "'instance-00000072' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000072.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:16:12.871 4088 3038342257832 MainThread DEBUG os_win._utils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000072' failed to start. Not enough memory in the system to start the virtual machine instance-00000072. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000072' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Not enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) 'instance-00000072' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4869945049285889 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:16:12.882 4088 3038342255368 MainThread DEBUG nova.compute.manager [req-9ae7a547-b130-4513-a84b-711098e06a2c - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:16:12.915 4088 3038342255368 MainThread INFO nova.compute.manager [req-9ae7a547-b130-4513-a84b-711098e06a2c - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:16:13.897 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': 'F009EC73-36FF-4ED2-893B-BD66CF29064C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14874), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:16:14.055 4088 3038342257832 MainThread ERROR os_win.utils.jobutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000072\' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)instance-00000072138D272C-09DC-46D4-B309-C447E7D767D112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)instance-00000072138D272C-09DC-46D4-B309-C447E7D767D110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000072\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)instance-00000072138D272C-09DC-46D4-B309-C447E7D767D1%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'F009EC73-36FF-4ED2-893B-BD66CF29064C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116553), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 16, 13), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 16, 14), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000072' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)\n\nNot enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)\n\n'instance-00000072' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)", 'ErrorSummaryDescription': "'instance-00000072' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000072.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:16:14.055 4088 3038342257832 MainThread DEBUG os_win._utils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000072' failed to start. Not enough memory in the system to start the virtual machine instance-00000072. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000072' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Not enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) 'instance-00000072' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.6714892387390137 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:16:14.102 4088 3038342257480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000072" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:14.102 4088 3038342257480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000072" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:14.102 4088 3038342255368 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:16:14.102 4088 3038342255368 MainThread INFO nova.compute.manager [-] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] VM Stopped (Lifecycle Event) 2021-09-10 17:16:14.124 4088 3038342255368 MainThread DEBUG nova.compute.manager [req-21913214-9b0c-46e6-9912-a18fe2380d4f - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:16:14.124 4088 3038342255368 MainThread DEBUG nova.virt.hyperv.vmops [req-21913214-9b0c-46e6-9912-a18fe2380d4f - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:14.180 4088 3038342255368 MainThread DEBUG nova.compute.manager [req-21913214-9b0c-46e6-9912-a18fe2380d4f - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:16:14.210 4088 3038342255368 MainThread INFO nova.compute.manager [req-21913214-9b0c-46e6-9912-a18fe2380d4f - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:16:15.085 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '784E3630-8381-4C3E-989A-DE92D0ACFBCD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14896), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:16:15.226 4088 3038342257832 MainThread ERROR os_win.utils.jobutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000072\' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)instance-00000072138D272C-09DC-46D4-B309-C447E7D767D112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)instance-00000072138D272C-09DC-46D4-B309-C447E7D767D110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000072\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)instance-00000072138D272C-09DC-46D4-B309-C447E7D767D1%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '784E3630-8381-4C3E-989A-DE92D0ACFBCD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115623), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 16, 15), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 16, 15), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000072' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)\n\nNot enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)\n\n'instance-00000072' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)", 'ErrorSummaryDescription': "'instance-00000072' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000072.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:16:15.226 4088 3038342257832 MainThread DEBUG os_win._utils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000072' failed to start. Not enough memory in the system to start the virtual machine instance-00000072. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000072' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Not enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) 'instance-00000072' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.8421528339385986 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:16:15.257 4088 3038342257480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000072" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:15.257 4088 3038342257480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000072" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:15.257 4088 3038342255368 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:16:15.257 4088 3038342255368 MainThread INFO nova.compute.manager [-] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] VM Stopped (Lifecycle Event) 2021-09-10 17:16:15.273 4088 3038342255368 MainThread DEBUG nova.compute.manager [req-3258987c-59d3-4518-9b5f-cb321b9e65bb - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:16:15.273 4088 3038342255368 MainThread DEBUG nova.virt.hyperv.vmops [req-3258987c-59d3-4518-9b5f-cb321b9e65bb - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:15.335 4088 3038342255368 MainThread DEBUG nova.compute.manager [req-3258987c-59d3-4518-9b5f-cb321b9e65bb - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:16:15.354 4088 3038342255368 MainThread INFO nova.compute.manager [req-3258987c-59d3-4518-9b5f-cb321b9e65bb - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:16:16.246 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': 'EBD79947-247A-45D1-973E-0ABEAA575DA1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15405), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:16:16.384 4088 3038342257832 MainThread ERROR os_win.utils.jobutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000072\' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)instance-00000072138D272C-09DC-46D4-B309-C447E7D767D112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)instance-00000072138D272C-09DC-46D4-B309-C447E7D767D110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000072\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)instance-00000072138D272C-09DC-46D4-B309-C447E7D767D1%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'EBD79947-247A-45D1-973E-0ABEAA575DA1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118056), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 16, 16), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 16, 16), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000072' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)\n\nNot enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)\n\n'instance-00000072' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)", 'ErrorSummaryDescription': "'instance-00000072' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000072.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:16:16.384 4088 3038342257832 MainThread DEBUG os_win._utils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000072' failed to start. Not enough memory in the system to start the virtual machine instance-00000072. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000072' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Not enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) 'instance-00000072' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.0002851486206055 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:16:16.429 4088 3038342255368 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:16:16.429 4088 3038342255368 MainThread INFO nova.compute.manager [-] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] VM Stopped (Lifecycle Event) 2021-09-10 17:16:16.429 4088 3038342257480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000072" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:16.429 4088 3038342257480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000072" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:16.460 4088 3038342255368 MainThread DEBUG nova.compute.manager [req-7773ab50-315f-4a4a-ab1e-f447db21f114 - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:16:16.473 4088 3038342255368 MainThread DEBUG nova.virt.hyperv.vmops [req-7773ab50-315f-4a4a-ab1e-f447db21f114 - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:16.507 4088 3038342255368 MainThread DEBUG nova.compute.manager [req-7773ab50-315f-4a4a-ab1e-f447db21f114 - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:16:16.540 4088 3038342255368 MainThread INFO nova.compute.manager [req-7773ab50-315f-4a4a-ab1e-f447db21f114 - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:16:17.398 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': 'C4B0B635-49F6-4135-A50F-8AE1A9202DAE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15319), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:16:17.555 4088 3038342257832 MainThread ERROR os_win.utils.jobutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000072\' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)instance-00000072138D272C-09DC-46D4-B309-C447E7D767D112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)instance-00000072138D272C-09DC-46D4-B309-C447E7D767D110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000072\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)instance-00000072138D272C-09DC-46D4-B309-C447E7D767D1%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C4B0B635-49F6-4135-A50F-8AE1A9202DAE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113165), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 16, 17), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 16, 17), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000072' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)\n\nNot enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)\n\n'instance-00000072' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1)", 'ErrorSummaryDescription': "'instance-00000072' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000072.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:16:17.555 4088 3038342257832 MainThread ERROR nova.virt.hyperv.vmops [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Failed to change vm state of instance-00000072 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000072' failed to start. 2021-09-10 17:16:17.555 4088 3038342257832 MainThread INFO nova.virt.hyperv.vmops [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Got request to destroy instance 2021-09-10 17:16:17.570 4088 3038342257480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000072" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:17.570 4088 3038342257480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000072" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:17.570 4088 3038342255368 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:16:17.570 4088 3038342255368 MainThread INFO nova.compute.manager [-] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] VM Stopped (Lifecycle Event) 2021-09-10 17:16:17.632 4088 3038342255368 MainThread DEBUG nova.compute.manager [req-42a61f3a-51f6-4875-aec9-1324c7f5a328 - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:16:17.632 4088 3038342255368 MainThread DEBUG nova.virt.hyperv.vmops [req-42a61f3a-51f6-4875-aec9-1324c7f5a328 - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:17.698 4088 3038342255368 MainThread DEBUG nova.compute.manager [req-42a61f3a-51f6-4875-aec9-1324c7f5a328 - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:16:17.758 4088 3038342255368 MainThread INFO nova.compute.manager [req-42a61f3a-51f6-4875-aec9-1324c7f5a328 - - - - -] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:16:19.433 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:16:19.433 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000072" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:19.433 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000072" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:19.445 4088 3038342257832 MainThread DEBUG os_win.utils.compute.vmutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Successfully changed vm state of instance-00000072 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:16:19.445 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Successfully changed state of VM instance-00000072 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:16:19.492 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': 'EA8DB7D1-3DCF-4C64-96BE-58F6D320A663', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14674), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:16:19.616 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job succeeded: {'InstanceID': 'EA8DB7D1-3DCF-4C64-96BE-58F6D320A663', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=96316), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:16:19.616 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000072" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:19.616 4088 3038342257832 MainThread DEBUG os_win.utils.pathutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Removing directory: C:\openstack\instances\instance-00000072 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:16:19.616 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000072" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:19.616 4088 3038342257832 MainThread ERROR nova.compute.manager [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000072' failed to start. Not enough memory in the system to start the virtual machine instance-00000072. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000072' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Not enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) 'instance-00000072' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Error code: 32778. 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Traceback (most recent call last): 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] return function(*args, **kwargs) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] admin_password, network_info, block_device_info) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] return function(self, *args, **kwds) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self.force_reraise() 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] raise self.value 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] should_plug_vifs=False) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 'req_state': req_state}) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self.force_reraise() 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] raise self.value 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] time.sleep(sleep_time) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self.force_reraise() 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] raise self.value 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] return f(*args, **kwargs) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] return self._wait_for_job(job_path) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] error_desc=err_desc) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000072' failed to start. 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Not enough memory in the system to start the virtual machine instance-00000072. 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000072' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Not enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 'instance-00000072' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Error code: 32778. 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] During handling of the above exception, another exception occurred: 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Traceback (most recent call last): 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] yield resources 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] accel_info=accel_info) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] return function(*args, **kwargs) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] admin_password, network_info, block_device_info) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] return function(self, *args, **kwds) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self.force_reraise() 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] raise self.value 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] should_plug_vifs=False) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 'req_state': req_state}) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self.force_reraise() 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] raise self.value 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] time.sleep(sleep_time) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self.force_reraise() 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] raise self.value 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] return f(*args, **kwargs) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] return self._wait_for_job(job_path) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] error_desc=err_desc) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000072' failed to start. 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Not enough memory in the system to start the virtual machine instance-00000072. 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000072' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Not enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 'instance-00000072' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Error code: 32778. 2021-09-10 17:16:19.616 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:19.616 4088 3038342257832 MainThread INFO nova.compute.manager [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Terminating instance 2021-09-10 17:16:19.616 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:16:19.616 4088 3038342257832 MainThread INFO nova.virt.hyperv.vmops [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Got request to destroy instance 2021-09-10 17:16:19.616 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:16:19.616 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000072" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:19.646 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000072" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:19.646 4088 3038342257832 MainThread INFO nova.compute.manager [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:16:19.646 4088 3038342257832 MainThread DEBUG nova.compute.claims [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:16:19.650 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:19.802 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.hostops [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:16:19.819 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.hostops [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:16:20.025 4088 3038342257832 MainThread DEBUG nova.compute.provider_tree [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:16:20.071 4088 3038342257832 MainThread DEBUG nova.scheduler.client.report [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:16:20.071 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:20.071 4088 3038342257832 MainThread ERROR nova.compute.manager [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000072' failed to start. Not enough memory in the system to start the virtual machine instance-00000072. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000072' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Not enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) 'instance-00000072' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Error code: 32778. 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Traceback (most recent call last): 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] return function(*args, **kwargs) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] admin_password, network_info, block_device_info) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] return function(self, *args, **kwds) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self.force_reraise() 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] raise self.value 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] should_plug_vifs=False) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 'req_state': req_state}) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self.force_reraise() 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] raise self.value 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] time.sleep(sleep_time) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self.force_reraise() 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] raise self.value 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] return f(*args, **kwargs) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] return self._wait_for_job(job_path) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] error_desc=err_desc) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000072' failed to start. 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Not enough memory in the system to start the virtual machine instance-00000072. 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000072' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Not enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 'instance-00000072' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Error code: 32778. 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] During handling of the above exception, another exception occurred: 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Traceback (most recent call last): 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] accel_info=accel_info) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] return function(*args, **kwargs) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] admin_password, network_info, block_device_info) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] return function(self, *args, **kwds) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self.force_reraise() 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] raise self.value 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] should_plug_vifs=False) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 'req_state': req_state}) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self.force_reraise() 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] raise self.value 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] time.sleep(sleep_time) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self.force_reraise() 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] raise self.value 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] return f(*args, **kwargs) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] return self._wait_for_job(job_path) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] error_desc=err_desc) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000072' failed to start. 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Not enough memory in the system to start the virtual machine instance-00000072. 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000072' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Not enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 'instance-00000072' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Error code: 32778. 2021-09-10 17:16:20.071 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] 2021-09-10 17:16:20.085 4088 3038342257832 MainThread DEBUG nova.compute.utils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] WMI job failed with status 10. Error summary description: 'instance-00000072' failed to start. Not enough memory in the system to start the virtual machine instance-00000072. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:16:20.085 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Build of instance 236a5f41-195e-4bd9-9c70-230e5a1cf40f was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000072' failed to start. Not enough memory in the system to start the virtual machine instance-00000072. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000072' failed to start. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Not enough memory in the system to start the virtual machine instance-00000072 with ram size 1024 megabytes. (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) 'instance-00000072' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 138D272C-09DC-46D4-B309-C447E7D767D1) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:16:20.085 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:16:20.085 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:16:20.085 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:16:20.085 4088 3038342257832 MainThread DEBUG nova.network.neutron [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:16:21.460 4088 3038342257832 MainThread DEBUG nova.network.neutron [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:16:21.501 4088 3038342257832 MainThread INFO nova.compute.manager [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 236a5f41-195e-4bd9-9c70-230e5a1cf40f] Took 1.42 seconds to deallocate network for instance. 2021-09-10 17:16:21.866 4088 3038342257832 MainThread INFO nova.scheduler.client.report [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Deleted allocations for instance 236a5f41-195e-4bd9-9c70-230e5a1cf40f 2021-09-10 17:16:21.903 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-0d2d8f84-0a81-4f83-8b71-ac603395fb34 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "236a5f41-195e-4bd9-9c70-230e5a1cf40f" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 25.890s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:47.615 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_power_states run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:16:47.724 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 18930e09-cd62-4d3e-b27f-e9541dfa3efc _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:16:47.724 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:16:47.724 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 66c5445c-c347-4833-8af8-58ba8ff6d95e _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:16:47.724 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:16:47.724 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9db39d70-5120-4de4-bb87-480a6efb8a3a _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:16:47.724 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 0e77fafa-3f8a-4513-bb64-518c77e99029 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:16:47.724 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 50586591-86ba-41be-b4e1-5004ea0d76dd _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:16:47.724 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 98da4c02-e4db-4a02-a807-c737f9038672 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:16:47.724 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 359fd482-69f5-4194-9466-f46ea31258d3 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:16:47.724 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 6a33a253-c7b1-44b1-bdc0-eca64733ab55 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:16:47.724 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 592bb39a-81cb-43f8-a643-b04092bd9e8a _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:16:47.724 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9446e666-4364-4dcd-b041-405653a856bd _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:16:47.724 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9bb2d354-2d76-40ea-8b9c-b18a21edefbb _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:16:47.724 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "359fd482-69f5-4194-9466-f46ea31258d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:47.724 4088 3038340493160 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:47.745 4088 3038342256248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:47.745 4088 3038342256248 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:47.745 4088 3038342257480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:47.745 4088 3038342257480 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:47.745 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:47.745 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:47.745 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:47.745 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:47.745 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:47.745 4088 3038340491224 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:47.745 4088 3038342255544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "98da4c02-e4db-4a02-a807-c737f9038672" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:47.745 4088 3038342255544 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:47.745 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9446e666-4364-4dcd-b041-405653a856bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:47.745 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 9446e666-4364-4dcd-b041-405653a856bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:47.745 4088 3038340490344 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:47.745 4088 3038340490344 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:47.745 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:47.745 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:47.745 4088 3038342257304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:47.745 4088 3038342257304 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:47.760 4088 3038342257128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:47.760 4088 3038342257128 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:47.760 4088 3038342255368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:47.760 4088 3038342255368 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:16:47.974 4088 3038342256248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.234s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:48.068 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:48.068 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:48.068 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "359fd482-69f5-4194-9466-f46ea31258d3" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.344s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:48.084 4088 3038342257128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:48.193 4088 3038340490344 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:48.209 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:48.209 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9446e666-4364-4dcd-b041-405653a856bd" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:48.271 4088 3038342257480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.531s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:48.287 4088 3038342255544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "98da4c02-e4db-4a02-a807-c737f9038672" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.547s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:48.318 4088 3038342255368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.562s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:48.334 4088 3038342257304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.594s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:48.334 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.594s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:53.637 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:16:54.505 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:16:56.177 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Lock "8ee5dab1-c5ca-4888-b656-e2359a016d43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:56.217 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:16:56.381 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:56.381 4088 3038340492280 MainThread DEBUG nova.virt.hardware [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:16:56.381 4088 3038340492280 MainThread INFO nova.compute.claims [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Claim successful on node n-h2-808474-1 2021-09-10 17:16:56.520 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:16:56.665 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.hostops [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:16:56.677 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.hostops [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:16:56.883 4088 3038340492280 MainThread DEBUG nova.compute.provider_tree [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:16:56.895 4088 3038340492280 MainThread DEBUG nova.scheduler.client.report [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:16:56.895 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:56.895 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:16:57.052 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:16:57.052 4088 3038342257832 GreenThread-105 DEBUG nova.compute.manager [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:16:57.052 4088 3038342257832 GreenThread-105 DEBUG nova.network.neutron [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:16:57.412 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:16:57.427 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Spawning new instance 2021-09-10 17:16:57.446 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Lock "instance-00000073" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:57.446 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Lock "instance-00000073" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:57.446 4088 3038340492280 MainThread DEBUG nova.block_device [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:16:57.446 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:16:57.446 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:16:57.458 4088 3038340492280 MainThread DEBUG os_win.utils.pathutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Creating directory: C:\openstack\instances\instance-00000073 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:16:57.458 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000073\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:16:57.507 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:16:57.507 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:16:57.692 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Resizing VHD C:\openstack\instances\instance-00000073\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:16:58.071 4088 3038342257832 GreenThread-105 DEBUG nova.policy [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f9bbe6baa01415c8d1cbf1560a0a6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8755ff27ce54a87aae58455dcebfc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:16:58.524 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:16:58.524 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:17:00.509 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:17:00.525 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_incomplete_migrations run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:17:00.525 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances with incomplete migration _cleanup_incomplete_migrations c:\openstack\build\nova\nova\compute\manager.py:10640 2021-09-10 17:17:01.539 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:17:02.512 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:17:02.512 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:17:02.728 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-98da4c02-e4db-4a02-a807-c737f9038672" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:17:02.728 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:17:03.458 4088 3038342257832 GreenThread-105 DEBUG nova.network.neutron [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Successfully created port: 63bdfb28-4b4e-4e81-8b15-c1020eebcb94 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:17:04.259 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Updating instance_info_cache with network_info: [{"id": "51e81291-5d40-4203-b72f-f016060edd87", "address": "fa:16:3e:82:36:43", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap51e81291-5d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:17:04.274 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-98da4c02-e4db-4a02-a807-c737f9038672" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:17:04.274 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:17:05.496 4088 3038342257832 GreenThread-105 DEBUG nova.network.neutron [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Successfully updated port: 63bdfb28-4b4e-4e81-8b15-c1020eebcb94 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:17:05.520 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:17:05.524 4088 3038342257832 GreenThread-105 DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Acquired lock "refresh_cache-8ee5dab1-c5ca-4888-b656-e2359a016d43" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:17:05.540 4088 3038342257832 GreenThread-105 DEBUG nova.network.neutron [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:17:05.540 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:05.540 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:05.540 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:17:05.540 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:17:05.567 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:17:05.618 4088 3038340493160 MainThread DEBUG nova.compute.manager [req-b1209b00-1abd-4f0e-a14f-25ec429d4f9a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Received event network-changed-63bdfb28-4b4e-4e81-8b15-c1020eebcb94 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:17:05.618 4088 3038340493160 MainThread DEBUG nova.compute.manager [req-b1209b00-1abd-4f0e-a14f-25ec429d4f9a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Refreshing instance network info cache due to event network-changed-63bdfb28-4b4e-4e81-8b15-c1020eebcb94. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:17:05.678 4088 3038342257832 GreenThread-105 DEBUG nova.network.neutron [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:17:05.786 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2236MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:17:05.810 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:06.619 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:17:06.619 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:17:06.619 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:17:06.619 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:17:06.619 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:17:06.619 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:17:06.619 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:17:06.619 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:17:06.619 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:17:06.619 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:17:06.619 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:17:06.619 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:17:06.619 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:17:06.619 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 8ee5dab1-c5ca-4888-b656-e2359a016d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:17:06.619 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:17:06.619 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=14GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:17:06.692 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing inventories for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:757 2021-09-10 17:17:06.756 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Updating ProviderTree inventory for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 from _refresh_and_get_inventory using data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} _refresh_and_get_inventory c:\openstack\build\nova\nova\scheduler\client\report.py:723 2021-09-10 17:17:06.756 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Updating inventory in ProviderTree for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 with inventory: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:176 2021-09-10 17:17:06.796 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing aggregate associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, aggregates: None _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:766 2021-09-10 17:17:06.879 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing trait associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_VHD,COMPUTE_IMAGE_TYPE_VHDX,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:778 2021-09-10 17:17:06.879 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:17:06.895 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:17:06.993 4088 3038342257832 GreenThread-105 DEBUG nova.network.neutron [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Updating instance_info_cache with network_info: [{"id": "63bdfb28-4b4e-4e81-8b15-c1020eebcb94", "address": "fa:16:3e:8e:86:0a", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap63bdfb28-4b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:17:07.024 4088 3038342257832 GreenThread-105 DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Releasing lock "refresh_cache-8ee5dab1-c5ca-4888-b656-e2359a016d43" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:17:07.024 4088 3038342257832 GreenThread-105 DEBUG nova.compute.manager [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Instance network_info: |[{"id": "63bdfb28-4b4e-4e81-8b15-c1020eebcb94", "address": "fa:16:3e:8e:86:0a", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap63bdfb28-4b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:17:07.024 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Preparing to wait for external event network-vif-plugged-63bdfb28-4b4e-4e81-8b15-c1020eebcb94 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:17:07.024 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Lock "8ee5dab1-c5ca-4888-b656-e2359a016d43-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:07.024 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Lock "8ee5dab1-c5ca-4888-b656-e2359a016d43-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:07.024 4088 3038340492280 MainThread DEBUG os_win.utils.compute.vmutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Creating VM instance-00000073 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:17:07.024 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-b1209b00-1abd-4f0e-a14f-25ec429d4f9a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-8ee5dab1-c5ca-4888-b656-e2359a016d43" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:17:07.024 4088 3038340493160 MainThread DEBUG nova.network.neutron [req-b1209b00-1abd-4f0e-a14f-25ec429d4f9a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Refreshing network info cache for port 63bdfb28-4b4e-4e81-8b15-c1020eebcb94 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:17:07.116 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:17:07.131 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:17:07.131 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:17:07.131 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:08.478 4088 3038340493160 MainThread DEBUG nova.network.neutron [req-b1209b00-1abd-4f0e-a14f-25ec429d4f9a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Updated VIF entry in instance network info cache for port 63bdfb28-4b4e-4e81-8b15-c1020eebcb94. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:17:08.478 4088 3038340493160 MainThread DEBUG nova.network.neutron [req-b1209b00-1abd-4f0e-a14f-25ec429d4f9a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Updating instance_info_cache with network_info: [{"id": "63bdfb28-4b4e-4e81-8b15-c1020eebcb94", "address": "fa:16:3e:8e:86:0a", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap63bdfb28-4b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:17:08.523 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:17:08.552 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [req-b1209b00-1abd-4f0e-a14f-25ec429d4f9a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-8ee5dab1-c5ca-4888-b656-e2359a016d43" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:17:08.755 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:17:11.771 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:17:12.506 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._run_pending_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:17:12.506 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10602 2021-09-10 17:17:12.538 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] There are 0 instances to clean _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10611 2021-09-10 17:17:18.285 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Lock "93488f38-5aea-4764-bdcd-f98205b2fdbf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:18.336 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:17:18.526 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:18.526 4088 3038300758440 MainThread DEBUG nova.virt.hardware [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:17:18.526 4088 3038300758440 MainThread INFO nova.compute.claims [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Claim successful on node n-h2-808474-1 2021-09-10 17:17:18.755 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.hostops [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:17:18.770 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.hostops [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:17:18.916 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-ad158f08-331e-4999-83e3-a78435948e83 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Received event network-vif-plugged-63bdfb28-4b4e-4e81-8b15-c1020eebcb94 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:17:18.916 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-ad158f08-331e-4999-83e3-a78435948e83 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "8ee5dab1-c5ca-4888-b656-e2359a016d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:18.916 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-ad158f08-331e-4999-83e3-a78435948e83 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "8ee5dab1-c5ca-4888-b656-e2359a016d43-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:18.916 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-ad158f08-331e-4999-83e3-a78435948e83 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Processing event network-vif-plugged-63bdfb28-4b4e-4e81-8b15-c1020eebcb94 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:17:18.963 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Using config drive for instance 2021-09-10 17:17:18.988 4088 3038300758440 MainThread DEBUG nova.compute.provider_tree [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:17:19.012 4088 3038300758440 MainThread DEBUG nova.scheduler.client.report [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:17:19.012 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:19.012 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:17:19.150 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:17:19.150 4088 3038342146888 GreenThread-106 DEBUG nova.compute.manager [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:17:19.150 4088 3038342146888 GreenThread-106 DEBUG nova.network.neutron [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:17:19.479 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Creating config drive at C:\openstack\instances\instance-00000073\configdrive.iso 2021-09-10 17:17:19.572 4088 3038340492280 MainThread DEBUG oslo_concurrency.processutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000073\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpfstyg1hn execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:17:19.723 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:17:19.723 4088 3038300758440 MainThread INFO nova.virt.hyperv.vmops [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Spawning new instance 2021-09-10 17:17:19.743 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Lock "instance-00000074" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:19.743 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Lock "instance-00000074" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:19.743 4088 3038300758440 MainThread DEBUG nova.block_device [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:17:19.743 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:19.743 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:19.760 4088 3038300758440 MainThread DEBUG os_win.utils.pathutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Creating directory: C:\openstack\instances\instance-00000074 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:17:19.760 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.vmops [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000074\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:17:19.887 4088 3038340492280 MainThread DEBUG oslo_concurrency.processutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000073\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpfstyg1hn" returned: 0 in 0.313s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:17:19.992 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.vmops [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Resizing VHD C:\openstack\instances\instance-00000074\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:17:20.020 4088 3038342146888 GreenThread-106 DEBUG nova.policy [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11e4c6eac8924ee882931a301b388a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12cf0aeb647e41119e2189d6819df350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:17:20.432 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Setting boot order for instance: instance-00000073: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:17:20.537 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:17:20.573 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Waiting for WMI job: {'InstanceID': 'E9B19C77-280B-4678-84BE-E6AC613EE747', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20347), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:20.698 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] WMI job failed: {'RawErrors': (('124\'instance-00000073\' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)instance-00000073D4AC260A-4AF4-431E-B4DB-328881CDEB6612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)instance-00000073D4AC260A-4AF4-431E-B4DB-328881CDEB6610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000073\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)instance-00000073D4AC260A-4AF4-431E-B4DB-328881CDEB66%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E9B19C77-280B-4678-84BE-E6AC613EE747', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113240), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 17, 20), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 17, 20), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000073' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)\n\nNot enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)\n\n'instance-00000073' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)", 'ErrorSummaryDescription': "'instance-00000073' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000073.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:17:20.698 4088 3038340492280 MainThread DEBUG os_win._utils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000073' failed to start. Not enough memory in the system to start the virtual machine instance-00000073. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000073' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Not enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) 'instance-00000073' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.16081976890563965 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:17:20.755 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000073" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:20.755 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000073" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:20.755 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:17:20.755 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] VM Stopped (Lifecycle Event) 2021-09-10 17:17:20.788 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-675b0895-5729-489e-b429-b8d895e4ade6 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:17:20.788 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-675b0895-5729-489e-b429-b8d895e4ade6 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:17:20.835 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-675b0895-5729-489e-b429-b8d895e4ade6 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:17:20.885 4088 3038300761080 MainThread INFO nova.compute.manager [req-675b0895-5729-489e-b429-b8d895e4ade6 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:17:21.724 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Waiting for WMI job: {'InstanceID': '6DB786FE-9DED-44D2-832C-C5CF1A99F288', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15482), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:21.852 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] WMI job failed: {'RawErrors': (('124\'instance-00000073\' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)instance-00000073D4AC260A-4AF4-431E-B4DB-328881CDEB6612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)instance-00000073D4AC260A-4AF4-431E-B4DB-328881CDEB6610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000073\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)instance-00000073D4AC260A-4AF4-431E-B4DB-328881CDEB66%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6DB786FE-9DED-44D2-832C-C5CF1A99F288', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111544), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 17, 21), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 17, 21), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000073' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)\n\nNot enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)\n\n'instance-00000073' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)", 'ErrorSummaryDescription': "'instance-00000073' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000073.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:17:21.852 4088 3038340492280 MainThread DEBUG os_win._utils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000073' failed to start. Not enough memory in the system to start the virtual machine instance-00000073. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000073' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Not enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) 'instance-00000073' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3148953914642334 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:17:21.896 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:17:21.896 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] VM Stopped (Lifecycle Event) 2021-09-10 17:17:21.896 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000073" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:21.896 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000073" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:21.926 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-7a897b83-4065-4f4a-aa21-1f5f8d5c7a16 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:17:21.926 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-7a897b83-4065-4f4a-aa21-1f5f8d5c7a16 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:17:21.957 4088 3038342146888 GreenThread-106 DEBUG nova.network.neutron [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Successfully created port: 47b4f464-5f61-478e-a198-51a55591bf2f _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:17:21.989 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-7a897b83-4065-4f4a-aa21-1f5f8d5c7a16 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:17:22.052 4088 3038300761080 MainThread INFO nova.compute.manager [req-7a897b83-4065-4f4a-aa21-1f5f8d5c7a16 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:17:22.888 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Waiting for WMI job: {'InstanceID': '5021424F-9C62-48D1-AB30-4C32DAE74F08', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16029), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:23.042 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] WMI job failed: {'RawErrors': (('124\'instance-00000073\' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)instance-00000073D4AC260A-4AF4-431E-B4DB-328881CDEB6612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)instance-00000073D4AC260A-4AF4-431E-B4DB-328881CDEB6610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000073\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)instance-00000073D4AC260A-4AF4-431E-B4DB-328881CDEB66%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5021424F-9C62-48D1-AB30-4C32DAE74F08', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112935), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 17, 22), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 17, 22), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000073' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)\n\nNot enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)\n\n'instance-00000073' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)", 'ErrorSummaryDescription': "'instance-00000073' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000073.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:17:23.042 4088 3038340492280 MainThread DEBUG os_win._utils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000073' failed to start. Not enough memory in the system to start the virtual machine instance-00000073. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000073' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Not enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) 'instance-00000073' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5055999755859375 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:17:23.074 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000073" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:23.088 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000073" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:23.088 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:17:23.088 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] VM Stopped (Lifecycle Event) 2021-09-10 17:17:23.176 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-3b9cae70-dc26-4508-bb9c-f21ed8b7c654 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:17:23.176 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-3b9cae70-dc26-4508-bb9c-f21ed8b7c654 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:17:23.235 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-3b9cae70-dc26-4508-bb9c-f21ed8b7c654 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:17:23.302 4088 3038300761080 MainThread INFO nova.compute.manager [req-3b9cae70-dc26-4508-bb9c-f21ed8b7c654 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:17:23.302 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "3b484a16-f305-421b-a31a-69bd404d1d4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:23.332 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:17:23.479 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:23.490 4088 3038342145480 MainThread DEBUG nova.virt.hardware [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:17:23.490 4088 3038342145480 MainThread INFO nova.compute.claims [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Claim successful on node n-h2-808474-1 2021-09-10 17:17:23.738 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.hostops [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:17:23.759 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.hostops [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:17:23.963 4088 3038342145480 MainThread DEBUG nova.compute.provider_tree [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:17:23.988 4088 3038342145480 MainThread DEBUG nova.scheduler.client.report [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:17:23.992 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:23.992 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:17:23.992 4088 3038342146888 GreenThread-106 DEBUG nova.network.neutron [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Successfully updated port: 47b4f464-5f61-478e-a198-51a55591bf2f _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:17:24.041 4088 3038342146888 GreenThread-106 DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Acquired lock "refresh_cache-93488f38-5aea-4764-bdcd-f98205b2fdbf" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:17:24.041 4088 3038342146888 GreenThread-106 DEBUG nova.network.neutron [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:17:24.072 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Waiting for WMI job: {'InstanceID': '3FC8F8E8-1533-454B-96D0-F50CD0C4ADB9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14912), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:24.166 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:17:24.166 4088 3038342144424 GreenThread-107 DEBUG nova.compute.manager [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:17:24.166 4088 3038342144424 GreenThread-107 DEBUG nova.network.neutron [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:17:24.226 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] WMI job failed: {'RawErrors': (('124\'instance-00000073\' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)instance-00000073D4AC260A-4AF4-431E-B4DB-328881CDEB6612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)instance-00000073D4AC260A-4AF4-431E-B4DB-328881CDEB6610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000073\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)instance-00000073D4AC260A-4AF4-431E-B4DB-328881CDEB66%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3FC8F8E8-1533-454B-96D0-F50CD0C4ADB9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112552), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 17, 24), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 17, 24), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000073' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)\n\nNot enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)\n\n'instance-00000073' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)", 'ErrorSummaryDescription': "'instance-00000073' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000073.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:17:24.226 4088 3038340492280 MainThread DEBUG os_win._utils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000073' failed to start. Not enough memory in the system to start the virtual machine instance-00000073. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000073' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Not enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) 'instance-00000073' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.688816785812378 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:17:24.264 4088 3038342146888 GreenThread-106 DEBUG nova.network.neutron [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:17:24.264 4088 3038342144600 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:17:24.264 4088 3038342144600 MainThread INFO nova.compute.manager [-] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] VM Stopped (Lifecycle Event) 2021-09-10 17:17:24.276 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000073" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:24.276 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000073" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:24.287 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-4cbe17fc-2f86-46a1-a397-4e85c3aa423c - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:17:24.287 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-4cbe17fc-2f86-46a1-a397-4e85c3aa423c - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:17:24.338 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-4cbe17fc-2f86-46a1-a397-4e85c3aa423c - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:17:24.363 4088 3038342144600 MainThread INFO nova.compute.manager [req-4cbe17fc-2f86-46a1-a397-4e85c3aa423c - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:17:24.363 4088 3038342144424 GreenThread-107 DEBUG nova.policy [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '799e4a49be0e448b9d6d54d57b7d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf483b0ac5349bca4c898bb3b806d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:17:24.394 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:17:24.405 4088 3038342145480 MainThread INFO nova.virt.hyperv.vmops [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Spawning new instance 2021-09-10 17:17:24.416 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000075" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:24.416 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000075" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:24.416 4088 3038342145480 MainThread DEBUG nova.block_device [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:17:24.416 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:24.416 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:24.416 4088 3038342145480 MainThread DEBUG os_win.utils.pathutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Creating directory: C:\openstack\instances\instance-00000075 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:17:24.416 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000075\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:17:24.519 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-d76f32b2-db51-419c-9381-fd0a66476cb7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Received event network-changed-47b4f464-5f61-478e-a198-51a55591bf2f external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:17:24.520 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-d76f32b2-db51-419c-9381-fd0a66476cb7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Refreshing instance network info cache due to event network-changed-47b4f464-5f61-478e-a198-51a55591bf2f. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:17:24.672 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Resizing VHD C:\openstack\instances\instance-00000075\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:17:25.037 4088 3038342146888 GreenThread-106 DEBUG nova.network.neutron [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Updating instance_info_cache with network_info: [{"id": "47b4f464-5f61-478e-a198-51a55591bf2f", "address": "fa:16:3e:ba:20:4c", "network": {"id": "532751df-3933-413f-b51b-1349c0db7399", "bridge": null, "label": "tempest-VolumesActionsTest-94880735-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "12cf0aeb647e41119e2189d6819df350", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap47b4f464-5f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:17:25.072 4088 3038342146888 GreenThread-106 DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Releasing lock "refresh_cache-93488f38-5aea-4764-bdcd-f98205b2fdbf" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:17:25.072 4088 3038342146888 GreenThread-106 DEBUG nova.compute.manager [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Instance network_info: |[{"id": "47b4f464-5f61-478e-a198-51a55591bf2f", "address": "fa:16:3e:ba:20:4c", "network": {"id": "532751df-3933-413f-b51b-1349c0db7399", "bridge": null, "label": "tempest-VolumesActionsTest-94880735-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "12cf0aeb647e41119e2189d6819df350", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap47b4f464-5f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:17:25.072 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Preparing to wait for external event network-vif-plugged-47b4f464-5f61-478e-a198-51a55591bf2f prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:17:25.072 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Lock "93488f38-5aea-4764-bdcd-f98205b2fdbf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:25.072 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Lock "93488f38-5aea-4764-bdcd-f98205b2fdbf-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:25.072 4088 3038300758440 MainThread DEBUG os_win.utils.compute.vmutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Creating VM instance-00000074 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:17:25.072 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-d76f32b2-db51-419c-9381-fd0a66476cb7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-93488f38-5aea-4764-bdcd-f98205b2fdbf" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:17:25.072 4088 3038342144600 MainThread DEBUG nova.network.neutron [req-d76f32b2-db51-419c-9381-fd0a66476cb7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Refreshing network info cache for port 47b4f464-5f61-478e-a198-51a55591bf2f _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:17:25.250 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Waiting for WMI job: {'InstanceID': '0C6F8F8D-F213-4389-A10F-823C88746957', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15632), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:25.384 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] WMI job failed: {'RawErrors': (('124\'instance-00000073\' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)instance-00000073D4AC260A-4AF4-431E-B4DB-328881CDEB6612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)instance-00000073D4AC260A-4AF4-431E-B4DB-328881CDEB6610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000073\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)instance-00000073D4AC260A-4AF4-431E-B4DB-328881CDEB66%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0C6F8F8D-F213-4389-A10F-823C88746957', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119728), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 17, 25), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 17, 25), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000073' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)\n\nNot enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)\n\n'instance-00000073' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)", 'ErrorSummaryDescription': "'instance-00000073' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000073.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:17:25.384 4088 3038340492280 MainThread DEBUG os_win._utils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000073' failed to start. Not enough memory in the system to start the virtual machine instance-00000073. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000073' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Not enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) 'instance-00000073' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.847546339035034 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:17:25.457 4088 3038342144072 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:17:25.473 4088 3038342144072 MainThread INFO nova.compute.manager [-] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] VM Stopped (Lifecycle Event) 2021-09-10 17:17:25.473 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000073" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:25.473 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000073" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:25.535 4088 3038342144072 MainThread DEBUG nova.compute.manager [req-8f2f3a5a-a2e7-466d-afab-aebd1ff2f407 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:17:25.535 4088 3038342144072 MainThread DEBUG nova.virt.hyperv.vmops [req-8f2f3a5a-a2e7-466d-afab-aebd1ff2f407 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:17:25.615 4088 3038342144072 MainThread DEBUG nova.compute.manager [req-8f2f3a5a-a2e7-466d-afab-aebd1ff2f407 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:17:25.668 4088 3038342144072 MainThread INFO nova.compute.manager [req-8f2f3a5a-a2e7-466d-afab-aebd1ff2f407 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:17:25.896 4088 3038342144600 MainThread DEBUG nova.network.neutron [req-d76f32b2-db51-419c-9381-fd0a66476cb7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Updated VIF entry in instance network info cache for port 47b4f464-5f61-478e-a198-51a55591bf2f. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:17:25.896 4088 3038342144600 MainThread DEBUG nova.network.neutron [req-d76f32b2-db51-419c-9381-fd0a66476cb7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Updating instance_info_cache with network_info: [{"id": "47b4f464-5f61-478e-a198-51a55591bf2f", "address": "fa:16:3e:ba:20:4c", "network": {"id": "532751df-3933-413f-b51b-1349c0db7399", "bridge": null, "label": "tempest-VolumesActionsTest-94880735-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "12cf0aeb647e41119e2189d6819df350", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap47b4f464-5f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:17:25.917 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-d76f32b2-db51-419c-9381-fd0a66476cb7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-93488f38-5aea-4764-bdcd-f98205b2fdbf" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:17:26.411 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Waiting for WMI job: {'InstanceID': 'A59DD818-70A2-422C-803F-E61B9952E26C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16426), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:26.536 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] WMI job failed: {'RawErrors': (('124\'instance-00000073\' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)instance-00000073D4AC260A-4AF4-431E-B4DB-328881CDEB6612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)instance-00000073D4AC260A-4AF4-431E-B4DB-328881CDEB6610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000073\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)instance-00000073D4AC260A-4AF4-431E-B4DB-328881CDEB66%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A59DD818-70A2-422C-803F-E61B9952E26C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117333), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 17, 26), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 17, 26), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000073' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)\n\nNot enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)\n\n'instance-00000073' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66)", 'ErrorSummaryDescription': "'instance-00000073' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000073.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:17:26.536 4088 3038340492280 MainThread ERROR nova.virt.hyperv.vmops [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Failed to change vm state of instance-00000073 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000073' failed to start. 2021-09-10 17:17:26.536 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Got request to destroy instance 2021-09-10 17:17:26.649 4088 3038342144600 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:17:26.649 4088 3038342144600 MainThread INFO nova.compute.manager [-] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] VM Stopped (Lifecycle Event) 2021-09-10 17:17:26.649 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000073" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:26.649 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000073" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:26.708 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-b3494722-fa6b-4d62-a12f-ad0023ad3a97 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:17:26.708 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-b3494722-fa6b-4d62-a12f-ad0023ad3a97 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:17:26.754 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-b3494722-fa6b-4d62-a12f-ad0023ad3a97 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:17:26.788 4088 3038342144600 MainThread INFO nova.compute.manager [req-b3494722-fa6b-4d62-a12f-ad0023ad3a97 - - - - -] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:17:26.834 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.vmops [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:17:27.177 4088 3038342144424 GreenThread-107 DEBUG nova.network.neutron [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Successfully created port: 4c6d3dfa-bc14-4cc8-ac7b-e0bc265d641e _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:17:28.542 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:17:28.542 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Lock "instance-00000073" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:28.558 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Lock "instance-00000073" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:28.574 4088 3038340492280 MainThread DEBUG os_win.utils.compute.vmutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Successfully changed vm state of instance-00000073 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:17:28.574 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Successfully changed state of VM instance-00000073 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:17:28.619 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Waiting for WMI job: {'InstanceID': 'AE8DE75B-FF6D-44E7-95E1-082414201CA8', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14882), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:28.746 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] WMI job succeeded: {'InstanceID': 'AE8DE75B-FF6D-44E7-95E1-082414201CA8', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=127623), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:17:28.746 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Lock "instance-00000073" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:28.746 4088 3038340492280 MainThread DEBUG os_win.utils.pathutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Removing directory: C:\openstack\instances\instance-00000073 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:17:28.746 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Lock "instance-00000073" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:28.746 4088 3038340492280 MainThread ERROR nova.compute.manager [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000073' failed to start. Not enough memory in the system to start the virtual machine instance-00000073. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000073' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Not enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) 'instance-00000073' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Error code: 32778. 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Traceback (most recent call last): 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] return function(*args, **kwargs) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] admin_password, network_info, block_device_info) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] return function(self, *args, **kwds) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self.force_reraise() 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] raise self.value 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] should_plug_vifs=False) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 'req_state': req_state}) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self.force_reraise() 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] raise self.value 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] time.sleep(sleep_time) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self.force_reraise() 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] raise self.value 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] return f(*args, **kwargs) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] return self._wait_for_job(job_path) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] error_desc=err_desc) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000073' failed to start. 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Not enough memory in the system to start the virtual machine instance-00000073. 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000073' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Not enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 'instance-00000073' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Error code: 32778. 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] During handling of the above exception, another exception occurred: 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Traceback (most recent call last): 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] yield resources 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] accel_info=accel_info) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] return function(*args, **kwargs) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] admin_password, network_info, block_device_info) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] return function(self, *args, **kwds) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self.force_reraise() 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] raise self.value 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] should_plug_vifs=False) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 'req_state': req_state}) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self.force_reraise() 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] raise self.value 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] time.sleep(sleep_time) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self.force_reraise() 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] raise self.value 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] return f(*args, **kwargs) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] return self._wait_for_job(job_path) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] error_desc=err_desc) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000073' failed to start. 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Not enough memory in the system to start the virtual machine instance-00000073. 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000073' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Not enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 'instance-00000073' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Error code: 32778. 2021-09-10 17:17:28.746 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:28.746 4088 3038340492280 MainThread INFO nova.compute.manager [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Terminating instance 2021-09-10 17:17:28.746 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:17:28.746 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Got request to destroy instance 2021-09-10 17:17:28.761 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:17:28.761 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Lock "instance-00000073" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:28.776 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Lock "instance-00000073" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:28.776 4088 3038340492280 MainThread INFO nova.compute.manager [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:17:28.776 4088 3038340492280 MainThread DEBUG nova.compute.claims [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:17:28.776 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:28.932 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.hostops [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:17:28.962 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.hostops [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:17:28.962 4088 3038342144424 GreenThread-107 DEBUG nova.network.neutron [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Successfully updated port: 4c6d3dfa-bc14-4cc8-ac7b-e0bc265d641e _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:17:28.973 4088 3038342144424 GreenThread-107 DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Acquired lock "refresh_cache-3b484a16-f305-421b-a31a-69bd404d1d4c" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:17:28.973 4088 3038342144424 GreenThread-107 DEBUG nova.network.neutron [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:17:29.051 4088 3038342144072 MainThread DEBUG nova.compute.manager [req-8a64a47d-30d3-4174-a784-bb004d22ab20 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Received event network-changed-4c6d3dfa-bc14-4cc8-ac7b-e0bc265d641e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:17:29.051 4088 3038342144072 MainThread DEBUG nova.compute.manager [req-8a64a47d-30d3-4174-a784-bb004d22ab20 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Refreshing instance network info cache due to event network-changed-4c6d3dfa-bc14-4cc8-ac7b-e0bc265d641e. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:17:29.130 4088 3038342144424 GreenThread-107 DEBUG nova.network.neutron [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:17:29.183 4088 3038340492280 MainThread DEBUG nova.compute.provider_tree [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:17:29.199 4088 3038340492280 MainThread DEBUG nova.scheduler.client.report [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:17:29.199 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:29.199 4088 3038340492280 MainThread ERROR nova.compute.manager [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000073' failed to start. Not enough memory in the system to start the virtual machine instance-00000073. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000073' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Not enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) 'instance-00000073' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Error code: 32778. 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Traceback (most recent call last): 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] return function(*args, **kwargs) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] admin_password, network_info, block_device_info) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] return function(self, *args, **kwds) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self.force_reraise() 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] raise self.value 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] should_plug_vifs=False) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 'req_state': req_state}) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self.force_reraise() 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] raise self.value 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] time.sleep(sleep_time) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self.force_reraise() 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] raise self.value 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] return f(*args, **kwargs) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] return self._wait_for_job(job_path) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] error_desc=err_desc) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000073' failed to start. 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Not enough memory in the system to start the virtual machine instance-00000073. 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000073' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Not enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 'instance-00000073' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Error code: 32778. 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] During handling of the above exception, another exception occurred: 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Traceback (most recent call last): 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] accel_info=accel_info) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] return function(*args, **kwargs) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] admin_password, network_info, block_device_info) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] return function(self, *args, **kwds) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self.force_reraise() 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] raise self.value 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] should_plug_vifs=False) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 'req_state': req_state}) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self.force_reraise() 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] raise self.value 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] time.sleep(sleep_time) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self.force_reraise() 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] raise self.value 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] return f(*args, **kwargs) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] return self._wait_for_job(job_path) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] error_desc=err_desc) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000073' failed to start. 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Not enough memory in the system to start the virtual machine instance-00000073. 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000073' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Not enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 'instance-00000073' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Error code: 32778. 2021-09-10 17:17:29.199 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] 2021-09-10 17:17:29.199 4088 3038340492280 MainThread DEBUG nova.compute.utils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] WMI job failed with status 10. Error summary description: 'instance-00000073' failed to start. Not enough memory in the system to start the virtual machine instance-00000073. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:17:29.199 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Build of instance 8ee5dab1-c5ca-4888-b656-e2359a016d43 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000073' failed to start. Not enough memory in the system to start the virtual machine instance-00000073. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000073' failed to start. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Not enough memory in the system to start the virtual machine instance-00000073 with ram size 1024 megabytes. (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) 'instance-00000073' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D4AC260A-4AF4-431E-B4DB-328881CDEB66) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:17:29.199 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:17:29.199 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:17:29.199 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:17:29.199 4088 3038340492280 MainThread DEBUG nova.network.neutron [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:17:29.761 4088 3038342144424 GreenThread-107 DEBUG nova.network.neutron [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Updating instance_info_cache with network_info: [{"id": "4c6d3dfa-bc14-4cc8-ac7b-e0bc265d641e", "address": "fa:16:3e:75:ce:84", "network": {"id": "4fcf38f4-2fb6-40c8-b7df-43fa2b0eb6ff", "bridge": null, "label": "tempest-network-smoke--1532811086", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5cf483b0ac5349bca4c898bb3b806d21", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4c6d3dfa-bc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:17:29.787 4088 3038342144424 GreenThread-107 DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Releasing lock "refresh_cache-3b484a16-f305-421b-a31a-69bd404d1d4c" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:17:29.787 4088 3038342144424 GreenThread-107 DEBUG nova.compute.manager [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Instance network_info: |[{"id": "4c6d3dfa-bc14-4cc8-ac7b-e0bc265d641e", "address": "fa:16:3e:75:ce:84", "network": {"id": "4fcf38f4-2fb6-40c8-b7df-43fa2b0eb6ff", "bridge": null, "label": "tempest-network-smoke--1532811086", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5cf483b0ac5349bca4c898bb3b806d21", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4c6d3dfa-bc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:17:29.787 4088 3038342144072 MainThread DEBUG oslo_concurrency.lockutils [req-8a64a47d-30d3-4174-a784-bb004d22ab20 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-3b484a16-f305-421b-a31a-69bd404d1d4c" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:17:29.787 4088 3038342144072 MainThread DEBUG nova.network.neutron [req-8a64a47d-30d3-4174-a784-bb004d22ab20 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Refreshing network info cache for port 4c6d3dfa-bc14-4cc8-ac7b-e0bc265d641e _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:17:29.787 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Preparing to wait for external event network-vif-plugged-4c6d3dfa-bc14-4cc8-ac7b-e0bc265d641e prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:17:29.787 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "3b484a16-f305-421b-a31a-69bd404d1d4c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:29.803 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "3b484a16-f305-421b-a31a-69bd404d1d4c-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:29.803 4088 3038342145480 MainThread DEBUG os_win.utils.compute.vmutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Creating VM instance-00000075 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:17:30.959 4088 3038342144072 MainThread DEBUG nova.network.neutron [req-8a64a47d-30d3-4174-a784-bb004d22ab20 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Updated VIF entry in instance network info cache for port 4c6d3dfa-bc14-4cc8-ac7b-e0bc265d641e. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:17:30.959 4088 3038342144072 MainThread DEBUG nova.network.neutron [req-8a64a47d-30d3-4174-a784-bb004d22ab20 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Updating instance_info_cache with network_info: [{"id": "4c6d3dfa-bc14-4cc8-ac7b-e0bc265d641e", "address": "fa:16:3e:75:ce:84", "network": {"id": "4fcf38f4-2fb6-40c8-b7df-43fa2b0eb6ff", "bridge": null, "label": "tempest-network-smoke--1532811086", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5cf483b0ac5349bca4c898bb3b806d21", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4c6d3dfa-bc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:17:31.004 4088 3038342144072 MainThread DEBUG oslo_concurrency.lockutils [req-8a64a47d-30d3-4174-a784-bb004d22ab20 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-3b484a16-f305-421b-a31a-69bd404d1d4c" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:17:31.558 4088 3038340492280 MainThread DEBUG nova.network.neutron [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:17:31.567 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:17:31.600 4088 3038340492280 MainThread INFO nova.compute.manager [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] [instance: 8ee5dab1-c5ca-4888-b656-e2359a016d43] Took 2.41 seconds to deallocate network for instance. 2021-09-10 17:17:31.823 4088 3038340492280 MainThread INFO nova.scheduler.client.report [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Deleted allocations for instance 8ee5dab1-c5ca-4888-b656-e2359a016d43 2021-09-10 17:17:31.880 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-ffcf8c73-ce46-468c-be2e-59a434f1ea2d 0f9bbe6baa01415c8d1cbf1560a0a6a3 b8755ff27ce54a87aae58455dcebfc3c - default default] Lock "8ee5dab1-c5ca-4888-b656-e2359a016d43" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 35.703s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:34.323 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-42a51da1-b111-480f-84dd-03dbe1394d69 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Received event network-vif-plugged-47b4f464-5f61-478e-a198-51a55591bf2f external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:17:34.323 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-42a51da1-b111-480f-84dd-03dbe1394d69 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "93488f38-5aea-4764-bdcd-f98205b2fdbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:34.323 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-42a51da1-b111-480f-84dd-03dbe1394d69 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "93488f38-5aea-4764-bdcd-f98205b2fdbf-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:34.323 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-42a51da1-b111-480f-84dd-03dbe1394d69 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Processing event network-vif-plugged-47b4f464-5f61-478e-a198-51a55591bf2f _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:17:34.367 4088 3038300758440 MainThread INFO nova.virt.hyperv.vmops [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Using config drive for instance 2021-09-10 17:17:34.574 4088 3038300758440 MainThread INFO nova.virt.hyperv.vmops [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Creating config drive at C:\openstack\instances\instance-00000074\configdrive.iso 2021-09-10 17:17:34.677 4088 3038300758440 MainThread DEBUG oslo_concurrency.processutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000074\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpkxnmveqg execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:17:34.992 4088 3038300758440 MainThread DEBUG oslo_concurrency.processutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000074\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpkxnmveqg" returned: 0 in 0.312s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:17:35.511 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.vmops [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Setting boot order for instance: instance-00000074: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:17:35.582 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.vmops [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:17:35.631 4088 3038300758440 MainThread DEBUG os_win.utils.jobutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Waiting for WMI job: {'InstanceID': '6B996EF4-F16D-4924-9591-40917AAFB4B1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15697), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:35.775 4088 3038300758440 MainThread ERROR os_win.utils.jobutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000074\' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)instance-000000744084533D-355F-4F36-9F65-6E5ABE3F8CF612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)instance-000000744084533D-355F-4F36-9F65-6E5ABE3F8CF610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000074\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)instance-000000744084533D-355F-4F36-9F65-6E5ABE3F8CF6%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6B996EF4-F16D-4924-9591-40917AAFB4B1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115075), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 17, 35), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 17, 35), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000074' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)\n\nNot enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)\n\n'instance-00000074' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)", 'ErrorSummaryDescription': "'instance-00000074' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000074.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:17:35.775 4088 3038300758440 MainThread DEBUG os_win._utils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000074' failed to start. Not enough memory in the system to start the virtual machine instance-00000074. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000074' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Not enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) 'instance-00000074' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1934375762939453 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:17:35.816 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:17:35.816 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] VM Stopped (Lifecycle Event) 2021-09-10 17:17:35.816 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000074" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:35.816 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000074" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:35.835 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-fb0cb63c-94b3-416a-b41f-2617fd03bb52 - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:17:35.835 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-fb0cb63c-94b3-416a-b41f-2617fd03bb52 - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:17:35.897 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-fb0cb63c-94b3-416a-b41f-2617fd03bb52 - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:17:35.957 4088 3038300761080 MainThread INFO nova.compute.manager [req-fb0cb63c-94b3-416a-b41f-2617fd03bb52 - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:17:36.787 4088 3038300758440 MainThread DEBUG os_win.utils.jobutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Waiting for WMI job: {'InstanceID': 'E3D4FFD0-49AC-4AC6-A922-9C0B3C5B9FC8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17703), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:36.943 4088 3038300758440 MainThread ERROR os_win.utils.jobutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000074\' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)instance-000000744084533D-355F-4F36-9F65-6E5ABE3F8CF612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)instance-000000744084533D-355F-4F36-9F65-6E5ABE3F8CF610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000074\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)instance-000000744084533D-355F-4F36-9F65-6E5ABE3F8CF6%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E3D4FFD0-49AC-4AC6-A922-9C0B3C5B9FC8', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112312), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 17, 36), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 17, 36), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000074' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)\n\nNot enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)\n\n'instance-00000074' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)", 'ErrorSummaryDescription': "'instance-00000074' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000074.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:17:36.943 4088 3038300758440 MainThread DEBUG os_win._utils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000074' failed to start. Not enough memory in the system to start the virtual machine instance-00000074. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000074' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Not enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) 'instance-00000074' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3613102436065674 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:17:36.979 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000074" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:36.979 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000074" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:36.979 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:17:36.979 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] VM Stopped (Lifecycle Event) 2021-09-10 17:17:37.027 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-d98da53c-9a0b-4906-a7da-2f651a359b58 - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:17:37.027 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-d98da53c-9a0b-4906-a7da-2f651a359b58 - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:17:37.148 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-d98da53c-9a0b-4906-a7da-2f651a359b58 - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:17:37.192 4088 3038300761080 MainThread INFO nova.compute.manager [req-d98da53c-9a0b-4906-a7da-2f651a359b58 - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:17:37.988 4088 3038300758440 MainThread DEBUG os_win.utils.jobutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Waiting for WMI job: {'InstanceID': 'E3329489-7D54-45F4-AB15-56B26BC07A33', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15222), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:38.152 4088 3038300758440 MainThread ERROR os_win.utils.jobutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000074\' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)instance-000000744084533D-355F-4F36-9F65-6E5ABE3F8CF612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)instance-000000744084533D-355F-4F36-9F65-6E5ABE3F8CF610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000074\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)instance-000000744084533D-355F-4F36-9F65-6E5ABE3F8CF6%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E3329489-7D54-45F4-AB15-56B26BC07A33', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116643), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 17, 37), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 17, 38), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000074' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)\n\nNot enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)\n\n'instance-00000074' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)", 'ErrorSummaryDescription': "'instance-00000074' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000074.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:17:38.152 4088 3038300758440 MainThread DEBUG os_win._utils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000074' failed to start. Not enough memory in the system to start the virtual machine instance-00000074. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000074' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Not enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) 'instance-00000074' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5700180530548096 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:17:38.185 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:17:38.185 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] VM Stopped (Lifecycle Event) 2021-09-10 17:17:38.185 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000074" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:38.185 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000074" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:38.208 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-a55ac651-ec09-469d-bb92-f9c504efbd9e - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:17:38.208 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-a55ac651-ec09-469d-bb92-f9c504efbd9e - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:17:38.262 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-a55ac651-ec09-469d-bb92-f9c504efbd9e - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:17:38.301 4088 3038300761080 MainThread INFO nova.compute.manager [req-a55ac651-ec09-469d-bb92-f9c504efbd9e - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:17:38.301 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-60384237-4c36-4055-9b92-94a219257094 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Received event network-vif-plugged-4c6d3dfa-bc14-4cc8-ac7b-e0bc265d641e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:17:38.301 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-60384237-4c36-4055-9b92-94a219257094 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "3b484a16-f305-421b-a31a-69bd404d1d4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:38.317 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-60384237-4c36-4055-9b92-94a219257094 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "3b484a16-f305-421b-a31a-69bd404d1d4c-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:38.317 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-60384237-4c36-4055-9b92-94a219257094 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Processing event network-vif-plugged-4c6d3dfa-bc14-4cc8-ac7b-e0bc265d641e _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:17:38.347 4088 3038342145480 MainThread INFO nova.virt.hyperv.vmops [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Using config drive for instance 2021-09-10 17:17:38.681 4088 3038342145480 MainThread INFO nova.virt.hyperv.vmops [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Creating config drive at C:\openstack\instances\instance-00000075\configdrive.iso 2021-09-10 17:17:38.777 4088 3038342145480 MainThread DEBUG oslo_concurrency.processutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000075\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp4zyoeyzi execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:17:39.084 4088 3038342145480 MainThread DEBUG oslo_concurrency.processutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000075\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp4zyoeyzi" returned: 0 in 0.313s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:17:39.178 4088 3038300758440 MainThread DEBUG os_win.utils.jobutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Waiting for WMI job: {'InstanceID': '737AE39C-D929-4111-B99D-5FF131D81261', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15235), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:39.317 4088 3038300758440 MainThread ERROR os_win.utils.jobutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000074\' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)instance-000000744084533D-355F-4F36-9F65-6E5ABE3F8CF612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)instance-000000744084533D-355F-4F36-9F65-6E5ABE3F8CF610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000074\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)instance-000000744084533D-355F-4F36-9F65-6E5ABE3F8CF6%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '737AE39C-D929-4111-B99D-5FF131D81261', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114267), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 17, 39), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 17, 39), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000074' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)\n\nNot enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)\n\n'instance-00000074' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)", 'ErrorSummaryDescription': "'instance-00000074' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000074.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:17:39.317 4088 3038300758440 MainThread DEBUG os_win._utils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000074' failed to start. Not enough memory in the system to start the virtual machine instance-00000074. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000074' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Not enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) 'instance-00000074' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7346608638763428 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:17:39.378 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:17:39.378 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] VM Stopped (Lifecycle Event) 2021-09-10 17:17:39.378 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000074" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:39.378 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000074" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:39.408 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-14e33b06-ceaa-40d1-bb84-e9335df6effb - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:17:39.423 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-14e33b06-ceaa-40d1-bb84-e9335df6effb - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:17:39.465 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-14e33b06-ceaa-40d1-bb84-e9335df6effb - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:17:39.495 4088 3038300761080 MainThread INFO nova.compute.manager [req-14e33b06-ceaa-40d1-bb84-e9335df6effb - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:17:39.675 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Setting boot order for instance: instance-00000075: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:17:39.769 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:17:39.801 4088 3038342145480 MainThread DEBUG os_win.utils.jobutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '0ADED19F-003D-4553-AB78-D151B4906043', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14755), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:39.942 4088 3038342145480 MainThread ERROR os_win.utils.jobutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000075\' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)instance-00000075C8EFE004-4B17-458C-8BD3-46AA8330637012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)instance-00000075C8EFE004-4B17-458C-8BD3-46AA8330637010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000075\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)instance-00000075C8EFE004-4B17-458C-8BD3-46AA83306370%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0ADED19F-003D-4553-AB78-D151B4906043', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115695), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 17, 39), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 17, 39), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000075' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)\n\nNot enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)\n\n'instance-00000075' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)", 'ErrorSummaryDescription': "'instance-00000075' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000075.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:17:39.942 4088 3038342145480 MainThread DEBUG os_win._utils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000075' failed to start. Not enough memory in the system to start the virtual machine instance-00000075. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000075' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Not enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) 'instance-00000075' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.17305493354797363 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:17:39.942 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000075" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:39.942 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000075" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:39.942 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:17:39.942 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] VM Stopped (Lifecycle Event) 2021-09-10 17:17:39.981 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-6c29c8ac-1ba8-46c1-9208-ef962a963ac6 - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:17:39.981 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-6c29c8ac-1ba8-46c1-9208-ef962a963ac6 - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:17:40.019 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-6c29c8ac-1ba8-46c1-9208-ef962a963ac6 - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:17:40.060 4088 3038300761080 MainThread INFO nova.compute.manager [req-6c29c8ac-1ba8-46c1-9208-ef962a963ac6 - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:17:40.348 4088 3038300758440 MainThread DEBUG os_win.utils.jobutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Waiting for WMI job: {'InstanceID': '50FAD294-4FD7-4F7C-B524-6E3727B1DEBF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15534), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:40.477 4088 3038300758440 MainThread ERROR os_win.utils.jobutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000074\' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)instance-000000744084533D-355F-4F36-9F65-6E5ABE3F8CF612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)instance-000000744084533D-355F-4F36-9F65-6E5ABE3F8CF610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000074\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)instance-000000744084533D-355F-4F36-9F65-6E5ABE3F8CF6%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '50FAD294-4FD7-4F7C-B524-6E3727B1DEBF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121692), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 17, 40), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 17, 40), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000074' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)\n\nNot enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)\n\n'instance-00000074' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)", 'ErrorSummaryDescription': "'instance-00000074' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000074.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:17:40.477 4088 3038300758440 MainThread DEBUG os_win._utils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000074' failed to start. Not enough memory in the system to start the virtual machine instance-00000074. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000074' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Not enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) 'instance-00000074' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.89505934715271 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:17:40.520 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:17:40.520 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] VM Stopped (Lifecycle Event) 2021-09-10 17:17:40.520 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000074" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:40.520 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000074" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:40.566 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-1a8b605c-0add-4001-ba20-56dee8b74bc1 - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:17:40.566 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-1a8b605c-0add-4001-ba20-56dee8b74bc1 - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:17:40.622 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-1a8b605c-0add-4001-ba20-56dee8b74bc1 - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:17:40.638 4088 3038300761080 MainThread INFO nova.compute.manager [req-1a8b605c-0add-4001-ba20-56dee8b74bc1 - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:17:40.973 4088 3038342145480 MainThread DEBUG os_win.utils.jobutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '4B83EB8D-7479-448D-9A19-C832A7306CE1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16471), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:41.119 4088 3038342145480 MainThread ERROR os_win.utils.jobutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000075\' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)instance-00000075C8EFE004-4B17-458C-8BD3-46AA8330637012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)instance-00000075C8EFE004-4B17-458C-8BD3-46AA8330637010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000075\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)instance-00000075C8EFE004-4B17-458C-8BD3-46AA83306370%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4B83EB8D-7479-448D-9A19-C832A7306CE1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116097), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 17, 40), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 17, 41), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000075' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)\n\nNot enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)\n\n'instance-00000075' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)", 'ErrorSummaryDescription': "'instance-00000075' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000075.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:17:41.119 4088 3038342145480 MainThread DEBUG os_win._utils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000075' failed to start. Not enough memory in the system to start the virtual machine instance-00000075. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000075' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Not enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) 'instance-00000075' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3494453430175781 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:17:41.131 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:17:41.131 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] VM Stopped (Lifecycle Event) 2021-09-10 17:17:41.131 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000075" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:41.159 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000075" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:41.211 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-a29d08bc-92a4-48e7-aa0a-8cd54d7270c4 - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:17:41.211 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-a29d08bc-92a4-48e7-aa0a-8cd54d7270c4 - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:17:41.239 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-a29d08bc-92a4-48e7-aa0a-8cd54d7270c4 - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:17:41.285 4088 3038300761080 MainThread INFO nova.compute.manager [req-a29d08bc-92a4-48e7-aa0a-8cd54d7270c4 - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:17:41.517 4088 3038300758440 MainThread DEBUG os_win.utils.jobutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Waiting for WMI job: {'InstanceID': '96D67A21-E766-46A8-A15E-81A310EC3B00', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15404), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:41.667 4088 3038300758440 MainThread ERROR os_win.utils.jobutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000074\' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)instance-000000744084533D-355F-4F36-9F65-6E5ABE3F8CF612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)instance-000000744084533D-355F-4F36-9F65-6E5ABE3F8CF610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000074\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)instance-000000744084533D-355F-4F36-9F65-6E5ABE3F8CF6%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '96D67A21-E766-46A8-A15E-81A310EC3B00', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111467), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 17, 41), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 17, 41), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000074' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)\n\nNot enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)\n\n'instance-00000074' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6)", 'ErrorSummaryDescription': "'instance-00000074' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000074.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:17:41.667 4088 3038300758440 MainThread ERROR nova.virt.hyperv.vmops [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Failed to change vm state of instance-00000074 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000074' failed to start. 2021-09-10 17:17:41.667 4088 3038300758440 MainThread INFO nova.virt.hyperv.vmops [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Got request to destroy instance 2021-09-10 17:17:41.701 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:17:41.701 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] VM Stopped (Lifecycle Event) 2021-09-10 17:17:41.701 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000074" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:41.701 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000074" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:41.738 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-4418d630-8517-4699-ab2d-997665ec3b1b - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:17:41.738 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-4418d630-8517-4699-ab2d-997665ec3b1b - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:17:41.794 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-4418d630-8517-4699-ab2d-997665ec3b1b - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:17:41.831 4088 3038300761080 MainThread INFO nova.compute.manager [req-4418d630-8517-4699-ab2d-997665ec3b1b - - - - -] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:17:42.145 4088 3038342145480 MainThread DEBUG os_win.utils.jobutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '1E06951D-BF71-4A7F-82F4-B3E102F43328', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15026), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:42.292 4088 3038342145480 MainThread ERROR os_win.utils.jobutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000075\' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)instance-00000075C8EFE004-4B17-458C-8BD3-46AA8330637012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)instance-00000075C8EFE004-4B17-458C-8BD3-46AA8330637010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000075\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)instance-00000075C8EFE004-4B17-458C-8BD3-46AA83306370%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1E06951D-BF71-4A7F-82F4-B3E102F43328', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118212), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 17, 42), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 17, 42), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000075' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)\n\nNot enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)\n\n'instance-00000075' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)", 'ErrorSummaryDescription': "'instance-00000075' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000075.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:17:42.292 4088 3038342145480 MainThread DEBUG os_win._utils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000075' failed to start. Not enough memory in the system to start the virtual machine instance-00000075. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000075' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Not enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) 'instance-00000075' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5231282711029053 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:17:42.316 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:17:42.316 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] VM Stopped (Lifecycle Event) 2021-09-10 17:17:42.316 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000075" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:42.316 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000075" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:42.349 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-038dd45e-30ff-4939-bcf8-9073f88579ad - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:17:42.363 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-038dd45e-30ff-4939-bcf8-9073f88579ad - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:17:42.410 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-038dd45e-30ff-4939-bcf8-9073f88579ad - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:17:42.448 4088 3038300761080 MainThread INFO nova.compute.manager [req-038dd45e-30ff-4939-bcf8-9073f88579ad - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:17:43.310 4088 3038342145480 MainThread DEBUG os_win.utils.jobutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '4C248CBB-B96D-4937-ACB9-E8E271BFBF1B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16944), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:43.456 4088 3038342145480 MainThread ERROR os_win.utils.jobutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000075\' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)instance-00000075C8EFE004-4B17-458C-8BD3-46AA8330637012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)instance-00000075C8EFE004-4B17-458C-8BD3-46AA8330637010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000075\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)instance-00000075C8EFE004-4B17-458C-8BD3-46AA83306370%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4C248CBB-B96D-4937-ACB9-E8E271BFBF1B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117053), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 17, 43), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 17, 43), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000075' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)\n\nNot enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)\n\n'instance-00000075' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)", 'ErrorSummaryDescription': "'instance-00000075' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000075.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:17:43.456 4088 3038342145480 MainThread DEBUG os_win._utils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000075' failed to start. Not enough memory in the system to start the virtual machine instance-00000075. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000075' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Not enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) 'instance-00000075' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.6871769428253174 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:17:43.489 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:17:43.489 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] VM Stopped (Lifecycle Event) 2021-09-10 17:17:43.489 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000075" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:43.489 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000075" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:43.504 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-0dc003c7-a07d-4d2d-93e0-c857ef34d990 - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:17:43.520 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-0dc003c7-a07d-4d2d-93e0-c857ef34d990 - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:17:43.557 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-0dc003c7-a07d-4d2d-93e0-c857ef34d990 - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:17:43.557 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.vmops [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:17:43.557 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Lock "instance-00000074" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:43.557 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Lock "instance-00000074" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:43.585 4088 3038300758440 MainThread DEBUG os_win.utils.compute.vmutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Successfully changed vm state of instance-00000074 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:17:43.585 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.vmops [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Successfully changed state of VM instance-00000074 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:17:43.585 4088 3038300761080 MainThread INFO nova.compute.manager [req-0dc003c7-a07d-4d2d-93e0-c857ef34d990 - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:17:43.635 4088 3038300758440 MainThread DEBUG os_win.utils.jobutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Waiting for WMI job: {'InstanceID': '87F22A68-2EB8-4517-A80B-DDB0A46C7F10', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15132), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:43.738 4088 3038300758440 MainThread DEBUG os_win.utils.jobutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] WMI job succeeded: {'InstanceID': '87F22A68-2EB8-4517-A80B-DDB0A46C7F10', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=121080), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:17:43.738 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Lock "instance-00000074" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:43.738 4088 3038300758440 MainThread DEBUG os_win.utils.pathutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Removing directory: C:\openstack\instances\instance-00000074 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:17:43.738 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Lock "instance-00000074" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:43.738 4088 3038300758440 MainThread ERROR nova.compute.manager [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000074' failed to start. Not enough memory in the system to start the virtual machine instance-00000074. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000074' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Not enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) 'instance-00000074' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Error code: 32778. 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Traceback (most recent call last): 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] return function(*args, **kwargs) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] admin_password, network_info, block_device_info) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] return function(self, *args, **kwds) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self.force_reraise() 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] raise self.value 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] should_plug_vifs=False) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 'req_state': req_state}) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self.force_reraise() 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] raise self.value 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] time.sleep(sleep_time) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self.force_reraise() 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] raise self.value 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] return f(*args, **kwargs) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] return self._wait_for_job(job_path) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] error_desc=err_desc) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000074' failed to start. 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Not enough memory in the system to start the virtual machine instance-00000074. 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000074' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Not enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 'instance-00000074' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Error code: 32778. 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] During handling of the above exception, another exception occurred: 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Traceback (most recent call last): 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] yield resources 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] accel_info=accel_info) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] return function(*args, **kwargs) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] admin_password, network_info, block_device_info) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] return function(self, *args, **kwds) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self.force_reraise() 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] raise self.value 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] should_plug_vifs=False) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 'req_state': req_state}) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self.force_reraise() 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] raise self.value 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] time.sleep(sleep_time) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self.force_reraise() 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] raise self.value 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] return f(*args, **kwargs) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] return self._wait_for_job(job_path) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] error_desc=err_desc) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000074' failed to start. 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Not enough memory in the system to start the virtual machine instance-00000074. 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000074' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Not enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 'instance-00000074' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Error code: 32778. 2021-09-10 17:17:43.738 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:43.738 4088 3038300758440 MainThread INFO nova.compute.manager [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Terminating instance 2021-09-10 17:17:43.738 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:17:43.738 4088 3038300758440 MainThread INFO nova.virt.hyperv.vmops [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Got request to destroy instance 2021-09-10 17:17:43.779 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.vmops [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:17:43.779 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Lock "instance-00000074" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:43.779 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Lock "instance-00000074" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:43.779 4088 3038300758440 MainThread INFO nova.compute.manager [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Took 0.05 seconds to destroy the instance on the hypervisor. 2021-09-10 17:17:43.779 4088 3038300758440 MainThread DEBUG nova.compute.claims [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:17:43.779 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:43.928 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.hostops [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:17:43.928 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.hostops [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:17:44.162 4088 3038300758440 MainThread DEBUG nova.compute.provider_tree [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:17:44.177 4088 3038300758440 MainThread DEBUG nova.scheduler.client.report [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:17:44.177 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.391s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:44.177 4088 3038300758440 MainThread ERROR nova.compute.manager [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000074' failed to start. Not enough memory in the system to start the virtual machine instance-00000074. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000074' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Not enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) 'instance-00000074' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Error code: 32778. 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Traceback (most recent call last): 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] return function(*args, **kwargs) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] admin_password, network_info, block_device_info) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] return function(self, *args, **kwds) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self.force_reraise() 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] raise self.value 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] should_plug_vifs=False) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 'req_state': req_state}) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self.force_reraise() 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] raise self.value 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] time.sleep(sleep_time) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self.force_reraise() 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] raise self.value 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] return f(*args, **kwargs) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] return self._wait_for_job(job_path) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] error_desc=err_desc) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000074' failed to start. 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Not enough memory in the system to start the virtual machine instance-00000074. 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000074' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Not enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 'instance-00000074' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Error code: 32778. 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] During handling of the above exception, another exception occurred: 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Traceback (most recent call last): 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] accel_info=accel_info) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] return function(*args, **kwargs) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] admin_password, network_info, block_device_info) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] return function(self, *args, **kwds) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self.force_reraise() 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] raise self.value 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] should_plug_vifs=False) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 'req_state': req_state}) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self.force_reraise() 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] raise self.value 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] time.sleep(sleep_time) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self.force_reraise() 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] raise self.value 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] return f(*args, **kwargs) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] return self._wait_for_job(job_path) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] error_desc=err_desc) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000074' failed to start. 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Not enough memory in the system to start the virtual machine instance-00000074. 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000074' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Not enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 'instance-00000074' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Error code: 32778. 2021-09-10 17:17:44.177 4088 3038300758440 MainThread TRACE nova.compute.manager [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] 2021-09-10 17:17:44.177 4088 3038300758440 MainThread DEBUG nova.compute.utils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] WMI job failed with status 10. Error summary description: 'instance-00000074' failed to start. Not enough memory in the system to start the virtual machine instance-00000074. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:17:44.177 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Build of instance 93488f38-5aea-4764-bdcd-f98205b2fdbf was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000074' failed to start. Not enough memory in the system to start the virtual machine instance-00000074. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000074' failed to start. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Not enough memory in the system to start the virtual machine instance-00000074 with ram size 1024 megabytes. (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) 'instance-00000074' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4084533D-355F-4F36-9F65-6E5ABE3F8CF6) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:17:44.191 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:17:44.191 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:17:44.191 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:17:44.191 4088 3038300758440 MainThread DEBUG nova.network.neutron [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:17:44.488 4088 3038342145480 MainThread DEBUG os_win.utils.jobutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '7F390184-7484-4A1D-A7E2-CA53BCF73C91', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16453), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:44.616 4088 3038342145480 MainThread ERROR os_win.utils.jobutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000075\' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)instance-00000075C8EFE004-4B17-458C-8BD3-46AA8330637012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)instance-00000075C8EFE004-4B17-458C-8BD3-46AA8330637010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000075\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)instance-00000075C8EFE004-4B17-458C-8BD3-46AA83306370%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7F390184-7484-4A1D-A7E2-CA53BCF73C91', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120129), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 17, 44), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 17, 44), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000075' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)\n\nNot enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)\n\n'instance-00000075' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)", 'ErrorSummaryDescription': "'instance-00000075' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000075.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:17:44.616 4088 3038342145480 MainThread DEBUG os_win._utils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000075' failed to start. Not enough memory in the system to start the virtual machine instance-00000075. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000075' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Not enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) 'instance-00000075' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.846380710601807 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:17:44.663 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000075" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:44.663 4088 3038340491224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000075" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:44.663 4088 3038340493160 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:17:44.663 4088 3038340493160 MainThread INFO nova.compute.manager [-] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] VM Stopped (Lifecycle Event) 2021-09-10 17:17:44.676 4088 3038340493160 MainThread DEBUG nova.compute.manager [req-e15f3e92-d614-4963-8b38-c2a7bf9541b4 - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:17:44.676 4088 3038340493160 MainThread DEBUG nova.virt.hyperv.vmops [req-e15f3e92-d614-4963-8b38-c2a7bf9541b4 - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:17:44.742 4088 3038340493160 MainThread DEBUG nova.compute.manager [req-e15f3e92-d614-4963-8b38-c2a7bf9541b4 - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:17:44.771 4088 3038340493160 MainThread INFO nova.compute.manager [req-e15f3e92-d614-4963-8b38-c2a7bf9541b4 - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:17:45.206 4088 3038300758440 MainThread DEBUG nova.network.neutron [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:17:45.239 4088 3038300758440 MainThread INFO nova.compute.manager [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] [instance: 93488f38-5aea-4764-bdcd-f98205b2fdbf] Took 1.05 seconds to deallocate network for instance. 2021-09-10 17:17:45.466 4088 3038300758440 MainThread INFO nova.scheduler.client.report [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Deleted allocations for instance 93488f38-5aea-4764-bdcd-f98205b2fdbf 2021-09-10 17:17:45.490 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-4de6e491-143a-4d9f-91fd-b9b8fb7252fe 11e4c6eac8924ee882931a301b388a54 12cf0aeb647e41119e2189d6819df350 - default default] Lock "93488f38-5aea-4764-bdcd-f98205b2fdbf" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 27.203s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:45.646 4088 3038342145480 MainThread DEBUG os_win.utils.jobutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '3356B8D7-5459-42AF-B53E-B2732351121C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16065), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:45.800 4088 3038342145480 MainThread ERROR os_win.utils.jobutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000075\' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)instance-00000075C8EFE004-4B17-458C-8BD3-46AA8330637012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)instance-00000075C8EFE004-4B17-458C-8BD3-46AA8330637010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000075\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)instance-00000075C8EFE004-4B17-458C-8BD3-46AA83306370%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3356B8D7-5459-42AF-B53E-B2732351121C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116515), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 17, 45), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 17, 45), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000075' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)\n\nNot enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)\n\n'instance-00000075' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370)", 'ErrorSummaryDescription': "'instance-00000075' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000075.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:17:45.800 4088 3038342145480 MainThread ERROR nova.virt.hyperv.vmops [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Failed to change vm state of instance-00000075 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000075' failed to start. 2021-09-10 17:17:45.800 4088 3038342145480 MainThread INFO nova.virt.hyperv.vmops [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Got request to destroy instance 2021-09-10 17:17:45.828 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000075" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:45.828 4088 3038340493160 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000075" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:45.828 4088 3038342257832 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:17:45.828 4088 3038342257832 MainThread INFO nova.compute.manager [-] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] VM Stopped (Lifecycle Event) 2021-09-10 17:17:45.857 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-198e1a45-1b9b-40f4-b681-5ff5cebf9b7b - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:17:45.857 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-198e1a45-1b9b-40f4-b681-5ff5cebf9b7b - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:17:45.912 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-198e1a45-1b9b-40f4-b681-5ff5cebf9b7b - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:17:45.935 4088 3038342257832 MainThread INFO nova.compute.manager [req-198e1a45-1b9b-40f4-b681-5ff5cebf9b7b - - - - -] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:17:47.669 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:17:47.669 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000075" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:47.669 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000075" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:47.692 4088 3038342145480 MainThread DEBUG os_win.utils.compute.vmutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Successfully changed vm state of instance-00000075 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:17:47.692 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Successfully changed state of VM instance-00000075 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:17:47.739 4088 3038342145480 MainThread DEBUG os_win.utils.jobutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '48485963-F925-479E-B386-5FEE86FBD30F', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15583), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:17:47.868 4088 3038342145480 MainThread DEBUG os_win.utils.jobutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job succeeded: {'InstanceID': '48485963-F925-479E-B386-5FEE86FBD30F', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=112573), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:17:47.868 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000075" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:47.868 4088 3038342145480 MainThread DEBUG os_win.utils.pathutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Removing directory: C:\openstack\instances\instance-00000075 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:17:47.868 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000075" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:47.868 4088 3038342145480 MainThread ERROR nova.compute.manager [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000075' failed to start. Not enough memory in the system to start the virtual machine instance-00000075. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000075' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Not enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) 'instance-00000075' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Error code: 32778. 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Traceback (most recent call last): 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] return function(*args, **kwargs) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] admin_password, network_info, block_device_info) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] return function(self, *args, **kwds) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self.force_reraise() 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] raise self.value 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] should_plug_vifs=False) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 'req_state': req_state}) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self.force_reraise() 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] raise self.value 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] time.sleep(sleep_time) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self.force_reraise() 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] raise self.value 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] return f(*args, **kwargs) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] return self._wait_for_job(job_path) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] error_desc=err_desc) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000075' failed to start. 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Not enough memory in the system to start the virtual machine instance-00000075. 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000075' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Not enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 'instance-00000075' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Error code: 32778. 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] During handling of the above exception, another exception occurred: 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Traceback (most recent call last): 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] yield resources 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] accel_info=accel_info) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] return function(*args, **kwargs) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] admin_password, network_info, block_device_info) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] return function(self, *args, **kwds) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self.force_reraise() 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] raise self.value 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] should_plug_vifs=False) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 'req_state': req_state}) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self.force_reraise() 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] raise self.value 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] time.sleep(sleep_time) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self.force_reraise() 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] raise self.value 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] return f(*args, **kwargs) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] return self._wait_for_job(job_path) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] error_desc=err_desc) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000075' failed to start. 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Not enough memory in the system to start the virtual machine instance-00000075. 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000075' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Not enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 'instance-00000075' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Error code: 32778. 2021-09-10 17:17:47.868 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:47.881 4088 3038342145480 MainThread INFO nova.compute.manager [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Terminating instance 2021-09-10 17:17:47.881 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:17:47.881 4088 3038342145480 MainThread INFO nova.virt.hyperv.vmops [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Got request to destroy instance 2021-09-10 17:17:47.895 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:17:47.895 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000075" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:47.895 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000075" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:47.895 4088 3038342145480 MainThread INFO nova.compute.manager [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:17:47.895 4088 3038342145480 MainThread DEBUG nova.compute.claims [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:17:47.895 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:17:48.036 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.hostops [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:17:48.050 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.hostops [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:17:48.244 4088 3038342145480 MainThread DEBUG nova.compute.provider_tree [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:17:48.276 4088 3038342145480 MainThread DEBUG nova.scheduler.client.report [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:17:48.276 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.375s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:48.276 4088 3038342145480 MainThread ERROR nova.compute.manager [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000075' failed to start. Not enough memory in the system to start the virtual machine instance-00000075. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000075' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Not enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) 'instance-00000075' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Error code: 32778. 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Traceback (most recent call last): 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] return function(*args, **kwargs) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] admin_password, network_info, block_device_info) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] return function(self, *args, **kwds) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self.force_reraise() 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] raise self.value 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] should_plug_vifs=False) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 'req_state': req_state}) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self.force_reraise() 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] raise self.value 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] time.sleep(sleep_time) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self.force_reraise() 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] raise self.value 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] return f(*args, **kwargs) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] return self._wait_for_job(job_path) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] error_desc=err_desc) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000075' failed to start. 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Not enough memory in the system to start the virtual machine instance-00000075. 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000075' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Not enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 'instance-00000075' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Error code: 32778. 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] During handling of the above exception, another exception occurred: 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Traceback (most recent call last): 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] accel_info=accel_info) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] return function(*args, **kwargs) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] admin_password, network_info, block_device_info) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] return function(self, *args, **kwds) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self.force_reraise() 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] raise self.value 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] should_plug_vifs=False) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 'req_state': req_state}) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self.force_reraise() 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] raise self.value 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] time.sleep(sleep_time) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self.force_reraise() 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] raise self.value 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] return f(*args, **kwargs) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] return self._wait_for_job(job_path) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] error_desc=err_desc) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000075' failed to start. 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Not enough memory in the system to start the virtual machine instance-00000075. 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000075' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Not enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 'instance-00000075' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Error code: 32778. 2021-09-10 17:17:48.276 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] 2021-09-10 17:17:48.276 4088 3038342145480 MainThread DEBUG nova.compute.utils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] WMI job failed with status 10. Error summary description: 'instance-00000075' failed to start. Not enough memory in the system to start the virtual machine instance-00000075. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:17:48.276 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Build of instance 3b484a16-f305-421b-a31a-69bd404d1d4c was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000075' failed to start. Not enough memory in the system to start the virtual machine instance-00000075. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000075' failed to start. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Not enough memory in the system to start the virtual machine instance-00000075 with ram size 1024 megabytes. (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) 'instance-00000075' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C8EFE004-4B17-458C-8BD3-46AA83306370) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:17:48.276 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:17:48.276 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:17:48.276 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:17:48.276 4088 3038342145480 MainThread DEBUG nova.network.neutron [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:17:49.863 4088 3038342145480 MainThread DEBUG nova.network.neutron [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:17:49.893 4088 3038342145480 MainThread INFO nova.compute.manager [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 3b484a16-f305-421b-a31a-69bd404d1d4c] Took 1.62 seconds to deallocate network for instance. 2021-09-10 17:17:50.130 4088 3038342145480 MainThread INFO nova.scheduler.client.report [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Deleted allocations for instance 3b484a16-f305-421b-a31a-69bd404d1d4c 2021-09-10 17:17:50.176 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-a9ae6c12-f46e-4a0e-bf78-a165de5b40b2 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "3b484a16-f305-421b-a31a-69bd404d1d4c" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 26.875s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:17:54.528 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:17:56.507 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:17:57.514 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:17:57.514 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:17:59.502 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:17:59.502 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:18:01.502 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:18:02.504 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:18:02.504 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:18:02.975 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-359fd482-69f5-4194-9466-f46ea31258d3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:18:02.975 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:18:04.226 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Updating instance_info_cache with network_info: [{"id": "43904798-2eab-4ec0-9b1b-f79a929eba99", "address": "fa:16:3e:9c:26:60", "network": {"id": "7434a41e-b78f-4cb9-8ffe-b2514d097201", "bridge": null, "label": "tempest-LiveAutoBlockMigrationV225Test-1499875764-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91237ebda1b54d2dbc761e48fdd93516", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap43904798-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:18:04.257 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-359fd482-69f5-4194-9466-f46ea31258d3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:18:04.257 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:18:04.257 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:18:06.499 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:18:06.515 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:06.521 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:18:06.521 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:18:06.521 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:18:06.521 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:18:06.772 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2232MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:18:06.772 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:07.027 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:18:07.027 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:18:07.027 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:18:07.027 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:18:07.027 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:18:07.027 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:18:07.027 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:18:07.027 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:18:07.027 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:18:07.027 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:18:07.027 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:18:07.027 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:18:07.027 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:18:07.027 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:18:07.027 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:18:07.061 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:18:07.087 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:18:07.299 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:18:07.299 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:18:07.299 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:18:07.299 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:18:42.192 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "2c0ae919-97f4-4b59-a070-63a3ec8effa7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:42.214 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:18:42.332 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:42.332 4088 3038342145480 MainThread DEBUG nova.virt.hardware [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:18:42.332 4088 3038342145480 MainThread INFO nova.compute.claims [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Claim successful on node n-h2-808474-1 2021-09-10 17:18:42.424 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.hostops [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:18:42.454 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.hostops [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:18:42.661 4088 3038342145480 MainThread DEBUG nova.compute.provider_tree [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:18:42.692 4088 3038342145480 MainThread DEBUG nova.scheduler.client.report [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:18:42.692 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:18:42.692 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:18:42.770 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:18:42.770 4088 3038300760904 GreenThread-108 DEBUG nova.compute.manager [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:18:42.770 4088 3038300760904 GreenThread-108 DEBUG nova.network.neutron [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:18:42.942 4088 3038300760904 GreenThread-108 DEBUG nova.policy [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '799e4a49be0e448b9d6d54d57b7d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf483b0ac5349bca4c898bb3b806d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:18:42.942 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:18:42.970 4088 3038342145480 MainThread INFO nova.virt.hyperv.vmops [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Spawning new instance 2021-09-10 17:18:42.970 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000076" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:42.970 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000076" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:18:42.970 4088 3038342145480 MainThread DEBUG nova.block_device [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:18:42.970 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:42.970 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:18:42.970 4088 3038342145480 MainThread DEBUG os_win.utils.pathutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Creating directory: C:\openstack\instances\instance-00000076 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:18:42.970 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000076\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:18:43.236 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Resizing VHD C:\openstack\instances\instance-00000076\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:18:44.267 4088 3038300760904 GreenThread-108 DEBUG nova.network.neutron [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Successfully created port: 8817e0ce-e375-4824-bd91-1f93be078d68 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:18:45.284 4088 3038300760904 GreenThread-108 DEBUG nova.network.neutron [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Successfully updated port: 8817e0ce-e375-4824-bd91-1f93be078d68 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:18:45.299 4088 3038300760904 GreenThread-108 DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Acquired lock "refresh_cache-2c0ae919-97f4-4b59-a070-63a3ec8effa7" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:18:45.299 4088 3038300760904 GreenThread-108 DEBUG nova.network.neutron [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:18:45.384 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-2a89f183-48ee-44e4-83d0-f7245b26685e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Received event network-changed-8817e0ce-e375-4824-bd91-1f93be078d68 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:18:45.384 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-2a89f183-48ee-44e4-83d0-f7245b26685e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Refreshing instance network info cache due to event network-changed-8817e0ce-e375-4824-bd91-1f93be078d68. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:18:45.427 4088 3038300760904 GreenThread-108 DEBUG nova.network.neutron [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:18:46.006 4088 3038300760904 GreenThread-108 DEBUG nova.network.neutron [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Updating instance_info_cache with network_info: [{"id": "8817e0ce-e375-4824-bd91-1f93be078d68", "address": "fa:16:3e:13:3a:b0", "network": {"id": "d0efb974-5cdf-4275-bab1-2abb154484f9", "bridge": null, "label": "tempest-network-smoke--1033545172", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5cf483b0ac5349bca4c898bb3b806d21", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8817e0ce-e3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:18:46.047 4088 3038300760904 GreenThread-108 DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Releasing lock "refresh_cache-2c0ae919-97f4-4b59-a070-63a3ec8effa7" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:18:46.047 4088 3038300760904 GreenThread-108 DEBUG nova.compute.manager [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Instance network_info: |[{"id": "8817e0ce-e375-4824-bd91-1f93be078d68", "address": "fa:16:3e:13:3a:b0", "network": {"id": "d0efb974-5cdf-4275-bab1-2abb154484f9", "bridge": null, "label": "tempest-network-smoke--1033545172", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5cf483b0ac5349bca4c898bb3b806d21", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8817e0ce-e3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:18:46.047 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Preparing to wait for external event network-vif-plugged-8817e0ce-e375-4824-bd91-1f93be078d68 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:18:46.047 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "2c0ae919-97f4-4b59-a070-63a3ec8effa7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:46.047 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "2c0ae919-97f4-4b59-a070-63a3ec8effa7-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:18:46.047 4088 3038342145480 MainThread DEBUG os_win.utils.compute.vmutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Creating VM instance-00000076 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:18:46.047 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-2a89f183-48ee-44e4-83d0-f7245b26685e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-2c0ae919-97f4-4b59-a070-63a3ec8effa7" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:18:46.047 4088 3038342146184 MainThread DEBUG nova.network.neutron [req-2a89f183-48ee-44e4-83d0-f7245b26685e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Refreshing network info cache for port 8817e0ce-e375-4824-bd91-1f93be078d68 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:18:46.751 4088 3038342146184 MainThread DEBUG nova.network.neutron [req-2a89f183-48ee-44e4-83d0-f7245b26685e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Updated VIF entry in instance network info cache for port 8817e0ce-e375-4824-bd91-1f93be078d68. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:18:46.771 4088 3038342146184 MainThread DEBUG nova.network.neutron [req-2a89f183-48ee-44e4-83d0-f7245b26685e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Updating instance_info_cache with network_info: [{"id": "8817e0ce-e375-4824-bd91-1f93be078d68", "address": "fa:16:3e:13:3a:b0", "network": {"id": "d0efb974-5cdf-4275-bab1-2abb154484f9", "bridge": null, "label": "tempest-network-smoke--1033545172", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5cf483b0ac5349bca4c898bb3b806d21", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8817e0ce-e3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:18:46.784 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [req-2a89f183-48ee-44e4-83d0-f7245b26685e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-2c0ae919-97f4-4b59-a070-63a3ec8effa7" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:18:47.814 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:18:52.024 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "27993f4e-58ab-4d61-a84c-7036ecfd1fad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:52.049 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:18:52.145 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:52.145 4088 3038342146712 MainThread DEBUG nova.virt.hardware [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:18:52.145 4088 3038342146712 MainThread INFO nova.compute.claims [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Claim successful on node n-h2-808474-1 2021-09-10 17:18:52.273 4088 3038342146712 MainThread DEBUG nova.virt.hyperv.hostops [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:18:52.287 4088 3038342146712 MainThread DEBUG nova.virt.hyperv.hostops [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:18:52.489 4088 3038342146712 MainThread DEBUG nova.compute.provider_tree [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:18:52.503 4088 3038342146712 MainThread DEBUG nova.scheduler.client.report [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:18:52.503 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:18:52.503 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:18:52.591 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:18:52.594 4088 3038342146008 GreenThread-109 DEBUG nova.compute.manager [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:18:52.594 4088 3038342146008 GreenThread-109 DEBUG nova.network.neutron [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:18:52.796 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:18:52.805 4088 3038342146712 MainThread INFO nova.virt.hyperv.vmops [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Spawning new instance 2021-09-10 17:18:52.805 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "instance-00000077" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:52.805 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "instance-00000077" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:18:52.805 4088 3038342146712 MainThread DEBUG nova.block_device [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:18:52.805 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:52.805 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:18:52.829 4088 3038342146008 GreenThread-109 DEBUG nova.policy [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb6b40339c39491bbe2bdee1c7c82123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecf4120b310452eb14917a31b551102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:18:52.829 4088 3038342146712 MainThread DEBUG os_win.utils.pathutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Creating directory: C:\openstack\instances\instance-00000077 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:18:52.829 4088 3038342146712 MainThread DEBUG nova.virt.hyperv.vmops [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000077\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:18:53.087 4088 3038342146712 MainThread DEBUG nova.virt.hyperv.vmops [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Resizing VHD C:\openstack\instances\instance-00000077\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:18:53.571 4088 3038342146008 GreenThread-109 DEBUG nova.network.neutron [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Successfully created port: 47bb4775-7df1-42a8-bb27-32f4b00688ea _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:18:54.266 4088 3038342147240 MainThread DEBUG nova.compute.manager [req-a6cb4983-5bec-415a-b4f9-0ba7acbab3ed 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Received event network-vif-plugged-8817e0ce-e375-4824-bd91-1f93be078d68 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:18:54.266 4088 3038342147240 MainThread DEBUG oslo_concurrency.lockutils [req-a6cb4983-5bec-415a-b4f9-0ba7acbab3ed 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "2c0ae919-97f4-4b59-a070-63a3ec8effa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:54.266 4088 3038342147240 MainThread DEBUG oslo_concurrency.lockutils [req-a6cb4983-5bec-415a-b4f9-0ba7acbab3ed 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "2c0ae919-97f4-4b59-a070-63a3ec8effa7-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:18:54.266 4088 3038342147240 MainThread DEBUG nova.compute.manager [req-a6cb4983-5bec-415a-b4f9-0ba7acbab3ed 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Processing event network-vif-plugged-8817e0ce-e375-4824-bd91-1f93be078d68 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:18:54.306 4088 3038342145480 MainThread INFO nova.virt.hyperv.vmops [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Using config drive for instance 2021-09-10 17:18:54.462 4088 3038342146008 GreenThread-109 DEBUG nova.network.neutron [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Successfully updated port: 47bb4775-7df1-42a8-bb27-32f4b00688ea _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:18:54.479 4088 3038342146008 GreenThread-109 DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Acquired lock "refresh_cache-27993f4e-58ab-4d61-a84c-7036ecfd1fad" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:18:54.479 4088 3038342146008 GreenThread-109 DEBUG nova.network.neutron [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:18:54.509 4088 3038360457288 MainThread DEBUG nova.compute.manager [req-1b7c8923-51f2-4e13-b2d7-170df7661db3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Received event network-changed-47bb4775-7df1-42a8-bb27-32f4b00688ea external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:18:54.509 4088 3038360457288 MainThread DEBUG nova.compute.manager [req-1b7c8923-51f2-4e13-b2d7-170df7661db3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Refreshing instance network info cache due to event network-changed-47bb4775-7df1-42a8-bb27-32f4b00688ea. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:18:54.518 4088 3038342145480 MainThread INFO nova.virt.hyperv.vmops [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Creating config drive at C:\openstack\instances\instance-00000076\configdrive.iso 2021-09-10 17:18:54.603 4088 3038342145480 MainThread DEBUG oslo_concurrency.processutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000076\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpoe1pfs4r execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:18:54.740 4088 3038342146008 GreenThread-109 DEBUG nova.network.neutron [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:18:54.925 4088 3038342145480 MainThread DEBUG oslo_concurrency.processutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000076\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpoe1pfs4r" returned: 0 in 0.329s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:18:55.135 4088 3038342146008 GreenThread-109 DEBUG nova.network.neutron [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Updating instance_info_cache with network_info: [{"id": "47bb4775-7df1-42a8-bb27-32f4b00688ea", "address": "fa:16:3e:65:4b:b6", "network": {"id": "e5325df2-5bda-4a32-9161-573dacd6e1e6", "bridge": null, "label": "tempest-VolumesSnapshotTestJSON-49926641-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fecf4120b310452eb14917a31b551102", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap47bb4775-7d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:18:55.161 4088 3038342146008 GreenThread-109 DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Releasing lock "refresh_cache-27993f4e-58ab-4d61-a84c-7036ecfd1fad" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:18:55.161 4088 3038342146008 GreenThread-109 DEBUG nova.compute.manager [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Instance network_info: |[{"id": "47bb4775-7df1-42a8-bb27-32f4b00688ea", "address": "fa:16:3e:65:4b:b6", "network": {"id": "e5325df2-5bda-4a32-9161-573dacd6e1e6", "bridge": null, "label": "tempest-VolumesSnapshotTestJSON-49926641-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fecf4120b310452eb14917a31b551102", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap47bb4775-7d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:18:55.161 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-1b7c8923-51f2-4e13-b2d7-170df7661db3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-27993f4e-58ab-4d61-a84c-7036ecfd1fad" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:18:55.161 4088 3038360457288 MainThread DEBUG nova.network.neutron [req-1b7c8923-51f2-4e13-b2d7-170df7661db3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Refreshing network info cache for port 47bb4775-7df1-42a8-bb27-32f4b00688ea _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:18:55.161 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Preparing to wait for external event network-vif-plugged-47bb4775-7df1-42a8-bb27-32f4b00688ea prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:18:55.161 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "27993f4e-58ab-4d61-a84c-7036ecfd1fad-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:55.161 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "27993f4e-58ab-4d61-a84c-7036ecfd1fad-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:18:55.161 4088 3038342146712 MainThread DEBUG os_win.utils.compute.vmutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Creating VM instance-00000077 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:18:55.307 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:18:55.441 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Setting boot order for instance: instance-00000076: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:18:55.604 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:18:55.641 4088 3038342145480 MainThread DEBUG os_win.utils.jobutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '1D28C02F-C057-45F2-B374-E06CD0D68B48', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21575), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:18:55.782 4088 3038342145480 MainThread ERROR os_win.utils.jobutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000076\' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)instance-000000763FA7CF25-7FEA-48CC-A60F-89F10E00FD3D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)instance-000000763FA7CF25-7FEA-48CC-A60F-89F10E00FD3D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000076\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)instance-000000763FA7CF25-7FEA-48CC-A60F-89F10E00FD3D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1D28C02F-C057-45F2-B374-E06CD0D68B48', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=132275), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 18, 55), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 18, 55), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000076' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)\n\nNot enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)\n\n'instance-00000076' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)", 'ErrorSummaryDescription': "'instance-00000076' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000076.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:18:55.798 4088 3038342145480 MainThread DEBUG os_win._utils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000076' failed to start. Not enough memory in the system to start the virtual machine instance-00000076. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000076' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Not enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) 'instance-00000076' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.19363141059875488 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:18:55.845 4088 3038342145656 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:18:55.845 4088 3038342145656 MainThread INFO nova.compute.manager [-] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] VM Stopped (Lifecycle Event) 2021-09-10 17:18:55.864 4088 3038342146360 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000076" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:55.864 4088 3038342146360 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000076" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:18:55.864 4088 3038342145656 MainThread DEBUG nova.compute.manager [req-eea6f7b8-e16a-43c9-9402-0599534b93b5 - - - - -] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:18:55.864 4088 3038342145656 MainThread DEBUG nova.virt.hyperv.vmops [req-eea6f7b8-e16a-43c9-9402-0599534b93b5 - - - - -] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:18:55.909 4088 3038342145656 MainThread DEBUG nova.compute.manager [req-eea6f7b8-e16a-43c9-9402-0599534b93b5 - - - - -] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:18:55.954 4088 3038342145656 MainThread INFO nova.compute.manager [req-eea6f7b8-e16a-43c9-9402-0599534b93b5 - - - - -] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:18:56.281 4088 3038360457288 MainThread DEBUG nova.network.neutron [req-1b7c8923-51f2-4e13-b2d7-170df7661db3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Updated VIF entry in instance network info cache for port 47bb4775-7df1-42a8-bb27-32f4b00688ea. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:18:56.281 4088 3038360457288 MainThread DEBUG nova.network.neutron [req-1b7c8923-51f2-4e13-b2d7-170df7661db3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Updating instance_info_cache with network_info: [{"id": "47bb4775-7df1-42a8-bb27-32f4b00688ea", "address": "fa:16:3e:65:4b:b6", "network": {"id": "e5325df2-5bda-4a32-9161-573dacd6e1e6", "bridge": null, "label": "tempest-VolumesSnapshotTestJSON-49926641-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fecf4120b310452eb14917a31b551102", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap47bb4775-7d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:18:56.291 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-1b7c8923-51f2-4e13-b2d7-170df7661db3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-27993f4e-58ab-4d61-a84c-7036ecfd1fad" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:18:56.847 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Lock "145749dc-cbfd-4187-9e03-760c213b8b43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:56.876 4088 3038342145480 MainThread DEBUG os_win.utils.jobutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '73F431D2-DF41-4B76-884C-B2135CAECBB6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15313), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:18:56.876 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:18:56.973 4088 3038342146712 MainThread DEBUG nova.virt.hyperv.vmops [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:18:57.000 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:57.000 4088 3038360457816 MainThread DEBUG nova.virt.hardware [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:18:57.000 4088 3038360457816 MainThread INFO nova.compute.claims [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Claim successful on node n-h2-808474-1 2021-09-10 17:18:57.048 4088 3038342145480 MainThread ERROR os_win.utils.jobutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000076\' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)instance-000000763FA7CF25-7FEA-48CC-A60F-89F10E00FD3D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)instance-000000763FA7CF25-7FEA-48CC-A60F-89F10E00FD3D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000076\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)instance-000000763FA7CF25-7FEA-48CC-A60F-89F10E00FD3D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '73F431D2-DF41-4B76-884C-B2135CAECBB6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116784), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 18, 56), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 18, 56), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000076' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)\n\nNot enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)\n\n'instance-00000076' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)", 'ErrorSummaryDescription': "'instance-00000076' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000076.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:18:57.048 4088 3038342145480 MainThread DEBUG os_win._utils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000076' failed to start. Not enough memory in the system to start the virtual machine instance-00000076. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000076' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Not enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) 'instance-00000076' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4441676139831543 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:18:57.141 4088 3038360457816 MainThread DEBUG nova.virt.hyperv.hostops [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:18:57.141 4088 3038360457816 MainThread DEBUG nova.virt.hyperv.hostops [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:18:57.384 4088 3038360457816 MainThread DEBUG nova.compute.provider_tree [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:18:57.400 4088 3038360457816 MainThread DEBUG nova.scheduler.client.report [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:18:57.400 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:18:57.400 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:18:57.477 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:18:57.488 4088 3038360457992 GreenThread-110 DEBUG nova.compute.manager [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:18:57.488 4088 3038360457992 GreenThread-110 DEBUG nova.network.neutron [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:18:57.650 4088 3038360457992 GreenThread-110 DEBUG nova.policy [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51b7f766d13c41e3b48015e63ff73fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed35d747aa64087be13e1426708be67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:18:57.650 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:18:57.677 4088 3038360457816 MainThread INFO nova.virt.hyperv.vmops [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Spawning new instance 2021-09-10 17:18:57.689 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Lock "instance-00000078" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:57.689 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Lock "instance-00000078" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:18:57.689 4088 3038360457816 MainThread DEBUG nova.block_device [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:18:57.689 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:57.689 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:18:57.710 4088 3038360457816 MainThread DEBUG os_win.utils.pathutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Creating directory: C:\openstack\instances\instance-00000078 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:18:57.721 4088 3038360457816 MainThread DEBUG nova.virt.hyperv.vmops [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000078\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:18:57.992 4088 3038360457816 MainThread DEBUG nova.virt.hyperv.vmops [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Resizing VHD C:\openstack\instances\instance-00000078\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:18:58.081 4088 3038342145480 MainThread DEBUG os_win.utils.jobutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '03B6BCD2-1D9F-4662-992B-899D66A5E766', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15215), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:18:58.206 4088 3038342145480 MainThread ERROR os_win.utils.jobutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000076\' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)instance-000000763FA7CF25-7FEA-48CC-A60F-89F10E00FD3D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)instance-000000763FA7CF25-7FEA-48CC-A60F-89F10E00FD3D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000076\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)instance-000000763FA7CF25-7FEA-48CC-A60F-89F10E00FD3D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '03B6BCD2-1D9F-4662-992B-899D66A5E766', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114215), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 18, 58), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 18, 58), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000076' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)\n\nNot enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)\n\n'instance-00000076' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)", 'ErrorSummaryDescription': "'instance-00000076' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000076.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:18:58.206 4088 3038342145480 MainThread DEBUG os_win._utils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000076' failed to start. Not enough memory in the system to start the virtual machine instance-00000076. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000076' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Not enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) 'instance-00000076' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.6023497581481934 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:18:58.254 4088 3038360457640 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000076" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:58.254 4088 3038360457640 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000076" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:18:58.254 4088 3038360458168 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:18:58.254 4088 3038360458168 MainThread INFO nova.compute.manager [-] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] VM Stopped (Lifecycle Event) 2021-09-10 17:18:58.290 4088 3038360458168 MainThread DEBUG nova.compute.manager [req-e2a1b6b6-4a4b-49de-a291-e50283362638 - - - - -] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:18:58.290 4088 3038360458168 MainThread DEBUG nova.virt.hyperv.vmops [req-e2a1b6b6-4a4b-49de-a291-e50283362638 - - - - -] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:18:58.329 4088 3038360458168 MainThread DEBUG nova.compute.manager [req-e2a1b6b6-4a4b-49de-a291-e50283362638 - - - - -] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:18:58.386 4088 3038360458168 MainThread INFO nova.compute.manager [req-e2a1b6b6-4a4b-49de-a291-e50283362638 - - - - -] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:18:58.501 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:18:58.501 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:18:58.548 4088 3038360457992 GreenThread-110 DEBUG nova.network.neutron [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Successfully created port: 337801ad-c83b-483b-9e68-841d15149067 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:18:58.563 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:18:58.563 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:18:59.237 4088 3038342145480 MainThread DEBUG os_win.utils.jobutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '9C6AA2B1-8089-448F-92BC-8C429D5D30A9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16502), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:18:59.378 4088 3038360457992 GreenThread-110 DEBUG nova.network.neutron [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Successfully updated port: 337801ad-c83b-483b-9e68-841d15149067 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:18:59.394 4088 3038342145480 MainThread ERROR os_win.utils.jobutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000076\' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)instance-000000763FA7CF25-7FEA-48CC-A60F-89F10E00FD3D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)instance-000000763FA7CF25-7FEA-48CC-A60F-89F10E00FD3D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000076\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)instance-000000763FA7CF25-7FEA-48CC-A60F-89F10E00FD3D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9C6AA2B1-8089-448F-92BC-8C429D5D30A9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117039), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 18, 59), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 18, 59), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000076' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)\n\nNot enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)\n\n'instance-00000076' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)", 'ErrorSummaryDescription': "'instance-00000076' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000076.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:18:59.394 4088 3038342145480 MainThread DEBUG os_win._utils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000076' failed to start. Not enough memory in the system to start the virtual machine instance-00000076. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000076' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Not enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) 'instance-00000076' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.789445400238037 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:18:59.408 4088 3038360457992 GreenThread-110 DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Acquired lock "refresh_cache-145749dc-cbfd-4187-9e03-760c213b8b43" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:18:59.408 4088 3038360457992 GreenThread-110 DEBUG nova.network.neutron [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:18:59.408 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000076" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:18:59.408 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000076" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:18:59.408 4088 3038342147240 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:18:59.408 4088 3038342147240 MainThread INFO nova.compute.manager [-] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] VM Stopped (Lifecycle Event) 2021-09-10 17:18:59.439 4088 3038360458520 MainThread DEBUG nova.compute.manager [req-312e1c1c-27bc-4bbb-ae7d-7c9ab381d51b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Received event network-changed-337801ad-c83b-483b-9e68-841d15149067 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:18:59.439 4088 3038360458520 MainThread DEBUG nova.compute.manager [req-312e1c1c-27bc-4bbb-ae7d-7c9ab381d51b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Refreshing instance network info cache due to event network-changed-337801ad-c83b-483b-9e68-841d15149067. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:18:59.469 4088 3038342147240 MainThread DEBUG nova.compute.manager [req-9ec00b88-f76a-4650-b870-793f7a0373f9 - - - - -] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:18:59.469 4088 3038342147240 MainThread DEBUG nova.virt.hyperv.vmops [req-9ec00b88-f76a-4650-b870-793f7a0373f9 - - - - -] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:18:59.502 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:18:59.521 4088 3038360457992 GreenThread-110 DEBUG nova.network.neutron [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:18:59.521 4088 3038342147240 MainThread DEBUG nova.compute.manager [req-9ec00b88-f76a-4650-b870-793f7a0373f9 - - - - -] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:18:59.562 4088 3038342147240 MainThread INFO nova.compute.manager [req-9ec00b88-f76a-4650-b870-793f7a0373f9 - - - - -] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:18:59.973 4088 3038360457992 GreenThread-110 DEBUG nova.network.neutron [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Updating instance_info_cache with network_info: [{"id": "337801ad-c83b-483b-9e68-841d15149067", "address": "fa:16:3e:6e:98:5b", "network": {"id": "8080ea88-714a-417c-bc62-e1cbbcd08f8e", "bridge": null, "label": "tempest-TestServerBasicOps-227122155-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fed35d747aa64087be13e1426708be67", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap337801ad-c8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:19:00.000 4088 3038360457992 GreenThread-110 DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Releasing lock "refresh_cache-145749dc-cbfd-4187-9e03-760c213b8b43" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:19:00.000 4088 3038360457992 GreenThread-110 DEBUG nova.compute.manager [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Instance network_info: |[{"id": "337801ad-c83b-483b-9e68-841d15149067", "address": "fa:16:3e:6e:98:5b", "network": {"id": "8080ea88-714a-417c-bc62-e1cbbcd08f8e", "bridge": null, "label": "tempest-TestServerBasicOps-227122155-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fed35d747aa64087be13e1426708be67", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap337801ad-c8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:19:00.000 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Preparing to wait for external event network-vif-plugged-337801ad-c83b-483b-9e68-841d15149067 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:19:00.000 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Lock "145749dc-cbfd-4187-9e03-760c213b8b43-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:00.000 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Lock "145749dc-cbfd-4187-9e03-760c213b8b43-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:00.000 4088 3038360457816 MainThread DEBUG os_win.utils.compute.vmutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Creating VM instance-00000078 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:19:00.000 4088 3038360458520 MainThread DEBUG oslo_concurrency.lockutils [req-312e1c1c-27bc-4bbb-ae7d-7c9ab381d51b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-145749dc-cbfd-4187-9e03-760c213b8b43" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:19:00.000 4088 3038360458520 MainThread DEBUG nova.network.neutron [req-312e1c1c-27bc-4bbb-ae7d-7c9ab381d51b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Refreshing network info cache for port 337801ad-c83b-483b-9e68-841d15149067 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:19:00.407 4088 3038342145480 MainThread DEBUG os_win.utils.jobutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': 'A20F9217-0E3D-4292-A0B8-AE37500BE205', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16659), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:00.500 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:19:00.550 4088 3038342145480 MainThread ERROR os_win.utils.jobutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000076\' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)instance-000000763FA7CF25-7FEA-48CC-A60F-89F10E00FD3D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)instance-000000763FA7CF25-7FEA-48CC-A60F-89F10E00FD3D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000076\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)instance-000000763FA7CF25-7FEA-48CC-A60F-89F10E00FD3D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A20F9217-0E3D-4292-A0B8-AE37500BE205', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115087), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000076' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)\n\nNot enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)\n\n'instance-00000076' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)", 'ErrorSummaryDescription': "'instance-00000076' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000076.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:00.572 4088 3038342145480 MainThread DEBUG os_win._utils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000076' failed to start. Not enough memory in the system to start the virtual machine instance-00000076. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000076' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Not enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) 'instance-00000076' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.967617750167847 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:19:00.595 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000076" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:00.595 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000076" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:00.595 4088 3038360457992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:00.595 4088 3038360457992 MainThread INFO nova.compute.manager [-] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] VM Stopped (Lifecycle Event) 2021-09-10 17:19:00.617 4088 3038360457992 MainThread DEBUG nova.compute.manager [req-803eda8c-c954-4063-b3ce-e8484b1d4ff9 - - - - -] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:00.617 4088 3038360457992 MainThread DEBUG nova.virt.hyperv.vmops [req-803eda8c-c954-4063-b3ce-e8484b1d4ff9 - - - - -] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:00.672 4088 3038360458520 MainThread DEBUG nova.network.neutron [req-312e1c1c-27bc-4bbb-ae7d-7c9ab381d51b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Updated VIF entry in instance network info cache for port 337801ad-c83b-483b-9e68-841d15149067. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:19:00.672 4088 3038360458520 MainThread DEBUG nova.network.neutron [req-312e1c1c-27bc-4bbb-ae7d-7c9ab381d51b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Updating instance_info_cache with network_info: [{"id": "337801ad-c83b-483b-9e68-841d15149067", "address": "fa:16:3e:6e:98:5b", "network": {"id": "8080ea88-714a-417c-bc62-e1cbbcd08f8e", "bridge": null, "label": "tempest-TestServerBasicOps-227122155-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fed35d747aa64087be13e1426708be67", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap337801ad-c8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:19:00.703 4088 3038360458520 MainThread DEBUG oslo_concurrency.lockutils [req-312e1c1c-27bc-4bbb-ae7d-7c9ab381d51b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-145749dc-cbfd-4187-9e03-760c213b8b43" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:19:00.703 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "f78339f3-2ad5-4e9f-8fa3-f315aa3de3df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:00.703 4088 3038360457992 MainThread DEBUG nova.compute.manager [req-803eda8c-c954-4063-b3ce-e8484b1d4ff9 - - - - -] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:00.740 4088 3038360458168 MainThread DEBUG nova.compute.manager [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:19:00.740 4088 3038360457992 MainThread INFO nova.compute.manager [req-803eda8c-c954-4063-b3ce-e8484b1d4ff9 - - - - -] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:00.817 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:00.817 4088 3038360458168 MainThread DEBUG nova.virt.hardware [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:19:00.817 4088 3038360458168 MainThread INFO nova.compute.claims [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Claim successful on node n-h2-808474-1 2021-09-10 17:19:00.945 4088 3038360458168 MainThread DEBUG nova.virt.hyperv.hostops [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:19:00.971 4088 3038360458168 MainThread DEBUG nova.virt.hyperv.hostops [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:19:01.221 4088 3038360458168 MainThread DEBUG nova.compute.provider_tree [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:19:01.235 4088 3038360458168 MainThread DEBUG nova.scheduler.client.report [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:19:01.235 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:01.235 4088 3038360458168 MainThread DEBUG nova.compute.manager [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:19:01.299 4088 3038360458168 MainThread DEBUG nova.compute.utils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 17:19:01.299 4088 3038338906600 GreenThread-111 DEBUG nova.compute.manager [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:19:01.299 4088 3038338906600 GreenThread-111 DEBUG nova.network.neutron [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:19:01.316 4088 3038360458168 MainThread DEBUG nova.compute.manager [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:19:01.444 4088 3038338906600 GreenThread-111 DEBUG nova.policy [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddf55d6b15144f37ae1d2f48a5918a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13a4a12834460091659ecf8dd9d41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:19:01.453 4088 3038360458168 MainThread DEBUG nova.compute.manager [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:19:01.453 4088 3038360458168 MainThread INFO nova.virt.hyperv.vmops [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Spawning new instance 2021-09-10 17:19:01.453 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "instance-00000079" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:01.453 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "instance-00000079" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:01.453 4088 3038360458168 MainThread DEBUG nova.block_device [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:19:01.453 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:01.453 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:01.484 4088 3038360458168 MainThread DEBUG os_win.utils.pathutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Creating directory: C:\openstack\instances\instance-00000079 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:19:01.484 4088 3038360458168 MainThread DEBUG nova.virt.hyperv.vmops [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000079\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:19:01.504 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:19:01.643 4088 3038342145480 MainThread DEBUG os_win.utils.jobutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '4B1597F8-C0FE-4CE1-A41B-2A71D326A641', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15623), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:01.766 4088 3038360458168 MainThread DEBUG nova.virt.hyperv.vmops [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Resizing VHD C:\openstack\instances\instance-00000079\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:19:01.784 4088 3038360457816 MainThread DEBUG nova.virt.hyperv.vmops [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:19:01.784 4088 3038342145480 MainThread ERROR os_win.utils.jobutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000076\' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)instance-000000763FA7CF25-7FEA-48CC-A60F-89F10E00FD3D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)instance-000000763FA7CF25-7FEA-48CC-A60F-89F10E00FD3D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000076\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)instance-000000763FA7CF25-7FEA-48CC-A60F-89F10E00FD3D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4B1597F8-C0FE-4CE1-A41B-2A71D326A641', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119457), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 1), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 1), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000076' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)\n\nNot enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)\n\n'instance-00000076' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D)", 'ErrorSummaryDescription': "'instance-00000076' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000076.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:01.784 4088 3038342145480 MainThread ERROR nova.virt.hyperv.vmops [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Failed to change vm state of instance-00000076 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000076' failed to start. 2021-09-10 17:19:01.784 4088 3038342145480 MainThread INFO nova.virt.hyperv.vmops [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Got request to destroy instance 2021-09-10 17:19:02.135 4088 3038338906600 GreenThread-111 DEBUG nova.network.neutron [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Successfully created port: fa33b8a0-d81f-470d-9135-051a80a8ca3e _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:19:02.261 4088 3038360457992 MainThread DEBUG nova.compute.manager [req-c928c133-cf24-425d-bcb5-23417556fac5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Received event network-vif-plugged-47bb4775-7df1-42a8-bb27-32f4b00688ea external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:19:02.261 4088 3038360457992 MainThread DEBUG oslo_concurrency.lockutils [req-c928c133-cf24-425d-bcb5-23417556fac5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "27993f4e-58ab-4d61-a84c-7036ecfd1fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:02.261 4088 3038360457992 MainThread DEBUG oslo_concurrency.lockutils [req-c928c133-cf24-425d-bcb5-23417556fac5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "27993f4e-58ab-4d61-a84c-7036ecfd1fad-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:02.261 4088 3038360457992 MainThread DEBUG nova.compute.manager [req-c928c133-cf24-425d-bcb5-23417556fac5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Processing event network-vif-plugged-47bb4775-7df1-42a8-bb27-32f4b00688ea _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:19:02.288 4088 3038342146712 MainThread INFO nova.virt.hyperv.vmops [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Using config drive for instance 2021-09-10 17:19:02.407 4088 3038342146712 MainThread INFO nova.virt.hyperv.vmops [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Creating config drive at C:\openstack\instances\instance-00000077\configdrive.iso 2021-09-10 17:19:02.487 4088 3038342146712 MainThread DEBUG oslo_concurrency.processutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000077\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp7bzlr856 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:19:02.613 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:19:02.613 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:19:02.720 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-6a33a253-c7b1-44b1-bdc0-eca64733ab55" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:19:02.720 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:19:02.800 4088 3038342146712 MainThread DEBUG oslo_concurrency.processutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000077\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp7bzlr856" returned: 0 in 0.313s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:19:02.830 4088 3038338906600 GreenThread-111 DEBUG nova.network.neutron [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Successfully updated port: fa33b8a0-d81f-470d-9135-051a80a8ca3e _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:19:02.856 4088 3038338906600 GreenThread-111 DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Acquired lock "refresh_cache-f78339f3-2ad5-4e9f-8fa3-f315aa3de3df" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:19:02.856 4088 3038338906600 GreenThread-111 DEBUG nova.network.neutron [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:19:02.928 4088 3038338906600 GreenThread-111 DEBUG nova.network.neutron [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:19:03.012 4088 3038360457640 MainThread DEBUG nova.compute.manager [req-be3ed242-8cb9-45df-8094-20666031ad98 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Received event network-changed-fa33b8a0-d81f-470d-9135-051a80a8ca3e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:19:03.012 4088 3038360457640 MainThread DEBUG nova.compute.manager [req-be3ed242-8cb9-45df-8094-20666031ad98 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Refreshing instance network info cache due to event network-changed-fa33b8a0-d81f-470d-9135-051a80a8ca3e. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:19:03.312 4088 3038338906600 GreenThread-111 DEBUG nova.network.neutron [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Updating instance_info_cache with network_info: [{"id": "fa33b8a0-d81f-470d-9135-051a80a8ca3e", "address": "fa:16:3e:50:dd:6c", "network": {"id": "64cdd12b-fd00-45d8-bb80-13f83006e3d5", "bridge": null, "label": "tempest-VolumesActionsTest-1247926926-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be13a4a12834460091659ecf8dd9d41f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfa33b8a0-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:19:03.329 4088 3038338906600 GreenThread-111 DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Releasing lock "refresh_cache-f78339f3-2ad5-4e9f-8fa3-f315aa3de3df" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:19:03.329 4088 3038338906600 GreenThread-111 DEBUG nova.compute.manager [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Instance network_info: |[{"id": "fa33b8a0-d81f-470d-9135-051a80a8ca3e", "address": "fa:16:3e:50:dd:6c", "network": {"id": "64cdd12b-fd00-45d8-bb80-13f83006e3d5", "bridge": null, "label": "tempest-VolumesActionsTest-1247926926-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be13a4a12834460091659ecf8dd9d41f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfa33b8a0-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:19:03.329 4088 3038360457640 MainThread DEBUG oslo_concurrency.lockutils [req-be3ed242-8cb9-45df-8094-20666031ad98 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-f78339f3-2ad5-4e9f-8fa3-f315aa3de3df" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:19:03.329 4088 3038360457640 MainThread DEBUG nova.network.neutron [req-be3ed242-8cb9-45df-8094-20666031ad98 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Refreshing network info cache for port fa33b8a0-d81f-470d-9135-051a80a8ca3e _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:19:03.329 4088 3038360458168 MainThread DEBUG nova.compute.manager [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Preparing to wait for external event network-vif-plugged-fa33b8a0-d81f-470d-9135-051a80a8ca3e prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:19:03.329 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "f78339f3-2ad5-4e9f-8fa3-f315aa3de3df-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:03.329 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "f78339f3-2ad5-4e9f-8fa3-f315aa3de3df-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:03.355 4088 3038360458168 MainThread DEBUG os_win.utils.compute.vmutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Creating VM instance-00000079 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:19:03.370 4088 3038342146712 MainThread DEBUG nova.virt.hyperv.vmops [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Setting boot order for instance: instance-00000077: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:19:03.458 4088 3038342146712 MainThread DEBUG nova.virt.hyperv.vmops [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:19:03.486 4088 3038342146712 MainThread DEBUG os_win.utils.jobutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Waiting for WMI job: {'InstanceID': '8E82D8E3-5710-46C1-A3A6-EA87012F1DD7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14899), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:03.533 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Updating instance_info_cache with network_info: [{"id": "d98b48f6-4cb1-44c3-9950-b42769c9d93e", "address": "fa:16:3e:44:cf:f9", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd98b48f6-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:19:03.558 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-6a33a253-c7b1-44b1-bdc0-eca64733ab55" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:19:03.558 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:19:03.615 4088 3038342146712 MainThread ERROR os_win.utils.jobutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000077\' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)instance-000000771A073DE7-BEEB-4790-9871-BD9697A7F7D612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)instance-000000771A073DE7-BEEB-4790-9871-BD9697A7F7D610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000077\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)instance-000000771A073DE7-BEEB-4790-9871-BD9697A7F7D6%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '8E82D8E3-5710-46C1-A3A6-EA87012F1DD7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114609), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 3), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000077' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)\n\nNot enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)\n\n'instance-00000077' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)", 'ErrorSummaryDescription': "'instance-00000077' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000077.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:03.615 4088 3038342146712 MainThread DEBUG os_win._utils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000077' failed to start. Not enough memory in the system to start the virtual machine instance-00000077. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000077' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Not enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) 'instance-00000077' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.15612435340881348 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:19:03.688 4088 3038360458520 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:03.688 4088 3038360458520 MainThread INFO nova.compute.manager [-] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] VM Stopped (Lifecycle Event) 2021-09-10 17:19:03.688 4088 3038360457992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000077" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:03.688 4088 3038360457992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000077" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:03.716 4088 3038360458520 MainThread DEBUG nova.compute.manager [req-001798cf-dc5c-4389-9fe8-29ccdd672ad8 - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:03.716 4088 3038360458520 MainThread DEBUG nova.virt.hyperv.vmops [req-001798cf-dc5c-4389-9fe8-29ccdd672ad8 - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:03.767 4088 3038360458520 MainThread DEBUG nova.compute.manager [req-001798cf-dc5c-4389-9fe8-29ccdd672ad8 - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:03.800 4088 3038360458520 MainThread INFO nova.compute.manager [req-001798cf-dc5c-4389-9fe8-29ccdd672ad8 - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:04.109 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:19:04.109 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000076" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:04.109 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000076" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:04.142 4088 3038342145480 MainThread DEBUG os_win.utils.compute.vmutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Successfully changed vm state of instance-00000076 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:19:04.142 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Successfully changed state of VM instance-00000076 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:19:04.183 4088 3038342145480 MainThread DEBUG os_win.utils.jobutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '108BA046-C1CB-4E2D-A4FC-0355266EF01B', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14528), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:04.205 4088 3038360457640 MainThread DEBUG nova.network.neutron [req-be3ed242-8cb9-45df-8094-20666031ad98 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Updated VIF entry in instance network info cache for port fa33b8a0-d81f-470d-9135-051a80a8ca3e. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:19:04.205 4088 3038360457640 MainThread DEBUG nova.network.neutron [req-be3ed242-8cb9-45df-8094-20666031ad98 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Updating instance_info_cache with network_info: [{"id": "fa33b8a0-d81f-470d-9135-051a80a8ca3e", "address": "fa:16:3e:50:dd:6c", "network": {"id": "64cdd12b-fd00-45d8-bb80-13f83006e3d5", "bridge": null, "label": "tempest-VolumesActionsTest-1247926926-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be13a4a12834460091659ecf8dd9d41f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfa33b8a0-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:19:04.221 4088 3038360457640 MainThread DEBUG oslo_concurrency.lockutils [req-be3ed242-8cb9-45df-8094-20666031ad98 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-f78339f3-2ad5-4e9f-8fa3-f315aa3de3df" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:19:04.299 4088 3038342145480 MainThread DEBUG os_win.utils.jobutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job succeeded: {'InstanceID': '108BA046-C1CB-4E2D-A4FC-0355266EF01B', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=109407), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:19:04.299 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000076" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:04.299 4088 3038342145480 MainThread DEBUG os_win.utils.pathutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Removing directory: C:\openstack\instances\instance-00000076 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:19:04.299 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000076" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:04.299 4088 3038342145480 MainThread ERROR nova.compute.manager [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000076' failed to start. Not enough memory in the system to start the virtual machine instance-00000076. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000076' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Not enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) 'instance-00000076' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Error code: 32778. 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Traceback (most recent call last): 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] return function(*args, **kwargs) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] admin_password, network_info, block_device_info) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] return function(self, *args, **kwds) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self.force_reraise() 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] raise self.value 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] should_plug_vifs=False) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 'req_state': req_state}) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self.force_reraise() 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] raise self.value 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] time.sleep(sleep_time) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self.force_reraise() 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] raise self.value 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] return f(*args, **kwargs) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] return self._wait_for_job(job_path) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] error_desc=err_desc) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000076' failed to start. 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Not enough memory in the system to start the virtual machine instance-00000076. 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000076' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Not enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 'instance-00000076' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Error code: 32778. 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] During handling of the above exception, another exception occurred: 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Traceback (most recent call last): 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] yield resources 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] accel_info=accel_info) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] return function(*args, **kwargs) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] admin_password, network_info, block_device_info) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] return function(self, *args, **kwds) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self.force_reraise() 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] raise self.value 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] should_plug_vifs=False) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 'req_state': req_state}) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self.force_reraise() 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] raise self.value 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] time.sleep(sleep_time) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self.force_reraise() 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] raise self.value 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] return f(*args, **kwargs) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] return self._wait_for_job(job_path) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] error_desc=err_desc) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000076' failed to start. 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Not enough memory in the system to start the virtual machine instance-00000076. 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000076' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Not enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 'instance-00000076' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Error code: 32778. 2021-09-10 17:19:04.299 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.299 4088 3038342145480 MainThread INFO nova.compute.manager [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Terminating instance 2021-09-10 17:19:04.329 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:19:04.329 4088 3038342145480 MainThread INFO nova.virt.hyperv.vmops [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Got request to destroy instance 2021-09-10 17:19:04.375 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:19:04.375 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000076" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:04.375 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-00000076" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:04.375 4088 3038342145480 MainThread INFO nova.compute.manager [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Took 0.05 seconds to destroy the instance on the hypervisor. 2021-09-10 17:19:04.375 4088 3038342145480 MainThread DEBUG nova.compute.claims [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:19:04.375 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:04.469 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.hostops [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:19:04.500 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:19:04.500 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.hostops [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:19:04.741 4088 3038342146712 MainThread DEBUG os_win.utils.jobutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Waiting for WMI job: {'InstanceID': '2CEB8FE2-7EFC-4F6B-955B-1DC95B0DD49D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18648), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:04.752 4088 3038342145480 MainThread DEBUG nova.compute.provider_tree [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:19:04.752 4088 3038342145480 MainThread DEBUG nova.scheduler.client.report [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:19:04.752 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.375s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:04.752 4088 3038342145480 MainThread ERROR nova.compute.manager [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000076' failed to start. Not enough memory in the system to start the virtual machine instance-00000076. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000076' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Not enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) 'instance-00000076' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Error code: 32778. 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Traceback (most recent call last): 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] return function(*args, **kwargs) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] admin_password, network_info, block_device_info) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] return function(self, *args, **kwds) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self.force_reraise() 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] raise self.value 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] should_plug_vifs=False) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 'req_state': req_state}) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self.force_reraise() 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] raise self.value 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] time.sleep(sleep_time) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self.force_reraise() 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] raise self.value 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] return f(*args, **kwargs) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] return self._wait_for_job(job_path) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] error_desc=err_desc) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000076' failed to start. 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Not enough memory in the system to start the virtual machine instance-00000076. 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000076' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Not enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 'instance-00000076' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Error code: 32778. 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] During handling of the above exception, another exception occurred: 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Traceback (most recent call last): 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] accel_info=accel_info) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] return function(*args, **kwargs) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] admin_password, network_info, block_device_info) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] return function(self, *args, **kwds) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self.force_reraise() 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] raise self.value 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] should_plug_vifs=False) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 'req_state': req_state}) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self.force_reraise() 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] raise self.value 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] time.sleep(sleep_time) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self.force_reraise() 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] raise self.value 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] return f(*args, **kwargs) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] return self._wait_for_job(job_path) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] error_desc=err_desc) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000076' failed to start. 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Not enough memory in the system to start the virtual machine instance-00000076. 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000076' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Not enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 'instance-00000076' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Error code: 32778. 2021-09-10 17:19:04.752 4088 3038342145480 MainThread TRACE nova.compute.manager [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] 2021-09-10 17:19:04.781 4088 3038342145480 MainThread DEBUG nova.compute.utils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] WMI job failed with status 10. Error summary description: 'instance-00000076' failed to start. Not enough memory in the system to start the virtual machine instance-00000076. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:19:04.781 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Build of instance 2c0ae919-97f4-4b59-a070-63a3ec8effa7 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000076' failed to start. Not enough memory in the system to start the virtual machine instance-00000076. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000076' failed to start. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Not enough memory in the system to start the virtual machine instance-00000076 with ram size 1024 megabytes. (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) 'instance-00000076' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3FA7CF25-7FEA-48CC-A60F-89F10E00FD3D) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:19:04.784 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:19:04.784 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:19:04.784 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:19:04.784 4088 3038342145480 MainThread DEBUG nova.network.neutron [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:19:04.891 4088 3038342146712 MainThread ERROR os_win.utils.jobutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000077\' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)instance-000000771A073DE7-BEEB-4790-9871-BD9697A7F7D612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)instance-000000771A073DE7-BEEB-4790-9871-BD9697A7F7D610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000077\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)instance-000000771A073DE7-BEEB-4790-9871-BD9697A7F7D6%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '2CEB8FE2-7EFC-4F6B-955B-1DC95B0DD49D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119399), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 4), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000077' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)\n\nNot enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)\n\n'instance-00000077' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)", 'ErrorSummaryDescription': "'instance-00000077' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000077.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:04.891 4088 3038342146712 MainThread DEBUG os_win._utils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000077' failed to start. Not enough memory in the system to start the virtual machine instance-00000077. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000077' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Not enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) 'instance-00000077' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4326350688934326 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:19:05.236 4088 3038360458168 MainThread DEBUG nova.virt.hyperv.vmops [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:19:05.286 4088 3038342145480 MainThread DEBUG nova.network.neutron [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:19:05.330 4088 3038342145480 MainThread INFO nova.compute.manager [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2c0ae919-97f4-4b59-a070-63a3ec8effa7] Took 0.55 seconds to deallocate network for instance. 2021-09-10 17:19:05.501 4088 3038342145480 MainThread INFO nova.scheduler.client.report [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Deleted allocations for instance 2c0ae919-97f4-4b59-a070-63a3ec8effa7 2021-09-10 17:19:05.532 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-36968fc0-1598-4cdc-bbc9-8f30c9de52d9 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "2c0ae919-97f4-4b59-a070-63a3ec8effa7" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 23.344s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:05.908 4088 3038342146712 MainThread DEBUG os_win.utils.jobutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Waiting for WMI job: {'InstanceID': '756DDBAB-D4B5-422C-8705-D05502365904', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15226), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:06.174 4088 3038342145480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:06.174 4088 3038342145480 MainThread INFO nova.compute.manager [-] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] VM Stopped (Lifecycle Event) 2021-09-10 17:19:06.174 4088 3038360459048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000077" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:06.174 4088 3038360459048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000077" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:06.174 4088 3038342146712 MainThread ERROR os_win.utils.jobutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000077\' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)instance-000000771A073DE7-BEEB-4790-9871-BD9697A7F7D612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)instance-000000771A073DE7-BEEB-4790-9871-BD9697A7F7D610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000077\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)instance-000000771A073DE7-BEEB-4790-9871-BD9697A7F7D6%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '756DDBAB-D4B5-422C-8705-D05502365904', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118305), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 5), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 6), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000077' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)\n\nNot enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)\n\n'instance-00000077' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)", 'ErrorSummaryDescription': "'instance-00000077' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000077.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:06.174 4088 3038342146712 MainThread DEBUG os_win._utils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000077' failed to start. Not enough memory in the system to start the virtual machine instance-00000077. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000077' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Not enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) 'instance-00000077' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.7153446674346924 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:19:06.201 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-e5eb2420-a86a-4138-9fb8-69b93875bfff - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:06.201 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-e5eb2420-a86a-4138-9fb8-69b93875bfff - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:06.256 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-e5eb2420-a86a-4138-9fb8-69b93875bfff - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:06.276 4088 3038342145480 MainThread INFO nova.compute.manager [req-e5eb2420-a86a-4138-9fb8-69b93875bfff - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:06.502 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:19:06.518 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:06.518 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:06.518 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:19:06.518 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:19:06.533 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:19:06.768 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2230MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:19:06.768 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:06.948 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:19:06.948 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:19:06.948 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:19:06.948 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:19:06.948 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:19:06.948 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:19:06.948 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:19:06.948 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:19:06.948 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:19:06.948 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:19:06.948 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:19:06.948 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:19:06.948 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:19:06.948 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 27993f4e-58ab-4d61-a84c-7036ecfd1fad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:19:06.948 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 145749dc-cbfd-4187-9e03-760c213b8b43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:19:06.948 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance f78339f3-2ad5-4e9f-8fa3-f315aa3de3df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:19:06.948 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 16 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:19:06.948 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=16896MB phys_disk=79GB used_disk=16GB total_vcpus=6 used_vcpus=16 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:19:06.986 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:19:06.986 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:19:07.204 4088 3038342146712 MainThread DEBUG os_win.utils.jobutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Waiting for WMI job: {'InstanceID': '3E61D11E-6ACB-401D-9E5B-AE37616BB9DA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16922), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:07.283 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:19:07.307 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:19:07.307 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:19:07.307 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.547s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:07.355 4088 3038342146712 MainThread ERROR os_win.utils.jobutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000077\' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)instance-000000771A073DE7-BEEB-4790-9871-BD9697A7F7D612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)instance-000000771A073DE7-BEEB-4790-9871-BD9697A7F7D610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000077\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)instance-000000771A073DE7-BEEB-4790-9871-BD9697A7F7D6%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3E61D11E-6ACB-401D-9E5B-AE37616BB9DA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=127246), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 7), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000077' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)\n\nNot enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)\n\n'instance-00000077' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)", 'ErrorSummaryDescription': "'instance-00000077' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000077.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:07.355 4088 3038342146712 MainThread DEBUG os_win._utils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000077' failed to start. Not enough memory in the system to start the virtual machine instance-00000077. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000077' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Not enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) 'instance-00000077' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.896623134613037 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:19:07.396 4088 3038360459048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000077" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:07.396 4088 3038360459048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000077" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:07.396 4088 3038342145480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:07.396 4088 3038342145480 MainThread INFO nova.compute.manager [-] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] VM Stopped (Lifecycle Event) 2021-09-10 17:19:07.422 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-0edcbe58-544a-4668-ac82-4817baaeea81 - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:07.422 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-0edcbe58-544a-4668-ac82-4817baaeea81 - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:07.466 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-0edcbe58-544a-4668-ac82-4817baaeea81 - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:07.500 4088 3038342145480 MainThread INFO nova.compute.manager [req-0edcbe58-544a-4668-ac82-4817baaeea81 - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:08.391 4088 3038342146712 MainThread DEBUG os_win.utils.jobutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Waiting for WMI job: {'InstanceID': '7DE6358C-96C7-421C-A892-7EAD3A959C4E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16141), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:08.534 4088 3038342146712 MainThread ERROR os_win.utils.jobutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000077\' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)instance-000000771A073DE7-BEEB-4790-9871-BD9697A7F7D612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)instance-000000771A073DE7-BEEB-4790-9871-BD9697A7F7D610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000077\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)instance-000000771A073DE7-BEEB-4790-9871-BD9697A7F7D6%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7DE6358C-96C7-421C-A892-7EAD3A959C4E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116126), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 8), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 8), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000077' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)\n\nNot enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)\n\n'instance-00000077' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)", 'ErrorSummaryDescription': "'instance-00000077' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000077.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:08.550 4088 3038342146712 MainThread DEBUG os_win._utils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000077' failed to start. Not enough memory in the system to start the virtual machine instance-00000077. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000077' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Not enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) 'instance-00000077' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.091307163238525 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:19:08.567 4088 3038360459048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000077" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:08.584 4088 3038360459048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000077" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:08.584 4088 3038342145480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:08.584 4088 3038342145480 MainThread INFO nova.compute.manager [-] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] VM Stopped (Lifecycle Event) 2021-09-10 17:19:08.604 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-12d6ff0e-3257-4119-80b1-06f33473bd84 - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:08.604 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-12d6ff0e-3257-4119-80b1-06f33473bd84 - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:08.641 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-12d6ff0e-3257-4119-80b1-06f33473bd84 - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:08.672 4088 3038342145480 MainThread INFO nova.compute.manager [req-12d6ff0e-3257-4119-80b1-06f33473bd84 - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:08.831 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-cc804eb5-a6ea-4373-bd52-148d5055bd0b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Received event network-vif-plugged-337801ad-c83b-483b-9e68-841d15149067 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:19:08.831 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-cc804eb5-a6ea-4373-bd52-148d5055bd0b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "145749dc-cbfd-4187-9e03-760c213b8b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:08.831 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-cc804eb5-a6ea-4373-bd52-148d5055bd0b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "145749dc-cbfd-4187-9e03-760c213b8b43-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:08.831 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-cc804eb5-a6ea-4373-bd52-148d5055bd0b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Processing event network-vif-plugged-337801ad-c83b-483b-9e68-841d15149067 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:19:08.853 4088 3038360457816 MainThread INFO nova.virt.hyperv.vmops [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Using config drive for instance 2021-09-10 17:19:09.151 4088 3038360457816 MainThread INFO nova.virt.hyperv.vmops [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Creating config drive at C:\openstack\instances\instance-00000078\configdrive.iso 2021-09-10 17:19:09.245 4088 3038360457816 MainThread DEBUG oslo_concurrency.processutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000078\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpossqrbnr execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:19:09.557 4088 3038360457816 MainThread DEBUG oslo_concurrency.processutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000078\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpossqrbnr" returned: 0 in 0.312s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:19:09.589 4088 3038342146712 MainThread DEBUG os_win.utils.jobutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Waiting for WMI job: {'InstanceID': '43D69D31-38AA-4EEE-B2A0-855B8A4B5775', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=31474), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:09.719 4088 3038342146712 MainThread ERROR os_win.utils.jobutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000077\' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)instance-000000771A073DE7-BEEB-4790-9871-BD9697A7F7D612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)instance-000000771A073DE7-BEEB-4790-9871-BD9697A7F7D610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000077\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)instance-000000771A073DE7-BEEB-4790-9871-BD9697A7F7D6%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '43D69D31-38AA-4EEE-B2A0-855B8A4B5775', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114532), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 9), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 9), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000077' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)\n\nNot enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)\n\n'instance-00000077' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6)", 'ErrorSummaryDescription': "'instance-00000077' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000077.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:09.719 4088 3038342146712 MainThread ERROR nova.virt.hyperv.vmops [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Failed to change vm state of instance-00000077 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000077' failed to start. 2021-09-10 17:19:09.719 4088 3038342146712 MainThread INFO nova.virt.hyperv.vmops [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Got request to destroy instance 2021-09-10 17:19:09.761 4088 3038360459224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000077" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:09.761 4088 3038360459224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000077" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:09.761 4088 3038342145480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:09.761 4088 3038342145480 MainThread INFO nova.compute.manager [-] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] VM Stopped (Lifecycle Event) 2021-09-10 17:19:09.784 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-09cea2a6-a8dd-470a-bd14-af41b3cd34b2 - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:09.784 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-09cea2a6-a8dd-470a-bd14-af41b3cd34b2 - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:09.841 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-09cea2a6-a8dd-470a-bd14-af41b3cd34b2 - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:09.861 4088 3038342145480 MainThread INFO nova.compute.manager [req-09cea2a6-a8dd-470a-bd14-af41b3cd34b2 - - - - -] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:10.126 4088 3038360457816 MainThread DEBUG nova.virt.hyperv.vmops [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Setting boot order for instance: instance-00000078: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:19:10.204 4088 3038360457816 MainThread DEBUG nova.virt.hyperv.vmops [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:19:10.246 4088 3038360457816 MainThread DEBUG os_win.utils.jobutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Waiting for WMI job: {'InstanceID': 'BDA0F228-EF72-4B66-BBD3-740801430B6C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15135), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:10.396 4088 3038360457816 MainThread ERROR os_win.utils.jobutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000078\' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)instance-00000078458D8423-3F59-4768-8AF1-367E79283BBF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)instance-00000078458D8423-3F59-4768-8AF1-367E79283BBF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000078\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)instance-00000078458D8423-3F59-4768-8AF1-367E79283BBF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BDA0F228-EF72-4B66-BBD3-740801430B6C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121190), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 10), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 10), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000078' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)\n\nNot enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)\n\n'instance-00000078' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)", 'ErrorSummaryDescription': "'instance-00000078' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000078.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:10.396 4088 3038360457816 MainThread DEBUG os_win._utils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000078' failed to start. Not enough memory in the system to start the virtual machine instance-00000078. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000078' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Not enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) 'instance-00000078' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.19171667098999023 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:19:10.426 4088 3038360459224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000078" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:10.426 4088 3038360459224 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000078" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:10.426 4088 3038342145480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:10.426 4088 3038342145480 MainThread INFO nova.compute.manager [-] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] VM Stopped (Lifecycle Event) 2021-09-10 17:19:10.453 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-3c7df07f-4bb8-4980-b45a-f0e93e186c6b - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:10.469 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-3c7df07f-4bb8-4980-b45a-f0e93e186c6b - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:10.518 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-3c7df07f-4bb8-4980-b45a-f0e93e186c6b - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:10.543 4088 3038342145480 MainThread INFO nova.compute.manager [req-3c7df07f-4bb8-4980-b45a-f0e93e186c6b - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:10.951 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-3d93e131-b1f1-4634-8306-33dc43da1b17 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Received event network-vif-plugged-fa33b8a0-d81f-470d-9135-051a80a8ca3e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:19:10.951 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-3d93e131-b1f1-4634-8306-33dc43da1b17 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "f78339f3-2ad5-4e9f-8fa3-f315aa3de3df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:10.968 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [req-3d93e131-b1f1-4634-8306-33dc43da1b17 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "f78339f3-2ad5-4e9f-8fa3-f315aa3de3df-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:10.968 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-3d93e131-b1f1-4634-8306-33dc43da1b17 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Processing event network-vif-plugged-fa33b8a0-d81f-470d-9135-051a80a8ca3e _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:19:11.002 4088 3038360458168 MainThread INFO nova.virt.hyperv.vmops [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Using config drive for instance 2021-09-10 17:19:11.160 4088 3038360458168 MainThread INFO nova.virt.hyperv.vmops [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Creating config drive at C:\openstack\instances\instance-00000079\configdrive.iso 2021-09-10 17:19:11.251 4088 3038360458168 MainThread DEBUG oslo_concurrency.processutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000079\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp6qxsrvyt execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:19:11.437 4088 3038360457816 MainThread DEBUG os_win.utils.jobutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Waiting for WMI job: {'InstanceID': 'A266C532-645C-42F7-9E98-A5D1EAA29546', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16965), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:11.576 4088 3038360457816 MainThread ERROR os_win.utils.jobutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000078\' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)instance-00000078458D8423-3F59-4768-8AF1-367E79283BBF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)instance-00000078458D8423-3F59-4768-8AF1-367E79283BBF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000078\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)instance-00000078458D8423-3F59-4768-8AF1-367E79283BBF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A266C532-645C-42F7-9E98-A5D1EAA29546', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=130127), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 11), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 11), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000078' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)\n\nNot enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)\n\n'instance-00000078' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)", 'ErrorSummaryDescription': "'instance-00000078' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000078.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:11.594 4088 3038360457816 MainThread DEBUG os_win._utils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000078' failed to start. Not enough memory in the system to start the virtual machine instance-00000078. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000078' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Not enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) 'instance-00000078' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.389664888381958 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:19:11.598 4088 3038360458168 MainThread DEBUG oslo_concurrency.processutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000079\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp6qxsrvyt" returned: 0 in 0.343s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:19:11.629 4088 3038360458696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000078" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:11.629 4088 3038360458696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000078" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:11.656 4088 3038360459048 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:11.656 4088 3038360459048 MainThread INFO nova.compute.manager [-] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] VM Stopped (Lifecycle Event) 2021-09-10 17:19:11.688 4088 3038360459048 MainThread DEBUG nova.compute.manager [req-8a993ee2-3066-4be1-b7be-7b368fcbe4ff - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:11.688 4088 3038360459048 MainThread DEBUG nova.virt.hyperv.vmops [req-8a993ee2-3066-4be1-b7be-7b368fcbe4ff - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:11.738 4088 3038360459048 MainThread DEBUG nova.compute.manager [req-8a993ee2-3066-4be1-b7be-7b368fcbe4ff - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:11.760 4088 3038360459048 MainThread INFO nova.compute.manager [req-8a993ee2-3066-4be1-b7be-7b368fcbe4ff - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:12.041 4088 3038342146712 MainThread DEBUG nova.virt.hyperv.vmops [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:19:12.041 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "instance-00000077" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:12.041 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "instance-00000077" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:12.050 4088 3038342146712 MainThread DEBUG os_win.utils.compute.vmutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Successfully changed vm state of instance-00000077 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:19:12.050 4088 3038342146712 MainThread DEBUG nova.virt.hyperv.vmops [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Successfully changed state of VM instance-00000077 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:19:12.111 4088 3038342146712 MainThread DEBUG os_win.utils.jobutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Waiting for WMI job: {'InstanceID': '613C7BAB-7948-472E-91FF-0EEF1039A3C2', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15403), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:12.175 4088 3038360458168 MainThread DEBUG nova.virt.hyperv.vmops [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Setting boot order for instance: instance-00000079: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:19:12.251 4088 3038342146712 MainThread DEBUG os_win.utils.jobutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] WMI job succeeded: {'InstanceID': '613C7BAB-7948-472E-91FF-0EEF1039A3C2', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=99794), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:19:12.251 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "instance-00000077" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:12.251 4088 3038342146712 MainThread DEBUG os_win.utils.pathutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Removing directory: C:\openstack\instances\instance-00000077 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:19:12.251 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "instance-00000077" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:12.251 4088 3038342146712 MainThread ERROR nova.compute.manager [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000077' failed to start. Not enough memory in the system to start the virtual machine instance-00000077. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000077' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Not enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) 'instance-00000077' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Error code: 32778. 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Traceback (most recent call last): 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] return function(*args, **kwargs) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] admin_password, network_info, block_device_info) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] return function(self, *args, **kwds) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self.force_reraise() 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] raise self.value 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] should_plug_vifs=False) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 'req_state': req_state}) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self.force_reraise() 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] raise self.value 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] time.sleep(sleep_time) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self.force_reraise() 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] raise self.value 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] return f(*args, **kwargs) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] return self._wait_for_job(job_path) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] error_desc=err_desc) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000077' failed to start. 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Not enough memory in the system to start the virtual machine instance-00000077. 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000077' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Not enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 'instance-00000077' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Error code: 32778. 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] During handling of the above exception, another exception occurred: 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Traceback (most recent call last): 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] yield resources 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] accel_info=accel_info) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] return function(*args, **kwargs) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] admin_password, network_info, block_device_info) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] return function(self, *args, **kwds) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self.force_reraise() 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] raise self.value 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] should_plug_vifs=False) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 'req_state': req_state}) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self.force_reraise() 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] raise self.value 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] time.sleep(sleep_time) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self.force_reraise() 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] raise self.value 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] return f(*args, **kwargs) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] return self._wait_for_job(job_path) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] error_desc=err_desc) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000077' failed to start. 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Not enough memory in the system to start the virtual machine instance-00000077. 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000077' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Not enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 'instance-00000077' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Error code: 32778. 2021-09-10 17:19:12.251 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.251 4088 3038342146712 MainThread INFO nova.compute.manager [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Terminating instance 2021-09-10 17:19:12.251 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:19:12.251 4088 3038342146712 MainThread INFO nova.virt.hyperv.vmops [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Got request to destroy instance 2021-09-10 17:19:12.251 4088 3038360458168 MainThread DEBUG nova.virt.hyperv.vmops [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:19:12.268 4088 3038342146712 MainThread DEBUG nova.virt.hyperv.vmops [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:19:12.268 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "instance-00000077" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:12.268 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "instance-00000077" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:12.268 4088 3038342146712 MainThread INFO nova.compute.manager [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Took 0.01 seconds to destroy the instance on the hypervisor. 2021-09-10 17:19:12.268 4088 3038342146712 MainThread DEBUG nova.compute.claims [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:19:12.268 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:12.296 4088 3038360458168 MainThread DEBUG os_win.utils.jobutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Waiting for WMI job: {'InstanceID': '67CDC063-33A0-4531-9AAE-D528FFD1254D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=26713), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:12.443 4088 3038360458168 MainThread ERROR os_win.utils.jobutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] WMI job failed: {'RawErrors': (('124\'instance-00000079\' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)instance-000000793122F714-EB6E-4270-94E4-CFC0C1F7CFA912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)instance-000000793122F714-EB6E-4270-94E4-CFC0C1F7CFA910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000079\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)instance-000000793122F714-EB6E-4270-94E4-CFC0C1F7CFA9%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '67CDC063-33A0-4531-9AAE-D528FFD1254D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121919), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 12), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 12), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000079' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)\n\nNot enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)\n\n'instance-00000079' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)", 'ErrorSummaryDescription': "'instance-00000079' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000079.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:12.443 4088 3038360458168 MainThread DEBUG os_win._utils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000079' failed to start. Not enough memory in the system to start the virtual machine instance-00000079. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000079' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Not enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) 'instance-00000079' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1921370029449463 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:19:12.454 4088 3038342146712 MainThread DEBUG nova.virt.hyperv.hostops [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:19:12.469 4088 3038342146712 MainThread DEBUG nova.virt.hyperv.hostops [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:19:12.469 4088 3038360459048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000079" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:12.469 4088 3038360459048 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000079" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:12.469 4088 3038342145480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:12.469 4088 3038342145480 MainThread INFO nova.compute.manager [-] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] VM Stopped (Lifecycle Event) 2021-09-10 17:19:12.520 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-5bf7afd6-a227-4135-bf67-d29ef82b992c - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:12.520 4088 3038342145480 MainThread DEBUG nova.virt.hyperv.vmops [req-5bf7afd6-a227-4135-bf67-d29ef82b992c - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:12.562 4088 3038342145480 MainThread DEBUG nova.compute.manager [req-5bf7afd6-a227-4135-bf67-d29ef82b992c - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:12.595 4088 3038342145480 MainThread INFO nova.compute.manager [req-5bf7afd6-a227-4135-bf67-d29ef82b992c - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:12.627 4088 3038360457816 MainThread DEBUG os_win.utils.jobutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Waiting for WMI job: {'InstanceID': '9793386B-4225-4148-BAF1-D43AE416FE0A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19562), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:12.703 4088 3038342146712 MainThread DEBUG nova.compute.provider_tree [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:19:12.722 4088 3038342146712 MainThread DEBUG nova.scheduler.client.report [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:19:12.722 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:12.722 4088 3038342146712 MainThread ERROR nova.compute.manager [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000077' failed to start. Not enough memory in the system to start the virtual machine instance-00000077. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000077' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Not enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) 'instance-00000077' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Error code: 32778. 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Traceback (most recent call last): 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] return function(*args, **kwargs) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] admin_password, network_info, block_device_info) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] return function(self, *args, **kwds) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self.force_reraise() 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] raise self.value 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] should_plug_vifs=False) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 'req_state': req_state}) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self.force_reraise() 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] raise self.value 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] time.sleep(sleep_time) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self.force_reraise() 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] raise self.value 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] return f(*args, **kwargs) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] return self._wait_for_job(job_path) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] error_desc=err_desc) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000077' failed to start. 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Not enough memory in the system to start the virtual machine instance-00000077. 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000077' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Not enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 'instance-00000077' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Error code: 32778. 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] During handling of the above exception, another exception occurred: 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Traceback (most recent call last): 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] accel_info=accel_info) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] return function(*args, **kwargs) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] admin_password, network_info, block_device_info) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] return function(self, *args, **kwds) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self.force_reraise() 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] raise self.value 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] should_plug_vifs=False) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 'req_state': req_state}) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self.force_reraise() 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] raise self.value 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] time.sleep(sleep_time) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self.force_reraise() 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] raise self.value 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] return f(*args, **kwargs) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] return self._wait_for_job(job_path) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] error_desc=err_desc) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000077' failed to start. 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Not enough memory in the system to start the virtual machine instance-00000077. 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000077' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Not enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 'instance-00000077' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Error code: 32778. 2021-09-10 17:19:12.722 4088 3038342146712 MainThread TRACE nova.compute.manager [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] 2021-09-10 17:19:12.739 4088 3038342146712 MainThread DEBUG nova.compute.utils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] WMI job failed with status 10. Error summary description: 'instance-00000077' failed to start. Not enough memory in the system to start the virtual machine instance-00000077. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:19:12.739 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Build of instance 27993f4e-58ab-4d61-a84c-7036ecfd1fad was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000077' failed to start. Not enough memory in the system to start the virtual machine instance-00000077. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000077' failed to start. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Not enough memory in the system to start the virtual machine instance-00000077 with ram size 1024 megabytes. (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) 'instance-00000077' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1A073DE7-BEEB-4790-9871-BD9697A7F7D6) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:19:12.739 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:19:12.739 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:19:12.739 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:19:12.749 4088 3038342146712 MainThread DEBUG nova.network.neutron [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:19:12.792 4088 3038360457816 MainThread ERROR os_win.utils.jobutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000078\' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)instance-00000078458D8423-3F59-4768-8AF1-367E79283BBF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)instance-00000078458D8423-3F59-4768-8AF1-367E79283BBF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000078\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)instance-00000078458D8423-3F59-4768-8AF1-367E79283BBF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9793386B-4225-4148-BAF1-D43AE416FE0A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=133598), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 12), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 12), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000078' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)\n\nNot enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)\n\n'instance-00000078' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)", 'ErrorSummaryDescription': "'instance-00000078' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000078.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:12.792 4088 3038360457816 MainThread DEBUG os_win._utils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000078' failed to start. Not enough memory in the system to start the virtual machine instance-00000078. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000078' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Not enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) 'instance-00000078' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5877153873443604 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:19:12.817 4088 3038342146184 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:12.817 4088 3038342146184 MainThread INFO nova.compute.manager [-] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] VM Stopped (Lifecycle Event) 2021-09-10 17:19:12.817 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000078" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:12.817 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000078" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:12.854 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-852bc88d-3937-42e3-98a1-e66b6e93c3e4 - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:12.854 4088 3038342146184 MainThread DEBUG nova.virt.hyperv.vmops [req-852bc88d-3937-42e3-98a1-e66b6e93c3e4 - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:12.908 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-852bc88d-3937-42e3-98a1-e66b6e93c3e4 - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:12.922 4088 3038342146184 MainThread INFO nova.compute.manager [req-852bc88d-3937-42e3-98a1-e66b6e93c3e4 - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:13.488 4088 3038360458168 MainThread DEBUG os_win.utils.jobutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Waiting for WMI job: {'InstanceID': '1262A1FE-C16E-4198-A42E-D207AE5BD277', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=26197), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:13.625 4088 3038360458168 MainThread ERROR os_win.utils.jobutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] WMI job failed: {'RawErrors': (('124\'instance-00000079\' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)instance-000000793122F714-EB6E-4270-94E4-CFC0C1F7CFA912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)instance-000000793122F714-EB6E-4270-94E4-CFC0C1F7CFA910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000079\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)instance-000000793122F714-EB6E-4270-94E4-CFC0C1F7CFA9%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1262A1FE-C16E-4198-A42E-D207AE5BD277', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=131652), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 13), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 13), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000079' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)\n\nNot enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)\n\n'instance-00000079' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)", 'ErrorSummaryDescription': "'instance-00000079' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000079.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:13.625 4088 3038360458168 MainThread DEBUG os_win._utils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000079' failed to start. Not enough memory in the system to start the virtual machine instance-00000079. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000079' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Not enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) 'instance-00000079' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3738927841186523 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:19:13.675 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000079" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:13.675 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000079" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:13.675 4088 3038342146184 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:13.675 4088 3038342146184 MainThread INFO nova.compute.manager [-] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] VM Stopped (Lifecycle Event) 2021-09-10 17:19:13.719 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-3106374a-6dcf-443a-8644-e3b567e7b816 - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:13.719 4088 3038342146184 MainThread DEBUG nova.virt.hyperv.vmops [req-3106374a-6dcf-443a-8644-e3b567e7b816 - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:13.781 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-3106374a-6dcf-443a-8644-e3b567e7b816 - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:13.815 4088 3038342146712 MainThread DEBUG nova.network.neutron [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:19:13.830 4088 3038360457816 MainThread DEBUG os_win.utils.jobutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Waiting for WMI job: {'InstanceID': 'BE4119B9-9FD7-4D3A-9D5B-189E8F0654D9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21392), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:13.846 4088 3038342146184 MainThread INFO nova.compute.manager [req-3106374a-6dcf-443a-8644-e3b567e7b816 - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:13.861 4088 3038342146712 MainThread INFO nova.compute.manager [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 27993f4e-58ab-4d61-a84c-7036ecfd1fad] Took 1.11 seconds to deallocate network for instance. 2021-09-10 17:19:13.971 4088 3038360457816 MainThread ERROR os_win.utils.jobutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000078\' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)instance-00000078458D8423-3F59-4768-8AF1-367E79283BBF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)instance-00000078458D8423-3F59-4768-8AF1-367E79283BBF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000078\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)instance-00000078458D8423-3F59-4768-8AF1-367E79283BBF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BE4119B9-9FD7-4D3A-9D5B-189E8F0654D9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=130061), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 13), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 13), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000078' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)\n\nNot enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)\n\n'instance-00000078' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)", 'ErrorSummaryDescription': "'instance-00000078' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000078.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:13.971 4088 3038360457816 MainThread DEBUG os_win._utils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000078' failed to start. Not enough memory in the system to start the virtual machine instance-00000078. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000078' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Not enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) 'instance-00000078' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7673745155334473 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:19:14.031 4088 3038342146184 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:14.031 4088 3038342146184 MainThread INFO nova.compute.manager [-] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] VM Stopped (Lifecycle Event) 2021-09-10 17:19:14.031 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000078" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:14.031 4088 3038342144952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000078" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:14.031 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-fb194d41-c204-4c48-ac62-b30277c14e3d - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:14.031 4088 3038342146184 MainThread DEBUG nova.virt.hyperv.vmops [req-fb194d41-c204-4c48-ac62-b30277c14e3d - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:14.079 4088 3038342146712 MainThread INFO nova.scheduler.client.report [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Deleted allocations for instance 27993f4e-58ab-4d61-a84c-7036ecfd1fad 2021-09-10 17:19:14.111 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-fb194d41-c204-4c48-ac62-b30277c14e3d - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:14.140 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-14cce35c-ce11-4c8b-b24b-c45a2ca8731e bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "27993f4e-58ab-4d61-a84c-7036ecfd1fad" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 22.125s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:14.151 4088 3038342146184 MainThread INFO nova.compute.manager [req-fb194d41-c204-4c48-ac62-b30277c14e3d - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:14.656 4088 3038360458168 MainThread DEBUG os_win.utils.jobutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Waiting for WMI job: {'InstanceID': '6EBDB538-4C48-4D8D-A6D9-D6536E0B19C0', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15858), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:14.760 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:19:14.807 4088 3038360458168 MainThread ERROR os_win.utils.jobutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] WMI job failed: {'RawErrors': (('124\'instance-00000079\' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)instance-000000793122F714-EB6E-4270-94E4-CFC0C1F7CFA912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)instance-000000793122F714-EB6E-4270-94E4-CFC0C1F7CFA910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000079\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)instance-000000793122F714-EB6E-4270-94E4-CFC0C1F7CFA9%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6EBDB538-4C48-4D8D-A6D9-D6536E0B19C0', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120238), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 14), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 14), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000079' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)\n\nNot enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)\n\n'instance-00000079' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)", 'ErrorSummaryDescription': "'instance-00000079' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000079.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:14.807 4088 3038360458168 MainThread DEBUG os_win._utils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000079' failed to start. Not enough memory in the system to start the virtual machine instance-00000079. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000079' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Not enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) 'instance-00000079' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.555483102798462 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:19:14.839 4088 3038342146184 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:14.839 4088 3038342146184 MainThread INFO nova.compute.manager [-] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] VM Stopped (Lifecycle Event) 2021-09-10 17:19:14.839 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000079" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:14.839 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000079" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:14.859 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-f24db49e-afed-4844-b0c6-59d2cba496d8 - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:14.859 4088 3038342146184 MainThread DEBUG nova.virt.hyperv.vmops [req-f24db49e-afed-4844-b0c6-59d2cba496d8 - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:14.900 4088 3038342146184 MainThread DEBUG nova.compute.manager [req-f24db49e-afed-4844-b0c6-59d2cba496d8 - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:14.928 4088 3038342146184 MainThread INFO nova.compute.manager [req-f24db49e-afed-4844-b0c6-59d2cba496d8 - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:14.984 4088 3038360457816 MainThread DEBUG os_win.utils.jobutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Waiting for WMI job: {'InstanceID': '23FC4308-0A61-4E2B-8424-2F8FE096654B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17291), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:15.143 4088 3038360457816 MainThread ERROR os_win.utils.jobutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000078\' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)instance-00000078458D8423-3F59-4768-8AF1-367E79283BBF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)instance-00000078458D8423-3F59-4768-8AF1-367E79283BBF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000078\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)instance-00000078458D8423-3F59-4768-8AF1-367E79283BBF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '23FC4308-0A61-4E2B-8424-2F8FE096654B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=122008), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 14), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 15), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000078' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)\n\nNot enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)\n\n'instance-00000078' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)", 'ErrorSummaryDescription': "'instance-00000078' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000078.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:15.143 4088 3038360457816 MainThread DEBUG os_win._utils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000078' failed to start. Not enough memory in the system to start the virtual machine instance-00000078. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000078' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Not enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) 'instance-00000078' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.938656568527222 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:19:15.171 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000078" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:15.171 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000078" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:15.171 4088 3038300760904 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:15.171 4088 3038300760904 MainThread INFO nova.compute.manager [-] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] VM Stopped (Lifecycle Event) 2021-09-10 17:19:15.202 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-e7054362-2f93-48e7-9449-d06670c9c855 - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:15.202 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.vmops [req-e7054362-2f93-48e7-9449-d06670c9c855 - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:15.235 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-e7054362-2f93-48e7-9449-d06670c9c855 - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:15.297 4088 3038300760904 MainThread INFO nova.compute.manager [req-e7054362-2f93-48e7-9449-d06670c9c855 - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:15.844 4088 3038360458168 MainThread DEBUG os_win.utils.jobutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Waiting for WMI job: {'InstanceID': '6C17F136-5BB0-484E-AEAB-09C1D6279F10', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16958), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:15.987 4088 3038360458168 MainThread ERROR os_win.utils.jobutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] WMI job failed: {'RawErrors': (('124\'instance-00000079\' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)instance-000000793122F714-EB6E-4270-94E4-CFC0C1F7CFA912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)instance-000000793122F714-EB6E-4270-94E4-CFC0C1F7CFA910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000079\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)instance-000000793122F714-EB6E-4270-94E4-CFC0C1F7CFA9%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6C17F136-5BB0-484E-AEAB-09C1D6279F10', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113251), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 15), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 15), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000079' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)\n\nNot enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)\n\n'instance-00000079' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)", 'ErrorSummaryDescription': "'instance-00000079' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000079.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:15.987 4088 3038360458168 MainThread DEBUG os_win._utils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000079' failed to start. Not enough memory in the system to start the virtual machine instance-00000079. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000079' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Not enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) 'instance-00000079' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7360572814941406 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:19:16.002 4088 3038300760904 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:16.002 4088 3038300760904 MainThread INFO nova.compute.manager [-] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] VM Stopped (Lifecycle Event) 2021-09-10 17:19:16.002 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000079" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:16.021 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000079" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:16.055 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-731fd3c1-b5c3-43dd-b6d5-16b49d3dccca - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:16.055 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.vmops [req-731fd3c1-b5c3-43dd-b6d5-16b49d3dccca - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:16.109 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-731fd3c1-b5c3-43dd-b6d5-16b49d3dccca - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:16.126 4088 3038300760904 MainThread INFO nova.compute.manager [req-731fd3c1-b5c3-43dd-b6d5-16b49d3dccca - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:16.187 4088 3038360457816 MainThread DEBUG os_win.utils.jobutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Waiting for WMI job: {'InstanceID': '3FD0554D-FC0E-4ED4-A29D-8318D601D214', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15876), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:16.331 4088 3038360457816 MainThread ERROR os_win.utils.jobutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000078\' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)instance-00000078458D8423-3F59-4768-8AF1-367E79283BBF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)instance-00000078458D8423-3F59-4768-8AF1-367E79283BBF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000078\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)instance-00000078458D8423-3F59-4768-8AF1-367E79283BBF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3FD0554D-FC0E-4ED4-A29D-8318D601D214', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116262), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 16), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 16), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000078' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)\n\nNot enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)\n\n'instance-00000078' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF)", 'ErrorSummaryDescription': "'instance-00000078' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000078.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:16.331 4088 3038360457816 MainThread ERROR nova.virt.hyperv.vmops [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Failed to change vm state of instance-00000078 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000078' failed to start. 2021-09-10 17:19:16.331 4088 3038360457816 MainThread INFO nova.virt.hyperv.vmops [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Got request to destroy instance 2021-09-10 17:19:16.360 4088 3038300760904 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:16.360 4088 3038300760904 MainThread INFO nova.compute.manager [-] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] VM Stopped (Lifecycle Event) 2021-09-10 17:19:16.360 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000078" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:16.360 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000078" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:16.392 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-02abbdfd-9814-4a35-87e9-236a7ba6d101 - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:16.392 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.vmops [req-02abbdfd-9814-4a35-87e9-236a7ba6d101 - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:16.438 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-02abbdfd-9814-4a35-87e9-236a7ba6d101 - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:16.492 4088 3038300760904 MainThread INFO nova.compute.manager [req-02abbdfd-9814-4a35-87e9-236a7ba6d101 - - - - -] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:17.017 4088 3038360458168 MainThread DEBUG os_win.utils.jobutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Waiting for WMI job: {'InstanceID': '6E755B8D-FEB8-4D57-A189-C5C828FB7215', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18121), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:17.166 4088 3038360458168 MainThread ERROR os_win.utils.jobutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] WMI job failed: {'RawErrors': (('124\'instance-00000079\' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)instance-000000793122F714-EB6E-4270-94E4-CFC0C1F7CFA912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)instance-000000793122F714-EB6E-4270-94E4-CFC0C1F7CFA910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000079\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)instance-000000793122F714-EB6E-4270-94E4-CFC0C1F7CFA9%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6E755B8D-FEB8-4D57-A189-C5C828FB7215', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119688), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 16), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 17), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000079' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)\n\nNot enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)\n\n'instance-00000079' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)", 'ErrorSummaryDescription': "'instance-00000079' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000079.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:17.166 4088 3038360458168 MainThread DEBUG os_win._utils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000079' failed to start. Not enough memory in the system to start the virtual machine instance-00000079. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000079' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Not enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) 'instance-00000079' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.914372205734253 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:19:17.189 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000079" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:17.189 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000079" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:17.202 4088 3038300760904 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:17.202 4088 3038300760904 MainThread INFO nova.compute.manager [-] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] VM Stopped (Lifecycle Event) 2021-09-10 17:19:17.234 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-ddd5b31c-5e35-4673-9fd9-2039286e9c45 - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:17.234 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.vmops [req-ddd5b31c-5e35-4673-9fd9-2039286e9c45 - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:17.284 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-ddd5b31c-5e35-4673-9fd9-2039286e9c45 - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:17.323 4088 3038300760904 MainThread INFO nova.compute.manager [req-ddd5b31c-5e35-4673-9fd9-2039286e9c45 - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:18.194 4088 3038360458168 MainThread DEBUG os_win.utils.jobutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Waiting for WMI job: {'InstanceID': '4E83FF3F-6F1A-4AE3-A3C5-5C19BF5AA5D7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16252), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:18.303 4088 3038360457816 MainThread DEBUG nova.virt.hyperv.vmops [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:19:18.303 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Lock "instance-00000078" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:18.303 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Lock "instance-00000078" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:18.331 4088 3038360458168 MainThread ERROR os_win.utils.jobutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] WMI job failed: {'RawErrors': (('124\'instance-00000079\' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)instance-000000793122F714-EB6E-4270-94E4-CFC0C1F7CFA912030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)instance-000000793122F714-EB6E-4270-94E4-CFC0C1F7CFA910243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000079\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)instance-000000793122F714-EB6E-4270-94E4-CFC0C1F7CFA9%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4E83FF3F-6F1A-4AE3-A3C5-5C19BF5AA5D7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115344), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 18), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 18), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000079' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)\n\nNot enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)\n\n'instance-00000079' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9)", 'ErrorSummaryDescription': "'instance-00000079' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000079.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:18.331 4088 3038360458168 MainThread ERROR nova.virt.hyperv.vmops [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Failed to change vm state of instance-00000079 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000079' failed to start. 2021-09-10 17:19:18.331 4088 3038360458168 MainThread INFO nova.virt.hyperv.vmops [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Got request to destroy instance 2021-09-10 17:19:18.364 4088 3038360457816 MainThread DEBUG os_win.utils.compute.vmutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Successfully changed vm state of instance-00000078 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:19:18.364 4088 3038360457816 MainThread DEBUG nova.virt.hyperv.vmops [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Successfully changed state of VM instance-00000078 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:19:18.375 4088 3038300760904 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:18.375 4088 3038300760904 MainThread INFO nova.compute.manager [-] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] VM Stopped (Lifecycle Event) 2021-09-10 17:19:18.375 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000079" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:18.375 4088 3038342146184 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000079" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:18.425 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-417e7e60-fdbe-4b65-826e-ea37294d2fbe - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:18.425 4088 3038300760904 MainThread DEBUG nova.virt.hyperv.vmops [req-417e7e60-fdbe-4b65-826e-ea37294d2fbe - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:18.425 4088 3038360457816 MainThread DEBUG os_win.utils.jobutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Waiting for WMI job: {'InstanceID': '310BDEE6-91F1-4819-BD88-AC0CBA48500A', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15105), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:18.533 4088 3038300760904 MainThread DEBUG nova.compute.manager [req-417e7e60-fdbe-4b65-826e-ea37294d2fbe - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:18.533 4088 3038360457816 MainThread DEBUG os_win.utils.jobutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] WMI job succeeded: {'InstanceID': '310BDEE6-91F1-4819-BD88-AC0CBA48500A', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=103493), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:19:18.533 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Lock "instance-00000078" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:18.533 4088 3038360457816 MainThread DEBUG os_win.utils.pathutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Removing directory: C:\openstack\instances\instance-00000078 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:19:18.533 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Lock "instance-00000078" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:18.557 4088 3038360457816 MainThread ERROR nova.compute.manager [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000078' failed to start. Not enough memory in the system to start the virtual machine instance-00000078. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000078' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Not enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) 'instance-00000078' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Error code: 32778. 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Traceback (most recent call last): 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] return function(*args, **kwargs) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] admin_password, network_info, block_device_info) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] return function(self, *args, **kwds) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self.force_reraise() 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] raise self.value 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] should_plug_vifs=False) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 'req_state': req_state}) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self.force_reraise() 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] raise self.value 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] time.sleep(sleep_time) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self.force_reraise() 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] raise self.value 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] return f(*args, **kwargs) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] return self._wait_for_job(job_path) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] error_desc=err_desc) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000078' failed to start. 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Not enough memory in the system to start the virtual machine instance-00000078. 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000078' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Not enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 'instance-00000078' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Error code: 32778. 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] During handling of the above exception, another exception occurred: 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Traceback (most recent call last): 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] yield resources 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] accel_info=accel_info) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] return function(*args, **kwargs) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] admin_password, network_info, block_device_info) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] return function(self, *args, **kwds) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self.force_reraise() 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] raise self.value 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] should_plug_vifs=False) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 'req_state': req_state}) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self.force_reraise() 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] raise self.value 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] time.sleep(sleep_time) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self.force_reraise() 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] raise self.value 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] return f(*args, **kwargs) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] return self._wait_for_job(job_path) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] error_desc=err_desc) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000078' failed to start. 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Not enough memory in the system to start the virtual machine instance-00000078. 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000078' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Not enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 'instance-00000078' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Error code: 32778. 2021-09-10 17:19:18.557 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:18.557 4088 3038360457816 MainThread INFO nova.compute.manager [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Terminating instance 2021-09-10 17:19:18.557 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:19:18.557 4088 3038360457816 MainThread INFO nova.virt.hyperv.vmops [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Got request to destroy instance 2021-09-10 17:19:18.573 4088 3038300760904 MainThread INFO nova.compute.manager [req-417e7e60-fdbe-4b65-826e-ea37294d2fbe - - - - -] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:18.573 4088 3038360457816 MainThread DEBUG nova.virt.hyperv.vmops [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:19:18.573 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Lock "instance-00000078" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:18.573 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Lock "instance-00000078" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:18.573 4088 3038360457816 MainThread INFO nova.compute.manager [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:19:18.573 4088 3038360457816 MainThread DEBUG nova.compute.claims [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:19:18.573 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:18.734 4088 3038360457816 MainThread DEBUG nova.virt.hyperv.hostops [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:19:18.734 4088 3038360457816 MainThread DEBUG nova.virt.hyperv.hostops [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:19:18.979 4088 3038360457816 MainThread DEBUG nova.compute.provider_tree [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:19:19.011 4088 3038360457816 MainThread DEBUG nova.scheduler.client.report [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:19:19.011 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.437s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:19.011 4088 3038360457816 MainThread ERROR nova.compute.manager [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000078' failed to start. Not enough memory in the system to start the virtual machine instance-00000078. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000078' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Not enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) 'instance-00000078' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Error code: 32778. 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Traceback (most recent call last): 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] return function(*args, **kwargs) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] admin_password, network_info, block_device_info) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] return function(self, *args, **kwds) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self.force_reraise() 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] raise self.value 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] should_plug_vifs=False) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 'req_state': req_state}) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self.force_reraise() 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] raise self.value 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] time.sleep(sleep_time) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self.force_reraise() 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] raise self.value 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] return f(*args, **kwargs) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] return self._wait_for_job(job_path) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] error_desc=err_desc) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000078' failed to start. 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Not enough memory in the system to start the virtual machine instance-00000078. 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000078' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Not enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 'instance-00000078' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Error code: 32778. 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] During handling of the above exception, another exception occurred: 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Traceback (most recent call last): 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] accel_info=accel_info) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] return function(*args, **kwargs) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] admin_password, network_info, block_device_info) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] return function(self, *args, **kwds) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self.force_reraise() 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] raise self.value 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] should_plug_vifs=False) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 'req_state': req_state}) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self.force_reraise() 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] raise self.value 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] time.sleep(sleep_time) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self.force_reraise() 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] raise self.value 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] return f(*args, **kwargs) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] return self._wait_for_job(job_path) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] error_desc=err_desc) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000078' failed to start. 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Not enough memory in the system to start the virtual machine instance-00000078. 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000078' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Not enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 'instance-00000078' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Error code: 32778. 2021-09-10 17:19:19.011 4088 3038360457816 MainThread TRACE nova.compute.manager [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] 2021-09-10 17:19:19.011 4088 3038360457816 MainThread DEBUG nova.compute.utils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] WMI job failed with status 10. Error summary description: 'instance-00000078' failed to start. Not enough memory in the system to start the virtual machine instance-00000078. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:19:19.011 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Build of instance 145749dc-cbfd-4187-9e03-760c213b8b43 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000078' failed to start. Not enough memory in the system to start the virtual machine instance-00000078. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000078' failed to start. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Not enough memory in the system to start the virtual machine instance-00000078 with ram size 1024 megabytes. (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) 'instance-00000078' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 458D8423-3F59-4768-8AF1-367E79283BBF) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:19:19.011 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:19:19.011 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:19:19.026 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:19:19.026 4088 3038360457816 MainThread DEBUG nova.network.neutron [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:19:19.952 4088 3038360457816 MainThread DEBUG nova.network.neutron [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:19:20.008 4088 3038360457816 MainThread INFO nova.compute.manager [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] [instance: 145749dc-cbfd-4187-9e03-760c213b8b43] Took 0.98 seconds to deallocate network for instance. 2021-09-10 17:19:20.359 4088 3038360458168 MainThread DEBUG nova.virt.hyperv.vmops [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:19:20.359 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "instance-00000079" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:20.359 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "instance-00000079" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:20.381 4088 3038360457816 MainThread INFO nova.scheduler.client.report [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Deleted allocations for instance 145749dc-cbfd-4187-9e03-760c213b8b43 2021-09-10 17:19:20.403 4088 3038360458168 MainThread DEBUG os_win.utils.compute.vmutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Successfully changed vm state of instance-00000079 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:19:20.403 4088 3038360458168 MainThread DEBUG nova.virt.hyperv.vmops [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Successfully changed state of VM instance-00000079 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:19:20.453 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-910dbf53-f35c-443e-aa97-1a636be69903 51b7f766d13c41e3b48015e63ff73fa4 fed35d747aa64087be13e1426708be67 - default default] Lock "145749dc-cbfd-4187-9e03-760c213b8b43" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 23.610s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:20.453 4088 3038360458168 MainThread DEBUG os_win.utils.jobutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Waiting for WMI job: {'InstanceID': '0A0432FF-F460-4E3C-9D0F-F19C0244BAE9', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15201), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:20.562 4088 3038360458168 MainThread DEBUG os_win.utils.jobutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] WMI job succeeded: {'InstanceID': '0A0432FF-F460-4E3C-9D0F-F19C0244BAE9', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=101556), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:19:20.562 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "instance-00000079" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:20.562 4088 3038360458168 MainThread DEBUG os_win.utils.pathutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Removing directory: C:\openstack\instances\instance-00000079 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:19:20.562 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "instance-00000079" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:20.562 4088 3038360458168 MainThread ERROR nova.compute.manager [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000079' failed to start. Not enough memory in the system to start the virtual machine instance-00000079. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000079' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Not enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) 'instance-00000079' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Error code: 32778. 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Traceback (most recent call last): 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] return function(*args, **kwargs) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] admin_password, network_info, block_device_info) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] return function(self, *args, **kwds) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self.force_reraise() 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] raise self.value 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] should_plug_vifs=False) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 'req_state': req_state}) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self.force_reraise() 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] raise self.value 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] time.sleep(sleep_time) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self.force_reraise() 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] raise self.value 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] return f(*args, **kwargs) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] return self._wait_for_job(job_path) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] error_desc=err_desc) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000079' failed to start. 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Not enough memory in the system to start the virtual machine instance-00000079. 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000079' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Not enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 'instance-00000079' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Error code: 32778. 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] During handling of the above exception, another exception occurred: 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Traceback (most recent call last): 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] yield resources 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] accel_info=accel_info) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] return function(*args, **kwargs) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] admin_password, network_info, block_device_info) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] return function(self, *args, **kwds) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self.force_reraise() 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] raise self.value 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] should_plug_vifs=False) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 'req_state': req_state}) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self.force_reraise() 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] raise self.value 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] time.sleep(sleep_time) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self.force_reraise() 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] raise self.value 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] return f(*args, **kwargs) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] return self._wait_for_job(job_path) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] error_desc=err_desc) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000079' failed to start. 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Not enough memory in the system to start the virtual machine instance-00000079. 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000079' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Not enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 'instance-00000079' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Error code: 32778. 2021-09-10 17:19:20.562 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:20.562 4088 3038360458168 MainThread INFO nova.compute.manager [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Terminating instance 2021-09-10 17:19:20.588 4088 3038360458168 MainThread DEBUG nova.compute.manager [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:19:20.588 4088 3038360458168 MainThread INFO nova.virt.hyperv.vmops [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Got request to destroy instance 2021-09-10 17:19:20.603 4088 3038360458168 MainThread DEBUG nova.virt.hyperv.vmops [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:19:20.603 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "instance-00000079" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:20.603 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "instance-00000079" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:20.603 4088 3038360458168 MainThread INFO nova.compute.manager [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:19:20.603 4088 3038360458168 MainThread DEBUG nova.compute.claims [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:19:20.603 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:20.829 4088 3038360458168 MainThread DEBUG nova.virt.hyperv.hostops [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:19:20.843 4088 3038360458168 MainThread DEBUG nova.virt.hyperv.hostops [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:19:21.069 4088 3038360458168 MainThread DEBUG nova.compute.provider_tree [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:19:21.079 4088 3038360458168 MainThread DEBUG nova.scheduler.client.report [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:19:21.079 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:21.079 4088 3038360458168 MainThread ERROR nova.compute.manager [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000079' failed to start. Not enough memory in the system to start the virtual machine instance-00000079. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000079' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Not enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) 'instance-00000079' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Error code: 32778. 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Traceback (most recent call last): 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] return function(*args, **kwargs) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] admin_password, network_info, block_device_info) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] return function(self, *args, **kwds) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self.force_reraise() 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] raise self.value 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] should_plug_vifs=False) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 'req_state': req_state}) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self.force_reraise() 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] raise self.value 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] time.sleep(sleep_time) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self.force_reraise() 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] raise self.value 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] return f(*args, **kwargs) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] return self._wait_for_job(job_path) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] error_desc=err_desc) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000079' failed to start. 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Not enough memory in the system to start the virtual machine instance-00000079. 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000079' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Not enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 'instance-00000079' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Error code: 32778. 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] During handling of the above exception, another exception occurred: 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Traceback (most recent call last): 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] accel_info=accel_info) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] return function(*args, **kwargs) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] admin_password, network_info, block_device_info) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] return function(self, *args, **kwds) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self.force_reraise() 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] raise self.value 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] should_plug_vifs=False) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 'req_state': req_state}) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self.force_reraise() 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] raise self.value 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] time.sleep(sleep_time) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self.force_reraise() 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] raise self.value 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] return f(*args, **kwargs) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] return self._wait_for_job(job_path) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] error_desc=err_desc) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000079' failed to start. 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Not enough memory in the system to start the virtual machine instance-00000079. 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000079' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Not enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 'instance-00000079' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Error code: 32778. 2021-09-10 17:19:21.079 4088 3038360458168 MainThread TRACE nova.compute.manager [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] 2021-09-10 17:19:21.094 4088 3038360458168 MainThread DEBUG nova.compute.utils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] WMI job failed with status 10. Error summary description: 'instance-00000079' failed to start. Not enough memory in the system to start the virtual machine instance-00000079. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:19:21.094 4088 3038360458168 MainThread DEBUG nova.compute.manager [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Build of instance f78339f3-2ad5-4e9f-8fa3-f315aa3de3df was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000079' failed to start. Not enough memory in the system to start the virtual machine instance-00000079. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000079' failed to start. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Not enough memory in the system to start the virtual machine instance-00000079 with ram size 1024 megabytes. (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) 'instance-00000079' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3122F714-EB6E-4270-94E4-CFC0C1F7CFA9) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:19:21.094 4088 3038360458168 MainThread DEBUG nova.compute.manager [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:19:21.094 4088 3038360458168 MainThread DEBUG nova.compute.manager [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:19:21.094 4088 3038360458168 MainThread DEBUG nova.compute.manager [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:19:21.094 4088 3038360458168 MainThread DEBUG nova.network.neutron [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:19:21.812 4088 3038360458168 MainThread DEBUG nova.network.neutron [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:19:21.863 4088 3038360458168 MainThread INFO nova.compute.manager [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: f78339f3-2ad5-4e9f-8fa3-f315aa3de3df] Took 0.77 seconds to deallocate network for instance. 2021-09-10 17:19:22.188 4088 3038360458168 MainThread INFO nova.scheduler.client.report [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Deleted allocations for instance f78339f3-2ad5-4e9f-8fa3-f315aa3de3df 2021-09-10 17:19:22.265 4088 3038360458168 MainThread DEBUG oslo_concurrency.lockutils [req-7a260601-43ff-4d5a-9869-5093f83b038b ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "f78339f3-2ad5-4e9f-8fa3-f315aa3de3df" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 21.562s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:45.076 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "2af9b131-c85d-4418-810b-00a540718354" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:45.078 4088 3038360457288 MainThread DEBUG nova.compute.manager [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:19:45.164 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:45.188 4088 3038360457288 MainThread DEBUG nova.virt.hardware [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:19:45.188 4088 3038360457288 MainThread INFO nova.compute.claims [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Claim successful on node n-h2-808474-1 2021-09-10 17:19:45.276 4088 3038360457288 MainThread DEBUG nova.virt.hyperv.hostops [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:19:45.304 4088 3038360457288 MainThread DEBUG nova.virt.hyperv.hostops [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:19:45.511 4088 3038360457288 MainThread DEBUG nova.compute.provider_tree [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:19:45.522 4088 3038360457288 MainThread DEBUG nova.scheduler.client.report [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:19:45.522 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:45.522 4088 3038360457288 MainThread DEBUG nova.compute.manager [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:19:45.596 4088 3038360457288 MainThread DEBUG nova.compute.manager [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:19:45.596 4088 3038360457816 GreenThread-112 DEBUG nova.compute.manager [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:19:45.596 4088 3038360457816 GreenThread-112 DEBUG nova.network.neutron [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:19:45.732 4088 3038360457288 MainThread DEBUG nova.compute.manager [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:19:45.748 4088 3038360457816 GreenThread-112 DEBUG nova.policy [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '799e4a49be0e448b9d6d54d57b7d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf483b0ac5349bca4c898bb3b806d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:19:45.748 4088 3038360457288 MainThread INFO nova.virt.hyperv.vmops [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Spawning new instance 2021-09-10 17:19:45.776 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-0000007a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:45.776 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-0000007a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:45.776 4088 3038360457288 MainThread DEBUG nova.block_device [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:19:45.776 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:45.776 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:45.793 4088 3038360457288 MainThread DEBUG os_win.utils.pathutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Creating directory: C:\openstack\instances\instance-0000007a check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:19:45.793 4088 3038360457288 MainThread DEBUG nova.virt.hyperv.vmops [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000007a\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:19:46.038 4088 3038360457288 MainThread DEBUG nova.virt.hyperv.vmops [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Resizing VHD C:\openstack\instances\instance-0000007a\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:19:46.434 4088 3038360457816 GreenThread-112 DEBUG nova.network.neutron [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Successfully created port: e3845d8b-1f16-4e36-b403-ad3f91b48839 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:19:47.250 4088 3038360457816 GreenThread-112 DEBUG nova.network.neutron [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Successfully updated port: e3845d8b-1f16-4e36-b403-ad3f91b48839 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:19:47.265 4088 3038360457816 GreenThread-112 DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Acquired lock "refresh_cache-2af9b131-c85d-4418-810b-00a540718354" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:19:47.265 4088 3038360457816 GreenThread-112 DEBUG nova.network.neutron [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:19:47.309 4088 3038360460104 MainThread DEBUG nova.compute.manager [req-9addb4cc-6e2e-4669-b9a3-1e4dd3a58e4a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Received event network-changed-e3845d8b-1f16-4e36-b403-ad3f91b48839 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:19:47.309 4088 3038360460104 MainThread DEBUG nova.compute.manager [req-9addb4cc-6e2e-4669-b9a3-1e4dd3a58e4a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Refreshing instance network info cache due to event network-changed-e3845d8b-1f16-4e36-b403-ad3f91b48839. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:19:47.389 4088 3038360457816 GreenThread-112 DEBUG nova.network.neutron [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:19:47.750 4088 3038360457816 GreenThread-112 DEBUG nova.network.neutron [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Updating instance_info_cache with network_info: [{"id": "e3845d8b-1f16-4e36-b403-ad3f91b48839", "address": "fa:16:3e:41:6d:24", "network": {"id": "c5eaeeeb-7369-44f7-81bc-5a26c24d5db5", "bridge": null, "label": "tempest-network-smoke--1195186798", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5cf483b0ac5349bca4c898bb3b806d21", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape3845d8b-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:19:47.783 4088 3038360457816 GreenThread-112 DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Releasing lock "refresh_cache-2af9b131-c85d-4418-810b-00a540718354" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:19:47.783 4088 3038360457816 GreenThread-112 DEBUG nova.compute.manager [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Instance network_info: |[{"id": "e3845d8b-1f16-4e36-b403-ad3f91b48839", "address": "fa:16:3e:41:6d:24", "network": {"id": "c5eaeeeb-7369-44f7-81bc-5a26c24d5db5", "bridge": null, "label": "tempest-network-smoke--1195186798", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5cf483b0ac5349bca4c898bb3b806d21", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape3845d8b-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:19:47.783 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [req-9addb4cc-6e2e-4669-b9a3-1e4dd3a58e4a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-2af9b131-c85d-4418-810b-00a540718354" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:19:47.783 4088 3038360460104 MainThread DEBUG nova.network.neutron [req-9addb4cc-6e2e-4669-b9a3-1e4dd3a58e4a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Refreshing network info cache for port e3845d8b-1f16-4e36-b403-ad3f91b48839 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:19:47.783 4088 3038360457288 MainThread DEBUG nova.compute.manager [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Preparing to wait for external event network-vif-plugged-e3845d8b-1f16-4e36-b403-ad3f91b48839 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:19:47.783 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "2af9b131-c85d-4418-810b-00a540718354-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:47.783 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "2af9b131-c85d-4418-810b-00a540718354-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:47.783 4088 3038360457288 MainThread DEBUG os_win.utils.compute.vmutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Creating VM instance-0000007a create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:19:48.390 4088 3038360461160 MainThread DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "56af32cb-10b4-48fe-9adb-25b79d8d4df9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:48.426 4088 3038360460104 MainThread DEBUG nova.network.neutron [req-9addb4cc-6e2e-4669-b9a3-1e4dd3a58e4a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Updated VIF entry in instance network info cache for port e3845d8b-1f16-4e36-b403-ad3f91b48839. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:19:48.436 4088 3038360460104 MainThread DEBUG nova.network.neutron [req-9addb4cc-6e2e-4669-b9a3-1e4dd3a58e4a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Updating instance_info_cache with network_info: [{"id": "e3845d8b-1f16-4e36-b403-ad3f91b48839", "address": "fa:16:3e:41:6d:24", "network": {"id": "c5eaeeeb-7369-44f7-81bc-5a26c24d5db5", "bridge": null, "label": "tempest-network-smoke--1195186798", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5cf483b0ac5349bca4c898bb3b806d21", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape3845d8b-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:19:48.436 4088 3038360461160 MainThread DEBUG nova.compute.manager [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:19:48.452 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [req-9addb4cc-6e2e-4669-b9a3-1e4dd3a58e4a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-2af9b131-c85d-4418-810b-00a540718354" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:19:48.533 4088 3038360461160 MainThread DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:48.533 4088 3038360461160 MainThread DEBUG nova.virt.hardware [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:19:48.533 4088 3038360461160 MainThread INFO nova.compute.claims [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Claim successful on node n-h2-808474-1 2021-09-10 17:19:48.637 4088 3038360461160 MainThread DEBUG nova.virt.hyperv.hostops [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:19:48.648 4088 3038360461160 MainThread DEBUG nova.virt.hyperv.hostops [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:19:48.887 4088 3038360461160 MainThread DEBUG nova.compute.provider_tree [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:19:48.905 4088 3038360461160 MainThread DEBUG nova.scheduler.client.report [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:19:48.905 4088 3038360461160 MainThread DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:48.905 4088 3038360461160 MainThread DEBUG nova.compute.manager [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:19:48.968 4088 3038360461160 MainThread DEBUG nova.compute.manager [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:19:48.983 4088 3038360457816 GreenThread-113 DEBUG nova.compute.manager [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:19:48.983 4088 3038360457816 GreenThread-113 DEBUG nova.network.neutron [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:19:49.093 4088 3038360461160 MainThread DEBUG nova.compute.manager [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:19:49.113 4088 3038360461160 MainThread INFO nova.virt.hyperv.vmops [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Spawning new instance 2021-09-10 17:19:49.125 4088 3038360461160 MainThread DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "instance-0000007b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:49.125 4088 3038360461160 MainThread DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "instance-0000007b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:49.125 4088 3038360461160 MainThread DEBUG nova.block_device [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:19:49.125 4088 3038360461160 MainThread DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:49.125 4088 3038360461160 MainThread DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:49.139 4088 3038360461160 MainThread DEBUG os_win.utils.pathutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Creating directory: C:\openstack\instances\instance-0000007b check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:19:49.139 4088 3038360461160 MainThread DEBUG nova.virt.hyperv.vmops [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000007b\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:19:49.177 4088 3038360457816 GreenThread-113 DEBUG nova.policy [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb6b40339c39491bbe2bdee1c7c82123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecf4120b310452eb14917a31b551102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:19:49.375 4088 3038360461160 MainThread DEBUG nova.virt.hyperv.vmops [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Resizing VHD C:\openstack\instances\instance-0000007b\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:19:49.670 4088 3038360457288 MainThread DEBUG nova.virt.hyperv.vmops [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:19:50.357 4088 3038360457816 GreenThread-113 DEBUG nova.network.neutron [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Successfully created port: cc8fd93e-c3b6-4139-ba42-8fd72646e8b2 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:19:51.809 4088 3038360457816 GreenThread-113 DEBUG nova.network.neutron [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Successfully updated port: cc8fd93e-c3b6-4139-ba42-8fd72646e8b2 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:19:51.842 4088 3038360457816 GreenThread-113 DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Acquired lock "refresh_cache-56af32cb-10b4-48fe-9adb-25b79d8d4df9" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:19:51.842 4088 3038360457816 GreenThread-113 DEBUG nova.network.neutron [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:19:51.888 4088 3038363729992 MainThread DEBUG nova.compute.manager [req-566b3893-0e9e-432f-a474-905a61d4b802 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Received event network-changed-cc8fd93e-c3b6-4139-ba42-8fd72646e8b2 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:19:51.888 4088 3038363729992 MainThread DEBUG nova.compute.manager [req-566b3893-0e9e-432f-a474-905a61d4b802 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Refreshing instance network info cache due to event network-changed-cc8fd93e-c3b6-4139-ba42-8fd72646e8b2. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:19:51.927 4088 3038360457816 GreenThread-113 DEBUG nova.network.neutron [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:19:52.484 4088 3038360457816 GreenThread-113 DEBUG nova.network.neutron [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Updating instance_info_cache with network_info: [{"id": "cc8fd93e-c3b6-4139-ba42-8fd72646e8b2", "address": "fa:16:3e:6c:14:cf", "network": {"id": "e5325df2-5bda-4a32-9161-573dacd6e1e6", "bridge": null, "label": "tempest-VolumesSnapshotTestJSON-49926641-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fecf4120b310452eb14917a31b551102", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcc8fd93e-c3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:19:52.523 4088 3038360457816 GreenThread-113 DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Releasing lock "refresh_cache-56af32cb-10b4-48fe-9adb-25b79d8d4df9" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:19:52.523 4088 3038360457816 GreenThread-113 DEBUG nova.compute.manager [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Instance network_info: |[{"id": "cc8fd93e-c3b6-4139-ba42-8fd72646e8b2", "address": "fa:16:3e:6c:14:cf", "network": {"id": "e5325df2-5bda-4a32-9161-573dacd6e1e6", "bridge": null, "label": "tempest-VolumesSnapshotTestJSON-49926641-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fecf4120b310452eb14917a31b551102", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcc8fd93e-c3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:19:52.523 4088 3038363729992 MainThread DEBUG oslo_concurrency.lockutils [req-566b3893-0e9e-432f-a474-905a61d4b802 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-56af32cb-10b4-48fe-9adb-25b79d8d4df9" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:19:52.523 4088 3038363729992 MainThread DEBUG nova.network.neutron [req-566b3893-0e9e-432f-a474-905a61d4b802 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Refreshing network info cache for port cc8fd93e-c3b6-4139-ba42-8fd72646e8b2 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:19:52.523 4088 3038360461160 MainThread DEBUG nova.compute.manager [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Preparing to wait for external event network-vif-plugged-cc8fd93e-c3b6-4139-ba42-8fd72646e8b2 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:19:52.523 4088 3038360461160 MainThread DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "56af32cb-10b4-48fe-9adb-25b79d8d4df9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:52.530 4088 3038360461160 MainThread DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "56af32cb-10b4-48fe-9adb-25b79d8d4df9-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:52.530 4088 3038360461160 MainThread DEBUG os_win.utils.compute.vmutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Creating VM instance-0000007b create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:19:53.178 4088 3038363729992 MainThread DEBUG nova.network.neutron [req-566b3893-0e9e-432f-a474-905a61d4b802 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Updated VIF entry in instance network info cache for port cc8fd93e-c3b6-4139-ba42-8fd72646e8b2. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:19:53.189 4088 3038363729992 MainThread DEBUG nova.network.neutron [req-566b3893-0e9e-432f-a474-905a61d4b802 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Updating instance_info_cache with network_info: [{"id": "cc8fd93e-c3b6-4139-ba42-8fd72646e8b2", "address": "fa:16:3e:6c:14:cf", "network": {"id": "e5325df2-5bda-4a32-9161-573dacd6e1e6", "bridge": null, "label": "tempest-VolumesSnapshotTestJSON-49926641-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fecf4120b310452eb14917a31b551102", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcc8fd93e-c3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:19:53.206 4088 3038363729992 MainThread DEBUG oslo_concurrency.lockutils [req-566b3893-0e9e-432f-a474-905a61d4b802 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-56af32cb-10b4-48fe-9adb-25b79d8d4df9" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:19:54.231 4088 3038360461160 MainThread DEBUG nova.virt.hyperv.vmops [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:19:55.591 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:19:55.606 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:19:56.847 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-1d79d5e5-598b-4786-a582-9e84eb5498ef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Received event network-vif-plugged-e3845d8b-1f16-4e36-b403-ad3f91b48839 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:19:56.847 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-1d79d5e5-598b-4786-a582-9e84eb5498ef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "2af9b131-c85d-4418-810b-00a540718354-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:56.847 4088 3038360457816 MainThread DEBUG oslo_concurrency.lockutils [req-1d79d5e5-598b-4786-a582-9e84eb5498ef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "2af9b131-c85d-4418-810b-00a540718354-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:56.847 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-1d79d5e5-598b-4786-a582-9e84eb5498ef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Processing event network-vif-plugged-e3845d8b-1f16-4e36-b403-ad3f91b48839 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:19:56.905 4088 3038360457288 MainThread INFO nova.virt.hyperv.vmops [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Using config drive for instance 2021-09-10 17:19:57.061 4088 3038360457288 MainThread INFO nova.virt.hyperv.vmops [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Creating config drive at C:\openstack\instances\instance-0000007a\configdrive.iso 2021-09-10 17:19:57.158 4088 3038360457288 MainThread DEBUG oslo_concurrency.processutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000007a\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpxd9st708 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:19:57.483 4088 3038360457288 MainThread DEBUG oslo_concurrency.processutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000007a\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpxd9st708" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:19:58.041 4088 3038360457288 MainThread DEBUG nova.virt.hyperv.vmops [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Setting boot order for instance: instance-0000007a: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:19:58.126 4088 3038360457288 MainThread DEBUG nova.virt.hyperv.vmops [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:19:58.149 4088 3038360457288 MainThread DEBUG os_win.utils.jobutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '70A5EFBA-6D4F-4CE2-937A-2B66CCF8C027', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20151), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:58.303 4088 3038360457288 MainThread ERROR os_win.utils.jobutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007a\' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)instance-0000007a67AB6C0E-4A7C-438B-A3F2-B302A680E7C712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)instance-0000007a67AB6C0E-4A7C-438B-A3F2-B302A680E7C710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)instance-0000007a67AB6C0E-4A7C-438B-A3F2-B302A680E7C7%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '70A5EFBA-6D4F-4CE2-937A-2B66CCF8C027', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117531), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 58), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 58), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007a' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)\n\nNot enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)\n\n'instance-0000007a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)", 'ErrorSummaryDescription': "'instance-0000007a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:58.303 4088 3038360457288 MainThread DEBUG os_win._utils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007a' failed to start. Not enough memory in the system to start the virtual machine instance-0000007a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007a' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Not enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) 'instance-0000007a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1763935089111328 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:19:58.326 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:58.326 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:58.326 4088 3038360460984 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:58.326 4088 3038360460984 MainThread INFO nova.compute.manager [-] [instance: 2af9b131-c85d-4418-810b-00a540718354] VM Stopped (Lifecycle Event) 2021-09-10 17:19:58.345 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-4842f9ff-0a04-4c6f-a6b8-84a7023a541d - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:58.345 4088 3038360460984 MainThread DEBUG nova.virt.hyperv.vmops [req-4842f9ff-0a04-4c6f-a6b8-84a7023a541d - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:58.393 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-4842f9ff-0a04-4c6f-a6b8-84a7023a541d - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:58.421 4088 3038360460984 MainThread INFO nova.compute.manager [req-4842f9ff-0a04-4c6f-a6b8-84a7023a541d - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:19:58.545 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:19:58.545 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:19:59.314 4088 3038360457288 MainThread DEBUG os_win.utils.jobutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '2FB25425-06BA-40C7-BB1D-B4FE76B19FDF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14974), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:19:59.451 4088 3038360457288 MainThread ERROR os_win.utils.jobutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007a\' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)instance-0000007a67AB6C0E-4A7C-438B-A3F2-B302A680E7C712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)instance-0000007a67AB6C0E-4A7C-438B-A3F2-B302A680E7C710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)instance-0000007a67AB6C0E-4A7C-438B-A3F2-B302A680E7C7%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '2FB25425-06BA-40C7-BB1D-B4FE76B19FDF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114177), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 19, 59), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 19, 59), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007a' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)\n\nNot enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)\n\n'instance-0000007a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)", 'ErrorSummaryDescription': "'instance-0000007a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:19:59.451 4088 3038360457288 MainThread DEBUG os_win._utils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007a' failed to start. Not enough memory in the system to start the virtual machine instance-0000007a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007a' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Not enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) 'instance-0000007a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.324648380279541 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:19:59.498 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:19:59.498 4088 3038360460984 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:19:59.498 4088 3038360460984 MainThread INFO nova.compute.manager [-] [instance: 2af9b131-c85d-4418-810b-00a540718354] VM Stopped (Lifecycle Event) 2021-09-10 17:19:59.498 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:19:59.498 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:19:59.530 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-1d6cb08e-a28f-46f9-b715-7fc4c686f918 - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:19:59.530 4088 3038360460984 MainThread DEBUG nova.virt.hyperv.vmops [req-1d6cb08e-a28f-46f9-b715-7fc4c686f918 - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:19:59.562 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-1d6cb08e-a28f-46f9-b715-7fc4c686f918 - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:19:59.591 4088 3038360460984 MainThread INFO nova.compute.manager [req-1d6cb08e-a28f-46f9-b715-7fc4c686f918 - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:00.484 4088 3038360457288 MainThread DEBUG os_win.utils.jobutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': 'FFC4F7E4-9BD6-4BC7-9993-6916D9C583FB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15375), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:00.500 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:20:00.586 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-598002b0-f023-4fea-8e79-991923bd8338 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Received event network-vif-plugged-cc8fd93e-c3b6-4139-ba42-8fd72646e8b2 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:20:00.601 4088 3038360460984 MainThread DEBUG oslo_concurrency.lockutils [req-598002b0-f023-4fea-8e79-991923bd8338 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "56af32cb-10b4-48fe-9adb-25b79d8d4df9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:00.601 4088 3038360460984 MainThread DEBUG oslo_concurrency.lockutils [req-598002b0-f023-4fea-8e79-991923bd8338 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "56af32cb-10b4-48fe-9adb-25b79d8d4df9-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:00.601 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-598002b0-f023-4fea-8e79-991923bd8338 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Processing event network-vif-plugged-cc8fd93e-c3b6-4139-ba42-8fd72646e8b2 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:20:00.623 4088 3038360457288 MainThread ERROR os_win.utils.jobutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007a\' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)instance-0000007a67AB6C0E-4A7C-438B-A3F2-B302A680E7C712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)instance-0000007a67AB6C0E-4A7C-438B-A3F2-B302A680E7C710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)instance-0000007a67AB6C0E-4A7C-438B-A3F2-B302A680E7C7%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'FFC4F7E4-9BD6-4BC7-9993-6916D9C583FB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113587), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007a' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)\n\nNot enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)\n\n'instance-0000007a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)", 'ErrorSummaryDescription': "'instance-0000007a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:00.623 4088 3038360457288 MainThread DEBUG os_win._utils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007a' failed to start. Not enough memory in the system to start the virtual machine instance-0000007a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007a' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Not enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) 'instance-0000007a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.496232271194458 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:00.639 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:00.639 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:00.639 4088 3038360460984 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:00.639 4088 3038360460984 MainThread INFO nova.compute.manager [-] [instance: 2af9b131-c85d-4418-810b-00a540718354] VM Stopped (Lifecycle Event) 2021-09-10 17:20:00.686 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-e380344f-7bc9-4d82-bcb4-dcc195f3d371 - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:00.686 4088 3038360460984 MainThread DEBUG nova.virt.hyperv.vmops [req-e380344f-7bc9-4d82-bcb4-dcc195f3d371 - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:00.686 4088 3038360461160 MainThread INFO nova.virt.hyperv.vmops [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Using config drive for instance 2021-09-10 17:20:00.748 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-e380344f-7bc9-4d82-bcb4-dcc195f3d371 - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:00.780 4088 3038360460984 MainThread INFO nova.compute.manager [req-e380344f-7bc9-4d82-bcb4-dcc195f3d371 - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:00.873 4088 3038360461160 MainThread INFO nova.virt.hyperv.vmops [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Creating config drive at C:\openstack\instances\instance-0000007b\configdrive.iso 2021-09-10 17:20:00.968 4088 3038360461160 MainThread DEBUG oslo_concurrency.processutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000007b\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpjf3y1tqi execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:20:01.295 4088 3038360461160 MainThread DEBUG oslo_concurrency.processutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000007b\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpjf3y1tqi" returned: 0 in 0.329s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:20:01.512 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:20:01.678 4088 3038360457288 MainThread DEBUG os_win.utils.jobutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': 'C2459E5F-54E7-40DF-B9AD-8F71E9A89E16', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17001), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:01.827 4088 3038360461160 MainThread DEBUG nova.virt.hyperv.vmops [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Setting boot order for instance: instance-0000007b: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:20:01.841 4088 3038360457288 MainThread ERROR os_win.utils.jobutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007a\' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)instance-0000007a67AB6C0E-4A7C-438B-A3F2-B302A680E7C712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)instance-0000007a67AB6C0E-4A7C-438B-A3F2-B302A680E7C710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)instance-0000007a67AB6C0E-4A7C-438B-A3F2-B302A680E7C7%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C2459E5F-54E7-40DF-B9AD-8F71E9A89E16', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121150), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 1), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 1), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007a' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)\n\nNot enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)\n\n'instance-0000007a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)", 'ErrorSummaryDescription': "'instance-0000007a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:01.841 4088 3038360457288 MainThread DEBUG os_win._utils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007a' failed to start. Not enough memory in the system to start the virtual machine instance-0000007a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007a' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Not enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) 'instance-0000007a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.714930772781372 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:01.921 4088 3038360461160 MainThread DEBUG nova.virt.hyperv.vmops [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:20:01.952 4088 3038360461160 MainThread DEBUG os_win.utils.jobutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Waiting for WMI job: {'InstanceID': '09F34C72-461E-498D-8D49-C2E119157226', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16082), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:02.092 4088 3038360461160 MainThread ERROR os_win.utils.jobutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007b\' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)instance-0000007b9F49C841-36B7-43A3-987E-FF7BEEC0E4B512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)instance-0000007b9F49C841-36B7-43A3-987E-FF7BEEC0E4B510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)instance-0000007b9F49C841-36B7-43A3-987E-FF7BEEC0E4B5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '09F34C72-461E-498D-8D49-C2E119157226', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113714), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 1), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 2), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007b' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)\n\nNot enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)\n\n'instance-0000007b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)", 'ErrorSummaryDescription': "'instance-0000007b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:02.092 4088 3038360461160 MainThread DEBUG os_win._utils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007b' failed to start. Not enough memory in the system to start the virtual machine instance-0000007b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007b' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Not enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) 'instance-0000007b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.17154574394226074 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:02.123 4088 3038360457816 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:02.123 4088 3038360457816 MainThread INFO nova.compute.manager [-] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] VM Stopped (Lifecycle Event) 2021-09-10 17:20:02.123 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:02.123 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:02.143 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-e3bc28b8-acae-4740-a952-d4216583d7e7 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:02.143 4088 3038360457816 MainThread DEBUG nova.virt.hyperv.vmops [req-e3bc28b8-acae-4740-a952-d4216583d7e7 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:02.185 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-e3bc28b8-acae-4740-a952-d4216583d7e7 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:02.216 4088 3038360457816 MainThread INFO nova.compute.manager [req-e3bc28b8-acae-4740-a952-d4216583d7e7 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:02.857 4088 3038360457288 MainThread DEBUG os_win.utils.jobutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '8F0B6069-AED5-42E8-9465-0ACBE1F443E0', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15013), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:02.998 4088 3038360457288 MainThread ERROR os_win.utils.jobutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007a\' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)instance-0000007a67AB6C0E-4A7C-438B-A3F2-B302A680E7C712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)instance-0000007a67AB6C0E-4A7C-438B-A3F2-B302A680E7C710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)instance-0000007a67AB6C0E-4A7C-438B-A3F2-B302A680E7C7%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '8F0B6069-AED5-42E8-9465-0ACBE1F443E0', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115932), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 2), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 2), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007a' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)\n\nNot enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)\n\n'instance-0000007a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)", 'ErrorSummaryDescription': "'instance-0000007a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:03.014 4088 3038360457288 MainThread DEBUG os_win._utils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007a' failed to start. Not enough memory in the system to start the virtual machine instance-0000007a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007a' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Not enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) 'instance-0000007a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.8876776695251465 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:03.046 4088 3038360457816 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:03.060 4088 3038360457816 MainThread INFO nova.compute.manager [-] [instance: 2af9b131-c85d-4418-810b-00a540718354] VM Stopped (Lifecycle Event) 2021-09-10 17:20:03.060 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:03.060 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:03.076 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-db3ff8d0-58eb-40bd-8a57-88fdccbc0bbe - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:03.076 4088 3038360457816 MainThread DEBUG nova.virt.hyperv.vmops [req-db3ff8d0-58eb-40bd-8a57-88fdccbc0bbe - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:03.139 4088 3038360461160 MainThread DEBUG os_win.utils.jobutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Waiting for WMI job: {'InstanceID': 'B6B56A08-165C-4827-BB57-45CD40CBD480', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15438), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:03.139 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-db3ff8d0-58eb-40bd-8a57-88fdccbc0bbe - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:03.155 4088 3038360457816 MainThread INFO nova.compute.manager [req-db3ff8d0-58eb-40bd-8a57-88fdccbc0bbe - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:03.279 4088 3038360461160 MainThread ERROR os_win.utils.jobutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007b\' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)instance-0000007b9F49C841-36B7-43A3-987E-FF7BEEC0E4B512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)instance-0000007b9F49C841-36B7-43A3-987E-FF7BEEC0E4B510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)instance-0000007b9F49C841-36B7-43A3-987E-FF7BEEC0E4B5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B6B56A08-165C-4827-BB57-45CD40CBD480', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112393), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 3), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007b' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)\n\nNot enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)\n\n'instance-0000007b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)", 'ErrorSummaryDescription': "'instance-0000007b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:03.279 4088 3038360461160 MainThread DEBUG os_win._utils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007b' failed to start. Not enough memory in the system to start the virtual machine instance-0000007b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007b' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Not enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) 'instance-0000007b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3580501079559326 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:03.296 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:03.296 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:03.296 4088 3038360457816 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:03.311 4088 3038360457816 MainThread INFO nova.compute.manager [-] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] VM Stopped (Lifecycle Event) 2021-09-10 17:20:03.326 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-7deb228e-857e-4a88-a5c1-7c04f45ea983 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:03.326 4088 3038360457816 MainThread DEBUG nova.virt.hyperv.vmops [req-7deb228e-857e-4a88-a5c1-7c04f45ea983 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:03.374 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-7deb228e-857e-4a88-a5c1-7c04f45ea983 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:03.417 4088 3038360457816 MainThread INFO nova.compute.manager [req-7deb228e-857e-4a88-a5c1-7c04f45ea983 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:03.497 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:20:04.015 4088 3038360457288 MainThread DEBUG os_win.utils.jobutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': 'A6B51A38-C271-4CDA-A032-7F26DD7FCD9E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16332), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:04.185 4088 3038360457288 MainThread ERROR os_win.utils.jobutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007a\' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)instance-0000007a67AB6C0E-4A7C-438B-A3F2-B302A680E7C712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)instance-0000007a67AB6C0E-4A7C-438B-A3F2-B302A680E7C710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)instance-0000007a67AB6C0E-4A7C-438B-A3F2-B302A680E7C7%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A6B51A38-C271-4CDA-A032-7F26DD7FCD9E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113367), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 4), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007a' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)\n\nNot enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)\n\n'instance-0000007a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7)", 'ErrorSummaryDescription': "'instance-0000007a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:04.185 4088 3038360457288 MainThread ERROR nova.virt.hyperv.vmops [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Failed to change vm state of instance-0000007a to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000007a' failed to start. 2021-09-10 17:20:04.185 4088 3038360457288 MainThread INFO nova.virt.hyperv.vmops [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Got request to destroy instance 2021-09-10 17:20:04.209 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:04.209 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:04.209 4088 3038360457816 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:04.209 4088 3038360457816 MainThread INFO nova.compute.manager [-] [instance: 2af9b131-c85d-4418-810b-00a540718354] VM Stopped (Lifecycle Event) 2021-09-10 17:20:04.233 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-4cb1b172-c173-499a-a660-d5e13cee6f77 - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:04.233 4088 3038360457816 MainThread DEBUG nova.virt.hyperv.vmops [req-4cb1b172-c173-499a-a660-d5e13cee6f77 - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:04.295 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-4cb1b172-c173-499a-a660-d5e13cee6f77 - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:04.312 4088 3038360457816 MainThread INFO nova.compute.manager [req-4cb1b172-c173-499a-a660-d5e13cee6f77 - - - - -] [instance: 2af9b131-c85d-4418-810b-00a540718354] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:04.331 4088 3038360461160 MainThread DEBUG os_win.utils.jobutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Waiting for WMI job: {'InstanceID': 'F6FDBD95-9890-4183-A71A-DB0D6A1FA5F7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17593), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:04.452 4088 3038360461160 MainThread ERROR os_win.utils.jobutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007b\' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)instance-0000007b9F49C841-36B7-43A3-987E-FF7BEEC0E4B512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)instance-0000007b9F49C841-36B7-43A3-987E-FF7BEEC0E4B510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)instance-0000007b9F49C841-36B7-43A3-987E-FF7BEEC0E4B5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'F6FDBD95-9890-4183-A71A-DB0D6A1FA5F7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116480), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 4), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007b' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)\n\nNot enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)\n\n'instance-0000007b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)", 'ErrorSummaryDescription': "'instance-0000007b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:04.479 4088 3038360461160 MainThread DEBUG os_win._utils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007b' failed to start. Not enough memory in the system to start the virtual machine instance-0000007b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007b' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Not enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) 'instance-0000007b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5581717491149902 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:04.483 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:04.483 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:04.483 4088 3038360457816 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:04.498 4088 3038360457816 MainThread INFO nova.compute.manager [-] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] VM Stopped (Lifecycle Event) 2021-09-10 17:20:04.513 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:20:04.513 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:20:04.513 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-9090b0c6-a822-468f-93d0-9a0f44d84464 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:04.513 4088 3038360457816 MainThread DEBUG nova.virt.hyperv.vmops [req-9090b0c6-a822-468f-93d0-9a0f44d84464 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:04.561 4088 3038360457816 MainThread DEBUG nova.compute.manager [req-9090b0c6-a822-468f-93d0-9a0f44d84464 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:04.597 4088 3038360457816 MainThread INFO nova.compute.manager [req-9090b0c6-a822-468f-93d0-9a0f44d84464 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:04.597 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-592bb39a-81cb-43f8-a643-b04092bd9e8a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:20:04.597 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:20:05.107 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Updating instance_info_cache with network_info: [{"id": "2ef6a3e6-e7a5-4da7-941d-89a1d5c697b7", "address": "fa:16:3e:eb:d0:49", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2ef6a3e6-e7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:20:05.107 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-592bb39a-81cb-43f8-a643-b04092bd9e8a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:20:05.107 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:20:05.499 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:20:05.499 4088 3038360461160 MainThread DEBUG os_win.utils.jobutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Waiting for WMI job: {'InstanceID': 'BBA7395F-D8E3-4CFD-8BE2-6BC27A554756', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16484), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:05.639 4088 3038360461160 MainThread ERROR os_win.utils.jobutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007b\' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)instance-0000007b9F49C841-36B7-43A3-987E-FF7BEEC0E4B512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)instance-0000007b9F49C841-36B7-43A3-987E-FF7BEEC0E4B510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)instance-0000007b9F49C841-36B7-43A3-987E-FF7BEEC0E4B5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BBA7395F-D8E3-4CFD-8BE2-6BC27A554756', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114161), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 5), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 5), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007b' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)\n\nNot enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)\n\n'instance-0000007b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)", 'ErrorSummaryDescription': "'instance-0000007b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:05.654 4088 3038360461160 MainThread DEBUG os_win._utils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007b' failed to start. Not enough memory in the system to start the virtual machine instance-0000007b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007b' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Not enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) 'instance-0000007b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7334189414978027 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:05.670 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:05.670 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:05.670 4088 3038360460984 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:05.670 4088 3038360460984 MainThread INFO nova.compute.manager [-] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] VM Stopped (Lifecycle Event) 2021-09-10 17:20:05.703 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-3d693fbf-6091-4d3f-99ca-dfc36ea94c72 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:05.703 4088 3038360460984 MainThread DEBUG nova.virt.hyperv.vmops [req-3d693fbf-6091-4d3f-99ca-dfc36ea94c72 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:05.749 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-3d693fbf-6091-4d3f-99ca-dfc36ea94c72 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:05.749 4088 3038360460984 MainThread INFO nova.compute.manager [req-3d693fbf-6091-4d3f-99ca-dfc36ea94c72 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:06.123 4088 3038360457288 MainThread DEBUG nova.virt.hyperv.vmops [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:20:06.145 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-0000007a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:06.145 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-0000007a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:06.154 4088 3038360457288 MainThread DEBUG os_win.utils.compute.vmutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Successfully changed vm state of instance-0000007a to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:20:06.154 4088 3038360457288 MainThread DEBUG nova.virt.hyperv.vmops [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Successfully changed state of VM instance-0000007a to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:20:06.202 4088 3038360457288 MainThread DEBUG os_win.utils.jobutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Waiting for WMI job: {'InstanceID': '75F19811-E603-49E8-A527-26C50069554E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15158), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:06.313 4088 3038360457288 MainThread DEBUG os_win.utils.jobutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] WMI job succeeded: {'InstanceID': '75F19811-E603-49E8-A527-26C50069554E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=99912), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:20:06.313 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-0000007a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:06.313 4088 3038360457288 MainThread DEBUG os_win.utils.pathutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Removing directory: C:\openstack\instances\instance-0000007a check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:20:06.313 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-0000007a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:06.335 4088 3038360457288 MainThread ERROR nova.compute.manager [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007a' failed to start. Not enough memory in the system to start the virtual machine instance-0000007a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007a' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Not enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) 'instance-0000007a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Error code: 32778. 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] Traceback (most recent call last): 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] return function(*args, **kwargs) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] admin_password, network_info, block_device_info) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] return function(self, *args, **kwds) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self.force_reraise() 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] raise self.value 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] should_plug_vifs=False) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 'req_state': req_state}) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self.force_reraise() 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] raise self.value 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] time.sleep(sleep_time) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self.force_reraise() 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] raise self.value 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] return f(*args, **kwargs) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] return self._wait_for_job(job_path) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] error_desc=err_desc) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000007a' failed to start. 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] Not enough memory in the system to start the virtual machine instance-0000007a. 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007a' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] Not enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 'instance-0000007a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Error code: 32778. 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] During handling of the above exception, another exception occurred: 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] Traceback (most recent call last): 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] yield resources 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] accel_info=accel_info) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] return function(*args, **kwargs) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] admin_password, network_info, block_device_info) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] return function(self, *args, **kwds) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self.force_reraise() 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] raise self.value 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] should_plug_vifs=False) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 'req_state': req_state}) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self.force_reraise() 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] raise self.value 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] time.sleep(sleep_time) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self.force_reraise() 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] raise self.value 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] return f(*args, **kwargs) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] return self._wait_for_job(job_path) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] error_desc=err_desc) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007a' failed to start. 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] Not enough memory in the system to start the virtual machine instance-0000007a. 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007a' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] Not enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 'instance-0000007a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Error code: 32778. 2021-09-10 17:20:06.335 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.335 4088 3038360457288 MainThread INFO nova.compute.manager [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Terminating instance 2021-09-10 17:20:06.335 4088 3038360457288 MainThread DEBUG nova.compute.manager [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:20:06.335 4088 3038360457288 MainThread INFO nova.virt.hyperv.vmops [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Got request to destroy instance 2021-09-10 17:20:06.357 4088 3038360457288 MainThread DEBUG nova.virt.hyperv.vmops [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:20:06.357 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-0000007a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:06.357 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "instance-0000007a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:06.360 4088 3038360457288 MainThread INFO nova.compute.manager [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:20:06.360 4088 3038360457288 MainThread DEBUG nova.compute.claims [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:20:06.360 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:06.441 4088 3038360457288 MainThread DEBUG nova.virt.hyperv.hostops [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:20:06.457 4088 3038360457288 MainThread DEBUG nova.virt.hyperv.hostops [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:20:06.671 4088 3038360457288 MainThread DEBUG nova.compute.provider_tree [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:20:06.671 4088 3038360457288 MainThread DEBUG nova.scheduler.client.report [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:20:06.671 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.313s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:06.671 4088 3038360457288 MainThread ERROR nova.compute.manager [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007a' failed to start. Not enough memory in the system to start the virtual machine instance-0000007a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007a' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Not enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) 'instance-0000007a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Error code: 32778. 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] Traceback (most recent call last): 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] return function(*args, **kwargs) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] admin_password, network_info, block_device_info) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] return function(self, *args, **kwds) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self.force_reraise() 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] raise self.value 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] should_plug_vifs=False) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 'req_state': req_state}) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self.force_reraise() 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] raise self.value 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] time.sleep(sleep_time) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self.force_reraise() 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] raise self.value 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] return f(*args, **kwargs) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] return self._wait_for_job(job_path) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] error_desc=err_desc) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000007a' failed to start. 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] Not enough memory in the system to start the virtual machine instance-0000007a. 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007a' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] Not enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 'instance-0000007a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Error code: 32778. 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] During handling of the above exception, another exception occurred: 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] Traceback (most recent call last): 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] accel_info=accel_info) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] return function(*args, **kwargs) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] admin_password, network_info, block_device_info) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] return function(self, *args, **kwds) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self.force_reraise() 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] raise self.value 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] should_plug_vifs=False) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 'req_state': req_state}) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self.force_reraise() 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] raise self.value 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] time.sleep(sleep_time) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self.force_reraise() 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] raise self.value 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] return f(*args, **kwargs) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] return self._wait_for_job(job_path) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] error_desc=err_desc) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007a' failed to start. 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] Not enough memory in the system to start the virtual machine instance-0000007a. 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007a' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] Not enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 'instance-0000007a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Error code: 32778. 2021-09-10 17:20:06.671 4088 3038360457288 MainThread TRACE nova.compute.manager [instance: 2af9b131-c85d-4418-810b-00a540718354] 2021-09-10 17:20:06.671 4088 3038360457288 MainThread DEBUG nova.compute.utils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] WMI job failed with status 10. Error summary description: 'instance-0000007a' failed to start. Not enough memory in the system to start the virtual machine instance-0000007a. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:20:06.700 4088 3038360457288 MainThread DEBUG nova.compute.manager [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Build of instance 2af9b131-c85d-4418-810b-00a540718354 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000007a' failed to start. Not enough memory in the system to start the virtual machine instance-0000007a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007a' failed to start. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Not enough memory in the system to start the virtual machine instance-0000007a with ram size 1024 megabytes. (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) 'instance-0000007a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 67AB6C0E-4A7C-438B-A3F2-B302A680E7C7) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:20:06.702 4088 3038360457288 MainThread DEBUG nova.compute.manager [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:20:06.702 4088 3038360457288 MainThread DEBUG nova.compute.manager [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:20:06.702 4088 3038360457288 MainThread DEBUG nova.compute.manager [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:20:06.702 4088 3038360457288 MainThread DEBUG nova.network.neutron [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:20:06.702 4088 3038360461160 MainThread DEBUG os_win.utils.jobutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Waiting for WMI job: {'InstanceID': 'B9D79BD6-FFC1-42D2-8759-C067ADC6AADA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16933), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:06.845 4088 3038360461160 MainThread ERROR os_win.utils.jobutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007b\' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)instance-0000007b9F49C841-36B7-43A3-987E-FF7BEEC0E4B512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)instance-0000007b9F49C841-36B7-43A3-987E-FF7BEEC0E4B510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)instance-0000007b9F49C841-36B7-43A3-987E-FF7BEEC0E4B5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B9D79BD6-FFC1-42D2-8759-C067ADC6AADA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118581), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 6), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 6), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007b' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)\n\nNot enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)\n\n'instance-0000007b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)", 'ErrorSummaryDescription': "'instance-0000007b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:06.845 4088 3038360461160 MainThread DEBUG os_win._utils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007b' failed to start. Not enough memory in the system to start the virtual machine instance-0000007b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007b' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Not enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) 'instance-0000007b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.9245429039001465 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:06.858 4088 3038363828824 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:06.858 4088 3038363828824 MainThread INFO nova.compute.manager [-] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] VM Stopped (Lifecycle Event) 2021-09-10 17:20:06.858 4088 3038363829000 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:06.858 4088 3038363829000 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:06.893 4088 3038363828824 MainThread DEBUG nova.compute.manager [req-05df5949-8a15-4d50-b286-8575e0e7415f - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:06.893 4088 3038363828824 MainThread DEBUG nova.virt.hyperv.vmops [req-05df5949-8a15-4d50-b286-8575e0e7415f - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:06.952 4088 3038363828824 MainThread DEBUG nova.compute.manager [req-05df5949-8a15-4d50-b286-8575e0e7415f - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:06.970 4088 3038363828824 MainThread INFO nova.compute.manager [req-05df5949-8a15-4d50-b286-8575e0e7415f - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:07.204 4088 3038360457288 MainThread DEBUG nova.network.neutron [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:20:07.233 4088 3038360457288 MainThread INFO nova.compute.manager [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] [instance: 2af9b131-c85d-4418-810b-00a540718354] Took 0.53 seconds to deallocate network for instance. 2021-09-10 17:20:07.388 4088 3038360457288 MainThread INFO nova.scheduler.client.report [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Deleted allocations for instance 2af9b131-c85d-4418-810b-00a540718354 2021-09-10 17:20:07.408 4088 3038360457288 MainThread DEBUG oslo_concurrency.lockutils [req-ce7c9e0a-e998-4d1b-a17a-a7b837d765ba 799e4a49be0e448b9d6d54d57b7d8d1b 5cf483b0ac5349bca4c898bb3b806d21 - default default] Lock "2af9b131-c85d-4418-810b-00a540718354" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 22.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:07.499 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:20:07.517 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:07.517 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:07.517 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:20:07.517 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:20:07.529 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:20:07.763 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2228MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:20:07.763 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:07.904 4088 3038360461160 MainThread DEBUG os_win.utils.jobutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Waiting for WMI job: {'InstanceID': '8854A26D-BF8F-473A-969C-D3D7F94E05BB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21442), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:07.904 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:20:07.904 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:20:07.904 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:20:07.904 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:20:07.904 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:20:07.904 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:20:07.904 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:20:07.904 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:20:07.904 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:20:07.904 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:20:07.904 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:20:07.904 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:20:07.904 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:20:07.904 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 56af32cb-10b4-48fe-9adb-25b79d8d4df9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:20:07.904 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:20:07.904 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=14GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:20:07.955 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:20:07.971 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:20:08.065 4088 3038360461160 MainThread ERROR os_win.utils.jobutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007b\' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)instance-0000007b9F49C841-36B7-43A3-987E-FF7BEEC0E4B512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)instance-0000007b9F49C841-36B7-43A3-987E-FF7BEEC0E4B510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)instance-0000007b9F49C841-36B7-43A3-987E-FF7BEEC0E4B5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '8854A26D-BF8F-473A-969C-D3D7F94E05BB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118127), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 8), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007b' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)\n\nNot enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)\n\n'instance-0000007b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5)", 'ErrorSummaryDescription': "'instance-0000007b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:08.065 4088 3038360461160 MainThread ERROR nova.virt.hyperv.vmops [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Failed to change vm state of instance-0000007b to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000007b' failed to start. 2021-09-10 17:20:08.065 4088 3038360461160 MainThread INFO nova.virt.hyperv.vmops [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Got request to destroy instance 2021-09-10 17:20:08.078 4088 3038360460984 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:08.078 4088 3038360460984 MainThread INFO nova.compute.manager [-] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] VM Stopped (Lifecycle Event) 2021-09-10 17:20:08.078 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:08.078 4088 3038360460104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:08.078 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-cf6d5bf3-046d-4b72-9b23-21964a694006 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:08.078 4088 3038360460984 MainThread DEBUG nova.virt.hyperv.vmops [req-cf6d5bf3-046d-4b72-9b23-21964a694006 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:08.139 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-cf6d5bf3-046d-4b72-9b23-21964a694006 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:08.156 4088 3038360460984 MainThread INFO nova.compute.manager [req-cf6d5bf3-046d-4b72-9b23-21964a694006 - - - - -] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:08.228 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:20:08.249 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:20:08.249 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:20:08.249 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:09.958 4088 3038360461160 MainThread DEBUG nova.virt.hyperv.vmops [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:20:09.958 4088 3038360461160 MainThread DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "instance-0000007b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:09.958 4088 3038360461160 MainThread DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "instance-0000007b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:09.982 4088 3038360461160 MainThread DEBUG os_win.utils.compute.vmutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Successfully changed vm state of instance-0000007b to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:20:09.982 4088 3038360461160 MainThread DEBUG nova.virt.hyperv.vmops [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Successfully changed state of VM instance-0000007b to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:20:10.024 4088 3038360461160 MainThread DEBUG os_win.utils.jobutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Waiting for WMI job: {'InstanceID': '8AE5DE8B-C5BF-4104-A950-B28BC5AB0BE5', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15338), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:10.156 4088 3038360461160 MainThread DEBUG os_win.utils.jobutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] WMI job succeeded: {'InstanceID': '8AE5DE8B-C5BF-4104-A950-B28BC5AB0BE5', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=110044), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:20:10.156 4088 3038360461160 MainThread DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "instance-0000007b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:10.156 4088 3038360461160 MainThread DEBUG os_win.utils.pathutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Removing directory: C:\openstack\instances\instance-0000007b check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:20:10.156 4088 3038360461160 MainThread DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "instance-0000007b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:10.156 4088 3038360461160 MainThread ERROR nova.compute.manager [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007b' failed to start. Not enough memory in the system to start the virtual machine instance-0000007b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007b' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Not enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) 'instance-0000007b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Error code: 32778. 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Traceback (most recent call last): 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] return function(*args, **kwargs) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] admin_password, network_info, block_device_info) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] return function(self, *args, **kwds) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self.force_reraise() 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] raise self.value 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] should_plug_vifs=False) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 'req_state': req_state}) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self.force_reraise() 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] raise self.value 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] time.sleep(sleep_time) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self.force_reraise() 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] raise self.value 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] return f(*args, **kwargs) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] return self._wait_for_job(job_path) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] error_desc=err_desc) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000007b' failed to start. 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Not enough memory in the system to start the virtual machine instance-0000007b. 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007b' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Not enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 'instance-0000007b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Error code: 32778. 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] During handling of the above exception, another exception occurred: 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Traceback (most recent call last): 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] yield resources 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] accel_info=accel_info) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] return function(*args, **kwargs) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] admin_password, network_info, block_device_info) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] return function(self, *args, **kwds) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self.force_reraise() 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] raise self.value 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] should_plug_vifs=False) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 'req_state': req_state}) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self.force_reraise() 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] raise self.value 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] time.sleep(sleep_time) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self.force_reraise() 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] raise self.value 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] return f(*args, **kwargs) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] return self._wait_for_job(job_path) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] error_desc=err_desc) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007b' failed to start. 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Not enough memory in the system to start the virtual machine instance-0000007b. 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007b' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Not enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 'instance-0000007b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Error code: 32778. 2021-09-10 17:20:10.156 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.156 4088 3038360461160 MainThread INFO nova.compute.manager [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Terminating instance 2021-09-10 17:20:10.156 4088 3038360461160 MainThread DEBUG nova.compute.manager [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:20:10.156 4088 3038360461160 MainThread INFO nova.virt.hyperv.vmops [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Got request to destroy instance 2021-09-10 17:20:10.185 4088 3038360461160 MainThread DEBUG nova.virt.hyperv.vmops [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:20:10.185 4088 3038360461160 MainThread DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "instance-0000007b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:10.185 4088 3038360461160 MainThread DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "instance-0000007b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:10.185 4088 3038360461160 MainThread INFO nova.compute.manager [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:20:10.185 4088 3038360461160 MainThread DEBUG nova.compute.claims [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:20:10.185 4088 3038360461160 MainThread DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:10.281 4088 3038360461160 MainThread DEBUG nova.virt.hyperv.hostops [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:20:10.281 4088 3038360461160 MainThread DEBUG nova.virt.hyperv.hostops [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:20:10.513 4088 3038360461160 MainThread DEBUG nova.compute.provider_tree [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:20:10.531 4088 3038360461160 MainThread DEBUG nova.scheduler.client.report [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:20:10.531 4088 3038360461160 MainThread DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.344s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:10.531 4088 3038360461160 MainThread ERROR nova.compute.manager [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007b' failed to start. Not enough memory in the system to start the virtual machine instance-0000007b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007b' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Not enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) 'instance-0000007b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Error code: 32778. 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Traceback (most recent call last): 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] return function(*args, **kwargs) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] admin_password, network_info, block_device_info) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] return function(self, *args, **kwds) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self.force_reraise() 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] raise self.value 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] should_plug_vifs=False) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 'req_state': req_state}) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self.force_reraise() 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] raise self.value 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] time.sleep(sleep_time) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self.force_reraise() 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] raise self.value 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] return f(*args, **kwargs) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] return self._wait_for_job(job_path) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] error_desc=err_desc) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000007b' failed to start. 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Not enough memory in the system to start the virtual machine instance-0000007b. 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007b' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Not enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 'instance-0000007b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Error code: 32778. 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] During handling of the above exception, another exception occurred: 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Traceback (most recent call last): 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] accel_info=accel_info) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] return function(*args, **kwargs) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] admin_password, network_info, block_device_info) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] return function(self, *args, **kwds) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self.force_reraise() 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] raise self.value 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] should_plug_vifs=False) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 'req_state': req_state}) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self.force_reraise() 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] raise self.value 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] time.sleep(sleep_time) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self.force_reraise() 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] raise self.value 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] return f(*args, **kwargs) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] return self._wait_for_job(job_path) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] error_desc=err_desc) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007b' failed to start. 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Not enough memory in the system to start the virtual machine instance-0000007b. 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007b' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Not enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 'instance-0000007b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Error code: 32778. 2021-09-10 17:20:10.531 4088 3038360461160 MainThread TRACE nova.compute.manager [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] 2021-09-10 17:20:10.531 4088 3038360461160 MainThread DEBUG nova.compute.utils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] WMI job failed with status 10. Error summary description: 'instance-0000007b' failed to start. Not enough memory in the system to start the virtual machine instance-0000007b. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:20:10.531 4088 3038360461160 MainThread DEBUG nova.compute.manager [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Build of instance 56af32cb-10b4-48fe-9adb-25b79d8d4df9 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000007b' failed to start. Not enough memory in the system to start the virtual machine instance-0000007b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007b' failed to start. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Not enough memory in the system to start the virtual machine instance-0000007b with ram size 1024 megabytes. (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) 'instance-0000007b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9F49C841-36B7-43A3-987E-FF7BEEC0E4B5) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:20:10.531 4088 3038360461160 MainThread DEBUG nova.compute.manager [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:20:10.531 4088 3038360461160 MainThread DEBUG nova.compute.manager [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:20:10.531 4088 3038360461160 MainThread DEBUG nova.compute.manager [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:20:10.531 4088 3038360461160 MainThread DEBUG nova.network.neutron [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:20:11.497 4088 3038360461160 MainThread DEBUG nova.network.neutron [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:20:11.515 4088 3038360461160 MainThread INFO nova.compute.manager [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] [instance: 56af32cb-10b4-48fe-9adb-25b79d8d4df9] Took 0.98 seconds to deallocate network for instance. 2021-09-10 17:20:11.669 4088 3038360461160 MainThread INFO nova.scheduler.client.report [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Deleted allocations for instance 56af32cb-10b4-48fe-9adb-25b79d8d4df9 2021-09-10 17:20:11.702 4088 3038360461160 MainThread DEBUG oslo_concurrency.lockutils [req-fb19b518-0913-4b10-8353-0c74953be429 bb6b40339c39491bbe2bdee1c7c82123 fecf4120b310452eb14917a31b551102 - default default] Lock "56af32cb-10b4-48fe-9adb-25b79d8d4df9" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 23.313s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:13.341 4088 3038363828472 MainThread DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "6d144805-b1e0-45a4-b3a7-71d14d6fac69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:13.356 4088 3038363828472 MainThread DEBUG nova.compute.manager [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:20:13.468 4088 3038363828472 MainThread DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:13.468 4088 3038363828472 MainThread DEBUG nova.virt.hardware [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:20:13.468 4088 3038363828472 MainThread INFO nova.compute.claims [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Claim successful on node n-h2-808474-1 2021-09-10 17:20:13.575 4088 3038363828472 MainThread DEBUG nova.virt.hyperv.hostops [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:20:13.575 4088 3038363828472 MainThread DEBUG nova.virt.hyperv.hostops [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:20:13.796 4088 3038363828472 MainThread DEBUG nova.compute.provider_tree [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:20:13.796 4088 3038363828472 MainThread DEBUG nova.scheduler.client.report [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:20:13.796 4088 3038363828472 MainThread DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:13.796 4088 3038363828472 MainThread DEBUG nova.compute.manager [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:20:13.873 4088 3038363828472 MainThread DEBUG nova.compute.manager [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:20:13.873 4088 3038360460808 GreenThread-114 DEBUG nova.compute.manager [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:20:13.873 4088 3038360460808 GreenThread-114 DEBUG nova.network.neutron [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:20:13.999 4088 3038363828472 MainThread DEBUG nova.compute.manager [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:20:14.029 4088 3038363828472 MainThread INFO nova.virt.hyperv.vmops [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Spawning new instance 2021-09-10 17:20:14.029 4088 3038363828472 MainThread DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "instance-0000007c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:14.029 4088 3038363828472 MainThread DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "instance-0000007c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:14.029 4088 3038363828472 MainThread DEBUG nova.block_device [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:20:14.029 4088 3038363828472 MainThread DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:14.029 4088 3038363828472 MainThread DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:14.047 4088 3038363828472 MainThread DEBUG os_win.utils.pathutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Creating directory: C:\openstack\instances\instance-0000007c check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:20:14.047 4088 3038363828472 MainThread DEBUG nova.virt.hyperv.vmops [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000007c\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:20:14.047 4088 3038360460808 GreenThread-114 DEBUG nova.policy [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddf55d6b15144f37ae1d2f48a5918a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13a4a12834460091659ecf8dd9d41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:20:14.343 4088 3038363828472 MainThread DEBUG nova.virt.hyperv.vmops [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Resizing VHD C:\openstack\instances\instance-0000007c\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:20:14.749 4088 3038360460808 GreenThread-114 DEBUG nova.network.neutron [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Successfully created port: f82fe26f-c25f-49d8-93b9-8f55e7fdd152 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:20:15.562 4088 3038360460808 GreenThread-114 DEBUG nova.network.neutron [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Successfully updated port: f82fe26f-c25f-49d8-93b9-8f55e7fdd152 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:20:15.576 4088 3038360460808 GreenThread-114 DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Acquired lock "refresh_cache-6d144805-b1e0-45a4-b3a7-71d14d6fac69" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:20:15.576 4088 3038360460808 GreenThread-114 DEBUG nova.network.neutron [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:20:15.608 4088 3038363829176 MainThread DEBUG nova.compute.manager [req-65189ee9-592b-425b-9f33-532c209c1d49 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Received event network-changed-f82fe26f-c25f-49d8-93b9-8f55e7fdd152 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:20:15.608 4088 3038363829176 MainThread DEBUG nova.compute.manager [req-65189ee9-592b-425b-9f33-532c209c1d49 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Refreshing instance network info cache due to event network-changed-f82fe26f-c25f-49d8-93b9-8f55e7fdd152. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:20:16.012 4088 3038360460808 GreenThread-114 DEBUG nova.network.neutron [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:20:16.437 4088 3038360460808 GreenThread-114 DEBUG nova.network.neutron [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Updating instance_info_cache with network_info: [{"id": "f82fe26f-c25f-49d8-93b9-8f55e7fdd152", "address": "fa:16:3e:f8:2a:9c", "network": {"id": "64cdd12b-fd00-45d8-bb80-13f83006e3d5", "bridge": null, "label": "tempest-VolumesActionsTest-1247926926-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be13a4a12834460091659ecf8dd9d41f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf82fe26f-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:20:16.469 4088 3038360460808 GreenThread-114 DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Releasing lock "refresh_cache-6d144805-b1e0-45a4-b3a7-71d14d6fac69" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:20:16.469 4088 3038360460808 GreenThread-114 DEBUG nova.compute.manager [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Instance network_info: |[{"id": "f82fe26f-c25f-49d8-93b9-8f55e7fdd152", "address": "fa:16:3e:f8:2a:9c", "network": {"id": "64cdd12b-fd00-45d8-bb80-13f83006e3d5", "bridge": null, "label": "tempest-VolumesActionsTest-1247926926-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be13a4a12834460091659ecf8dd9d41f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf82fe26f-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:20:16.469 4088 3038363829176 MainThread DEBUG oslo_concurrency.lockutils [req-65189ee9-592b-425b-9f33-532c209c1d49 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-6d144805-b1e0-45a4-b3a7-71d14d6fac69" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:20:16.469 4088 3038363829176 MainThread DEBUG nova.network.neutron [req-65189ee9-592b-425b-9f33-532c209c1d49 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Refreshing network info cache for port f82fe26f-c25f-49d8-93b9-8f55e7fdd152 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:20:16.469 4088 3038363828472 MainThread DEBUG nova.compute.manager [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Preparing to wait for external event network-vif-plugged-f82fe26f-c25f-49d8-93b9-8f55e7fdd152 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:20:16.469 4088 3038363828472 MainThread DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "6d144805-b1e0-45a4-b3a7-71d14d6fac69-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:16.469 4088 3038363828472 MainThread DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "6d144805-b1e0-45a4-b3a7-71d14d6fac69-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:16.469 4088 3038363828472 MainThread DEBUG os_win.utils.compute.vmutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Creating VM instance-0000007c create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:20:17.076 4088 3038363829176 MainThread DEBUG nova.network.neutron [req-65189ee9-592b-425b-9f33-532c209c1d49 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Updated VIF entry in instance network info cache for port f82fe26f-c25f-49d8-93b9-8f55e7fdd152. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:20:17.093 4088 3038363829176 MainThread DEBUG nova.network.neutron [req-65189ee9-592b-425b-9f33-532c209c1d49 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Updating instance_info_cache with network_info: [{"id": "f82fe26f-c25f-49d8-93b9-8f55e7fdd152", "address": "fa:16:3e:f8:2a:9c", "network": {"id": "64cdd12b-fd00-45d8-bb80-13f83006e3d5", "bridge": null, "label": "tempest-VolumesActionsTest-1247926926-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be13a4a12834460091659ecf8dd9d41f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf82fe26f-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:20:17.109 4088 3038363829176 MainThread DEBUG oslo_concurrency.lockutils [req-65189ee9-592b-425b-9f33-532c209c1d49 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-6d144805-b1e0-45a4-b3a7-71d14d6fac69" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:20:18.217 4088 3038363828472 MainThread DEBUG nova.virt.hyperv.vmops [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:20:18.844 4088 3038363828824 MainThread DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Lock "54b5cdb3-8dd4-4340-8e60-87009126553e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:18.866 4088 3038363828824 MainThread DEBUG nova.compute.manager [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:20:19.016 4088 3038363828824 MainThread DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:19.016 4088 3038363828824 MainThread DEBUG nova.virt.hardware [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:20:19.016 4088 3038363828824 MainThread INFO nova.compute.claims [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Claim successful on node n-h2-808474-1 2021-09-10 17:20:19.129 4088 3038363828824 MainThread DEBUG nova.virt.hyperv.hostops [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:20:19.155 4088 3038363828824 MainThread DEBUG nova.virt.hyperv.hostops [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:20:19.360 4088 3038363828824 MainThread DEBUG nova.compute.provider_tree [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:20:19.391 4088 3038363828824 MainThread DEBUG nova.scheduler.client.report [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:20:19.391 4088 3038363828824 MainThread DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:19.391 4088 3038363828824 MainThread DEBUG nova.compute.manager [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:20:19.468 4088 3038363828824 MainThread DEBUG nova.compute.manager [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:20:19.468 4088 3038360460984 GreenThread-115 DEBUG nova.compute.manager [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:20:19.468 4088 3038360460984 GreenThread-115 DEBUG nova.network.neutron [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:20:19.657 4088 3038363828824 MainThread DEBUG nova.compute.manager [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:20:19.657 4088 3038360460984 GreenThread-115 DEBUG nova.policy [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c75206b921de4d1991b46238f71d9725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d93cd09cd8429aa5cdf92bb48c2d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:20:19.673 4088 3038363828824 MainThread INFO nova.virt.hyperv.vmops [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Spawning new instance 2021-09-10 17:20:19.673 4088 3038363828824 MainThread DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Lock "instance-0000007d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:19.673 4088 3038363828824 MainThread DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Lock "instance-0000007d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:19.673 4088 3038363828824 MainThread DEBUG nova.block_device [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:20:19.673 4088 3038363828824 MainThread DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:19.673 4088 3038363828824 MainThread DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:19.673 4088 3038363828824 MainThread DEBUG os_win.utils.pathutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Creating directory: C:\openstack\instances\instance-0000007d check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:20:19.673 4088 3038363828824 MainThread DEBUG nova.virt.hyperv.vmops [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000007d\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:20:19.950 4088 3038363828824 MainThread DEBUG nova.virt.hyperv.vmops [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Resizing VHD C:\openstack\instances\instance-0000007d\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:20:20.653 4088 3038360460984 GreenThread-115 DEBUG nova.network.neutron [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Successfully created port: 98cb8704-d615-48e4-9670-d1ab42515abf _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:20:21.654 4088 3038360460984 GreenThread-115 DEBUG nova.network.neutron [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Successfully updated port: 98cb8704-d615-48e4-9670-d1ab42515abf _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:20:21.672 4088 3038360460984 GreenThread-115 DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Acquired lock "refresh_cache-54b5cdb3-8dd4-4340-8e60-87009126553e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:20:21.672 4088 3038360460984 GreenThread-115 DEBUG nova.network.neutron [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:20:21.725 4088 3038363829352 MainThread DEBUG nova.compute.manager [req-6a2f5f78-5e6f-4ac8-97bf-f4a46c3f08f4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Received event network-changed-98cb8704-d615-48e4-9670-d1ab42515abf external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:20:21.725 4088 3038363829352 MainThread DEBUG nova.compute.manager [req-6a2f5f78-5e6f-4ac8-97bf-f4a46c3f08f4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Refreshing instance network info cache due to event network-changed-98cb8704-d615-48e4-9670-d1ab42515abf. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:20:21.795 4088 3038360460984 GreenThread-115 DEBUG nova.network.neutron [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:20:22.327 4088 3038360460984 GreenThread-115 DEBUG nova.network.neutron [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Updating instance_info_cache with network_info: [{"id": "98cb8704-d615-48e4-9670-d1ab42515abf", "address": "fa:16:3e:71:18:be", "network": {"id": "2e7fc937-9752-4db4-bb5e-b12f09e9c693", "bridge": null, "label": "tempest-network-smoke--1559154251", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "44d93cd09cd8429aa5cdf92bb48c2d79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap98cb8704-d6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:20:22.344 4088 3038360460984 GreenThread-115 DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Releasing lock "refresh_cache-54b5cdb3-8dd4-4340-8e60-87009126553e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:20:22.344 4088 3038360460984 GreenThread-115 DEBUG nova.compute.manager [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Instance network_info: |[{"id": "98cb8704-d615-48e4-9670-d1ab42515abf", "address": "fa:16:3e:71:18:be", "network": {"id": "2e7fc937-9752-4db4-bb5e-b12f09e9c693", "bridge": null, "label": "tempest-network-smoke--1559154251", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "44d93cd09cd8429aa5cdf92bb48c2d79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap98cb8704-d6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:20:22.344 4088 3038363828824 MainThread DEBUG nova.compute.manager [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Preparing to wait for external event network-vif-plugged-98cb8704-d615-48e4-9670-d1ab42515abf prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:20:22.344 4088 3038363828824 MainThread DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Lock "54b5cdb3-8dd4-4340-8e60-87009126553e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:22.344 4088 3038363828824 MainThread DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Lock "54b5cdb3-8dd4-4340-8e60-87009126553e-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:22.344 4088 3038363828824 MainThread DEBUG os_win.utils.compute.vmutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Creating VM instance-0000007d create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:20:22.344 4088 3038363829352 MainThread DEBUG oslo_concurrency.lockutils [req-6a2f5f78-5e6f-4ac8-97bf-f4a46c3f08f4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-54b5cdb3-8dd4-4340-8e60-87009126553e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:20:22.344 4088 3038363829352 MainThread DEBUG nova.network.neutron [req-6a2f5f78-5e6f-4ac8-97bf-f4a46c3f08f4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Refreshing network info cache for port 98cb8704-d615-48e4-9670-d1ab42515abf _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:20:22.982 4088 3038363829352 MainThread DEBUG nova.network.neutron [req-6a2f5f78-5e6f-4ac8-97bf-f4a46c3f08f4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Updated VIF entry in instance network info cache for port 98cb8704-d615-48e4-9670-d1ab42515abf. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:20:22.982 4088 3038363829352 MainThread DEBUG nova.network.neutron [req-6a2f5f78-5e6f-4ac8-97bf-f4a46c3f08f4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Updating instance_info_cache with network_info: [{"id": "98cb8704-d615-48e4-9670-d1ab42515abf", "address": "fa:16:3e:71:18:be", "network": {"id": "2e7fc937-9752-4db4-bb5e-b12f09e9c693", "bridge": null, "label": "tempest-network-smoke--1559154251", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "44d93cd09cd8429aa5cdf92bb48c2d79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap98cb8704-d6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:20:23.012 4088 3038363829352 MainThread DEBUG oslo_concurrency.lockutils [req-6a2f5f78-5e6f-4ac8-97bf-f4a46c3f08f4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-54b5cdb3-8dd4-4340-8e60-87009126553e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:20:24.048 4088 3038363828824 MainThread DEBUG nova.virt.hyperv.vmops [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:20:24.559 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-1672456c-ac63-495f-900e-a293200a7a6a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Received event network-vif-plugged-f82fe26f-c25f-49d8-93b9-8f55e7fdd152 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:20:24.559 4088 3038360460984 MainThread DEBUG oslo_concurrency.lockutils [req-1672456c-ac63-495f-900e-a293200a7a6a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "6d144805-b1e0-45a4-b3a7-71d14d6fac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:24.559 4088 3038360460984 MainThread DEBUG oslo_concurrency.lockutils [req-1672456c-ac63-495f-900e-a293200a7a6a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "6d144805-b1e0-45a4-b3a7-71d14d6fac69-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:24.559 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-1672456c-ac63-495f-900e-a293200a7a6a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Processing event network-vif-plugged-f82fe26f-c25f-49d8-93b9-8f55e7fdd152 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:20:24.591 4088 3038363828472 MainThread INFO nova.virt.hyperv.vmops [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Using config drive for instance 2021-09-10 17:20:24.720 4088 3038363828472 MainThread INFO nova.virt.hyperv.vmops [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Creating config drive at C:\openstack\instances\instance-0000007c\configdrive.iso 2021-09-10 17:20:24.825 4088 3038363828472 MainThread DEBUG oslo_concurrency.processutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000007c\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp__uhwxp4 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:20:25.137 4088 3038363828472 MainThread DEBUG oslo_concurrency.processutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000007c\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp__uhwxp4" returned: 0 in 0.312s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:20:25.669 4088 3038363828472 MainThread DEBUG nova.virt.hyperv.vmops [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Setting boot order for instance: instance-0000007c: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:20:25.779 4088 3038363828472 MainThread DEBUG nova.virt.hyperv.vmops [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:20:25.809 4088 3038363828472 MainThread DEBUG os_win.utils.jobutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Waiting for WMI job: {'InstanceID': '0A915FEE-4D15-4FAD-9ABF-BB362306950E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15724), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:25.950 4088 3038363828472 MainThread ERROR os_win.utils.jobutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007c\' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)instance-0000007cD40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)instance-0000007cD40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)instance-0000007cD40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0A915FEE-4D15-4FAD-9ABF-BB362306950E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119548), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 25), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 25), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007c' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)\n\nNot enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)\n\n'instance-0000007c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)", 'ErrorSummaryDescription': "'instance-0000007c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:25.950 4088 3038363828472 MainThread DEBUG os_win._utils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007c' failed to start. Not enough memory in the system to start the virtual machine instance-0000007c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007c' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Not enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) 'instance-0000007c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.17078065872192383 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:25.982 4088 3038360460984 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:25.982 4088 3038360460984 MainThread INFO nova.compute.manager [-] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] VM Stopped (Lifecycle Event) 2021-09-10 17:20:25.982 4088 3038360460808 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:25.982 4088 3038360460808 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:26.002 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-0303fe01-fcd0-4af6-8dc1-17e72828fa01 - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:26.002 4088 3038360460984 MainThread DEBUG nova.virt.hyperv.vmops [req-0303fe01-fcd0-4af6-8dc1-17e72828fa01 - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:26.064 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-0303fe01-fcd0-4af6-8dc1-17e72828fa01 - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:26.080 4088 3038360460984 MainThread INFO nova.compute.manager [req-0303fe01-fcd0-4af6-8dc1-17e72828fa01 - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:26.987 4088 3038363828472 MainThread DEBUG os_win.utils.jobutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Waiting for WMI job: {'InstanceID': 'CEE27519-4482-4275-81C3-5A37F3A28738', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16168), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:27.130 4088 3038363828472 MainThread ERROR os_win.utils.jobutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007c\' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)instance-0000007cD40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)instance-0000007cD40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)instance-0000007cD40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'CEE27519-4482-4275-81C3-5A37F3A28738', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113796), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 26), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 27), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007c' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)\n\nNot enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)\n\n'instance-0000007c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)", 'ErrorSummaryDescription': "'instance-0000007c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:27.130 4088 3038363828472 MainThread DEBUG os_win._utils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007c' failed to start. Not enough memory in the system to start the virtual machine instance-0000007c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007c' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Not enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) 'instance-0000007c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3510255813598633 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:27.158 4088 3038360460808 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:27.158 4088 3038360460808 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:27.158 4088 3038360460984 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:27.158 4088 3038360460984 MainThread INFO nova.compute.manager [-] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] VM Stopped (Lifecycle Event) 2021-09-10 17:20:27.172 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-564f654a-e7b5-4daa-b478-307462a68f92 - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:27.172 4088 3038360460984 MainThread DEBUG nova.virt.hyperv.vmops [req-564f654a-e7b5-4daa-b478-307462a68f92 - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:27.231 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-564f654a-e7b5-4daa-b478-307462a68f92 - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:27.250 4088 3038360460984 MainThread INFO nova.compute.manager [req-564f654a-e7b5-4daa-b478-307462a68f92 - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:28.156 4088 3038363828472 MainThread DEBUG os_win.utils.jobutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Waiting for WMI job: {'InstanceID': '36197325-D63C-40F5-B711-69FF9199F3A4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15242), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:28.281 4088 3038363828472 MainThread ERROR os_win.utils.jobutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007c\' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)instance-0000007cD40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)instance-0000007cD40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)instance-0000007cD40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '36197325-D63C-40F5-B711-69FF9199F3A4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115286), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 28), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 28), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007c' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)\n\nNot enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)\n\n'instance-0000007c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)", 'ErrorSummaryDescription': "'instance-0000007c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:28.281 4088 3038363828472 MainThread DEBUG os_win._utils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007c' failed to start. Not enough memory in the system to start the virtual machine instance-0000007c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007c' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Not enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) 'instance-0000007c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.502521276473999 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:28.320 4088 3038360460808 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:28.320 4088 3038360460808 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:28.320 4088 3038360460984 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:28.320 4088 3038360460984 MainThread INFO nova.compute.manager [-] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] VM Stopped (Lifecycle Event) 2021-09-10 17:20:28.345 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-7c016ce5-e4af-457b-9a2f-3811f7507d5c - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:28.345 4088 3038360460984 MainThread DEBUG nova.virt.hyperv.vmops [req-7c016ce5-e4af-457b-9a2f-3811f7507d5c - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:28.404 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-7c016ce5-e4af-457b-9a2f-3811f7507d5c - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:28.420 4088 3038360460984 MainThread INFO nova.compute.manager [req-7c016ce5-e4af-457b-9a2f-3811f7507d5c - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:29.310 4088 3038363828472 MainThread DEBUG os_win.utils.jobutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Waiting for WMI job: {'InstanceID': 'B49288CE-1244-4039-B415-7D4E70706014', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15424), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:29.455 4088 3038363828472 MainThread ERROR os_win.utils.jobutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007c\' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)instance-0000007cD40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)instance-0000007cD40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)instance-0000007cD40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B49288CE-1244-4039-B415-7D4E70706014', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112670), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 29), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 29), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007c' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)\n\nNot enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)\n\n'instance-0000007c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)", 'ErrorSummaryDescription': "'instance-0000007c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:29.455 4088 3038363828472 MainThread DEBUG os_win._utils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007c' failed to start. Not enough memory in the system to start the virtual machine instance-0000007c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007c' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Not enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) 'instance-0000007c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.67610239982605 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:29.498 4088 3038360460808 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:29.498 4088 3038360460808 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:29.498 4088 3038360460984 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:29.512 4088 3038360460984 MainThread INFO nova.compute.manager [-] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] VM Stopped (Lifecycle Event) 2021-09-10 17:20:29.512 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-81bfd0b2-b306-4329-b5a8-42f84f6e635b - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:29.512 4088 3038360460984 MainThread DEBUG nova.virt.hyperv.vmops [req-81bfd0b2-b306-4329-b5a8-42f84f6e635b - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:29.576 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-81bfd0b2-b306-4329-b5a8-42f84f6e635b - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:29.595 4088 3038360460984 MainThread INFO nova.compute.manager [req-81bfd0b2-b306-4329-b5a8-42f84f6e635b - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:30.485 4088 3038363828472 MainThread DEBUG os_win.utils.jobutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Waiting for WMI job: {'InstanceID': '7421D0D8-7B49-46AA-9606-15399E3EE412', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15125), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:30.599 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-54f6acbd-98d0-4ca7-bbb0-135a60597142 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Received event network-vif-plugged-98cb8704-d615-48e4-9670-d1ab42515abf external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:20:30.599 4088 3038360460984 MainThread DEBUG oslo_concurrency.lockutils [req-54f6acbd-98d0-4ca7-bbb0-135a60597142 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "54b5cdb3-8dd4-4340-8e60-87009126553e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:30.599 4088 3038360460984 MainThread DEBUG oslo_concurrency.lockutils [req-54f6acbd-98d0-4ca7-bbb0-135a60597142 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "54b5cdb3-8dd4-4340-8e60-87009126553e-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:30.599 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-54f6acbd-98d0-4ca7-bbb0-135a60597142 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Processing event network-vif-plugged-98cb8704-d615-48e4-9670-d1ab42515abf _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:20:30.637 4088 3038363828824 MainThread INFO nova.virt.hyperv.vmops [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Using config drive for instance 2021-09-10 17:20:30.637 4088 3038363828472 MainThread ERROR os_win.utils.jobutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007c\' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)instance-0000007cD40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)instance-0000007cD40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)instance-0000007cD40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7421D0D8-7B49-46AA-9606-15399E3EE412', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111816), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 30), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 30), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007c' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)\n\nNot enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)\n\n'instance-0000007c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)", 'ErrorSummaryDescription': "'instance-0000007c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:30.649 4088 3038363828472 MainThread DEBUG os_win._utils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007c' failed to start. Not enough memory in the system to start the virtual machine instance-0000007c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007c' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Not enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) 'instance-0000007c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.869668960571289 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:30.685 4088 3038363829000 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:30.685 4088 3038363829000 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:30.685 4088 3038360460808 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:30.685 4088 3038360460808 MainThread INFO nova.compute.manager [-] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] VM Stopped (Lifecycle Event) 2021-09-10 17:20:30.702 4088 3038360460808 MainThread DEBUG nova.compute.manager [req-853dc541-5599-47c8-bef8-721dc506e1a9 - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:30.702 4088 3038360460808 MainThread DEBUG nova.virt.hyperv.vmops [req-853dc541-5599-47c8-bef8-721dc506e1a9 - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:30.746 4088 3038363828824 MainThread INFO nova.virt.hyperv.vmops [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Creating config drive at C:\openstack\instances\instance-0000007d\configdrive.iso 2021-09-10 17:20:30.845 4088 3038363828824 MainThread DEBUG oslo_concurrency.processutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000007d\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpiu2zplj_ execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:20:31.000 4088 3038360460808 MainThread DEBUG nova.compute.manager [req-853dc541-5599-47c8-bef8-721dc506e1a9 - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:31.019 4088 3038360460808 MainThread INFO nova.compute.manager [req-853dc541-5599-47c8-bef8-721dc506e1a9 - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:31.188 4088 3038363828824 MainThread DEBUG oslo_concurrency.processutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000007d\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpiu2zplj_" returned: 0 in 0.344s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:20:31.734 4088 3038363828824 MainThread DEBUG nova.virt.hyperv.vmops [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Setting boot order for instance: instance-0000007d: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:20:31.764 4088 3038363828472 MainThread DEBUG os_win.utils.jobutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Waiting for WMI job: {'InstanceID': '9E0B973A-9B72-44DB-BA60-D63A37CD5F75', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17062), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:31.826 4088 3038363828824 MainThread DEBUG nova.virt.hyperv.vmops [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:20:31.864 4088 3038363828824 MainThread DEBUG os_win.utils.jobutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Waiting for WMI job: {'InstanceID': 'DFC79865-D8AA-4E2C-88FD-F5B81CC6AB18', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16925), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:31.935 4088 3038363828472 MainThread ERROR os_win.utils.jobutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007c\' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)instance-0000007cD40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)instance-0000007cD40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)instance-0000007cD40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9E0B973A-9B72-44DB-BA60-D63A37CD5F75', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116198), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 31), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 31), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007c' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)\n\nNot enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)\n\n'instance-0000007c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F)", 'ErrorSummaryDescription': "'instance-0000007c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:31.935 4088 3038363828472 MainThread ERROR nova.virt.hyperv.vmops [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Failed to change vm state of instance-0000007c to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000007c' failed to start. 2021-09-10 17:20:31.935 4088 3038363828472 MainThread INFO nova.virt.hyperv.vmops [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Got request to destroy instance 2021-09-10 17:20:31.935 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:31.960 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:31.960 4088 3038360460808 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:31.960 4088 3038360460808 MainThread INFO nova.compute.manager [-] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] VM Stopped (Lifecycle Event) 2021-09-10 17:20:31.969 4088 3038360460808 MainThread DEBUG nova.compute.manager [req-10c44db9-93c8-429f-8a50-60365997e549 - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:31.969 4088 3038360460808 MainThread DEBUG nova.virt.hyperv.vmops [req-10c44db9-93c8-429f-8a50-60365997e549 - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:32.082 4088 3038363829528 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:32.082 4088 3038363829528 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:32.082 4088 3038363828648 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:32.082 4088 3038363828648 MainThread INFO nova.compute.manager [-] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] VM Stopped (Lifecycle Event) 2021-09-10 17:20:32.082 4088 3038360460808 MainThread DEBUG nova.compute.manager [req-10c44db9-93c8-429f-8a50-60365997e549 - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:32.097 4088 3038363828648 MainThread DEBUG nova.compute.manager [req-e637229c-df26-4233-b420-904f04df1734 - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:32.112 4088 3038363828648 MainThread DEBUG nova.virt.hyperv.vmops [req-e637229c-df26-4233-b420-904f04df1734 - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:32.112 4088 3038360460808 MainThread INFO nova.compute.manager [req-10c44db9-93c8-429f-8a50-60365997e549 - - - - -] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:32.125 4088 3038363828824 MainThread ERROR os_win.utils.jobutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007d\' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)instance-0000007d5272B030-65E4-43BB-8479-DA5F7EFA78FA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)instance-0000007d5272B030-65E4-43BB-8479-DA5F7EFA78FA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)instance-0000007d5272B030-65E4-43BB-8479-DA5F7EFA78FA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'DFC79865-D8AA-4E2C-88FD-F5B81CC6AB18', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=136915), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 31), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 31), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007d' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)\n\nNot enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)\n\n'instance-0000007d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)", 'ErrorSummaryDescription': "'instance-0000007d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:32.125 4088 3038363828824 MainThread DEBUG os_win._utils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007d' failed to start. Not enough memory in the system to start the virtual machine instance-0000007d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007d' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Not enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) 'instance-0000007d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.2988100051879883 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:32.154 4088 3038363828648 MainThread DEBUG nova.compute.manager [req-e637229c-df26-4233-b420-904f04df1734 - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:32.172 4088 3038363828648 MainThread INFO nova.compute.manager [req-e637229c-df26-4233-b420-904f04df1734 - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:33.154 4088 3038363828824 MainThread DEBUG os_win.utils.jobutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Waiting for WMI job: {'InstanceID': '4F520BE7-DEB9-469E-96BF-344C09D8B77A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15904), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:33.298 4088 3038363828824 MainThread ERROR os_win.utils.jobutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007d\' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)instance-0000007d5272B030-65E4-43BB-8479-DA5F7EFA78FA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)instance-0000007d5272B030-65E4-43BB-8479-DA5F7EFA78FA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)instance-0000007d5272B030-65E4-43BB-8479-DA5F7EFA78FA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4F520BE7-DEB9-469E-96BF-344C09D8B77A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116753), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 33), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 33), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007d' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)\n\nNot enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)\n\n'instance-0000007d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)", 'ErrorSummaryDescription': "'instance-0000007d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:33.298 4088 3038363828824 MainThread DEBUG os_win._utils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007d' failed to start. Not enough memory in the system to start the virtual machine instance-0000007d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007d' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Not enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) 'instance-0000007d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.4713733196258545 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:33.315 4088 3038360460808 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:33.315 4088 3038360460808 MainThread INFO nova.compute.manager [-] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] VM Stopped (Lifecycle Event) 2021-09-10 17:20:33.340 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:33.340 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:33.344 4088 3038360460808 MainThread DEBUG nova.compute.manager [req-65536f8d-fe01-4e3b-b462-03596999710e - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:33.344 4088 3038360460808 MainThread DEBUG nova.virt.hyperv.vmops [req-65536f8d-fe01-4e3b-b462-03596999710e - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:33.403 4088 3038360460808 MainThread DEBUG nova.compute.manager [req-65536f8d-fe01-4e3b-b462-03596999710e - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:33.403 4088 3038360460808 MainThread INFO nova.compute.manager [req-65536f8d-fe01-4e3b-b462-03596999710e - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:33.861 4088 3038363828472 MainThread DEBUG nova.virt.hyperv.vmops [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:20:33.861 4088 3038363828472 MainThread DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "instance-0000007c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:33.861 4088 3038363828472 MainThread DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "instance-0000007c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:33.874 4088 3038363828472 MainThread DEBUG os_win.utils.compute.vmutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Successfully changed vm state of instance-0000007c to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:20:33.874 4088 3038363828472 MainThread DEBUG nova.virt.hyperv.vmops [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Successfully changed state of VM instance-0000007c to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:20:33.919 4088 3038363828472 MainThread DEBUG os_win.utils.jobutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Waiting for WMI job: {'InstanceID': 'CC97BC68-C581-4E6A-B889-6EA654D16DC1', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15934), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:34.034 4088 3038363828472 MainThread DEBUG os_win.utils.jobutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] WMI job succeeded: {'InstanceID': 'CC97BC68-C581-4E6A-B889-6EA654D16DC1', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=111190), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:20:34.034 4088 3038363828472 MainThread DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "instance-0000007c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:34.034 4088 3038363828472 MainThread DEBUG os_win.utils.pathutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Removing directory: C:\openstack\instances\instance-0000007c check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:20:34.034 4088 3038363828472 MainThread DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "instance-0000007c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:34.034 4088 3038363828472 MainThread ERROR nova.compute.manager [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007c' failed to start. Not enough memory in the system to start the virtual machine instance-0000007c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007c' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Not enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) 'instance-0000007c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Error code: 32778. 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Traceback (most recent call last): 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] return function(*args, **kwargs) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] admin_password, network_info, block_device_info) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] return function(self, *args, **kwds) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self.force_reraise() 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] raise self.value 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] should_plug_vifs=False) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 'req_state': req_state}) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self.force_reraise() 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] raise self.value 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] time.sleep(sleep_time) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self.force_reraise() 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] raise self.value 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] return f(*args, **kwargs) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] return self._wait_for_job(job_path) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] error_desc=err_desc) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000007c' failed to start. 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Not enough memory in the system to start the virtual machine instance-0000007c. 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007c' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Not enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 'instance-0000007c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Error code: 32778. 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] During handling of the above exception, another exception occurred: 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Traceback (most recent call last): 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] yield resources 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] accel_info=accel_info) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] return function(*args, **kwargs) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] admin_password, network_info, block_device_info) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] return function(self, *args, **kwds) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self.force_reraise() 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] raise self.value 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] should_plug_vifs=False) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 'req_state': req_state}) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self.force_reraise() 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] raise self.value 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] time.sleep(sleep_time) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self.force_reraise() 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] raise self.value 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] return f(*args, **kwargs) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] return self._wait_for_job(job_path) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] error_desc=err_desc) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007c' failed to start. 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Not enough memory in the system to start the virtual machine instance-0000007c. 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007c' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Not enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 'instance-0000007c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Error code: 32778. 2021-09-10 17:20:34.034 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.059 4088 3038363828472 MainThread INFO nova.compute.manager [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Terminating instance 2021-09-10 17:20:34.059 4088 3038363828472 MainThread DEBUG nova.compute.manager [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:20:34.059 4088 3038363828472 MainThread INFO nova.virt.hyperv.vmops [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Got request to destroy instance 2021-09-10 17:20:34.081 4088 3038363828472 MainThread DEBUG nova.virt.hyperv.vmops [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:20:34.081 4088 3038363828472 MainThread DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "instance-0000007c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:34.081 4088 3038363828472 MainThread DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "instance-0000007c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:34.081 4088 3038363828472 MainThread INFO nova.compute.manager [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:20:34.081 4088 3038363828472 MainThread DEBUG nova.compute.claims [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:20:34.081 4088 3038363828472 MainThread DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:34.155 4088 3038363828472 MainThread DEBUG nova.virt.hyperv.hostops [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:20:34.186 4088 3038363828472 MainThread DEBUG nova.virt.hyperv.hostops [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:20:34.326 4088 3038363828824 MainThread DEBUG os_win.utils.jobutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Waiting for WMI job: {'InstanceID': '9E3C644A-A9B0-4480-B192-EAAF1FCC4669', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18493), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:34.390 4088 3038363828472 MainThread DEBUG nova.compute.provider_tree [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:20:34.425 4088 3038363828472 MainThread DEBUG nova.scheduler.client.report [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:20:34.425 4088 3038363828472 MainThread DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.344s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:34.425 4088 3038363828472 MainThread ERROR nova.compute.manager [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007c' failed to start. Not enough memory in the system to start the virtual machine instance-0000007c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007c' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Not enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) 'instance-0000007c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Error code: 32778. 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Traceback (most recent call last): 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] return function(*args, **kwargs) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] admin_password, network_info, block_device_info) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] return function(self, *args, **kwds) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self.force_reraise() 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] raise self.value 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] should_plug_vifs=False) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 'req_state': req_state}) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self.force_reraise() 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] raise self.value 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] time.sleep(sleep_time) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self.force_reraise() 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] raise self.value 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] return f(*args, **kwargs) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] return self._wait_for_job(job_path) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] error_desc=err_desc) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000007c' failed to start. 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Not enough memory in the system to start the virtual machine instance-0000007c. 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007c' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Not enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 'instance-0000007c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Error code: 32778. 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] During handling of the above exception, another exception occurred: 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Traceback (most recent call last): 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] accel_info=accel_info) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] return function(*args, **kwargs) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] admin_password, network_info, block_device_info) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] return function(self, *args, **kwds) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self.force_reraise() 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] raise self.value 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] should_plug_vifs=False) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 'req_state': req_state}) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self.force_reraise() 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] raise self.value 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] time.sleep(sleep_time) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self.force_reraise() 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] raise self.value 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] return f(*args, **kwargs) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] return self._wait_for_job(job_path) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] error_desc=err_desc) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007c' failed to start. 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Not enough memory in the system to start the virtual machine instance-0000007c. 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007c' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Not enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 'instance-0000007c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Error code: 32778. 2021-09-10 17:20:34.425 4088 3038363828472 MainThread TRACE nova.compute.manager [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] 2021-09-10 17:20:34.425 4088 3038363828472 MainThread DEBUG nova.compute.utils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] WMI job failed with status 10. Error summary description: 'instance-0000007c' failed to start. Not enough memory in the system to start the virtual machine instance-0000007c. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:20:34.441 4088 3038363828472 MainThread DEBUG nova.compute.manager [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Build of instance 6d144805-b1e0-45a4-b3a7-71d14d6fac69 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000007c' failed to start. Not enough memory in the system to start the virtual machine instance-0000007c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007c' failed to start. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Not enough memory in the system to start the virtual machine instance-0000007c with ram size 1024 megabytes. (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) 'instance-0000007c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D40DAEA0-57D8-4DF7-AB52-E33D15F7AC5F) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:20:34.441 4088 3038363828472 MainThread DEBUG nova.compute.manager [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:20:34.441 4088 3038363828472 MainThread DEBUG nova.compute.manager [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:20:34.441 4088 3038363828472 MainThread DEBUG nova.compute.manager [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:20:34.441 4088 3038363828472 MainThread DEBUG nova.network.neutron [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:20:34.488 4088 3038363828824 MainThread ERROR os_win.utils.jobutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007d\' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)instance-0000007d5272B030-65E4-43BB-8479-DA5F7EFA78FA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)instance-0000007d5272B030-65E4-43BB-8479-DA5F7EFA78FA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)instance-0000007d5272B030-65E4-43BB-8479-DA5F7EFA78FA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9E3C644A-A9B0-4480-B192-EAAF1FCC4669', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115737), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 34), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 34), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007d' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)\n\nNot enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)\n\n'instance-0000007d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)", 'ErrorSummaryDescription': "'instance-0000007d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:34.488 4088 3038363828824 MainThread DEBUG os_win._utils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007d' failed to start. Not enough memory in the system to start the virtual machine instance-0000007d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007d' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Not enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) 'instance-0000007d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.661364793777466 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:34.488 4088 3038360459928 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:34.488 4088 3038360459928 MainThread INFO nova.compute.manager [-] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] VM Stopped (Lifecycle Event) 2021-09-10 17:20:34.488 4088 3038360459752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:34.488 4088 3038360459752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:34.514 4088 3038360459928 MainThread DEBUG nova.compute.manager [req-6b20d5ce-5fb9-4161-825a-b1a4b0b1ed06 - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:34.514 4088 3038360459928 MainThread DEBUG nova.virt.hyperv.vmops [req-6b20d5ce-5fb9-4161-825a-b1a4b0b1ed06 - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:34.566 4088 3038360459928 MainThread DEBUG nova.compute.manager [req-6b20d5ce-5fb9-4161-825a-b1a4b0b1ed06 - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:34.581 4088 3038360459928 MainThread INFO nova.compute.manager [req-6b20d5ce-5fb9-4161-825a-b1a4b0b1ed06 - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:35.001 4088 3038363828472 MainThread DEBUG nova.network.neutron [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:20:35.013 4088 3038363828472 MainThread INFO nova.compute.manager [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] [instance: 6d144805-b1e0-45a4-b3a7-71d14d6fac69] Took 0.58 seconds to deallocate network for instance. 2021-09-10 17:20:35.160 4088 3038363828472 MainThread INFO nova.scheduler.client.report [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Deleted allocations for instance 6d144805-b1e0-45a4-b3a7-71d14d6fac69 2021-09-10 17:20:35.200 4088 3038363828472 MainThread DEBUG oslo_concurrency.lockutils [req-cb96e84e-46ef-447e-9447-b4d746b4170e ddf55d6b15144f37ae1d2f48a5918a49 be13a4a12834460091659ecf8dd9d41f - default default] Lock "6d144805-b1e0-45a4-b3a7-71d14d6fac69" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 21.860s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:35.515 4088 3038363828824 MainThread DEBUG os_win.utils.jobutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Waiting for WMI job: {'InstanceID': '4C224CB3-29A9-4FE9-A95F-3CD115C1D7EE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15560), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:35.653 4088 3038363828824 MainThread ERROR os_win.utils.jobutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007d\' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)instance-0000007d5272B030-65E4-43BB-8479-DA5F7EFA78FA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)instance-0000007d5272B030-65E4-43BB-8479-DA5F7EFA78FA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)instance-0000007d5272B030-65E4-43BB-8479-DA5F7EFA78FA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4C224CB3-29A9-4FE9-A95F-3CD115C1D7EE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111890), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 35), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 35), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007d' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)\n\nNot enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)\n\n'instance-0000007d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)", 'ErrorSummaryDescription': "'instance-0000007d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:35.653 4088 3038363828824 MainThread DEBUG os_win._utils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007d' failed to start. Not enough memory in the system to start the virtual machine instance-0000007d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007d' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Not enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) 'instance-0000007d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.827115058898926 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:35.674 4088 3038360459928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:35.674 4088 3038360459928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:35.674 4088 3038360461160 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:35.692 4088 3038360461160 MainThread INFO nova.compute.manager [-] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] VM Stopped (Lifecycle Event) 2021-09-10 17:20:35.707 4088 3038360461160 MainThread DEBUG nova.compute.manager [req-085ff91e-2f94-4fdb-abac-7fa322da64c8 - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:35.707 4088 3038360461160 MainThread DEBUG nova.virt.hyperv.vmops [req-085ff91e-2f94-4fdb-abac-7fa322da64c8 - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:35.750 4088 3038360461160 MainThread DEBUG nova.compute.manager [req-085ff91e-2f94-4fdb-abac-7fa322da64c8 - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:35.763 4088 3038360461160 MainThread INFO nova.compute.manager [req-085ff91e-2f94-4fdb-abac-7fa322da64c8 - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:36.687 4088 3038363828824 MainThread DEBUG os_win.utils.jobutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Waiting for WMI job: {'InstanceID': 'CE1F2AEF-AB0A-441A-B631-B26018721906', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14850), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:36.833 4088 3038363828824 MainThread ERROR os_win.utils.jobutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007d\' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)instance-0000007d5272B030-65E4-43BB-8479-DA5F7EFA78FA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)instance-0000007d5272B030-65E4-43BB-8479-DA5F7EFA78FA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)instance-0000007d5272B030-65E4-43BB-8479-DA5F7EFA78FA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'CE1F2AEF-AB0A-441A-B631-B26018721906', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111140), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 36), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 36), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007d' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)\n\nNot enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)\n\n'instance-0000007d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)", 'ErrorSummaryDescription': "'instance-0000007d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:36.833 4088 3038363828824 MainThread DEBUG os_win._utils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007d' failed to start. Not enough memory in the system to start the virtual machine instance-0000007d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007d' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Not enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) 'instance-0000007d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.006506681442261 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:36.859 4088 3038360461160 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:36.859 4088 3038360461160 MainThread INFO nova.compute.manager [-] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] VM Stopped (Lifecycle Event) 2021-09-10 17:20:36.887 4088 3038360459928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:36.887 4088 3038360459928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:36.895 4088 3038360461160 MainThread DEBUG nova.compute.manager [req-9a51f571-18b8-4441-a20b-91d6242c455e - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:36.895 4088 3038360461160 MainThread DEBUG nova.virt.hyperv.vmops [req-9a51f571-18b8-4441-a20b-91d6242c455e - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:36.950 4088 3038360461160 MainThread DEBUG nova.compute.manager [req-9a51f571-18b8-4441-a20b-91d6242c455e - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:36.998 4088 3038360461160 MainThread INFO nova.compute.manager [req-9a51f571-18b8-4441-a20b-91d6242c455e - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:37.853 4088 3038363828824 MainThread DEBUG os_win.utils.jobutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Waiting for WMI job: {'InstanceID': '0CB0368E-1393-4BAB-9CA6-82CC8AD757F1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15358), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:37.996 4088 3038363828824 MainThread ERROR os_win.utils.jobutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007d\' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)instance-0000007d5272B030-65E4-43BB-8479-DA5F7EFA78FA12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)instance-0000007d5272B030-65E4-43BB-8479-DA5F7EFA78FA10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)instance-0000007d5272B030-65E4-43BB-8479-DA5F7EFA78FA%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0CB0368E-1393-4BAB-9CA6-82CC8AD757F1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113009), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 37), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 37), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007d' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)\n\nNot enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)\n\n'instance-0000007d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA)", 'ErrorSummaryDescription': "'instance-0000007d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:37.996 4088 3038363828824 MainThread ERROR nova.virt.hyperv.vmops [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Failed to change vm state of instance-0000007d to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000007d' failed to start. 2021-09-10 17:20:37.996 4088 3038363828824 MainThread INFO nova.virt.hyperv.vmops [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Got request to destroy instance 2021-09-10 17:20:38.044 4088 3038360459928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:38.044 4088 3038360459928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:38.044 4088 3038360461160 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:38.044 4088 3038360461160 MainThread INFO nova.compute.manager [-] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] VM Stopped (Lifecycle Event) 2021-09-10 17:20:38.060 4088 3038360461160 MainThread DEBUG nova.compute.manager [req-e3af6363-9cb5-4c01-9585-648d5504929d - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:38.060 4088 3038360461160 MainThread DEBUG nova.virt.hyperv.vmops [req-e3af6363-9cb5-4c01-9585-648d5504929d - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:38.109 4088 3038360461160 MainThread DEBUG nova.compute.manager [req-e3af6363-9cb5-4c01-9585-648d5504929d - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:38.154 4088 3038360461160 MainThread INFO nova.compute.manager [req-e3af6363-9cb5-4c01-9585-648d5504929d - - - - -] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:38.231 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Lock "96ec5341-0317-49a0-869e-4ccbd1788cf1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:38.247 4088 3038363828648 MainThread DEBUG nova.compute.manager [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:20:38.374 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:38.374 4088 3038363828648 MainThread DEBUG nova.virt.hardware [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:20:38.374 4088 3038363828648 MainThread INFO nova.compute.claims [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Claim successful on node n-h2-808474-1 2021-09-10 17:20:38.514 4088 3038363828648 MainThread DEBUG nova.virt.hyperv.hostops [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:20:38.530 4088 3038363828648 MainThread DEBUG nova.virt.hyperv.hostops [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:20:38.770 4088 3038363828648 MainThread DEBUG nova.compute.provider_tree [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:20:38.770 4088 3038363828648 MainThread DEBUG nova.scheduler.client.report [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:20:38.770 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:38.770 4088 3038363828648 MainThread DEBUG nova.compute.manager [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:20:38.887 4088 3038363828648 MainThread DEBUG nova.compute.manager [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:20:38.887 4088 3038360460632 GreenThread-116 DEBUG nova.compute.manager [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:20:38.887 4088 3038360460632 GreenThread-116 DEBUG nova.network.neutron [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:20:39.036 4088 3038363828648 MainThread DEBUG nova.compute.manager [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:20:39.045 4088 3038363828648 MainThread INFO nova.virt.hyperv.vmops [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Spawning new instance 2021-09-10 17:20:39.045 4088 3038360460632 GreenThread-116 DEBUG nova.policy [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47eebdda1ffa45eaa1d396ecfcf5780b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e7cb91cb99496aae913ddb707af6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:20:39.045 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Lock "instance-0000007e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:39.045 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Lock "instance-0000007e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:39.045 4088 3038363828648 MainThread DEBUG nova.block_device [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:20:39.074 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:39.076 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:39.076 4088 3038363828648 MainThread DEBUG os_win.utils.pathutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Creating directory: C:\openstack\instances\instance-0000007e check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:20:39.076 4088 3038363828648 MainThread DEBUG nova.virt.hyperv.vmops [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000007e\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:20:39.346 4088 3038363828648 MainThread DEBUG nova.virt.hyperv.vmops [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Resizing VHD C:\openstack\instances\instance-0000007e\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:20:39.969 4088 3038360460632 GreenThread-116 DEBUG nova.network.neutron [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Successfully created port: d548ffba-f50c-42d0-8512-aded6796e3e5 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:20:39.999 4088 3038363828824 MainThread DEBUG nova.virt.hyperv.vmops [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:20:39.999 4088 3038363828824 MainThread DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Lock "instance-0000007d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:39.999 4088 3038363828824 MainThread DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Lock "instance-0000007d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:40.021 4088 3038363828824 MainThread DEBUG os_win.utils.compute.vmutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Successfully changed vm state of instance-0000007d to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:20:40.021 4088 3038363828824 MainThread DEBUG nova.virt.hyperv.vmops [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Successfully changed state of VM instance-0000007d to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:20:40.060 4088 3038363828824 MainThread DEBUG os_win.utils.jobutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Waiting for WMI job: {'InstanceID': 'A30AC810-85A5-4180-858E-BB986D6A9CDA', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16338), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:40.171 4088 3038363828824 MainThread DEBUG os_win.utils.jobutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] WMI job succeeded: {'InstanceID': 'A30AC810-85A5-4180-858E-BB986D6A9CDA', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=120088), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:20:40.171 4088 3038363828824 MainThread DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Lock "instance-0000007d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:40.171 4088 3038363828824 MainThread DEBUG os_win.utils.pathutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Removing directory: C:\openstack\instances\instance-0000007d check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:20:40.192 4088 3038363828824 MainThread DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Lock "instance-0000007d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:40.192 4088 3038363828824 MainThread ERROR nova.compute.manager [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007d' failed to start. Not enough memory in the system to start the virtual machine instance-0000007d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007d' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Not enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) 'instance-0000007d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Error code: 32778. 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Traceback (most recent call last): 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] return function(*args, **kwargs) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] admin_password, network_info, block_device_info) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] return function(self, *args, **kwds) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self.force_reraise() 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] raise self.value 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] should_plug_vifs=False) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 'req_state': req_state}) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self.force_reraise() 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] raise self.value 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] time.sleep(sleep_time) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self.force_reraise() 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] raise self.value 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] return f(*args, **kwargs) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] return self._wait_for_job(job_path) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] error_desc=err_desc) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000007d' failed to start. 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Not enough memory in the system to start the virtual machine instance-0000007d. 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007d' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Not enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 'instance-0000007d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Error code: 32778. 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] During handling of the above exception, another exception occurred: 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Traceback (most recent call last): 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] yield resources 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] accel_info=accel_info) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] return function(*args, **kwargs) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] admin_password, network_info, block_device_info) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] return function(self, *args, **kwds) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self.force_reraise() 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] raise self.value 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] should_plug_vifs=False) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 'req_state': req_state}) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self.force_reraise() 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] raise self.value 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] time.sleep(sleep_time) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self.force_reraise() 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] raise self.value 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] return f(*args, **kwargs) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] return self._wait_for_job(job_path) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] error_desc=err_desc) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007d' failed to start. 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Not enough memory in the system to start the virtual machine instance-0000007d. 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007d' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Not enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 'instance-0000007d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Error code: 32778. 2021-09-10 17:20:40.192 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.192 4088 3038363828824 MainThread INFO nova.compute.manager [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Terminating instance 2021-09-10 17:20:40.192 4088 3038363828824 MainThread DEBUG nova.compute.manager [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:20:40.192 4088 3038363828824 MainThread INFO nova.virt.hyperv.vmops [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Got request to destroy instance 2021-09-10 17:20:40.202 4088 3038363828824 MainThread DEBUG nova.virt.hyperv.vmops [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:20:40.217 4088 3038363828824 MainThread DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Lock "instance-0000007d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:40.217 4088 3038363828824 MainThread DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Lock "instance-0000007d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:40.217 4088 3038363828824 MainThread INFO nova.compute.manager [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:20:40.217 4088 3038363828824 MainThread DEBUG nova.compute.claims [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:20:40.217 4088 3038363828824 MainThread DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:40.451 4088 3038363828824 MainThread DEBUG nova.virt.hyperv.hostops [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:20:40.485 4088 3038363828824 MainThread DEBUG nova.virt.hyperv.hostops [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:20:40.699 4088 3038363828824 MainThread DEBUG nova.compute.provider_tree [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:20:40.708 4088 3038363828824 MainThread DEBUG nova.scheduler.client.report [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:20:40.724 4088 3038363828824 MainThread DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.500s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:40.724 4088 3038363828824 MainThread ERROR nova.compute.manager [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007d' failed to start. Not enough memory in the system to start the virtual machine instance-0000007d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007d' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Not enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) 'instance-0000007d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Error code: 32778. 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Traceback (most recent call last): 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] return function(*args, **kwargs) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] admin_password, network_info, block_device_info) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] return function(self, *args, **kwds) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self.force_reraise() 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] raise self.value 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] should_plug_vifs=False) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 'req_state': req_state}) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self.force_reraise() 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] raise self.value 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] time.sleep(sleep_time) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self.force_reraise() 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] raise self.value 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] return f(*args, **kwargs) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] return self._wait_for_job(job_path) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] error_desc=err_desc) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000007d' failed to start. 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Not enough memory in the system to start the virtual machine instance-0000007d. 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007d' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Not enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 'instance-0000007d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Error code: 32778. 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] During handling of the above exception, another exception occurred: 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Traceback (most recent call last): 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] accel_info=accel_info) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] return function(*args, **kwargs) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] admin_password, network_info, block_device_info) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] return function(self, *args, **kwds) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self.force_reraise() 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] raise self.value 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] should_plug_vifs=False) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 'req_state': req_state}) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self.force_reraise() 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] raise self.value 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] time.sleep(sleep_time) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self.force_reraise() 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] raise self.value 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] return f(*args, **kwargs) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] return self._wait_for_job(job_path) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] error_desc=err_desc) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007d' failed to start. 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Not enough memory in the system to start the virtual machine instance-0000007d. 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007d' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Not enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 'instance-0000007d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Error code: 32778. 2021-09-10 17:20:40.724 4088 3038363828824 MainThread TRACE nova.compute.manager [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] 2021-09-10 17:20:40.724 4088 3038363828824 MainThread DEBUG nova.compute.utils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] WMI job failed with status 10. Error summary description: 'instance-0000007d' failed to start. Not enough memory in the system to start the virtual machine instance-0000007d. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:20:40.724 4088 3038363828824 MainThread DEBUG nova.compute.manager [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Build of instance 54b5cdb3-8dd4-4340-8e60-87009126553e was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000007d' failed to start. Not enough memory in the system to start the virtual machine instance-0000007d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007d' failed to start. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Not enough memory in the system to start the virtual machine instance-0000007d with ram size 1024 megabytes. (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) 'instance-0000007d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 5272B030-65E4-43BB-8479-DA5F7EFA78FA) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:20:40.732 4088 3038363828824 MainThread DEBUG nova.compute.manager [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:20:40.732 4088 3038363828824 MainThread DEBUG nova.compute.manager [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:20:40.732 4088 3038363828824 MainThread DEBUG nova.compute.manager [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:20:40.732 4088 3038363828824 MainThread DEBUG nova.network.neutron [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:20:41.098 4088 3038360460632 GreenThread-116 DEBUG nova.network.neutron [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Successfully updated port: d548ffba-f50c-42d0-8512-aded6796e3e5 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:20:41.116 4088 3038360460632 GreenThread-116 DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Acquired lock "refresh_cache-96ec5341-0317-49a0-869e-4ccbd1788cf1" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:20:41.116 4088 3038360460632 GreenThread-116 DEBUG nova.network.neutron [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:20:41.185 4088 3038363830584 MainThread DEBUG nova.compute.manager [req-3a31548b-d2a3-4667-aaa1-ff44a4c297e7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Received event network-changed-d548ffba-f50c-42d0-8512-aded6796e3e5 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:20:41.185 4088 3038363830584 MainThread DEBUG nova.compute.manager [req-3a31548b-d2a3-4667-aaa1-ff44a4c297e7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Refreshing instance network info cache due to event network-changed-d548ffba-f50c-42d0-8512-aded6796e3e5. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:20:41.265 4088 3038360460632 GreenThread-116 DEBUG nova.network.neutron [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:20:41.551 4088 3038363828824 MainThread DEBUG nova.network.neutron [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:20:41.562 4088 3038363828824 MainThread INFO nova.compute.manager [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] [instance: 54b5cdb3-8dd4-4340-8e60-87009126553e] Took 0.83 seconds to deallocate network for instance. 2021-09-10 17:20:41.703 4088 3038360460632 GreenThread-116 DEBUG nova.network.neutron [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Updating instance_info_cache with network_info: [{"id": "d548ffba-f50c-42d0-8512-aded6796e3e5", "address": "fa:16:3e:24:f4:36", "network": {"id": "1e50d601-5a38-4221-ba03-d236b39fa882", "bridge": null, "label": "tempest-TestServerAdvancedOps-1310542228-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d2e7cb91cb99496aae913ddb707af6c4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd548ffba-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:20:41.738 4088 3038360460632 GreenThread-116 DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Releasing lock "refresh_cache-96ec5341-0317-49a0-869e-4ccbd1788cf1" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:20:41.738 4088 3038360460632 GreenThread-116 DEBUG nova.compute.manager [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Instance network_info: |[{"id": "d548ffba-f50c-42d0-8512-aded6796e3e5", "address": "fa:16:3e:24:f4:36", "network": {"id": "1e50d601-5a38-4221-ba03-d236b39fa882", "bridge": null, "label": "tempest-TestServerAdvancedOps-1310542228-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d2e7cb91cb99496aae913ddb707af6c4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd548ffba-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:20:41.747 4088 3038363830584 MainThread DEBUG oslo_concurrency.lockutils [req-3a31548b-d2a3-4667-aaa1-ff44a4c297e7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-96ec5341-0317-49a0-869e-4ccbd1788cf1" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:20:41.747 4088 3038363830584 MainThread DEBUG nova.network.neutron [req-3a31548b-d2a3-4667-aaa1-ff44a4c297e7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Refreshing network info cache for port d548ffba-f50c-42d0-8512-aded6796e3e5 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:20:41.747 4088 3038363828648 MainThread DEBUG nova.compute.manager [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Preparing to wait for external event network-vif-plugged-d548ffba-f50c-42d0-8512-aded6796e3e5 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:20:41.747 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Lock "96ec5341-0317-49a0-869e-4ccbd1788cf1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:41.747 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Lock "96ec5341-0317-49a0-869e-4ccbd1788cf1-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:41.747 4088 3038363828648 MainThread DEBUG os_win.utils.compute.vmutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Creating VM instance-0000007e create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:20:41.786 4088 3038363828824 MainThread INFO nova.scheduler.client.report [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Deleted allocations for instance 54b5cdb3-8dd4-4340-8e60-87009126553e 2021-09-10 17:20:41.824 4088 3038363828824 MainThread DEBUG oslo_concurrency.lockutils [req-48482a72-411f-4974-8347-26d29d68347a c75206b921de4d1991b46238f71d9725 44d93cd09cd8429aa5cdf92bb48c2d79 - default default] Lock "54b5cdb3-8dd4-4340-8e60-87009126553e" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 22.985s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:42.498 4088 3038363830584 MainThread DEBUG nova.network.neutron [req-3a31548b-d2a3-4667-aaa1-ff44a4c297e7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Updated VIF entry in instance network info cache for port d548ffba-f50c-42d0-8512-aded6796e3e5. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:20:42.520 4088 3038363830584 MainThread DEBUG nova.network.neutron [req-3a31548b-d2a3-4667-aaa1-ff44a4c297e7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Updating instance_info_cache with network_info: [{"id": "d548ffba-f50c-42d0-8512-aded6796e3e5", "address": "fa:16:3e:24:f4:36", "network": {"id": "1e50d601-5a38-4221-ba03-d236b39fa882", "bridge": null, "label": "tempest-TestServerAdvancedOps-1310542228-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d2e7cb91cb99496aae913ddb707af6c4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd548ffba-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:20:42.534 4088 3038363830584 MainThread DEBUG oslo_concurrency.lockutils [req-3a31548b-d2a3-4667-aaa1-ff44a4c297e7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-96ec5341-0317-49a0-869e-4ccbd1788cf1" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:20:43.514 4088 3038363828648 MainThread DEBUG nova.virt.hyperv.vmops [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:20:51.226 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-6d5f6488-ada3-4560-aeab-9e2a641f810e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Received event network-vif-plugged-d548ffba-f50c-42d0-8512-aded6796e3e5 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:20:51.226 4088 3038360460984 MainThread DEBUG oslo_concurrency.lockutils [req-6d5f6488-ada3-4560-aeab-9e2a641f810e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "96ec5341-0317-49a0-869e-4ccbd1788cf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:51.226 4088 3038360460984 MainThread DEBUG oslo_concurrency.lockutils [req-6d5f6488-ada3-4560-aeab-9e2a641f810e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "96ec5341-0317-49a0-869e-4ccbd1788cf1-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:51.226 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-6d5f6488-ada3-4560-aeab-9e2a641f810e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Processing event network-vif-plugged-d548ffba-f50c-42d0-8512-aded6796e3e5 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:20:51.277 4088 3038363828648 MainThread INFO nova.virt.hyperv.vmops [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Using config drive for instance 2021-09-10 17:20:51.498 4088 3038363828648 MainThread INFO nova.virt.hyperv.vmops [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Creating config drive at C:\openstack\instances\instance-0000007e\configdrive.iso 2021-09-10 17:20:51.602 4088 3038363828648 MainThread DEBUG oslo_concurrency.processutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000007e\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpo261_mqn execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:20:51.929 4088 3038363828648 MainThread DEBUG oslo_concurrency.processutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000007e\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpo261_mqn" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:20:52.497 4088 3038363828648 MainThread DEBUG nova.virt.hyperv.vmops [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Setting boot order for instance: instance-0000007e: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:20:52.564 4088 3038363828648 MainThread DEBUG nova.virt.hyperv.vmops [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:20:52.608 4088 3038363828648 MainThread DEBUG os_win.utils.jobutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Waiting for WMI job: {'InstanceID': 'B390C8FF-FD6C-445C-966C-86B8C7040FCE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14783), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:52.762 4088 3038363828648 MainThread ERROR os_win.utils.jobutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007e\' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)instance-0000007eAAF4EB01-E0F9-4CCA-B31B-69A5603A4C7112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)instance-0000007eAAF4EB01-E0F9-4CCA-B31B-69A5603A4C7110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)instance-0000007eAAF4EB01-E0F9-4CCA-B31B-69A5603A4C71%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B390C8FF-FD6C-445C-966C-86B8C7040FCE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=123233), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 52), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 52), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007e' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)\n\nNot enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)\n\n'instance-0000007e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)", 'ErrorSummaryDescription': "'instance-0000007e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:52.762 4088 3038363828648 MainThread DEBUG os_win._utils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007e' failed to start. Not enough memory in the system to start the virtual machine instance-0000007e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007e' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Not enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) 'instance-0000007e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.19787907600402832 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:52.811 4088 3038360460984 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:52.811 4088 3038360460984 MainThread INFO nova.compute.manager [-] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] VM Stopped (Lifecycle Event) 2021-09-10 17:20:52.811 4088 3038360460632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:52.811 4088 3038360460632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:52.811 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-796acc3a-84e2-455a-8686-621e1d965883 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:52.811 4088 3038360460984 MainThread DEBUG nova.virt.hyperv.vmops [req-796acc3a-84e2-455a-8686-621e1d965883 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:52.888 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-796acc3a-84e2-455a-8686-621e1d965883 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:52.904 4088 3038360460984 MainThread INFO nova.compute.manager [req-796acc3a-84e2-455a-8686-621e1d965883 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:53.789 4088 3038363828648 MainThread DEBUG os_win.utils.jobutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Waiting for WMI job: {'InstanceID': '32251A5D-F271-44AB-931D-8C2A8D6FE22D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14813), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:53.933 4088 3038363828648 MainThread ERROR os_win.utils.jobutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007e\' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)instance-0000007eAAF4EB01-E0F9-4CCA-B31B-69A5603A4C7112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)instance-0000007eAAF4EB01-E0F9-4CCA-B31B-69A5603A4C7110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)instance-0000007eAAF4EB01-E0F9-4CCA-B31B-69A5603A4C71%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '32251A5D-F271-44AB-931D-8C2A8D6FE22D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114599), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 53), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 53), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007e' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)\n\nNot enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)\n\n'instance-0000007e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)", 'ErrorSummaryDescription': "'instance-0000007e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:53.933 4088 3038363828648 MainThread DEBUG os_win._utils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007e' failed to start. Not enough memory in the system to start the virtual machine instance-0000007e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007e' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Not enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) 'instance-0000007e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3689682483673096 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:53.973 4088 3038360460632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:53.973 4088 3038360460632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:53.973 4088 3038360460984 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:53.973 4088 3038360460984 MainThread INFO nova.compute.manager [-] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] VM Stopped (Lifecycle Event) 2021-09-10 17:20:54.008 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-f8681b62-b4da-4d09-8b4b-b963bbd948a7 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:54.008 4088 3038360460984 MainThread DEBUG nova.virt.hyperv.vmops [req-f8681b62-b4da-4d09-8b4b-b963bbd948a7 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:54.054 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-f8681b62-b4da-4d09-8b4b-b963bbd948a7 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:54.086 4088 3038360460984 MainThread INFO nova.compute.manager [req-f8681b62-b4da-4d09-8b4b-b963bbd948a7 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:54.935 4088 3038363828648 MainThread DEBUG os_win.utils.jobutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Waiting for WMI job: {'InstanceID': '4941FFF6-E799-4DE0-AEFE-D70CB344EA86', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14604), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:55.157 4088 3038360460984 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:55.178 4088 3038360460984 MainThread INFO nova.compute.manager [-] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] VM Stopped (Lifecycle Event) 2021-09-10 17:20:55.178 4088 3038360460632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:55.178 4088 3038360460632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:55.185 4088 3038363828648 MainThread ERROR os_win.utils.jobutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007e\' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)instance-0000007eAAF4EB01-E0F9-4CCA-B31B-69A5603A4C7112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)instance-0000007eAAF4EB01-E0F9-4CCA-B31B-69A5603A4C7110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)instance-0000007eAAF4EB01-E0F9-4CCA-B31B-69A5603A4C71%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4941FFF6-E799-4DE0-AEFE-D70CB344EA86', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111246), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 54), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 55), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007e' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)\n\nNot enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)\n\n'instance-0000007e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)", 'ErrorSummaryDescription': "'instance-0000007e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:55.185 4088 3038363828648 MainThread DEBUG os_win._utils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007e' failed to start. Not enough memory in the system to start the virtual machine instance-0000007e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007e' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Not enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) 'instance-0000007e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.6208035945892334 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:55.185 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-221b2639-f505-48a5-b18c-9535f988934d - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:55.185 4088 3038360460984 MainThread DEBUG nova.virt.hyperv.vmops [req-221b2639-f505-48a5-b18c-9535f988934d - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:55.253 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-221b2639-f505-48a5-b18c-9535f988934d - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:55.275 4088 3038360460984 MainThread INFO nova.compute.manager [req-221b2639-f505-48a5-b18c-9535f988934d - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:56.205 4088 3038363828648 MainThread DEBUG os_win.utils.jobutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Waiting for WMI job: {'InstanceID': '7E2C58C9-EA87-41C7-83F6-3EADB90C8B68', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14686), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:56.356 4088 3038363828648 MainThread ERROR os_win.utils.jobutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007e\' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)instance-0000007eAAF4EB01-E0F9-4CCA-B31B-69A5603A4C7112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)instance-0000007eAAF4EB01-E0F9-4CCA-B31B-69A5603A4C7110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)instance-0000007eAAF4EB01-E0F9-4CCA-B31B-69A5603A4C71%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7E2C58C9-EA87-41C7-83F6-3EADB90C8B68', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=109740), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 56), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 56), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007e' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)\n\nNot enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)\n\n'instance-0000007e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)", 'ErrorSummaryDescription': "'instance-0000007e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:56.356 4088 3038363828648 MainThread DEBUG os_win._utils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007e' failed to start. Not enough memory in the system to start the virtual machine instance-0000007e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007e' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Not enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) 'instance-0000007e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.791438579559326 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:56.376 4088 3038360460984 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:56.376 4088 3038360460984 MainThread INFO nova.compute.manager [-] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] VM Stopped (Lifecycle Event) 2021-09-10 17:20:56.402 4088 3038360460632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:56.402 4088 3038360460632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:56.417 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-b2e1cf60-0be7-402a-8238-8a250ff119a5 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:56.417 4088 3038360460984 MainThread DEBUG nova.virt.hyperv.vmops [req-b2e1cf60-0be7-402a-8238-8a250ff119a5 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:56.465 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-b2e1cf60-0be7-402a-8238-8a250ff119a5 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:56.492 4088 3038360460984 MainThread INFO nova.compute.manager [req-b2e1cf60-0be7-402a-8238-8a250ff119a5 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:57.372 4088 3038363828648 MainThread DEBUG os_win.utils.jobutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Waiting for WMI job: {'InstanceID': 'E3A810CB-2AA0-48FD-B9F9-85C25BB60F52', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16019), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:57.496 4088 3038363828648 MainThread ERROR os_win.utils.jobutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007e\' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)instance-0000007eAAF4EB01-E0F9-4CCA-B31B-69A5603A4C7112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)instance-0000007eAAF4EB01-E0F9-4CCA-B31B-69A5603A4C7110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)instance-0000007eAAF4EB01-E0F9-4CCA-B31B-69A5603A4C71%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E3A810CB-2AA0-48FD-B9F9-85C25BB60F52', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110281), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 57), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 57), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007e' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)\n\nNot enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)\n\n'instance-0000007e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)", 'ErrorSummaryDescription': "'instance-0000007e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:57.496 4088 3038363828648 MainThread DEBUG os_win._utils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000007e' failed to start. Not enough memory in the system to start the virtual machine instance-0000007e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007e' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Not enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) 'instance-0000007e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.9313743114471436 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:20:57.550 4088 3038360460632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:57.550 4088 3038360460632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:57.550 4088 3038360460984 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:57.550 4088 3038360460984 MainThread INFO nova.compute.manager [-] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] VM Stopped (Lifecycle Event) 2021-09-10 17:20:57.581 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-e4280f78-0ef7-4fae-a4aa-df79a1b1c587 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:57.581 4088 3038360460984 MainThread DEBUG nova.virt.hyperv.vmops [req-e4280f78-0ef7-4fae-a4aa-df79a1b1c587 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:57.633 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-e4280f78-0ef7-4fae-a4aa-df79a1b1c587 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:57.667 4088 3038360460984 MainThread INFO nova.compute.manager [req-e4280f78-0ef7-4fae-a4aa-df79a1b1c587 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:58.242 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:20:58.530 4088 3038363828648 MainThread DEBUG os_win.utils.jobutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Waiting for WMI job: {'InstanceID': '7CF9F852-489E-4441-9C81-1BCCB9EA17E4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19055), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:20:58.683 4088 3038363828648 MainThread ERROR os_win.utils.jobutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000007e\' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)instance-0000007eAAF4EB01-E0F9-4CCA-B31B-69A5603A4C7112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)instance-0000007eAAF4EB01-E0F9-4CCA-B31B-69A5603A4C7110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000007e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)instance-0000007eAAF4EB01-E0F9-4CCA-B31B-69A5603A4C71%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7CF9F852-489E-4441-9C81-1BCCB9EA17E4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110682), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 20, 58), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 20, 58), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000007e' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)\n\nNot enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)\n\n'instance-0000007e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71)", 'ErrorSummaryDescription': "'instance-0000007e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000007e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:20:58.683 4088 3038363828648 MainThread ERROR nova.virt.hyperv.vmops [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Failed to change vm state of instance-0000007e to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000007e' failed to start. 2021-09-10 17:20:58.689 4088 3038363828648 MainThread INFO nova.virt.hyperv.vmops [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Got request to destroy instance 2021-09-10 17:20:58.707 4088 3038360460984 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:20:58.707 4088 3038360460984 MainThread INFO nova.compute.manager [-] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] VM Stopped (Lifecycle Event) 2021-09-10 17:20:58.707 4088 3038360460632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:20:58.707 4088 3038360460632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000007e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:20:58.726 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-e4d393c4-bf67-44e7-a157-66d0e8020ba6 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:20:58.726 4088 3038360460984 MainThread DEBUG nova.virt.hyperv.vmops [req-e4d393c4-bf67-44e7-a157-66d0e8020ba6 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:20:58.780 4088 3038360460984 MainThread DEBUG nova.compute.manager [req-e4d393c4-bf67-44e7-a157-66d0e8020ba6 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:20:58.801 4088 3038360460984 MainThread INFO nova.compute.manager [req-e4d393c4-bf67-44e7-a157-66d0e8020ba6 - - - - -] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:20:59.492 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:20:59.492 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:21:00.499 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:21:00.527 4088 3038363828648 MainThread DEBUG nova.virt.hyperv.vmops [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:21:00.527 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Lock "instance-0000007e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:21:00.527 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Lock "instance-0000007e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:21:00.558 4088 3038363828648 MainThread DEBUG os_win.utils.compute.vmutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Successfully changed vm state of instance-0000007e to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:21:00.558 4088 3038363828648 MainThread DEBUG nova.virt.hyperv.vmops [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Successfully changed state of VM instance-0000007e to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:21:00.601 4088 3038363828648 MainThread DEBUG os_win.utils.jobutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Waiting for WMI job: {'InstanceID': '4ED01AB2-30E7-46A2-9D97-ADD2AF5F19B5', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14990), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:21:00.726 4088 3038363828648 MainThread DEBUG os_win.utils.jobutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] WMI job succeeded: {'InstanceID': '4ED01AB2-30E7-46A2-9D97-ADD2AF5F19B5', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=107124), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:21:00.726 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Lock "instance-0000007e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:21:00.726 4088 3038363828648 MainThread DEBUG os_win.utils.pathutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Removing directory: C:\openstack\instances\instance-0000007e check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:21:00.726 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Lock "instance-0000007e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:21:00.726 4088 3038363828648 MainThread ERROR nova.compute.manager [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007e' failed to start. Not enough memory in the system to start the virtual machine instance-0000007e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007e' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Not enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) 'instance-0000007e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Error code: 32778. 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Traceback (most recent call last): 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] return function(*args, **kwargs) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] admin_password, network_info, block_device_info) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] return function(self, *args, **kwds) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self.force_reraise() 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] raise self.value 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] should_plug_vifs=False) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 'req_state': req_state}) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self.force_reraise() 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] raise self.value 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] time.sleep(sleep_time) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self.force_reraise() 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] raise self.value 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] return f(*args, **kwargs) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] return self._wait_for_job(job_path) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] error_desc=err_desc) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000007e' failed to start. 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Not enough memory in the system to start the virtual machine instance-0000007e. 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007e' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Not enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 'instance-0000007e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Error code: 32778. 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] During handling of the above exception, another exception occurred: 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Traceback (most recent call last): 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] yield resources 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] accel_info=accel_info) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] return function(*args, **kwargs) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] admin_password, network_info, block_device_info) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] return function(self, *args, **kwds) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self.force_reraise() 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] raise self.value 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] should_plug_vifs=False) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 'req_state': req_state}) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self.force_reraise() 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] raise self.value 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] time.sleep(sleep_time) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self.force_reraise() 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] raise self.value 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] return f(*args, **kwargs) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] return self._wait_for_job(job_path) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] error_desc=err_desc) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007e' failed to start. 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Not enough memory in the system to start the virtual machine instance-0000007e. 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007e' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Not enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 'instance-0000007e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Error code: 32778. 2021-09-10 17:21:00.726 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:00.726 4088 3038363828648 MainThread INFO nova.compute.manager [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Terminating instance 2021-09-10 17:21:00.726 4088 3038363828648 MainThread DEBUG nova.compute.manager [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:21:00.726 4088 3038363828648 MainThread INFO nova.virt.hyperv.vmops [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Got request to destroy instance 2021-09-10 17:21:00.749 4088 3038363828648 MainThread DEBUG nova.virt.hyperv.vmops [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:21:00.749 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Lock "instance-0000007e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:21:00.749 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Lock "instance-0000007e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:21:00.749 4088 3038363828648 MainThread INFO nova.compute.manager [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:21:00.749 4088 3038363828648 MainThread DEBUG nova.compute.claims [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:21:00.749 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:21:00.845 4088 3038363828648 MainThread DEBUG nova.virt.hyperv.hostops [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:21:00.870 4088 3038363828648 MainThread DEBUG nova.virt.hyperv.hostops [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:21:01.059 4088 3038363828648 MainThread DEBUG nova.compute.provider_tree [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:21:01.086 4088 3038363828648 MainThread DEBUG nova.scheduler.client.report [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:21:01.086 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.343s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:21:01.086 4088 3038363828648 MainThread ERROR nova.compute.manager [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007e' failed to start. Not enough memory in the system to start the virtual machine instance-0000007e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007e' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Not enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) 'instance-0000007e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Error code: 32778. 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Traceback (most recent call last): 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] return function(*args, **kwargs) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] admin_password, network_info, block_device_info) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] return function(self, *args, **kwds) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self.force_reraise() 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] raise self.value 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] should_plug_vifs=False) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 'req_state': req_state}) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self.force_reraise() 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] raise self.value 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] time.sleep(sleep_time) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self.force_reraise() 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] raise self.value 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] return f(*args, **kwargs) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] return self._wait_for_job(job_path) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] error_desc=err_desc) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000007e' failed to start. 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Not enough memory in the system to start the virtual machine instance-0000007e. 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007e' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Not enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 'instance-0000007e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Error code: 32778. 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] During handling of the above exception, another exception occurred: 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Traceback (most recent call last): 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] accel_info=accel_info) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] return function(*args, **kwargs) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] admin_password, network_info, block_device_info) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] return function(self, *args, **kwds) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self.force_reraise() 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] raise self.value 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] should_plug_vifs=False) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 'req_state': req_state}) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self.force_reraise() 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] raise self.value 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] time.sleep(sleep_time) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self.force_reraise() 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] raise self.value 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] return f(*args, **kwargs) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] return self._wait_for_job(job_path) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] error_desc=err_desc) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000007e' failed to start. 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Not enough memory in the system to start the virtual machine instance-0000007e. 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007e' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Not enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 'instance-0000007e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Error code: 32778. 2021-09-10 17:21:01.086 4088 3038363828648 MainThread TRACE nova.compute.manager [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] 2021-09-10 17:21:01.086 4088 3038363828648 MainThread DEBUG nova.compute.utils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] WMI job failed with status 10. Error summary description: 'instance-0000007e' failed to start. Not enough memory in the system to start the virtual machine instance-0000007e. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:21:01.086 4088 3038363828648 MainThread DEBUG nova.compute.manager [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Build of instance 96ec5341-0317-49a0-869e-4ccbd1788cf1 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000007e' failed to start. Not enough memory in the system to start the virtual machine instance-0000007e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000007e' failed to start. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Not enough memory in the system to start the virtual machine instance-0000007e with ram size 1024 megabytes. (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) 'instance-0000007e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID AAF4EB01-E0F9-4CCA-B31B-69A5603A4C71) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:21:01.104 4088 3038363828648 MainThread DEBUG nova.compute.manager [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:21:01.104 4088 3038363828648 MainThread DEBUG nova.compute.manager [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:21:01.104 4088 3038363828648 MainThread DEBUG nova.compute.manager [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:21:01.104 4088 3038363828648 MainThread DEBUG nova.network.neutron [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:21:01.570 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:21:01.589 4088 3038363828648 MainThread DEBUG nova.network.neutron [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:21:01.632 4088 3038363828648 MainThread INFO nova.compute.manager [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] [instance: 96ec5341-0317-49a0-869e-4ccbd1788cf1] Took 0.53 seconds to deallocate network for instance. 2021-09-10 17:21:01.757 4088 3038363828648 MainThread INFO nova.scheduler.client.report [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Deleted allocations for instance 96ec5341-0317-49a0-869e-4ccbd1788cf1 2021-09-10 17:21:01.801 4088 3038363828648 MainThread DEBUG oslo_concurrency.lockutils [req-a0bd4937-3ac3-42d3-91a3-72469b776398 47eebdda1ffa45eaa1d396ecfcf5780b d2e7cb91cb99496aae913ddb707af6c4 - default default] Lock "96ec5341-0317-49a0-869e-4ccbd1788cf1" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 23.563s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:21:02.491 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:21:03.497 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:21:04.495 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:21:05.508 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:21:06.507 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:21:06.507 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:21:06.885 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-9446e666-4364-4dcd-b041-405653a856bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:21:06.885 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:21:08.339 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Updating instance_info_cache with network_info: [{"id": "f581c585-39ab-4120-a040-5d92bb401a6c", "address": "fa:16:3e:da:9a:80", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf581c585-39", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:21:08.351 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-9446e666-4364-4dcd-b041-405653a856bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:21:08.351 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:21:09.507 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:21:09.526 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:21:09.526 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:21:09.526 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:21:09.526 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:21:09.547 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:21:09.757 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2228MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:21:09.757 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:21:10.038 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:21:10.038 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:21:10.038 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:21:10.038 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:21:10.038 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:21:10.038 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:21:10.038 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:21:10.038 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:21:10.038 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:21:10.057 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:21:10.057 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:21:10.057 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:21:10.057 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:21:10.057 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:21:10.057 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:21:10.076 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:21:10.107 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:21:10.303 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:21:10.331 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:21:10.331 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:21:10.331 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:21:21.775 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:21:59.524 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:22:00.493 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:22:00.493 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:22:03.493 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:22:03.493 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:22:03.493 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:22:05.493 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:22:05.493 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:22:08.493 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:22:08.493 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:22:08.699 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-9bb2d354-2d76-40ea-8b9c-b18a21edefbb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:22:08.699 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:22:09.711 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Updating instance_info_cache with network_info: [{"id": "cffb92ec-4239-478b-a7e3-533da175c554", "address": "fa:16:3e:61:8a:33", "network": {"id": "6762dff9-0e3f-42c6-a0d6-ae3571e9fc82", "bridge": null, "label": "tempest-AttachSCSIVolumeTestJSON-1567357011-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "10c929df49a24fb798e1b2d3f7414211", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcffb92ec-42", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:22:09.723 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-9bb2d354-2d76-40ea-8b9c-b18a21edefbb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:22:09.723 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:22:09.723 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:22:10.524 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:22:10.547 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:22:10.547 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:22:10.547 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:22:10.547 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:22:10.586 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:22:10.797 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2228MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:22:10.797 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:22:11.258 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:22:11.258 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:22:11.258 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:22:11.258 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:22:11.258 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:22:11.258 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:22:11.258 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:22:11.258 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:22:11.258 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:22:11.258 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:22:11.258 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:22:11.258 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:22:11.258 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:22:11.258 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:22:11.258 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:22:11.337 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing inventories for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:757 2021-09-10 17:22:11.399 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Updating ProviderTree inventory for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 from _refresh_and_get_inventory using data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} _refresh_and_get_inventory c:\openstack\build\nova\nova\scheduler\client\report.py:723 2021-09-10 17:22:11.399 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Updating inventory in ProviderTree for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 with inventory: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:176 2021-09-10 17:22:11.446 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing aggregate associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, aggregates: None _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:766 2021-09-10 17:22:11.508 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing trait associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_VHD,COMPUTE_IMAGE_TYPE_VHDX,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:778 2021-09-10 17:22:11.508 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:22:11.522 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:22:11.727 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:22:11.742 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:22:11.742 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:22:11.742 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.953s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:22:14.492 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_incomplete_migrations run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:22:14.492 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances with incomplete migration _cleanup_incomplete_migrations c:\openstack\build\nova\nova\compute\manager.py:10640 2021-09-10 17:22:24.508 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._run_pending_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:22:24.508 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10602 2021-09-10 17:22:24.523 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] There are 0 instances to clean _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10611 2021-09-10 17:22:42.522 4088 3038363830232 MainThread DEBUG oslo_concurrency.lockutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "df9dee3f-cee2-4374-b88f-571d3da1198c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:22:42.539 4088 3038363830232 MainThread DEBUG nova.compute.manager [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:22:42.636 4088 3038363830232 MainThread DEBUG oslo_concurrency.lockutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:22:42.636 4088 3038363830232 MainThread DEBUG nova.virt.hardware [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:22:42.636 4088 3038363830232 MainThread INFO nova.compute.claims [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Claim successful on node n-h2-808474-1 2021-09-10 17:22:42.788 4088 3038363830232 MainThread DEBUG nova.virt.hyperv.hostops [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:22:42.804 4088 3038363830232 MainThread DEBUG nova.virt.hyperv.hostops [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:22:42.992 4088 3038363830232 MainThread DEBUG nova.compute.provider_tree [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:22:43.022 4088 3038363830232 MainThread DEBUG nova.scheduler.client.report [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:22:43.022 4088 3038363830232 MainThread DEBUG oslo_concurrency.lockutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:22:43.022 4088 3038363830232 MainThread DEBUG nova.compute.manager [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:22:43.085 4088 3038363830232 MainThread DEBUG nova.compute.manager [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:22:43.085 4088 3038363828824 GreenThread-117 DEBUG nova.compute.manager [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:22:43.085 4088 3038363828824 GreenThread-117 DEBUG nova.network.neutron [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:22:43.148 4088 3038363830232 MainThread INFO nova.virt.block_device [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Booting with volume 53065bd6-c434-4af7-8c93-3a704bbd9a51 at /dev/sda 2021-09-10 17:22:43.204 4088 3038363828824 GreenThread-117 DEBUG nova.policy [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82eacb807eb449a28e17290cd4d841d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0aa6ac8af84d7291f244f216bb94b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:22:43.204 4088 3038363830232 MainThread DEBUG os_brick.utils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:22:43.204 4088 3038363830232 MainThread DEBUG os_brick.utils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] <== get_connector_properties: return (0ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:22:43.204 4088 3038363830232 MainThread DEBUG nova.virt.block_device [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Updating existing volume attachment record: 997ad29d-22e0-4eb5-88ec-088b94f0d2b9 _volume_attach c:\openstack\build\nova\nova\virt\block_device.py:556 2021-09-10 17:22:43.851 4088 3038363828824 GreenThread-117 DEBUG nova.network.neutron [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Successfully created port: be7ad636-2e88-4ae0-8c73-fe6332d60409 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:22:44.929 4088 3038363828824 GreenThread-117 DEBUG nova.network.neutron [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Successfully updated port: be7ad636-2e88-4ae0-8c73-fe6332d60409 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:22:44.945 4088 3038363828824 GreenThread-117 DEBUG oslo_concurrency.lockutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Acquired lock "refresh_cache-df9dee3f-cee2-4374-b88f-571d3da1198c" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:22:44.945 4088 3038363828824 GreenThread-117 DEBUG nova.network.neutron [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:22:45.007 4088 3038363831464 MainThread DEBUG nova.compute.manager [req-d0f24b62-0cac-4309-ab57-6b1422190cb0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Received event network-changed-be7ad636-2e88-4ae0-8c73-fe6332d60409 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:22:45.007 4088 3038363831464 MainThread DEBUG nova.compute.manager [req-d0f24b62-0cac-4309-ab57-6b1422190cb0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Refreshing instance network info cache due to event network-changed-be7ad636-2e88-4ae0-8c73-fe6332d60409. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:22:45.054 4088 3038363828824 GreenThread-117 DEBUG nova.network.neutron [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:22:45.444 4088 3038363828824 GreenThread-117 DEBUG nova.network.neutron [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Updating instance_info_cache with network_info: [{"id": "be7ad636-2e88-4ae0-8c73-fe6332d60409", "address": "fa:16:3e:f4:06:cc", "network": {"id": "385c7b14-693f-45e3-86cf-8a54c842098b", "bridge": null, "label": "tempest-TestVolumeBootPattern-577893151-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d0aa6ac8af84d7291f244f216bb94b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapbe7ad636-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:22:45.475 4088 3038363828824 GreenThread-117 DEBUG oslo_concurrency.lockutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Releasing lock "refresh_cache-df9dee3f-cee2-4374-b88f-571d3da1198c" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:22:45.475 4088 3038363828824 GreenThread-117 DEBUG nova.compute.manager [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Instance network_info: |[{"id": "be7ad636-2e88-4ae0-8c73-fe6332d60409", "address": "fa:16:3e:f4:06:cc", "network": {"id": "385c7b14-693f-45e3-86cf-8a54c842098b", "bridge": null, "label": "tempest-TestVolumeBootPattern-577893151-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d0aa6ac8af84d7291f244f216bb94b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapbe7ad636-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:22:45.475 4088 3038363831464 MainThread DEBUG oslo_concurrency.lockutils [req-d0f24b62-0cac-4309-ab57-6b1422190cb0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-df9dee3f-cee2-4374-b88f-571d3da1198c" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:22:45.475 4088 3038363831464 MainThread DEBUG nova.network.neutron [req-d0f24b62-0cac-4309-ab57-6b1422190cb0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Refreshing network info cache for port be7ad636-2e88-4ae0-8c73-fe6332d60409 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:22:46.117 4088 3038363831464 MainThread DEBUG nova.network.neutron [req-d0f24b62-0cac-4309-ab57-6b1422190cb0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Updated VIF entry in instance network info cache for port be7ad636-2e88-4ae0-8c73-fe6332d60409. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:22:46.117 4088 3038363831464 MainThread DEBUG nova.network.neutron [req-d0f24b62-0cac-4309-ab57-6b1422190cb0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Updating instance_info_cache with network_info: [{"id": "be7ad636-2e88-4ae0-8c73-fe6332d60409", "address": "fa:16:3e:f4:06:cc", "network": {"id": "385c7b14-693f-45e3-86cf-8a54c842098b", "bridge": null, "label": "tempest-TestVolumeBootPattern-577893151-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d0aa6ac8af84d7291f244f216bb94b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapbe7ad636-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:22:46.117 4088 3038363831464 MainThread DEBUG oslo_concurrency.lockutils [req-d0f24b62-0cac-4309-ab57-6b1422190cb0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-df9dee3f-cee2-4374-b88f-571d3da1198c" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:22:47.600 4088 3038363830232 MainThread DEBUG nova.compute.manager [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:22:47.632 4088 3038363830232 MainThread INFO nova.virt.hyperv.vmops [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Spawning new instance 2021-09-10 17:22:47.632 4088 3038363830232 MainThread DEBUG oslo_concurrency.lockutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000080" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:22:47.632 4088 3038363830232 MainThread DEBUG oslo_concurrency.lockutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000080" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:22:47.632 4088 3038363830232 MainThread DEBUG nova.block_device [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] block_device_list ['sda'] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:22:47.632 4088 3038363830232 MainThread DEBUG nova.compute.manager [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Preparing to wait for external event network-vif-plugged-be7ad636-2e88-4ae0-8c73-fe6332d60409 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:22:47.632 4088 3038363830232 MainThread DEBUG oslo_concurrency.lockutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "df9dee3f-cee2-4374-b88f-571d3da1198c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:22:47.632 4088 3038363830232 MainThread DEBUG oslo_concurrency.lockutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "df9dee3f-cee2-4374-b88f-571d3da1198c-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:22:47.648 4088 3038363830232 MainThread DEBUG os_win.utils.compute.vmutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Creating VM instance-00000080 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:22:48.647 4088 3038363830232 MainThread DEBUG nova.virt.hyperv.volumeops [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Attaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-53065bd6-c434-4af7-8c93-3a704bbd9a51', 'target_lun': 0, 'volume_id': '53065bd6-c434-4af7-8c93-3a704bbd9a51', 'auth_method': 'CHAP', 'auth_username': 'f9Q3UXsa8jpzy5QsH5BW', 'auth_password': '***', 'encrypted': True, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'reserved', 'instance': 'df9dee3f-cee2-4374-b88f-571d3da1198c', 'attached_at': '', 'detached_at': '', 'volume_id': '53065bd6-c434-4af7-8c93-3a704bbd9a51', 'serial': '53065bd6-c434-4af7-8c93-3a704bbd9a51'} to instance-00000080 _attach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:108 2021-09-10 17:22:48.647 4088 3038363830232 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-53065bd6-c434-4af7-8c93-3a704bbd9a51', 'target_lun': 0, 'volume_id': '53065bd6-c434-4af7-8c93-3a704bbd9a51', 'auth_method': 'CHAP', 'auth_username': 'f9Q3UXsa8jpzy5QsH5BW', 'auth_password': '***', 'encrypted': True, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:22:48.647 4088 3038363830232 MainThread INFO os_brick.initiator.windows.iscsi [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Attempting to establish an iSCSI session to target iqn.2010-10.org.openstack:volume-53065bd6-c434-4af7-8c93-3a704bbd9a51 on portal 10.222.0.55:3260 accessing LUN 0 using initiator None. 2021-09-10 17:22:48.647 4088 3038363830232 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Logging in iSCSI target iqn.2010-10.org.openstack:volume-53065bd6-c434-4af7-8c93-3a704bbd9a51 login_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:401 2021-09-10 17:22:53.663 4088 3038363830232 MainThread DEBUG os_win.utils.storage.diskutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:22:53.820 4088 3038363830232 MainThread DEBUG os_win.utils.storage.diskutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:22:54.367 4088 3038363830232 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] <== connect_volume: return (5719ms) {'type': 'block', 'path': '\\\\.\\PhysicalDrive1', 'number': 1, 'scsi_wwn': '36001405CD0A7DEEA5E34B4A9F53F938D'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:22:54.930 4088 3038363830232 MainThread DEBUG nova.virt.hyperv.vmops [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:22:59.530 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:22:59.530 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-884b94b2-0f0d-449e-9979-75f45c58ae56 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Received event network-vif-plugged-be7ad636-2e88-4ae0-8c73-fe6332d60409 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:22:59.530 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-884b94b2-0f0d-449e-9979-75f45c58ae56 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "df9dee3f-cee2-4374-b88f-571d3da1198c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:22:59.530 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-884b94b2-0f0d-449e-9979-75f45c58ae56 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "df9dee3f-cee2-4374-b88f-571d3da1198c-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:22:59.530 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-884b94b2-0f0d-449e-9979-75f45c58ae56 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Processing event network-vif-plugged-be7ad636-2e88-4ae0-8c73-fe6332d60409 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:22:59.568 4088 3038363830232 MainThread INFO nova.virt.hyperv.vmops [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Using config drive for instance 2021-09-10 17:22:59.687 4088 3038363830232 MainThread INFO nova.virt.hyperv.vmops [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Creating config drive at C:\openstack\instances\instance-00000080\configdrive.iso 2021-09-10 17:22:59.772 4088 3038363830232 MainThread DEBUG oslo_concurrency.processutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000080\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp76gbkpe7 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:23:00.102 4088 3038363830232 MainThread DEBUG oslo_concurrency.processutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000080\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp76gbkpe7" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:23:00.588 4088 3038363830232 MainThread DEBUG nova.virt.hyperv.vmops [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Setting boot order for instance: instance-00000080: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:23:00.666 4088 3038363830232 MainThread DEBUG nova.virt.hyperv.vmops [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:23:00.709 4088 3038363830232 MainThread DEBUG os_win.utils.jobutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': '2BAF589E-AEB1-4B03-8ED6-698F696E108D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18037), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:23:00.853 4088 3038363830232 MainThread ERROR os_win.utils.jobutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000080\' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)instance-0000008099152188-98F3-4A4C-A460-6A70368362F612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)instance-0000008099152188-98F3-4A4C-A460-6A70368362F610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000080\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)instance-0000008099152188-98F3-4A4C-A460-6A70368362F6%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '2BAF589E-AEB1-4B03-8ED6-698F696E108D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111335), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 23), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 23), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000080' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)\n\nNot enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)\n\n'instance-00000080' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)", 'ErrorSummaryDescription': "'instance-00000080' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000080.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:23:00.853 4088 3038363830232 MainThread DEBUG os_win._utils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000080' failed to start. Not enough memory in the system to start the virtual machine instance-00000080. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000080' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Not enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) 'instance-00000080' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18759560585021973 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:23:00.853 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:23:00.853 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] VM Stopped (Lifecycle Event) 2021-09-10 17:23:00.881 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000080" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:00.881 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000080" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:00.897 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-f6217f72-ffd1-4c70-8ed5-82bf5a3658f0 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:23:00.900 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-f6217f72-ffd1-4c70-8ed5-82bf5a3658f0 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:23:00.944 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-f6217f72-ffd1-4c70-8ed5-82bf5a3658f0 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:23:00.957 4088 3038300761080 MainThread INFO nova.compute.manager [req-f6217f72-ffd1-4c70-8ed5-82bf5a3658f0 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:23:01.506 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:23:01.506 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:23:01.890 4088 3038363830232 MainThread DEBUG os_win.utils.jobutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': '2FC6ECDD-BA04-4C94-8EB5-7D0A16ADC032', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15475), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:23:02.026 4088 3038363830232 MainThread ERROR os_win.utils.jobutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000080\' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)instance-0000008099152188-98F3-4A4C-A460-6A70368362F612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)instance-0000008099152188-98F3-4A4C-A460-6A70368362F610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000080\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)instance-0000008099152188-98F3-4A4C-A460-6A70368362F6%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '2FC6ECDD-BA04-4C94-8EB5-7D0A16ADC032', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111780), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 23, 1), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 23, 1), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000080' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)\n\nNot enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)\n\n'instance-00000080' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)", 'ErrorSummaryDescription': "'instance-00000080' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000080.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:23:02.026 4088 3038363830232 MainThread DEBUG os_win._utils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000080' failed to start. Not enough memory in the system to start the virtual machine instance-00000080. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000080' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Not enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) 'instance-00000080' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3605294227600098 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:23:02.053 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000080" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:02.053 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000080" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:02.053 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:23:02.068 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] VM Stopped (Lifecycle Event) 2021-09-10 17:23:02.084 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-178400a2-a6c8-4758-bbf7-1b4d7845e5c2 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:23:02.084 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-178400a2-a6c8-4758-bbf7-1b4d7845e5c2 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:23:02.136 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-178400a2-a6c8-4758-bbf7-1b4d7845e5c2 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:23:02.155 4088 3038300761080 MainThread INFO nova.compute.manager [req-178400a2-a6c8-4758-bbf7-1b4d7845e5c2 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:23:03.054 4088 3038363830232 MainThread DEBUG os_win.utils.jobutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': '313B52DB-5BA4-4B04-AD5A-28185D79A1DA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15603), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:23:03.210 4088 3038363830232 MainThread ERROR os_win.utils.jobutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000080\' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)instance-0000008099152188-98F3-4A4C-A460-6A70368362F612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)instance-0000008099152188-98F3-4A4C-A460-6A70368362F610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000080\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)instance-0000008099152188-98F3-4A4C-A460-6A70368362F6%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '313B52DB-5BA4-4B04-AD5A-28185D79A1DA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119294), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 23, 3), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 23, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000080' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)\n\nNot enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)\n\n'instance-00000080' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)", 'ErrorSummaryDescription': "'instance-00000080' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000080.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:23:03.210 4088 3038363830232 MainThread DEBUG os_win._utils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000080' failed to start. Not enough memory in the system to start the virtual machine instance-00000080. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000080' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Not enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) 'instance-00000080' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5443453788757324 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:23:03.210 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000080" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:03.210 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000080" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:03.210 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:23:03.210 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] VM Stopped (Lifecycle Event) 2021-09-10 17:23:03.240 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-8b130839-7c2e-4950-8ce8-e98d03b93050 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:23:03.240 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-8b130839-7c2e-4950-8ce8-e98d03b93050 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:23:03.287 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-8b130839-7c2e-4950-8ce8-e98d03b93050 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:23:03.308 4088 3038300761080 MainThread INFO nova.compute.manager [req-8b130839-7c2e-4950-8ce8-e98d03b93050 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:23:03.500 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:23:03.557 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:23:04.240 4088 3038363830232 MainThread DEBUG os_win.utils.jobutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': 'BFA2F128-70F4-4FEA-8A9C-220087F9E034', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14592), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:23:04.383 4088 3038363830232 MainThread ERROR os_win.utils.jobutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000080\' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)instance-0000008099152188-98F3-4A4C-A460-6A70368362F612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)instance-0000008099152188-98F3-4A4C-A460-6A70368362F610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000080\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)instance-0000008099152188-98F3-4A4C-A460-6A70368362F6%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BFA2F128-70F4-4FEA-8A9C-220087F9E034', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112148), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 23, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 23, 4), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000080' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)\n\nNot enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)\n\n'instance-00000080' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)", 'ErrorSummaryDescription': "'instance-00000080' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000080.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:23:04.383 4088 3038363830232 MainThread DEBUG os_win._utils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000080' failed to start. Not enough memory in the system to start the virtual machine instance-00000080. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000080' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Not enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) 'instance-00000080' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7174952030181885 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:23:04.417 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:23:04.417 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] VM Stopped (Lifecycle Event) 2021-09-10 17:23:04.417 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000080" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:04.417 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000080" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:04.432 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-411878ba-69ec-4867-8038-0b2880c935b0 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:23:04.432 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-411878ba-69ec-4867-8038-0b2880c935b0 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:23:04.479 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-411878ba-69ec-4867-8038-0b2880c935b0 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:23:04.510 4088 3038300761080 MainThread INFO nova.compute.manager [req-411878ba-69ec-4867-8038-0b2880c935b0 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:23:04.555 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:23:05.417 4088 3038363830232 MainThread DEBUG os_win.utils.jobutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': '01DE851D-4BFD-41D0-95C6-9EC791264D05', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15686), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:23:05.506 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:23:05.557 4088 3038363830232 MainThread ERROR os_win.utils.jobutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000080\' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)instance-0000008099152188-98F3-4A4C-A460-6A70368362F612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)instance-0000008099152188-98F3-4A4C-A460-6A70368362F610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000080\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)instance-0000008099152188-98F3-4A4C-A460-6A70368362F6%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '01DE851D-4BFD-41D0-95C6-9EC791264D05', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110049), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 23, 5), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 23, 5), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000080' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)\n\nNot enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)\n\n'instance-00000080' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)", 'ErrorSummaryDescription': "'instance-00000080' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000080.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:23:05.557 4088 3038363830232 MainThread DEBUG os_win._utils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000080' failed to start. Not enough memory in the system to start the virtual machine instance-00000080. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000080' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Not enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) 'instance-00000080' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.8909912109375 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:23:05.570 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000080" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:05.600 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000080" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:05.601 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:23:05.601 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] VM Stopped (Lifecycle Event) 2021-09-10 17:23:05.601 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-384acb23-724f-469d-bf91-b0e7f856c880 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:23:05.601 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-384acb23-724f-469d-bf91-b0e7f856c880 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:23:05.662 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-384acb23-724f-469d-bf91-b0e7f856c880 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:23:05.682 4088 3038300761080 MainThread INFO nova.compute.manager [req-384acb23-724f-469d-bf91-b0e7f856c880 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:23:06.490 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:23:06.591 4088 3038363830232 MainThread DEBUG os_win.utils.jobutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': 'FA2DA9D4-C293-447E-BCF2-1C95F4220CF0', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14974), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:23:06.725 4088 3038363830232 MainThread ERROR os_win.utils.jobutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000080\' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)instance-0000008099152188-98F3-4A4C-A460-6A70368362F612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)instance-0000008099152188-98F3-4A4C-A460-6A70368362F610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000080\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)instance-0000008099152188-98F3-4A4C-A460-6A70368362F6%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'FA2DA9D4-C293-447E-BCF2-1C95F4220CF0', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112120), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 23, 6), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 23, 6), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000080' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)\n\nNot enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)\n\n'instance-00000080' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6)", 'ErrorSummaryDescription': "'instance-00000080' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000080.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:23:06.725 4088 3038363830232 MainThread ERROR nova.virt.hyperv.vmops [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Failed to change vm state of instance-00000080 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000080' failed to start. 2021-09-10 17:23:06.725 4088 3038363830232 MainThread INFO nova.virt.hyperv.vmops [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Got request to destroy instance 2021-09-10 17:23:06.761 4088 3038300761080 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:23:06.761 4088 3038300761080 MainThread INFO nova.compute.manager [-] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] VM Stopped (Lifecycle Event) 2021-09-10 17:23:06.761 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000080" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:06.761 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000080" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:06.783 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-2157c644-05ba-4018-89bc-c740ee102c21 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:23:06.783 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-2157c644-05ba-4018-89bc-c740ee102c21 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:23:06.839 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-2157c644-05ba-4018-89bc-c740ee102c21 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:23:06.854 4088 3038300761080 MainThread INFO nova.compute.manager [req-2157c644-05ba-4018-89bc-c740ee102c21 - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:23:07.494 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:23:08.544 4088 3038363830232 MainThread DEBUG nova.virt.hyperv.vmops [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:23:08.544 4088 3038363830232 MainThread DEBUG oslo_concurrency.lockutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000080" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:08.544 4088 3038363830232 MainThread DEBUG oslo_concurrency.lockutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000080" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:08.573 4088 3038363830232 MainThread DEBUG os_win.utils.compute.vmutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Successfully changed vm state of instance-00000080 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:23:08.573 4088 3038363830232 MainThread DEBUG nova.virt.hyperv.vmops [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Successfully changed state of VM instance-00000080 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:23:08.606 4088 3038363830232 MainThread DEBUG os_win.utils.jobutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': '952BBEE6-B53D-418C-8595-2AF9EECCEAA8', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14358), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:23:08.718 4088 3038363830232 MainThread DEBUG os_win.utils.jobutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job succeeded: {'InstanceID': '952BBEE6-B53D-418C-8595-2AF9EECCEAA8', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=111185), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:23:08.718 4088 3038363830232 MainThread DEBUG oslo_concurrency.lockutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000080" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:08.718 4088 3038363830232 MainThread DEBUG os_win.utils.pathutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Removing directory: C:\openstack\instances\instance-00000080 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:23:08.718 4088 3038363830232 MainThread DEBUG oslo_concurrency.lockutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000080" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:08.740 4088 3038363830232 MainThread ERROR nova.compute.manager [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000080' failed to start. Not enough memory in the system to start the virtual machine instance-00000080. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000080' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Not enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) 'instance-00000080' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Error code: 32778. 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Traceback (most recent call last): 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] return function(*args, **kwargs) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] admin_password, network_info, block_device_info) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] return function(self, *args, **kwds) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self.force_reraise() 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] raise self.value 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] should_plug_vifs=False) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 'req_state': req_state}) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self.force_reraise() 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] raise self.value 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] time.sleep(sleep_time) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self.force_reraise() 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] raise self.value 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] return f(*args, **kwargs) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] return self._wait_for_job(job_path) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] error_desc=err_desc) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000080' failed to start. 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Not enough memory in the system to start the virtual machine instance-00000080. 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000080' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Not enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 'instance-00000080' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Error code: 32778. 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] During handling of the above exception, another exception occurred: 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Traceback (most recent call last): 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] yield resources 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] accel_info=accel_info) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] return function(*args, **kwargs) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] admin_password, network_info, block_device_info) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] return function(self, *args, **kwds) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self.force_reraise() 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] raise self.value 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] should_plug_vifs=False) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 'req_state': req_state}) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self.force_reraise() 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] raise self.value 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] time.sleep(sleep_time) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self.force_reraise() 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] raise self.value 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] return f(*args, **kwargs) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] return self._wait_for_job(job_path) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] error_desc=err_desc) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000080' failed to start. 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Not enough memory in the system to start the virtual machine instance-00000080. 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000080' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Not enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 'instance-00000080' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Error code: 32778. 2021-09-10 17:23:08.740 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:08.748 4088 3038363830232 MainThread INFO nova.compute.manager [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Terminating instance 2021-09-10 17:23:08.748 4088 3038363830232 MainThread DEBUG nova.compute.manager [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:23:08.748 4088 3038363830232 MainThread INFO nova.virt.hyperv.vmops [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Got request to destroy instance 2021-09-10 17:23:08.748 4088 3038363830232 MainThread DEBUG nova.virt.hyperv.vmops [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:23:08.748 4088 3038363830232 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-53065bd6-c434-4af7-8c93-3a704bbd9a51', 'target_lun': 0, 'volume_id': '53065bd6-c434-4af7-8c93-3a704bbd9a51', 'auth_method': 'CHAP', 'auth_username': 'f9Q3UXsa8jpzy5QsH5BW', 'auth_password': '***', 'encrypted': True, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:23:08.748 4088 3038363830232 MainThread DEBUG os_win.utils.storage.diskutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:23:08.850 4088 3038363830232 MainThread DEBUG os_win.utils.storage.diskutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:23:08.870 4088 3038363830232 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-53065bd6-c434-4af7-8c93-3a704bbd9a51 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 17:23:08.936 4088 3038363830232 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Removing iSCSI target persistent login: iqn.2010-10.org.openstack:volume-53065bd6-c434-4af7-8c93-3a704bbd9a51 _remove_target_persistent_logins c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:495 2021-09-10 17:23:08.936 4088 3038363830232 MainThread DEBUG os_brick.initiator.windows.iscsi [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] <== disconnect_volume: return (187ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:23:08.936 4088 3038363830232 MainThread DEBUG oslo_concurrency.lockutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000080" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:08.936 4088 3038363830232 MainThread DEBUG oslo_concurrency.lockutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000080" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:08.946 4088 3038363830232 MainThread INFO nova.compute.manager [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Took 0.20 seconds to destroy the instance on the hypervisor. 2021-09-10 17:23:10.495 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:23:10.495 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:23:10.495 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9342 2021-09-10 17:23:10.540 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Skipping network cache update for instance because it is Building. _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9352 2021-09-10 17:23:10.599 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-18930e09-cd62-4d3e-b27f-e9541dfa3efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:23:10.599 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:23:10.599 4088 3038296676664 GreenThread-2 DEBUG nova.objects.instance [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lazy-loading 'info_cache' on Instance uuid 18930e09-cd62-4d3e-b27f-e9541dfa3efc obj_load_attr c:\openstack\build\nova\nova\objects\instance.py:1101 2021-09-10 17:23:11.172 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Updating instance_info_cache with network_info: [{"id": "829c891f-1877-4967-a719-113170bb7add", "address": "fa:16:3e:5d:ef:74", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap829c891f-18", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:23:11.196 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-18930e09-cd62-4d3e-b27f-e9541dfa3efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:23:11.196 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:23:11.196 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:23:11.196 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:11.196 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:11.196 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:23:11.196 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:23:11.229 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:23:11.459 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2224MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:23:11.459 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:11.620 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:23:11.620 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:23:11.620 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:23:11.620 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:23:11.646 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:23:11.646 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:23:11.646 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:23:11.646 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:23:11.646 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:23:11.646 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:23:11.650 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:23:11.650 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:23:11.650 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:23:11.650 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance df9dee3f-cee2-4374-b88f-571d3da1198c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:23:11.650 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:23:11.650 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:23:11.667 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:23:11.683 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:23:11.723 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-776b617e-0a11-4b64-a197-140fd6449d22 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Received event network-vif-unplugged-be7ad636-2e88-4ae0-8c73-fe6332d60409 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:23:11.723 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-776b617e-0a11-4b64-a197-140fd6449d22 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "df9dee3f-cee2-4374-b88f-571d3da1198c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:11.723 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-776b617e-0a11-4b64-a197-140fd6449d22 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "df9dee3f-cee2-4374-b88f-571d3da1198c-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:11.723 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-776b617e-0a11-4b64-a197-140fd6449d22 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] No waiting events found dispatching network-vif-unplugged-be7ad636-2e88-4ae0-8c73-fe6332d60409 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:23:11.723 4088 3038300758440 MainThread WARNING nova.compute.manager [req-776b617e-0a11-4b64-a197-140fd6449d22 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Received unexpected event network-vif-unplugged-be7ad636-2e88-4ae0-8c73-fe6332d60409 for instance with vm_state building and task_state spawning. 2021-09-10 17:23:11.886 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:23:11.915 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:23:11.915 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:23:11.915 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:12.482 4088 3038363830232 MainThread INFO nova.compute.manager [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Took 3.53 seconds to detach 1 volumes for instance. 2021-09-10 17:23:12.482 4088 3038363830232 MainThread DEBUG nova.compute.claims [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:23:12.482 4088 3038363830232 MainThread DEBUG oslo_concurrency.lockutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:12.589 4088 3038363830232 MainThread DEBUG nova.virt.hyperv.hostops [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:23:12.604 4088 3038363830232 MainThread DEBUG nova.virt.hyperv.hostops [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:23:12.808 4088 3038363830232 MainThread DEBUG nova.compute.provider_tree [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:23:12.808 4088 3038363830232 MainThread DEBUG nova.scheduler.client.report [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:23:12.808 4088 3038363830232 MainThread DEBUG oslo_concurrency.lockutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:12.808 4088 3038363830232 MainThread ERROR nova.compute.manager [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000080' failed to start. Not enough memory in the system to start the virtual machine instance-00000080. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000080' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Not enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) 'instance-00000080' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Error code: 32778. 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Traceback (most recent call last): 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] return function(*args, **kwargs) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] admin_password, network_info, block_device_info) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] return function(self, *args, **kwds) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self.force_reraise() 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] raise self.value 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] should_plug_vifs=False) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 'req_state': req_state}) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self.force_reraise() 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] raise self.value 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] time.sleep(sleep_time) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self.force_reraise() 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] raise self.value 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] return f(*args, **kwargs) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] return self._wait_for_job(job_path) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] error_desc=err_desc) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000080' failed to start. 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Not enough memory in the system to start the virtual machine instance-00000080. 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000080' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Not enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 'instance-00000080' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Error code: 32778. 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] During handling of the above exception, another exception occurred: 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Traceback (most recent call last): 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] accel_info=accel_info) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] return function(*args, **kwargs) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] admin_password, network_info, block_device_info) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] return function(self, *args, **kwds) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self.force_reraise() 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] raise self.value 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] should_plug_vifs=False) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 'req_state': req_state}) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self.force_reraise() 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] raise self.value 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] time.sleep(sleep_time) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self.force_reraise() 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] raise self.value 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] return f(*args, **kwargs) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] return self._wait_for_job(job_path) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] error_desc=err_desc) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000080' failed to start. 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Not enough memory in the system to start the virtual machine instance-00000080. 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000080' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Not enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 'instance-00000080' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Error code: 32778. 2021-09-10 17:23:12.808 4088 3038363830232 MainThread TRACE nova.compute.manager [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] 2021-09-10 17:23:12.827 4088 3038363830232 MainThread DEBUG nova.compute.utils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] WMI job failed with status 10. Error summary description: 'instance-00000080' failed to start. Not enough memory in the system to start the virtual machine instance-00000080. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:23:12.827 4088 3038363830232 MainThread DEBUG nova.compute.manager [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Build of instance df9dee3f-cee2-4374-b88f-571d3da1198c was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000080' failed to start. Not enough memory in the system to start the virtual machine instance-00000080. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000080' failed to start. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Not enough memory in the system to start the virtual machine instance-00000080 with ram size 1024 megabytes. (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) 'instance-00000080' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 99152188-98F3-4A4C-A460-6A70368362F6) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:23:12.827 4088 3038363830232 MainThread DEBUG nova.compute.manager [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:23:12.827 4088 3038363830232 MainThread DEBUG nova.compute.manager [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:23:12.827 4088 3038363830232 MainThread DEBUG nova.compute.manager [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:23:12.827 4088 3038363830232 MainThread DEBUG nova.network.neutron [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:23:13.370 4088 3038363830232 MainThread DEBUG nova.network.neutron [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:23:13.386 4088 3038363830232 MainThread INFO nova.compute.manager [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: df9dee3f-cee2-4374-b88f-571d3da1198c] Took 0.55 seconds to deallocate network for instance. 2021-09-10 17:23:13.573 4088 3038363830232 MainThread INFO nova.scheduler.client.report [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Deleted allocations for instance df9dee3f-cee2-4374-b88f-571d3da1198c 2021-09-10 17:23:13.605 4088 3038363830232 MainThread DEBUG oslo_concurrency.lockutils [req-6dd6b3ca-f9a8-42d0-aafc-88a4afe66762 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "df9dee3f-cee2-4374-b88f-571d3da1198c" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 31.078s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:21.755 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:23:35.737 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "2196beef-9303-4ce4-a818-d05db0f89d55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:35.759 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:23:35.823 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:35.848 4088 3038340490696 MainThread DEBUG nova.virt.hardware [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:23:35.848 4088 3038340490696 MainThread INFO nova.compute.claims [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Claim successful on node n-h2-808474-1 2021-09-10 17:23:35.933 4088 3038340490696 MainThread DEBUG nova.virt.hyperv.hostops [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:23:35.973 4088 3038340490696 MainThread DEBUG nova.virt.hyperv.hostops [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:23:36.169 4088 3038340490696 MainThread DEBUG nova.compute.provider_tree [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:23:36.192 4088 3038340490696 MainThread DEBUG nova.scheduler.client.report [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:23:36.192 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:36.192 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:23:36.228 4088 3038340490696 MainThread DEBUG nova.compute.utils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Using /dev/sd instead of None get_next_device_name c:\openstack\build\nova\nova\compute\utils.py:239 2021-09-10 17:23:36.254 4088 3038340489464 GreenThread-118 DEBUG nova.compute.manager [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:23:36.254 4088 3038340489464 GreenThread-118 DEBUG nova.network.neutron [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:23:36.258 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:23:36.322 4088 3038340490696 MainThread INFO nova.virt.block_device [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Booting with volume snapshot ce77ec51-1f9c-42ef-b7e1-dfc4f52e11b1 at /dev/sda 2021-09-10 17:23:36.369 4088 3038340489464 GreenThread-118 DEBUG nova.policy [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82eacb807eb449a28e17290cd4d841d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0aa6ac8af84d7291f244f216bb94b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:23:37.036 4088 3038340489464 GreenThread-118 DEBUG nova.network.neutron [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Successfully created port: 4231bc99-297d-42f9-9101-a7baecbe3376 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:23:37.681 4088 3038340489464 GreenThread-118 DEBUG nova.network.neutron [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Successfully updated port: 4231bc99-297d-42f9-9101-a7baecbe3376 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:23:37.708 4088 3038340489464 GreenThread-118 DEBUG oslo_concurrency.lockutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Acquired lock "refresh_cache-2196beef-9303-4ce4-a818-d05db0f89d55" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:23:37.708 4088 3038340489464 GreenThread-118 DEBUG nova.network.neutron [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:23:37.759 4088 3038340489816 MainThread DEBUG nova.compute.manager [req-ffc95425-6afd-40c8-af4f-aaa65ce54967 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Received event network-changed-4231bc99-297d-42f9-9101-a7baecbe3376 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:23:37.759 4088 3038340489816 MainThread DEBUG nova.compute.manager [req-ffc95425-6afd-40c8-af4f-aaa65ce54967 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Refreshing instance network info cache due to event network-changed-4231bc99-297d-42f9-9101-a7baecbe3376. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:23:37.802 4088 3038340489464 GreenThread-118 DEBUG nova.network.neutron [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:23:38.178 4088 3038340489464 GreenThread-118 DEBUG nova.network.neutron [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Updating instance_info_cache with network_info: [{"id": "4231bc99-297d-42f9-9101-a7baecbe3376", "address": "fa:16:3e:9e:2a:e6", "network": {"id": "385c7b14-693f-45e3-86cf-8a54c842098b", "bridge": null, "label": "tempest-TestVolumeBootPattern-577893151-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d0aa6ac8af84d7291f244f216bb94b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4231bc99-29", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:23:38.197 4088 3038340489464 GreenThread-118 DEBUG oslo_concurrency.lockutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Releasing lock "refresh_cache-2196beef-9303-4ce4-a818-d05db0f89d55" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:23:38.197 4088 3038340489464 GreenThread-118 DEBUG nova.compute.manager [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Instance network_info: |[{"id": "4231bc99-297d-42f9-9101-a7baecbe3376", "address": "fa:16:3e:9e:2a:e6", "network": {"id": "385c7b14-693f-45e3-86cf-8a54c842098b", "bridge": null, "label": "tempest-TestVolumeBootPattern-577893151-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d0aa6ac8af84d7291f244f216bb94b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4231bc99-29", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:23:38.197 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-ffc95425-6afd-40c8-af4f-aaa65ce54967 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-2196beef-9303-4ce4-a818-d05db0f89d55" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:23:38.197 4088 3038340489816 MainThread DEBUG nova.network.neutron [req-ffc95425-6afd-40c8-af4f-aaa65ce54967 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Refreshing network info cache for port 4231bc99-297d-42f9-9101-a7baecbe3376 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:23:38.712 4088 3038340489816 MainThread DEBUG nova.network.neutron [req-ffc95425-6afd-40c8-af4f-aaa65ce54967 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Updated VIF entry in instance network info cache for port 4231bc99-297d-42f9-9101-a7baecbe3376. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:23:38.712 4088 3038340489816 MainThread DEBUG nova.network.neutron [req-ffc95425-6afd-40c8-af4f-aaa65ce54967 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Updating instance_info_cache with network_info: [{"id": "4231bc99-297d-42f9-9101-a7baecbe3376", "address": "fa:16:3e:9e:2a:e6", "network": {"id": "385c7b14-693f-45e3-86cf-8a54c842098b", "bridge": null, "label": "tempest-TestVolumeBootPattern-577893151-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d0aa6ac8af84d7291f244f216bb94b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4231bc99-29", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:23:38.728 4088 3038340489816 MainThread DEBUG oslo_concurrency.lockutils [req-ffc95425-6afd-40c8-af4f-aaa65ce54967 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-2196beef-9303-4ce4-a818-d05db0f89d55" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:23:46.082 4088 3038340490696 MainThread DEBUG os_brick.utils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:23:46.098 4088 3038340490696 MainThread DEBUG os_brick.utils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] <== get_connector_properties: return (15ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:23:46.098 4088 3038340490696 MainThread DEBUG nova.virt.block_device [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Updating existing volume attachment record: 4eee5154-82af-4f2d-a807-27c93f3d6642 _volume_attach c:\openstack\build\nova\nova\virt\block_device.py:556 2021-09-10 17:23:50.603 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Lock "82618a53-c60b-4a16-8224-464db13061d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:50.603 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:23:50.707 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:50.712 4088 3038340492280 MainThread DEBUG nova.virt.hardware [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:23:50.712 4088 3038340492280 MainThread INFO nova.compute.claims [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Claim successful on node n-h2-808474-1 2021-09-10 17:23:50.807 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.hostops [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:23:50.832 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.hostops [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:23:51.036 4088 3038340492280 MainThread DEBUG nova.compute.provider_tree [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:23:51.036 4088 3038340492280 MainThread DEBUG nova.scheduler.client.report [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:23:51.036 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:51.036 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:23:51.114 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:23:51.114 4088 3038340489992 GreenThread-119 DEBUG nova.compute.manager [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:23:51.114 4088 3038340489992 GreenThread-119 DEBUG nova.network.neutron [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:23:51.178 4088 3038340492280 MainThread INFO nova.virt.block_device [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Booting with volume 70f42dc2-02c6-4ce3-9c41-d23f15c09a93 at /dev/sda 2021-09-10 17:23:51.227 4088 3038340489992 GreenThread-119 DEBUG nova.policy [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c27ee1b52b274727b6211034f9223342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f6adcb5eeb4af58d2b79814528b63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:23:51.250 4088 3038340492280 MainThread DEBUG os_brick.utils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:23:51.250 4088 3038340492280 MainThread DEBUG os_brick.utils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] <== get_connector_properties: return (0ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:23:51.250 4088 3038340492280 MainThread DEBUG nova.virt.block_device [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Updating existing volume attachment record: 4f415ddc-f725-4e5e-b179-59bddbc97fab _volume_attach c:\openstack\build\nova\nova\virt\block_device.py:556 2021-09-10 17:23:51.886 4088 3038340489992 GreenThread-119 DEBUG nova.network.neutron [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Successfully created port: 1a4e82b0-eab3-4fbf-86ef-ebad6222e375 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:23:52.572 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:23:52.603 4088 3038340490696 MainThread INFO nova.virt.hyperv.vmops [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Spawning new instance 2021-09-10 17:23:52.603 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000082" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:52.603 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000082" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:52.603 4088 3038340490696 MainThread DEBUG nova.block_device [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] block_device_list ['sda'] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:23:52.603 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Preparing to wait for external event network-vif-plugged-4231bc99-297d-42f9-9101-a7baecbe3376 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:23:52.603 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "2196beef-9303-4ce4-a818-d05db0f89d55-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:52.603 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "2196beef-9303-4ce4-a818-d05db0f89d55-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:52.603 4088 3038340490696 MainThread DEBUG os_win.utils.compute.vmutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Creating VM instance-00000082 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:23:52.856 4088 3038340489992 GreenThread-119 DEBUG nova.network.neutron [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Successfully updated port: 1a4e82b0-eab3-4fbf-86ef-ebad6222e375 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:23:52.884 4088 3038340489992 GreenThread-119 DEBUG oslo_concurrency.lockutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Acquired lock "refresh_cache-82618a53-c60b-4a16-8224-464db13061d1" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:23:52.884 4088 3038340489992 GreenThread-119 DEBUG nova.network.neutron [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:23:52.930 4088 3038342146360 MainThread DEBUG nova.compute.manager [req-286d2b7e-a1ef-4bc8-bf6e-1873eecb6e8b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Received event network-changed-1a4e82b0-eab3-4fbf-86ef-ebad6222e375 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:23:52.930 4088 3038342146360 MainThread DEBUG nova.compute.manager [req-286d2b7e-a1ef-4bc8-bf6e-1873eecb6e8b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Refreshing instance network info cache due to event network-changed-1a4e82b0-eab3-4fbf-86ef-ebad6222e375. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:23:52.945 4088 3038340489992 GreenThread-119 DEBUG nova.network.neutron [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:23:53.333 4088 3038340489992 GreenThread-119 DEBUG nova.network.neutron [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Updating instance_info_cache with network_info: [{"id": "1a4e82b0-eab3-4fbf-86ef-ebad6222e375", "address": "fa:16:3e:84:cc:2b", "network": {"id": "394225f6-b2a5-41e0-bc05-3afc686320e7", "bridge": null, "label": "tempest-TestVolumeBackupRestore-402230705-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a7f6adcb5eeb4af58d2b79814528b63b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap1a4e82b0-ea", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:23:53.353 4088 3038340489992 GreenThread-119 DEBUG oslo_concurrency.lockutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Releasing lock "refresh_cache-82618a53-c60b-4a16-8224-464db13061d1" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:23:53.353 4088 3038340489992 GreenThread-119 DEBUG nova.compute.manager [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Instance network_info: |[{"id": "1a4e82b0-eab3-4fbf-86ef-ebad6222e375", "address": "fa:16:3e:84:cc:2b", "network": {"id": "394225f6-b2a5-41e0-bc05-3afc686320e7", "bridge": null, "label": "tempest-TestVolumeBackupRestore-402230705-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a7f6adcb5eeb4af58d2b79814528b63b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap1a4e82b0-ea", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:23:53.353 4088 3038342146360 MainThread DEBUG oslo_concurrency.lockutils [req-286d2b7e-a1ef-4bc8-bf6e-1873eecb6e8b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-82618a53-c60b-4a16-8224-464db13061d1" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:23:53.353 4088 3038342146360 MainThread DEBUG nova.network.neutron [req-286d2b7e-a1ef-4bc8-bf6e-1873eecb6e8b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Refreshing network info cache for port 1a4e82b0-eab3-4fbf-86ef-ebad6222e375 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:23:53.650 4088 3038340490696 MainThread DEBUG nova.virt.hyperv.volumeops [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Attaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-1ea6abf8-e7b9-42f9-b32a-c9e896b83f11', 'target_lun': 0, 'volume_id': '1ea6abf8-e7b9-42f9-b32a-c9e896b83f11', 'auth_method': 'CHAP', 'auth_username': 'YHQSuHP3q8WfRu6F79dD', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'reserved', 'instance': '2196beef-9303-4ce4-a818-d05db0f89d55', 'attached_at': '', 'detached_at': '', 'volume_id': '1ea6abf8-e7b9-42f9-b32a-c9e896b83f11', 'serial': '1ea6abf8-e7b9-42f9-b32a-c9e896b83f11'} to instance-00000082 _attach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:108 2021-09-10 17:23:53.665 4088 3038340490696 MainThread DEBUG os_brick.initiator.windows.iscsi [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-1ea6abf8-e7b9-42f9-b32a-c9e896b83f11', 'target_lun': 0, 'volume_id': '1ea6abf8-e7b9-42f9-b32a-c9e896b83f11', 'auth_method': 'CHAP', 'auth_username': 'YHQSuHP3q8WfRu6F79dD', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:23:53.665 4088 3038340490696 MainThread INFO os_brick.initiator.windows.iscsi [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Attempting to establish an iSCSI session to target iqn.2010-10.org.openstack:volume-1ea6abf8-e7b9-42f9-b32a-c9e896b83f11 on portal 10.222.0.55:3260 accessing LUN 0 using initiator None. 2021-09-10 17:23:53.665 4088 3038340490696 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Logging in iSCSI target iqn.2010-10.org.openstack:volume-1ea6abf8-e7b9-42f9-b32a-c9e896b83f11 login_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:401 2021-09-10 17:23:53.879 4088 3038342146360 MainThread DEBUG nova.network.neutron [req-286d2b7e-a1ef-4bc8-bf6e-1873eecb6e8b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Updated VIF entry in instance network info cache for port 1a4e82b0-eab3-4fbf-86ef-ebad6222e375. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:23:53.879 4088 3038342146360 MainThread DEBUG nova.network.neutron [req-286d2b7e-a1ef-4bc8-bf6e-1873eecb6e8b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Updating instance_info_cache with network_info: [{"id": "1a4e82b0-eab3-4fbf-86ef-ebad6222e375", "address": "fa:16:3e:84:cc:2b", "network": {"id": "394225f6-b2a5-41e0-bc05-3afc686320e7", "bridge": null, "label": "tempest-TestVolumeBackupRestore-402230705-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a7f6adcb5eeb4af58d2b79814528b63b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap1a4e82b0-ea", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:23:53.892 4088 3038342146360 MainThread DEBUG oslo_concurrency.lockutils [req-286d2b7e-a1ef-4bc8-bf6e-1873eecb6e8b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-82618a53-c60b-4a16-8224-464db13061d1" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:23:55.806 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:23:55.822 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Spawning new instance 2021-09-10 17:23:55.822 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Lock "instance-00000081" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:55.822 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Lock "instance-00000081" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:55.822 4088 3038340492280 MainThread DEBUG nova.block_device [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] block_device_list ['sda'] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:23:55.822 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Preparing to wait for external event network-vif-plugged-1a4e82b0-eab3-4fbf-86ef-ebad6222e375 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:23:55.822 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Lock "82618a53-c60b-4a16-8224-464db13061d1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:23:55.822 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Lock "82618a53-c60b-4a16-8224-464db13061d1-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:23:55.822 4088 3038340492280 MainThread DEBUG os_win.utils.compute.vmutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Creating VM instance-00000081 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:23:56.897 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.volumeops [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Attaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-70f42dc2-02c6-4ce3-9c41-d23f15c09a93', 'target_lun': 0, 'volume_id': '70f42dc2-02c6-4ce3-9c41-d23f15c09a93', 'auth_method': 'CHAP', 'auth_username': 'oNjfgyfFJpA46Qn36YH2', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'reserved', 'instance': '82618a53-c60b-4a16-8224-464db13061d1', 'attached_at': '', 'detached_at': '', 'volume_id': '70f42dc2-02c6-4ce3-9c41-d23f15c09a93', 'serial': '70f42dc2-02c6-4ce3-9c41-d23f15c09a93'} to instance-00000081 _attach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:108 2021-09-10 17:23:56.897 4088 3038340492280 MainThread DEBUG os_brick.initiator.windows.iscsi [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-70f42dc2-02c6-4ce3-9c41-d23f15c09a93', 'target_lun': 0, 'volume_id': '70f42dc2-02c6-4ce3-9c41-d23f15c09a93', 'auth_method': 'CHAP', 'auth_username': 'oNjfgyfFJpA46Qn36YH2', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:23:56.897 4088 3038340492280 MainThread INFO os_brick.initiator.windows.iscsi [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Attempting to establish an iSCSI session to target iqn.2010-10.org.openstack:volume-70f42dc2-02c6-4ce3-9c41-d23f15c09a93 on portal 10.222.0.55:3260 accessing LUN 0 using initiator None. 2021-09-10 17:23:56.897 4088 3038340492280 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Logging in iSCSI target iqn.2010-10.org.openstack:volume-70f42dc2-02c6-4ce3-9c41-d23f15c09a93 login_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:401 2021-09-10 17:23:58.676 4088 3038340490696 MainThread DEBUG os_win.utils.storage.diskutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:23:58.821 4088 3038340490696 MainThread DEBUG os_win.utils.storage.diskutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:23:58.868 4088 3038340490696 MainThread DEBUG os_brick.initiator.windows.iscsi [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] <== connect_volume: return (5203ms) {'type': 'block', 'path': '\\\\.\\PhysicalDrive1', 'number': 1, 'scsi_wwn': '36001405D365D2453AE342AABE45DF38C'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:23:59.524 4088 3038340490696 MainThread DEBUG nova.virt.hyperv.vmops [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:23:59.540 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:24:01.941 4088 3038340492280 MainThread DEBUG os_win.utils.storage.diskutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:24:02.035 4088 3038340492280 MainThread DEBUG os_win.utils.storage.diskutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:24:02.066 4088 3038340492280 MainThread DEBUG os_brick.initiator.windows.iscsi [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] <== connect_volume: return (5169ms) {'type': 'block', 'path': '\\\\.\\PhysicalDrive2', 'number': 2, 'scsi_wwn': '360014059CA4AFE2A3194BD5B6A1EC3D7'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:24:02.709 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:24:03.509 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:24:03.509 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:24:03.509 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:24:04.488 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:24:05.896 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-e0b7e4a7-24b4-4a0b-ad5a-92892a12566e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Received event network-vif-plugged-4231bc99-297d-42f9-9101-a7baecbe3376 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:24:05.896 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-e0b7e4a7-24b4-4a0b-ad5a-92892a12566e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "2196beef-9303-4ce4-a818-d05db0f89d55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:05.896 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-e0b7e4a7-24b4-4a0b-ad5a-92892a12566e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "2196beef-9303-4ce4-a818-d05db0f89d55-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:05.896 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-e0b7e4a7-24b4-4a0b-ad5a-92892a12566e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Processing event network-vif-plugged-4231bc99-297d-42f9-9101-a7baecbe3376 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:24:05.932 4088 3038340490696 MainThread INFO nova.virt.hyperv.vmops [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Using config drive for instance 2021-09-10 17:24:06.050 4088 3038340490696 MainThread INFO nova.virt.hyperv.vmops [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Creating config drive at C:\openstack\instances\instance-00000082\configdrive.iso 2021-09-10 17:24:06.132 4088 3038340490696 MainThread DEBUG oslo_concurrency.processutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000082\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp92j78vej execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:24:06.443 4088 3038340490696 MainThread DEBUG oslo_concurrency.processutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000082\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp92j78vej" returned: 0 in 0.313s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:24:06.503 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:24:06.947 4088 3038340490696 MainThread DEBUG nova.virt.hyperv.vmops [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Setting boot order for instance: instance-00000082: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:24:07.033 4088 3038340490696 MainThread DEBUG nova.virt.hyperv.vmops [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:24:07.073 4088 3038340490696 MainThread DEBUG os_win.utils.jobutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': '6D430E83-BF0C-46DC-AC1B-5D13D3A4D3E4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19153), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:24:07.192 4088 3038340490696 MainThread ERROR os_win.utils.jobutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000082\' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)instance-000000829BF62CBE-7F5D-4570-8A4F-10B1D169B02D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)instance-000000829BF62CBE-7F5D-4570-8A4F-10B1D169B02D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000082\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)instance-000000829BF62CBE-7F5D-4570-8A4F-10B1D169B02D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6D430E83-BF0C-46DC-AC1B-5D13D3A4D3E4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112274), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 24, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 24, 7), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000082' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)\n\nNot enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)\n\n'instance-00000082' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)", 'ErrorSummaryDescription': "'instance-00000082' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000082.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:24:07.192 4088 3038340490696 MainThread DEBUG os_win._utils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000082' failed to start. Not enough memory in the system to start the virtual machine instance-00000082. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000082' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Not enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) 'instance-00000082' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.15927791595458984 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:24:07.238 4088 3038340491752 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:24:07.238 4088 3038340491752 MainThread INFO nova.compute.manager [-] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] VM Stopped (Lifecycle Event) 2021-09-10 17:24:07.238 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000082" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:07.238 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000082" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:07.259 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-f22f6089-7e87-4d3c-a245-d0b437e2ce94 - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:24:07.259 4088 3038340491752 MainThread DEBUG nova.virt.hyperv.vmops [req-f22f6089-7e87-4d3c-a245-d0b437e2ce94 - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:24:07.302 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-f22f6089-7e87-4d3c-a245-d0b437e2ce94 - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:24:07.302 4088 3038340491752 MainThread INFO nova.compute.manager [req-f22f6089-7e87-4d3c-a245-d0b437e2ce94 - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:24:07.488 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:24:07.957 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-c29af77a-7450-44ba-b8b6-d908e21ae8fb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Received event network-vif-plugged-1a4e82b0-eab3-4fbf-86ef-ebad6222e375 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:24:07.957 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [req-c29af77a-7450-44ba-b8b6-d908e21ae8fb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "82618a53-c60b-4a16-8224-464db13061d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:07.957 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [req-c29af77a-7450-44ba-b8b6-d908e21ae8fb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "82618a53-c60b-4a16-8224-464db13061d1-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:07.957 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-c29af77a-7450-44ba-b8b6-d908e21ae8fb 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Processing event network-vif-plugged-1a4e82b0-eab3-4fbf-86ef-ebad6222e375 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:24:07.994 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Using config drive for instance 2021-09-10 17:24:08.087 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Creating config drive at C:\openstack\instances\instance-00000081\configdrive.iso 2021-09-10 17:24:08.196 4088 3038340492280 MainThread DEBUG oslo_concurrency.processutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000081\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpi68bndp3 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:24:08.379 4088 3038340490696 MainThread DEBUG os_win.utils.jobutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': 'B9C79A5C-3C23-415E-92E9-DCC1DB0E9591', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14790), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:24:08.494 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:24:08.518 4088 3038340492280 MainThread DEBUG oslo_concurrency.processutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000081\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpi68bndp3" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:24:08.541 4088 3038340490696 MainThread ERROR os_win.utils.jobutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000082\' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)instance-000000829BF62CBE-7F5D-4570-8A4F-10B1D169B02D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)instance-000000829BF62CBE-7F5D-4570-8A4F-10B1D169B02D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000082\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)instance-000000829BF62CBE-7F5D-4570-8A4F-10B1D169B02D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B9C79A5C-3C23-415E-92E9-DCC1DB0E9591', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113516), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 24, 8), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 24, 8), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000082' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)\n\nNot enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)\n\n'instance-00000082' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)", 'ErrorSummaryDescription': "'instance-00000082' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000082.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:24:08.541 4088 3038340490696 MainThread DEBUG os_win._utils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000082' failed to start. Not enough memory in the system to start the virtual machine instance-00000082. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000082' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Not enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) 'instance-00000082' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.5075008869171143 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:24:08.566 4088 3038340491752 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:24:08.566 4088 3038340491752 MainThread INFO nova.compute.manager [-] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] VM Stopped (Lifecycle Event) 2021-09-10 17:24:08.566 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000082" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:08.566 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000082" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:08.581 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-52dc3eb1-e5d1-427b-8ff7-b24d3c057f0b - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:24:08.581 4088 3038340491752 MainThread DEBUG nova.virt.hyperv.vmops [req-52dc3eb1-e5d1-427b-8ff7-b24d3c057f0b - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:24:08.635 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-52dc3eb1-e5d1-427b-8ff7-b24d3c057f0b - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:24:08.635 4088 3038340491752 MainThread INFO nova.compute.manager [req-52dc3eb1-e5d1-427b-8ff7-b24d3c057f0b - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:24:09.036 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Setting boot order for instance: instance-00000081: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:24:09.129 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:24:09.163 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Waiting for WMI job: {'InstanceID': '5403830D-9E62-458E-9085-EAD9553BD23B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16166), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:24:09.322 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000081\' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)instance-000000816E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)instance-000000816E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000081\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)instance-000000816E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5403830D-9E62-458E-9085-EAD9553BD23B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=124862), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 24, 9), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 24, 9), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000081' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)\n\nNot enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)\n\n'instance-00000081' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)", 'ErrorSummaryDescription': "'instance-00000081' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000081.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:24:09.322 4088 3038340492280 MainThread DEBUG os_win._utils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000081' failed to start. Not enough memory in the system to start the virtual machine instance-00000081. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000081' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Not enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) 'instance-00000081' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.19274330139160156 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:24:09.349 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000081" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:09.349 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000081" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:09.349 4088 3038340489464 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:24:09.349 4088 3038340489464 MainThread INFO nova.compute.manager [-] [instance: 82618a53-c60b-4a16-8224-464db13061d1] VM Stopped (Lifecycle Event) 2021-09-10 17:24:09.384 4088 3038340489464 MainThread DEBUG nova.compute.manager [req-8f48ae03-80c5-4d0b-a9c2-db70149f5662 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:24:09.384 4088 3038340489464 MainThread DEBUG nova.virt.hyperv.vmops [req-8f48ae03-80c5-4d0b-a9c2-db70149f5662 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:24:09.427 4088 3038340489464 MainThread DEBUG nova.compute.manager [req-8f48ae03-80c5-4d0b-a9c2-db70149f5662 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:24:09.448 4088 3038340489464 MainThread INFO nova.compute.manager [req-8f48ae03-80c5-4d0b-a9c2-db70149f5662 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:24:09.572 4088 3038340490696 MainThread DEBUG os_win.utils.jobutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': '61A9227E-7282-467D-A9AA-EF9621EF0D86', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16357), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:24:09.707 4088 3038340490696 MainThread ERROR os_win.utils.jobutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000082\' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)instance-000000829BF62CBE-7F5D-4570-8A4F-10B1D169B02D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)instance-000000829BF62CBE-7F5D-4570-8A4F-10B1D169B02D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000082\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)instance-000000829BF62CBE-7F5D-4570-8A4F-10B1D169B02D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '61A9227E-7282-467D-A9AA-EF9621EF0D86', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=123741), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 24, 9), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 24, 9), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000082' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)\n\nNot enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)\n\n'instance-00000082' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)", 'ErrorSummaryDescription': "'instance-00000082' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000082.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:24:09.707 4088 3038340490696 MainThread DEBUG os_win._utils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000082' failed to start. Not enough memory in the system to start the virtual machine instance-00000082. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000082' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Not enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) 'instance-00000082' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.673363208770752 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:24:09.744 4088 3038340489464 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:24:09.744 4088 3038340489464 MainThread INFO nova.compute.manager [-] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] VM Stopped (Lifecycle Event) 2021-09-10 17:24:09.744 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000082" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:09.744 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000082" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:09.769 4088 3038340489464 MainThread DEBUG nova.compute.manager [req-9a01b0d6-756e-403c-abcd-9d179902c1e7 - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:24:09.775 4088 3038340489464 MainThread DEBUG nova.virt.hyperv.vmops [req-9a01b0d6-756e-403c-abcd-9d179902c1e7 - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:24:09.803 4088 3038340489464 MainThread DEBUG nova.compute.manager [req-9a01b0d6-756e-403c-abcd-9d179902c1e7 - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:24:09.835 4088 3038340489464 MainThread INFO nova.compute.manager [req-9a01b0d6-756e-403c-abcd-9d179902c1e7 - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:24:10.344 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Waiting for WMI job: {'InstanceID': '83D106B2-70EF-4564-BE72-E40107DB50D7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15371), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:24:10.488 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:24:10.488 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:24:10.503 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000081\' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)instance-000000816E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)instance-000000816E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000081\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)instance-000000816E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '83D106B2-70EF-4564-BE72-E40107DB50D7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116072), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 24, 10), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 24, 10), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000081' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)\n\nNot enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)\n\n'instance-00000081' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)", 'ErrorSummaryDescription': "'instance-00000081' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000081.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:24:10.512 4088 3038340492280 MainThread DEBUG os_win._utils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000081' failed to start. Not enough memory in the system to start the virtual machine instance-00000081. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000081' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Not enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) 'instance-00000081' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3829095363616943 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:24:10.535 4088 3038340491752 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:24:10.535 4088 3038340491752 MainThread INFO nova.compute.manager [-] [instance: 82618a53-c60b-4a16-8224-464db13061d1] VM Stopped (Lifecycle Event) 2021-09-10 17:24:10.535 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000081" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:10.535 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000081" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:10.535 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-d632389c-90e0-4b77-809c-a75421aa3aba - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:24:10.535 4088 3038340491752 MainThread DEBUG nova.virt.hyperv.vmops [req-d632389c-90e0-4b77-809c-a75421aa3aba - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:24:10.566 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:24:10.566 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:24:10.603 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-d632389c-90e0-4b77-809c-a75421aa3aba - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:24:10.631 4088 3038340491752 MainThread INFO nova.compute.manager [req-d632389c-90e0-4b77-809c-a75421aa3aba - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:24:10.753 4088 3038340490696 MainThread DEBUG os_win.utils.jobutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': 'FEEC9566-6546-46AB-80E8-A7058F079CFF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17241), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:24:10.900 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000082" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:10.900 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000082" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:10.900 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:24:10.900 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] VM Stopped (Lifecycle Event) 2021-09-10 17:24:10.900 4088 3038340490696 MainThread ERROR os_win.utils.jobutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000082\' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)instance-000000829BF62CBE-7F5D-4570-8A4F-10B1D169B02D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)instance-000000829BF62CBE-7F5D-4570-8A4F-10B1D169B02D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000082\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)instance-000000829BF62CBE-7F5D-4570-8A4F-10B1D169B02D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'FEEC9566-6546-46AB-80E8-A7058F079CFF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113835), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 24, 10), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 24, 10), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000082' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)\n\nNot enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)\n\n'instance-00000082' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)", 'ErrorSummaryDescription': "'instance-00000082' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000082.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:24:10.900 4088 3038340490696 MainThread DEBUG os_win._utils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000082' failed to start. Not enough memory in the system to start the virtual machine instance-00000082. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000082' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Not enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) 'instance-00000082' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.8668839931488037 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:24:10.931 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-05bb66e1-b276-4bac-9c66-adc2f22d8baa - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:24:10.931 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-05bb66e1-b276-4bac-9c66-adc2f22d8baa - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:24:10.960 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-05bb66e1-b276-4bac-9c66-adc2f22d8baa - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:24:11.003 4088 3038340489992 MainThread INFO nova.compute.manager [req-05bb66e1-b276-4bac-9c66-adc2f22d8baa - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:24:11.069 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Updating instance_info_cache with network_info: [{"id": "e94d3f34-4aa5-46a2-9cf3-221c28446067", "address": "fa:16:3e:bd:9b:a0", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape94d3f34-4a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:24:11.086 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:24:11.086 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:24:11.086 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:24:11.102 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:11.102 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:11.102 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:24:11.102 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:24:11.130 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:24:11.349 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2218MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:24:11.349 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:11.494 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:24:11.494 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:24:11.494 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:24:11.509 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:24:11.509 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:24:11.509 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:24:11.509 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:24:11.509 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:24:11.509 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:24:11.509 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:24:11.509 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:24:11.509 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:24:11.509 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:24:11.509 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 2196beef-9303-4ce4-a818-d05db0f89d55 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:24:11.509 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 82618a53-c60b-4a16-8224-464db13061d1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:24:11.509 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 15 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:24:11.509 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=15872MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=15 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:24:11.545 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:24:11.545 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Waiting for WMI job: {'InstanceID': 'C1F24602-010D-415D-934A-D69C109D601F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17585), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:24:11.562 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:24:11.716 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000081\' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)instance-000000816E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)instance-000000816E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000081\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)instance-000000816E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C1F24602-010D-415D-934A-D69C109D601F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121167), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 24, 11), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 24, 11), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000081' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)\n\nNot enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)\n\n'instance-00000081' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)", 'ErrorSummaryDescription': "'instance-00000081' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000081.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:24:11.716 4088 3038340492280 MainThread DEBUG os_win._utils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000081' failed to start. Not enough memory in the system to start the virtual machine instance-00000081. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000081' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Not enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) 'instance-00000081' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5864884853363037 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:24:11.755 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000081" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:11.755 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000081" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:11.755 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:24:11.755 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: 82618a53-c60b-4a16-8224-464db13061d1] VM Stopped (Lifecycle Event) 2021-09-10 17:24:11.792 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-edd2a20f-6fb4-4ec5-9a65-c48fae0b31f6 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:24:11.792 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-edd2a20f-6fb4-4ec5-9a65-c48fae0b31f6 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:24:11.816 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:24:11.831 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:24:11.831 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:24:11.831 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:11.831 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-edd2a20f-6fb4-4ec5-9a65-c48fae0b31f6 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:24:11.878 4088 3038340489992 MainThread INFO nova.compute.manager [req-edd2a20f-6fb4-4ec5-9a65-c48fae0b31f6 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:24:11.915 4088 3038340490696 MainThread DEBUG os_win.utils.jobutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': '9727E8CC-E216-4F31-BF87-2093C62FDC25', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16315), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:24:12.072 4088 3038340490696 MainThread ERROR os_win.utils.jobutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000082\' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)instance-000000829BF62CBE-7F5D-4570-8A4F-10B1D169B02D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)instance-000000829BF62CBE-7F5D-4570-8A4F-10B1D169B02D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000082\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)instance-000000829BF62CBE-7F5D-4570-8A4F-10B1D169B02D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9727E8CC-E216-4F31-BF87-2093C62FDC25', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=122720), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 24, 11), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 24, 12), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000082' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)\n\nNot enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)\n\n'instance-00000082' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)", 'ErrorSummaryDescription': "'instance-00000082' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000082.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:24:12.072 4088 3038340490696 MainThread DEBUG os_win._utils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000082' failed to start. Not enough memory in the system to start the virtual machine instance-00000082. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000082' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Not enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) 'instance-00000082' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 5.038666009902954 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:24:12.086 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:24:12.086 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] VM Stopped (Lifecycle Event) 2021-09-10 17:24:12.086 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000082" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:12.086 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000082" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:12.113 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-d7dd723f-2e7a-4148-a7fe-960db2a395ff - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:24:12.113 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-d7dd723f-2e7a-4148-a7fe-960db2a395ff - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:24:12.164 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-d7dd723f-2e7a-4148-a7fe-960db2a395ff - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:24:12.180 4088 3038340489992 MainThread INFO nova.compute.manager [req-d7dd723f-2e7a-4148-a7fe-960db2a395ff - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:24:12.744 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Waiting for WMI job: {'InstanceID': '62E0E540-1AB7-4E28-9EE2-43A924AF930A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15974), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:24:12.884 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000081\' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)instance-000000816E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)instance-000000816E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000081\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)instance-000000816E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '62E0E540-1AB7-4E28-9EE2-43A924AF930A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113012), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 24, 12), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 24, 12), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000081' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)\n\nNot enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)\n\n'instance-00000081' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)", 'ErrorSummaryDescription': "'instance-00000081' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000081.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:24:12.884 4088 3038340492280 MainThread DEBUG os_win._utils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000081' failed to start. Not enough memory in the system to start the virtual machine instance-00000081. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000081' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Not enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) 'instance-00000081' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7550911903381348 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:24:12.925 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000081" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:12.925 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000081" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:12.925 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:24:12.925 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: 82618a53-c60b-4a16-8224-464db13061d1] VM Stopped (Lifecycle Event) 2021-09-10 17:24:12.947 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-733d7bc4-8283-4614-86c7-ab4eddee6697 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:24:12.947 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-733d7bc4-8283-4614-86c7-ab4eddee6697 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:24:12.985 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-733d7bc4-8283-4614-86c7-ab4eddee6697 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:24:13.009 4088 3038340489992 MainThread INFO nova.compute.manager [req-733d7bc4-8283-4614-86c7-ab4eddee6697 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:24:13.088 4088 3038340490696 MainThread DEBUG os_win.utils.jobutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': 'CDD6122A-02E4-417B-B3CF-AFDF49AC8012', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14376), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:24:13.223 4088 3038340490696 MainThread ERROR os_win.utils.jobutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000082\' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)instance-000000829BF62CBE-7F5D-4570-8A4F-10B1D169B02D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)instance-000000829BF62CBE-7F5D-4570-8A4F-10B1D169B02D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000082\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)instance-000000829BF62CBE-7F5D-4570-8A4F-10B1D169B02D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'CDD6122A-02E4-417B-B3CF-AFDF49AC8012', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110633), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 24, 13), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 24, 13), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000082' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)\n\nNot enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)\n\n'instance-00000082' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D)", 'ErrorSummaryDescription': "'instance-00000082' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000082.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:24:13.245 4088 3038340490696 MainThread ERROR nova.virt.hyperv.vmops [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Failed to change vm state of instance-00000082 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000082' failed to start. 2021-09-10 17:24:13.245 4088 3038340490696 MainThread INFO nova.virt.hyperv.vmops [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Got request to destroy instance 2021-09-10 17:24:13.245 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000082" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:13.245 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000082" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:13.245 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:24:13.245 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] VM Stopped (Lifecycle Event) 2021-09-10 17:24:13.269 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-a4552fd3-58b1-491b-be9e-06f13f6d8e65 - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:24:13.269 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-a4552fd3-58b1-491b-be9e-06f13f6d8e65 - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:24:13.321 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-a4552fd3-58b1-491b-be9e-06f13f6d8e65 - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:24:13.321 4088 3038340489992 MainThread INFO nova.compute.manager [req-a4552fd3-58b1-491b-be9e-06f13f6d8e65 - - - - -] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:24:13.905 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Waiting for WMI job: {'InstanceID': 'B8073065-2C95-42EB-AF97-3AC30EE8429C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14987), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:24:14.069 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000081\' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)instance-000000816E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)instance-000000816E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000081\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)instance-000000816E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B8073065-2C95-42EB-AF97-3AC30EE8429C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114019), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 24, 13), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 24, 14), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000081' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)\n\nNot enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)\n\n'instance-00000081' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)", 'ErrorSummaryDescription': "'instance-00000081' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000081.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:24:14.069 4088 3038340492280 MainThread DEBUG os_win._utils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000081' failed to start. Not enough memory in the system to start the virtual machine instance-00000081. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000081' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Not enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) 'instance-00000081' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.939565420150757 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:24:14.089 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:24:14.089 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: 82618a53-c60b-4a16-8224-464db13061d1] VM Stopped (Lifecycle Event) 2021-09-10 17:24:14.089 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000081" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:14.089 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000081" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:14.113 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-e3c34166-5c2f-44fe-9931-aa45d174d653 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:24:14.113 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-e3c34166-5c2f-44fe-9931-aa45d174d653 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:24:14.161 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-e3c34166-5c2f-44fe-9931-aa45d174d653 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:24:14.191 4088 3038340489992 MainThread INFO nova.compute.manager [req-e3c34166-5c2f-44fe-9931-aa45d174d653 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:24:15.054 4088 3038340490696 MainThread DEBUG nova.virt.hyperv.vmops [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:24:15.054 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000082" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:15.054 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000082" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:15.073 4088 3038340490696 MainThread DEBUG os_win.utils.compute.vmutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Successfully changed vm state of instance-00000082 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:24:15.073 4088 3038340490696 MainThread DEBUG nova.virt.hyperv.vmops [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Successfully changed state of VM instance-00000082 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:24:15.097 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Waiting for WMI job: {'InstanceID': 'B0A1B42A-D5BE-4A08-92FB-BF77864BBF46', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15501), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:24:15.118 4088 3038340490696 MainThread DEBUG os_win.utils.jobutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': '8A20FBFF-846D-4AC5-83B7-DD2CAFABFEF1', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14240), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:24:15.323 4088 3038340489992 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:24:15.323 4088 3038340489992 MainThread INFO nova.compute.manager [-] [instance: 82618a53-c60b-4a16-8224-464db13061d1] VM Stopped (Lifecycle Event) 2021-09-10 17:24:15.323 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000081" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:15.323 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000081" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:15.338 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-752184ba-e563-498f-8884-23d19c778f26 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:24:15.338 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-752184ba-e563-498f-8884-23d19c778f26 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:24:15.362 4088 3038340490696 MainThread DEBUG os_win.utils.jobutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job succeeded: {'InstanceID': '8A20FBFF-846D-4AC5-83B7-DD2CAFABFEF1', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=124276), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:24:15.362 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000082" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:15.362 4088 3038340490696 MainThread DEBUG os_win.utils.pathutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Removing directory: C:\openstack\instances\instance-00000082 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:24:15.362 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000082" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:15.362 4088 3038340490696 MainThread ERROR nova.compute.manager [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000082' failed to start. Not enough memory in the system to start the virtual machine instance-00000082. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000082' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Not enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) 'instance-00000082' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Error code: 32778. 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Traceback (most recent call last): 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] return function(*args, **kwargs) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] admin_password, network_info, block_device_info) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] return function(self, *args, **kwds) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self.force_reraise() 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] raise self.value 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] should_plug_vifs=False) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 'req_state': req_state}) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self.force_reraise() 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] raise self.value 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] time.sleep(sleep_time) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self.force_reraise() 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] raise self.value 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] return f(*args, **kwargs) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] return self._wait_for_job(job_path) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] error_desc=err_desc) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000082' failed to start. 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Not enough memory in the system to start the virtual machine instance-00000082. 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000082' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Not enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 'instance-00000082' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Error code: 32778. 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] During handling of the above exception, another exception occurred: 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Traceback (most recent call last): 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] yield resources 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] accel_info=accel_info) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] return function(*args, **kwargs) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] admin_password, network_info, block_device_info) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] return function(self, *args, **kwds) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self.force_reraise() 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] raise self.value 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] should_plug_vifs=False) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 'req_state': req_state}) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self.force_reraise() 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] raise self.value 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] time.sleep(sleep_time) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self.force_reraise() 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] raise self.value 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] return f(*args, **kwargs) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] return self._wait_for_job(job_path) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] error_desc=err_desc) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000082' failed to start. 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Not enough memory in the system to start the virtual machine instance-00000082. 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000082' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Not enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 'instance-00000082' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Error code: 32778. 2021-09-10 17:24:15.362 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:15.362 4088 3038340490696 MainThread INFO nova.compute.manager [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Terminating instance 2021-09-10 17:24:15.376 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:24:15.376 4088 3038340490696 MainThread INFO nova.virt.hyperv.vmops [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Got request to destroy instance 2021-09-10 17:24:15.376 4088 3038340492280 MainThread ERROR os_win.utils.jobutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] WMI job failed: {'RawErrors': (('124\'instance-00000081\' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)instance-000000816E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)instance-000000816E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000081\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)instance-000000816E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B0A1B42A-D5BE-4A08-92FB-BF77864BBF46', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=163741), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 24, 15), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 24, 15), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000081' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)\n\nNot enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)\n\n'instance-00000081' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF)", 'ErrorSummaryDescription': "'instance-00000081' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000081.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:24:15.376 4088 3038340492280 MainThread ERROR nova.virt.hyperv.vmops [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Failed to change vm state of instance-00000081 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000081' failed to start. 2021-09-10 17:24:15.394 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Got request to destroy instance 2021-09-10 17:24:15.394 4088 3038340490696 MainThread DEBUG nova.virt.hyperv.vmops [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:24:15.394 4088 3038340490696 MainThread DEBUG os_brick.initiator.windows.iscsi [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-1ea6abf8-e7b9-42f9-b32a-c9e896b83f11', 'target_lun': 0, 'volume_id': '1ea6abf8-e7b9-42f9-b32a-c9e896b83f11', 'auth_method': 'CHAP', 'auth_username': 'YHQSuHP3q8WfRu6F79dD', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:24:15.394 4088 3038340490696 MainThread DEBUG os_win.utils.storage.diskutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:24:15.394 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-752184ba-e563-498f-8884-23d19c778f26 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:24:15.409 4088 3038340489992 MainThread INFO nova.compute.manager [req-752184ba-e563-498f-8884-23d19c778f26 - - - - -] [instance: 82618a53-c60b-4a16-8224-464db13061d1] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:24:15.495 4088 3038340490696 MainThread DEBUG os_win.utils.storage.diskutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:24:15.495 4088 3038340490696 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-1ea6abf8-e7b9-42f9-b32a-c9e896b83f11 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 17:24:15.566 4088 3038340490696 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Removing iSCSI target persistent login: iqn.2010-10.org.openstack:volume-1ea6abf8-e7b9-42f9-b32a-c9e896b83f11 _remove_target_persistent_logins c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:495 2021-09-10 17:24:15.576 4088 3038340490696 MainThread DEBUG os_brick.initiator.windows.iscsi [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] <== disconnect_volume: return (181ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:24:15.576 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000082" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:15.576 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000082" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:15.576 4088 3038340490696 MainThread INFO nova.compute.manager [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Took 0.20 seconds to destroy the instance on the hypervisor. 2021-09-10 17:24:17.231 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:24:17.231 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Lock "instance-00000081" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:17.231 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Lock "instance-00000081" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:17.231 4088 3038340492280 MainThread DEBUG os_win.utils.compute.vmutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Successfully changed vm state of instance-00000081 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:24:17.231 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Successfully changed state of VM instance-00000081 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:24:17.293 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Waiting for WMI job: {'InstanceID': 'F7924D0D-EB4D-4FFB-A34C-1F48D7906262', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14437), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:24:17.409 4088 3038340492280 MainThread DEBUG os_win.utils.jobutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] WMI job succeeded: {'InstanceID': 'F7924D0D-EB4D-4FFB-A34C-1F48D7906262', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=105956), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:24:17.409 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Lock "instance-00000081" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:17.409 4088 3038340492280 MainThread DEBUG os_win.utils.pathutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Removing directory: C:\openstack\instances\instance-00000081 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:24:17.409 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Lock "instance-00000081" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:17.409 4088 3038340492280 MainThread ERROR nova.compute.manager [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000081' failed to start. Not enough memory in the system to start the virtual machine instance-00000081. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000081' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Not enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) 'instance-00000081' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Error code: 32778. 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] Traceback (most recent call last): 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] return function(*args, **kwargs) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] admin_password, network_info, block_device_info) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] return function(self, *args, **kwds) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self.force_reraise() 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] raise self.value 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] should_plug_vifs=False) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 'req_state': req_state}) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self.force_reraise() 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] raise self.value 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] time.sleep(sleep_time) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self.force_reraise() 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] raise self.value 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] return f(*args, **kwargs) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] return self._wait_for_job(job_path) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] error_desc=err_desc) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000081' failed to start. 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] Not enough memory in the system to start the virtual machine instance-00000081. 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000081' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] Not enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 'instance-00000081' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Error code: 32778. 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] During handling of the above exception, another exception occurred: 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] Traceback (most recent call last): 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] yield resources 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] accel_info=accel_info) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] return function(*args, **kwargs) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] admin_password, network_info, block_device_info) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] return function(self, *args, **kwds) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self.force_reraise() 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] raise self.value 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] should_plug_vifs=False) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 'req_state': req_state}) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self.force_reraise() 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] raise self.value 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] time.sleep(sleep_time) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self.force_reraise() 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] raise self.value 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] return f(*args, **kwargs) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] return self._wait_for_job(job_path) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] error_desc=err_desc) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000081' failed to start. 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] Not enough memory in the system to start the virtual machine instance-00000081. 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000081' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] Not enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 'instance-00000081' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Error code: 32778. 2021-09-10 17:24:17.409 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:17.409 4088 3038340492280 MainThread INFO nova.compute.manager [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Terminating instance 2021-09-10 17:24:17.409 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:24:17.409 4088 3038340492280 MainThread INFO nova.virt.hyperv.vmops [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Got request to destroy instance 2021-09-10 17:24:17.432 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.vmops [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:24:17.432 4088 3038340492280 MainThread DEBUG os_brick.initiator.windows.iscsi [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-70f42dc2-02c6-4ce3-9c41-d23f15c09a93', 'target_lun': 0, 'volume_id': '70f42dc2-02c6-4ce3-9c41-d23f15c09a93', 'auth_method': 'CHAP', 'auth_username': 'oNjfgyfFJpA46Qn36YH2', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:24:17.432 4088 3038340492280 MainThread DEBUG os_win.utils.storage.diskutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:24:17.531 4088 3038340492280 MainThread DEBUG os_win.utils.storage.diskutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:24:17.543 4088 3038340492280 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-70f42dc2-02c6-4ce3-9c41-d23f15c09a93 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 17:24:17.612 4088 3038340492280 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Removing iSCSI target persistent login: iqn.2010-10.org.openstack:volume-70f42dc2-02c6-4ce3-9c41-d23f15c09a93 _remove_target_persistent_logins c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:495 2021-09-10 17:24:17.612 4088 3038340492280 MainThread DEBUG os_brick.initiator.windows.iscsi [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] <== disconnect_volume: return (180ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:24:17.612 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Lock "instance-00000081" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:17.612 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Lock "instance-00000081" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:17.612 4088 3038340492280 MainThread INFO nova.compute.manager [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Took 0.20 seconds to destroy the instance on the hypervisor. 2021-09-10 17:24:18.858 4088 3038340490696 MainThread INFO nova.compute.manager [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Took 3.28 seconds to detach 1 volumes for instance. 2021-09-10 17:24:18.858 4088 3038340490696 MainThread DEBUG nova.compute.claims [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:24:18.858 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:18.972 4088 3038340490696 MainThread DEBUG nova.virt.hyperv.hostops [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:24:18.988 4088 3038340490696 MainThread DEBUG nova.virt.hyperv.hostops [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:24:19.202 4088 3038340490696 MainThread DEBUG nova.compute.provider_tree [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:24:19.211 4088 3038340490696 MainThread DEBUG nova.scheduler.client.report [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:24:19.211 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.343s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:19.211 4088 3038340490696 MainThread ERROR nova.compute.manager [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000082' failed to start. Not enough memory in the system to start the virtual machine instance-00000082. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000082' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Not enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) 'instance-00000082' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Error code: 32778. 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Traceback (most recent call last): 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] return function(*args, **kwargs) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] admin_password, network_info, block_device_info) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] return function(self, *args, **kwds) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self.force_reraise() 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] raise self.value 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] should_plug_vifs=False) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 'req_state': req_state}) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self.force_reraise() 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] raise self.value 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] time.sleep(sleep_time) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self.force_reraise() 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] raise self.value 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] return f(*args, **kwargs) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] return self._wait_for_job(job_path) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] error_desc=err_desc) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000082' failed to start. 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Not enough memory in the system to start the virtual machine instance-00000082. 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000082' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Not enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 'instance-00000082' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Error code: 32778. 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] During handling of the above exception, another exception occurred: 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Traceback (most recent call last): 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] accel_info=accel_info) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] return function(*args, **kwargs) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] admin_password, network_info, block_device_info) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] return function(self, *args, **kwds) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self.force_reraise() 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] raise self.value 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] should_plug_vifs=False) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 'req_state': req_state}) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self.force_reraise() 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] raise self.value 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] time.sleep(sleep_time) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self.force_reraise() 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] raise self.value 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] return f(*args, **kwargs) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] return self._wait_for_job(job_path) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] error_desc=err_desc) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000082' failed to start. 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Not enough memory in the system to start the virtual machine instance-00000082. 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000082' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Not enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 'instance-00000082' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Error code: 32778. 2021-09-10 17:24:19.211 4088 3038340490696 MainThread TRACE nova.compute.manager [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] 2021-09-10 17:24:19.211 4088 3038340490696 MainThread DEBUG nova.compute.utils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] WMI job failed with status 10. Error summary description: 'instance-00000082' failed to start. Not enough memory in the system to start the virtual machine instance-00000082. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:24:19.211 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Build of instance 2196beef-9303-4ce4-a818-d05db0f89d55 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000082' failed to start. Not enough memory in the system to start the virtual machine instance-00000082. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000082' failed to start. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Not enough memory in the system to start the virtual machine instance-00000082 with ram size 1024 megabytes. (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) 'instance-00000082' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 9BF62CBE-7F5D-4570-8A4F-10B1D169B02D) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:24:19.211 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:24:19.211 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:24:19.211 4088 3038340490696 MainThread DEBUG nova.compute.manager [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:24:19.211 4088 3038340490696 MainThread DEBUG nova.network.neutron [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:24:19.735 4088 3038340490696 MainThread DEBUG nova.network.neutron [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:24:19.749 4088 3038340490696 MainThread INFO nova.compute.manager [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 2196beef-9303-4ce4-a818-d05db0f89d55] Took 0.55 seconds to deallocate network for instance. 2021-09-10 17:24:19.919 4088 3038340490696 MainThread INFO nova.scheduler.client.report [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Deleted allocations for instance 2196beef-9303-4ce4-a818-d05db0f89d55 2021-09-10 17:24:19.969 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [req-5846f5b0-d13e-415b-b64d-b6ced1b2ce69 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "2196beef-9303-4ce4-a818-d05db0f89d55" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 44.234s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:22.014 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-dbaa50b5-ed57-4987-bd02-e7c73f9a0790 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Received event network-vif-unplugged-1a4e82b0-eab3-4fbf-86ef-ebad6222e375 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:24:22.014 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-dbaa50b5-ed57-4987-bd02-e7c73f9a0790 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "82618a53-c60b-4a16-8224-464db13061d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:22.014 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-dbaa50b5-ed57-4987-bd02-e7c73f9a0790 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "82618a53-c60b-4a16-8224-464db13061d1-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:22.014 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-dbaa50b5-ed57-4987-bd02-e7c73f9a0790 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] No waiting events found dispatching network-vif-unplugged-1a4e82b0-eab3-4fbf-86ef-ebad6222e375 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:24:22.014 4088 3038340489992 MainThread WARNING nova.compute.manager [req-dbaa50b5-ed57-4987-bd02-e7c73f9a0790 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Received unexpected event network-vif-unplugged-1a4e82b0-eab3-4fbf-86ef-ebad6222e375 for instance with vm_state building and task_state spawning. 2021-09-10 17:24:22.268 4088 3038340492280 MainThread INFO nova.compute.manager [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Took 4.66 seconds to detach 1 volumes for instance. 2021-09-10 17:24:22.268 4088 3038340492280 MainThread DEBUG nova.compute.claims [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:24:22.268 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:24:22.440 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.hostops [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:24:22.451 4088 3038340492280 MainThread DEBUG nova.virt.hyperv.hostops [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:24:22.659 4088 3038340492280 MainThread DEBUG nova.compute.provider_tree [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:24:22.675 4088 3038340492280 MainThread DEBUG nova.scheduler.client.report [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:24:22.675 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.406s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:24:22.675 4088 3038340492280 MainThread ERROR nova.compute.manager [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000081' failed to start. Not enough memory in the system to start the virtual machine instance-00000081. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000081' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Not enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) 'instance-00000081' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Error code: 32778. 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] Traceback (most recent call last): 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] return function(*args, **kwargs) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] admin_password, network_info, block_device_info) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] return function(self, *args, **kwds) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self.force_reraise() 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] raise self.value 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] should_plug_vifs=False) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 'req_state': req_state}) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self.force_reraise() 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] raise self.value 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] time.sleep(sleep_time) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self.force_reraise() 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] raise self.value 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] return f(*args, **kwargs) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] return self._wait_for_job(job_path) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] error_desc=err_desc) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000081' failed to start. 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] Not enough memory in the system to start the virtual machine instance-00000081. 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000081' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] Not enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 'instance-00000081' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Error code: 32778. 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] During handling of the above exception, another exception occurred: 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] Traceback (most recent call last): 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] accel_info=accel_info) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] return function(*args, **kwargs) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] admin_password, network_info, block_device_info) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] return function(self, *args, **kwds) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self.force_reraise() 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] raise self.value 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] should_plug_vifs=False) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 'req_state': req_state}) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self.force_reraise() 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] raise self.value 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] time.sleep(sleep_time) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self.force_reraise() 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] raise self.value 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] return f(*args, **kwargs) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] return self._wait_for_job(job_path) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] error_desc=err_desc) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000081' failed to start. 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] Not enough memory in the system to start the virtual machine instance-00000081. 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000081' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] Not enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 'instance-00000081' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Error code: 32778. 2021-09-10 17:24:22.675 4088 3038340492280 MainThread TRACE nova.compute.manager [instance: 82618a53-c60b-4a16-8224-464db13061d1] 2021-09-10 17:24:22.675 4088 3038340492280 MainThread DEBUG nova.compute.utils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] WMI job failed with status 10. Error summary description: 'instance-00000081' failed to start. Not enough memory in the system to start the virtual machine instance-00000081. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:24:22.675 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Build of instance 82618a53-c60b-4a16-8224-464db13061d1 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000081' failed to start. Not enough memory in the system to start the virtual machine instance-00000081. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000081' failed to start. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Not enough memory in the system to start the virtual machine instance-00000081 with ram size 1024 megabytes. (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) 'instance-00000081' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6E4C44D9-A770-40D9-B9CF-FEA85DEC2FCF) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:24:22.690 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:24:22.690 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:24:22.690 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:24:22.690 4088 3038340492280 MainThread DEBUG nova.network.neutron [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:24:23.240 4088 3038340492280 MainThread DEBUG nova.network.neutron [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:24:23.271 4088 3038340492280 MainThread INFO nova.compute.manager [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] [instance: 82618a53-c60b-4a16-8224-464db13061d1] Took 0.58 seconds to deallocate network for instance. 2021-09-10 17:24:23.456 4088 3038340492280 MainThread INFO nova.scheduler.client.report [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Deleted allocations for instance 82618a53-c60b-4a16-8224-464db13061d1 2021-09-10 17:24:23.493 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-76ca5694-adfc-40b3-a88d-ddc50429940a c27ee1b52b274727b6211034f9223342 a7f6adcb5eeb4af58d2b79814528b63b - default default] Lock "82618a53-c60b-4a16-8224-464db13061d1" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 32.891s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:25:00.239 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:25:03.485 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:25:04.486 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:25:04.486 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:25:05.489 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:25:07.501 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:25:08.501 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:25:09.479 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:25:09.479 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:25:11.485 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:25:11.489 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:25:11.489 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:25:11.504 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:25:11.504 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:25:11.524 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:25:11.739 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2222MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:25:11.739 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:25:11.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:25:11.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:25:11.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:25:11.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:25:11.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:25:11.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:25:11.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:25:11.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:25:11.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:25:11.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:25:11.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:25:11.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:25:11.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:25:11.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:25:11.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:25:11.915 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:25:11.951 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:25:12.163 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:25:12.178 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:25:12.178 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:25:12.178 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.437s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:25:13.172 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:25:13.172 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:25:13.310 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-66c5445c-c347-4833-8af8-58ba8ff6d95e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:25:13.310 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:25:13.896 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Updating instance_info_cache with network_info: [{"id": "fecb5a04-48f6-4c8b-bb0f-748b812daefa", "address": "fa:16:3e:2d:da:04", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfecb5a04-48", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:25:13.926 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-66c5445c-c347-4833-8af8-58ba8ff6d95e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:25:13.926 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:25:21.751 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:25:38.797 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "996ac19a-6395-455e-85e7-1fc5add701a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:25:38.817 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:25:38.885 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:25:38.885 4088 3038342147064 MainThread DEBUG nova.virt.hardware [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:25:38.885 4088 3038342147064 MainThread INFO nova.compute.claims [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Claim successful on node n-h2-808474-1 2021-09-10 17:25:38.989 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.hostops [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:25:39.015 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.hostops [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:25:39.218 4088 3038342147064 MainThread DEBUG nova.compute.provider_tree [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:25:39.223 4088 3038342147064 MainThread DEBUG nova.scheduler.client.report [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:25:39.223 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:25:39.223 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:25:39.290 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:25:39.290 4088 3038340490344 GreenThread-120 DEBUG nova.compute.manager [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:25:39.290 4088 3038340490344 GreenThread-120 DEBUG nova.network.neutron [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:25:39.348 4088 3038342147064 MainThread INFO nova.virt.block_device [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Booting with volume 5f36efd2-4359-43b8-bbad-c199178f098b at /dev/sda 2021-09-10 17:25:39.413 4088 3038340490344 GreenThread-120 DEBUG nova.policy [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82eacb807eb449a28e17290cd4d841d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0aa6ac8af84d7291f244f216bb94b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:25:39.413 4088 3038342147064 MainThread DEBUG os_brick.utils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:25:39.413 4088 3038342147064 MainThread DEBUG os_brick.utils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] <== get_connector_properties: return (0ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:25:39.413 4088 3038342147064 MainThread DEBUG nova.virt.block_device [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Updating existing volume attachment record: a7fbf9ad-d21e-44c2-ac0b-18d7d32a04ea _volume_attach c:\openstack\build\nova\nova\virt\block_device.py:556 2021-09-10 17:25:40.001 4088 3038340490344 GreenThread-120 DEBUG nova.network.neutron [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Successfully created port: f91826b4-2b51-4c84-8ca4-df208049d03f _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:25:40.692 4088 3038340490344 GreenThread-120 DEBUG nova.network.neutron [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Successfully updated port: f91826b4-2b51-4c84-8ca4-df208049d03f _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:25:40.712 4088 3038340490344 GreenThread-120 DEBUG oslo_concurrency.lockutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Acquired lock "refresh_cache-996ac19a-6395-455e-85e7-1fc5add701a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:25:40.712 4088 3038340490344 GreenThread-120 DEBUG nova.network.neutron [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:25:40.781 4088 3038340490344 GreenThread-120 DEBUG nova.network.neutron [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:25:40.812 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-d9491d73-27f7-4a68-9448-8f8d4191e29f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Received event network-changed-f91826b4-2b51-4c84-8ca4-df208049d03f external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:25:40.812 4088 3038342146712 MainThread DEBUG nova.compute.manager [req-d9491d73-27f7-4a68-9448-8f8d4191e29f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Refreshing instance network info cache due to event network-changed-f91826b4-2b51-4c84-8ca4-df208049d03f. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:25:41.130 4088 3038340490344 GreenThread-120 DEBUG nova.network.neutron [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Updating instance_info_cache with network_info: [{"id": "f91826b4-2b51-4c84-8ca4-df208049d03f", "address": "fa:16:3e:55:f0:b6", "network": {"id": "385c7b14-693f-45e3-86cf-8a54c842098b", "bridge": null, "label": "tempest-TestVolumeBootPattern-577893151-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d0aa6ac8af84d7291f244f216bb94b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf91826b4-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:25:41.145 4088 3038340490344 GreenThread-120 DEBUG oslo_concurrency.lockutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Releasing lock "refresh_cache-996ac19a-6395-455e-85e7-1fc5add701a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:25:41.145 4088 3038340490344 GreenThread-120 DEBUG nova.compute.manager [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Instance network_info: |[{"id": "f91826b4-2b51-4c84-8ca4-df208049d03f", "address": "fa:16:3e:55:f0:b6", "network": {"id": "385c7b14-693f-45e3-86cf-8a54c842098b", "bridge": null, "label": "tempest-TestVolumeBootPattern-577893151-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d0aa6ac8af84d7291f244f216bb94b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf91826b4-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:25:41.160 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-d9491d73-27f7-4a68-9448-8f8d4191e29f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-996ac19a-6395-455e-85e7-1fc5add701a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:25:41.160 4088 3038342146712 MainThread DEBUG nova.network.neutron [req-d9491d73-27f7-4a68-9448-8f8d4191e29f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Refreshing network info cache for port f91826b4-2b51-4c84-8ca4-df208049d03f _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:25:41.661 4088 3038342146712 MainThread DEBUG nova.network.neutron [req-d9491d73-27f7-4a68-9448-8f8d4191e29f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Updated VIF entry in instance network info cache for port f91826b4-2b51-4c84-8ca4-df208049d03f. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:25:41.661 4088 3038342146712 MainThread DEBUG nova.network.neutron [req-d9491d73-27f7-4a68-9448-8f8d4191e29f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Updating instance_info_cache with network_info: [{"id": "f91826b4-2b51-4c84-8ca4-df208049d03f", "address": "fa:16:3e:55:f0:b6", "network": {"id": "385c7b14-693f-45e3-86cf-8a54c842098b", "bridge": null, "label": "tempest-TestVolumeBootPattern-577893151-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d0aa6ac8af84d7291f244f216bb94b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf91826b4-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:25:41.661 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [req-d9491d73-27f7-4a68-9448-8f8d4191e29f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-996ac19a-6395-455e-85e7-1fc5add701a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:25:43.395 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:25:43.425 4088 3038342147064 MainThread INFO nova.virt.hyperv.vmops [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Spawning new instance 2021-09-10 17:25:43.439 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000083" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:25:43.439 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000083" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:25:43.439 4088 3038342147064 MainThread DEBUG nova.block_device [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] block_device_list ['sda'] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:25:43.439 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Preparing to wait for external event network-vif-plugged-f91826b4-2b51-4c84-8ca4-df208049d03f prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:25:43.439 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "996ac19a-6395-455e-85e7-1fc5add701a3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:25:43.439 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "996ac19a-6395-455e-85e7-1fc5add701a3-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:25:43.439 4088 3038342147064 MainThread DEBUG os_win.utils.compute.vmutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Creating VM instance-00000083 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:25:44.504 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.volumeops [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Attaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-5f36efd2-4359-43b8-bbad-c199178f098b', 'target_lun': 0, 'volume_id': '5f36efd2-4359-43b8-bbad-c199178f098b', 'auth_method': 'CHAP', 'auth_username': 'DhfLE9qb4MypNwLEAe2n', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'reserved', 'instance': '996ac19a-6395-455e-85e7-1fc5add701a3', 'attached_at': '', 'detached_at': '', 'volume_id': '5f36efd2-4359-43b8-bbad-c199178f098b', 'serial': '5f36efd2-4359-43b8-bbad-c199178f098b'} to instance-00000083 _attach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:108 2021-09-10 17:25:44.504 4088 3038342147064 MainThread DEBUG os_brick.initiator.windows.iscsi [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-5f36efd2-4359-43b8-bbad-c199178f098b', 'target_lun': 0, 'volume_id': '5f36efd2-4359-43b8-bbad-c199178f098b', 'auth_method': 'CHAP', 'auth_username': 'DhfLE9qb4MypNwLEAe2n', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:25:44.504 4088 3038342147064 MainThread INFO os_brick.initiator.windows.iscsi [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Attempting to establish an iSCSI session to target iqn.2010-10.org.openstack:volume-5f36efd2-4359-43b8-bbad-c199178f098b on portal 10.222.0.55:3260 accessing LUN 0 using initiator None. 2021-09-10 17:25:44.516 4088 3038342147064 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Logging in iSCSI target iqn.2010-10.org.openstack:volume-5f36efd2-4359-43b8-bbad-c199178f098b login_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:401 2021-09-10 17:25:49.530 4088 3038342147064 MainThread DEBUG os_win.utils.storage.diskutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:25:49.661 4088 3038342147064 MainThread DEBUG os_win.utils.storage.diskutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:25:49.723 4088 3038342147064 MainThread DEBUG os_brick.initiator.windows.iscsi [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] <== connect_volume: return (5219ms) {'type': 'block', 'path': '\\\\.\\PhysicalDrive1', 'number': 1, 'scsi_wwn': '360014055166669ACBBA46D28294FCAE7'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:25:50.301 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.vmops [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:25:54.412 4088 3038340490344 MainThread DEBUG nova.compute.manager [req-b6373226-16c9-410e-a5d0-bdcac03f59c0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Received event network-vif-plugged-f91826b4-2b51-4c84-8ca4-df208049d03f external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:25:54.412 4088 3038340490344 MainThread DEBUG oslo_concurrency.lockutils [req-b6373226-16c9-410e-a5d0-bdcac03f59c0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "996ac19a-6395-455e-85e7-1fc5add701a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:25:54.412 4088 3038340490344 MainThread DEBUG oslo_concurrency.lockutils [req-b6373226-16c9-410e-a5d0-bdcac03f59c0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "996ac19a-6395-455e-85e7-1fc5add701a3-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:25:54.436 4088 3038340490344 MainThread DEBUG nova.compute.manager [req-b6373226-16c9-410e-a5d0-bdcac03f59c0 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Processing event network-vif-plugged-f91826b4-2b51-4c84-8ca4-df208049d03f _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:25:54.456 4088 3038342147064 MainThread INFO nova.virt.hyperv.vmops [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Using config drive for instance 2021-09-10 17:25:54.568 4088 3038342147064 MainThread INFO nova.virt.hyperv.vmops [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Creating config drive at C:\openstack\instances\instance-00000083\configdrive.iso 2021-09-10 17:25:54.671 4088 3038342147064 MainThread DEBUG oslo_concurrency.processutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000083\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp72oaoxjv execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:25:55.020 4088 3038342147064 MainThread DEBUG oslo_concurrency.processutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000083\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp72oaoxjv" returned: 0 in 0.344s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:25:55.515 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.vmops [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Setting boot order for instance: instance-00000083: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:25:55.584 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.vmops [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:25:55.632 4088 3038342147064 MainThread DEBUG os_win.utils.jobutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': '98573A9E-7396-41BC-AA5D-808DC4368890', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20086), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:25:55.765 4088 3038342147064 MainThread ERROR os_win.utils.jobutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000083\' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)instance-000000830EE916E7-7DF0-4713-91BE-A2853E44FA4012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)instance-000000830EE916E7-7DF0-4713-91BE-A2853E44FA4010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000083\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)instance-000000830EE916E7-7DF0-4713-91BE-A2853E44FA40%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '98573A9E-7396-41BC-AA5D-808DC4368890', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113397), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 25, 55), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 25, 55), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000083' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)\n\nNot enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)\n\n'instance-00000083' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)", 'ErrorSummaryDescription': "'instance-00000083' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000083.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:25:55.765 4088 3038342147064 MainThread DEBUG os_win._utils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000083' failed to start. Not enough memory in the system to start the virtual machine instance-00000083. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000083' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Not enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) 'instance-00000083' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18078112602233887 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:25:55.811 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000083" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:25:55.811 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000083" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:25:55.811 4088 3038340490344 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:25:55.811 4088 3038340490344 MainThread INFO nova.compute.manager [-] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] VM Stopped (Lifecycle Event) 2021-09-10 17:25:55.833 4088 3038340490344 MainThread DEBUG nova.compute.manager [req-f357608d-0110-4f34-b3f4-0d133588bd1e - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:25:55.833 4088 3038340490344 MainThread DEBUG nova.virt.hyperv.vmops [req-f357608d-0110-4f34-b3f4-0d133588bd1e - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:25:55.874 4088 3038340490344 MainThread DEBUG nova.compute.manager [req-f357608d-0110-4f34-b3f4-0d133588bd1e - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:25:55.896 4088 3038340490344 MainThread INFO nova.compute.manager [req-f357608d-0110-4f34-b3f4-0d133588bd1e - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:25:56.802 4088 3038342147064 MainThread DEBUG os_win.utils.jobutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': 'EBC9151F-55EA-46B1-B4B3-0924D701E44B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15601), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:25:56.923 4088 3038342147064 MainThread ERROR os_win.utils.jobutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000083\' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)instance-000000830EE916E7-7DF0-4713-91BE-A2853E44FA4012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)instance-000000830EE916E7-7DF0-4713-91BE-A2853E44FA4010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000083\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)instance-000000830EE916E7-7DF0-4713-91BE-A2853E44FA40%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'EBC9151F-55EA-46B1-B4B3-0924D701E44B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111142), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 25, 56), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 25, 56), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000083' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)\n\nNot enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)\n\n'instance-00000083' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)", 'ErrorSummaryDescription': "'instance-00000083' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000083.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:25:56.923 4088 3038342147064 MainThread DEBUG os_win._utils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000083' failed to start. Not enough memory in the system to start the virtual machine instance-00000083. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000083' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Not enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) 'instance-00000083' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3385753631591797 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:25:56.984 4088 3038340490344 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:25:56.984 4088 3038340490344 MainThread INFO nova.compute.manager [-] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] VM Stopped (Lifecycle Event) 2021-09-10 17:25:56.984 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000083" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:25:56.984 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000083" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:25:56.984 4088 3038340490344 MainThread DEBUG nova.compute.manager [req-249a5608-b51d-40c6-bffd-971867eedb25 - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:25:56.984 4088 3038340490344 MainThread DEBUG nova.virt.hyperv.vmops [req-249a5608-b51d-40c6-bffd-971867eedb25 - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:25:57.047 4088 3038340490344 MainThread DEBUG nova.compute.manager [req-249a5608-b51d-40c6-bffd-971867eedb25 - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:25:57.070 4088 3038340490344 MainThread INFO nova.compute.manager [req-249a5608-b51d-40c6-bffd-971867eedb25 - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:25:57.958 4088 3038342147064 MainThread DEBUG os_win.utils.jobutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': '820D9982-C18A-4A8F-B50E-49BDF2DAC2D9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14621), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:25:58.095 4088 3038342147064 MainThread ERROR os_win.utils.jobutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000083\' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)instance-000000830EE916E7-7DF0-4713-91BE-A2853E44FA4012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)instance-000000830EE916E7-7DF0-4713-91BE-A2853E44FA4010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000083\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)instance-000000830EE916E7-7DF0-4713-91BE-A2853E44FA40%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '820D9982-C18A-4A8F-B50E-49BDF2DAC2D9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110052), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 25, 57), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 25, 58), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000083' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)\n\nNot enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)\n\n'instance-00000083' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)", 'ErrorSummaryDescription': "'instance-00000083' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000083.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:25:58.095 4088 3038342147064 MainThread DEBUG os_win._utils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000083' failed to start. Not enough memory in the system to start the virtual machine instance-00000083. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000083' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Not enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) 'instance-00000083' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.511230945587158 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:25:58.115 4088 3038340490344 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:25:58.115 4088 3038340490344 MainThread INFO nova.compute.manager [-] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] VM Stopped (Lifecycle Event) 2021-09-10 17:25:58.115 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000083" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:25:58.115 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000083" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:25:58.128 4088 3038340490344 MainThread DEBUG nova.compute.manager [req-9c3f04c2-66d1-4fbb-a1ff-eabad45a7e9a - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:25:58.128 4088 3038340490344 MainThread DEBUG nova.virt.hyperv.vmops [req-9c3f04c2-66d1-4fbb-a1ff-eabad45a7e9a - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:25:58.179 4088 3038340490344 MainThread DEBUG nova.compute.manager [req-9c3f04c2-66d1-4fbb-a1ff-eabad45a7e9a - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:25:58.207 4088 3038340490344 MainThread INFO nova.compute.manager [req-9c3f04c2-66d1-4fbb-a1ff-eabad45a7e9a - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:25:59.116 4088 3038342147064 MainThread DEBUG os_win.utils.jobutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': '522609B5-C7B5-4F13-93AC-1683A3019015', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15584), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:25:59.313 4088 3038340490344 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:25:59.313 4088 3038340490344 MainThread INFO nova.compute.manager [-] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] VM Stopped (Lifecycle Event) 2021-09-10 17:25:59.313 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000083" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:25:59.313 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000083" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:25:59.334 4088 3038340490344 MainThread DEBUG nova.compute.manager [req-0f5cb08a-891f-4700-a8d8-dbc2d3efaf5c - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:25:59.334 4088 3038340490344 MainThread DEBUG nova.virt.hyperv.vmops [req-0f5cb08a-891f-4700-a8d8-dbc2d3efaf5c - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:25:59.374 4088 3038342147064 MainThread ERROR os_win.utils.jobutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000083\' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)instance-000000830EE916E7-7DF0-4713-91BE-A2853E44FA4012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)instance-000000830EE916E7-7DF0-4713-91BE-A2853E44FA4010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000083\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)instance-000000830EE916E7-7DF0-4713-91BE-A2853E44FA40%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '522609B5-C7B5-4F13-93AC-1683A3019015', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=131046), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 25, 59), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 25, 59), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000083' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)\n\nNot enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)\n\n'instance-00000083' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)", 'ErrorSummaryDescription': "'instance-00000083' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000083.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:25:59.374 4088 3038342147064 MainThread DEBUG os_win._utils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000083' failed to start. Not enough memory in the system to start the virtual machine instance-00000083. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000083' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Not enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) 'instance-00000083' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.789886236190796 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:25:59.379 4088 3038340490344 MainThread DEBUG nova.compute.manager [req-0f5cb08a-891f-4700-a8d8-dbc2d3efaf5c - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:25:59.396 4088 3038340490344 MainThread INFO nova.compute.manager [req-0f5cb08a-891f-4700-a8d8-dbc2d3efaf5c - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:25:59.536 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:26:00.412 4088 3038342147064 MainThread DEBUG os_win.utils.jobutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': '9AB6E04A-F900-4583-A46C-A94A3A530CF9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15542), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:26:00.571 4088 3038340490344 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:26:00.571 4088 3038340490344 MainThread INFO nova.compute.manager [-] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] VM Stopped (Lifecycle Event) 2021-09-10 17:26:00.571 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000083" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:26:00.571 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000083" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:26:00.571 4088 3038342147064 MainThread ERROR os_win.utils.jobutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000083\' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)instance-000000830EE916E7-7DF0-4713-91BE-A2853E44FA4012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)instance-000000830EE916E7-7DF0-4713-91BE-A2853E44FA4010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000083\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)instance-000000830EE916E7-7DF0-4713-91BE-A2853E44FA40%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9AB6E04A-F900-4583-A46C-A94A3A530CF9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111039), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 26), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 26), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000083' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)\n\nNot enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)\n\n'instance-00000083' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)", 'ErrorSummaryDescription': "'instance-00000083' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000083.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:26:00.571 4088 3038342147064 MainThread DEBUG os_win._utils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000083' failed to start. Not enough memory in the system to start the virtual machine instance-00000083. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000083' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Not enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) 'instance-00000083' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.987314701080322 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:26:00.584 4088 3038340490344 MainThread DEBUG nova.compute.manager [req-d2ce18c9-176f-46e8-9737-ac3fc48a058b - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:26:00.584 4088 3038340490344 MainThread DEBUG nova.virt.hyperv.vmops [req-d2ce18c9-176f-46e8-9737-ac3fc48a058b - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:26:00.631 4088 3038340490344 MainThread DEBUG nova.compute.manager [req-d2ce18c9-176f-46e8-9737-ac3fc48a058b - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:26:00.655 4088 3038340490344 MainThread INFO nova.compute.manager [req-d2ce18c9-176f-46e8-9737-ac3fc48a058b - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:26:01.594 4088 3038342147064 MainThread DEBUG os_win.utils.jobutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': '857EFD9E-2D82-49BD-ABAA-82924C35163A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18773), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:26:01.733 4088 3038342147064 MainThread ERROR os_win.utils.jobutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000083\' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)instance-000000830EE916E7-7DF0-4713-91BE-A2853E44FA4012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)instance-000000830EE916E7-7DF0-4713-91BE-A2853E44FA4010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000083\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)instance-000000830EE916E7-7DF0-4713-91BE-A2853E44FA40%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '857EFD9E-2D82-49BD-ABAA-82924C35163A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112816), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 26, 1), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 26, 1), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000083' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)\n\nNot enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)\n\n'instance-00000083' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40)", 'ErrorSummaryDescription': "'instance-00000083' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000083.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:26:01.733 4088 3038342147064 MainThread ERROR nova.virt.hyperv.vmops [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Failed to change vm state of instance-00000083 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000083' failed to start. 2021-09-10 17:26:01.733 4088 3038342147064 MainThread INFO nova.virt.hyperv.vmops [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Got request to destroy instance 2021-09-10 17:26:01.771 4088 3038340490344 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:26:01.771 4088 3038340490344 MainThread INFO nova.compute.manager [-] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] VM Stopped (Lifecycle Event) 2021-09-10 17:26:01.771 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000083" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:26:01.771 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000083" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:26:01.787 4088 3038340490344 MainThread DEBUG nova.compute.manager [req-315ac7fe-769e-4dc1-960c-316c55262163 - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:26:01.787 4088 3038340490344 MainThread DEBUG nova.virt.hyperv.vmops [req-315ac7fe-769e-4dc1-960c-316c55262163 - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:26:01.832 4088 3038340490344 MainThread DEBUG nova.compute.manager [req-315ac7fe-769e-4dc1-960c-316c55262163 - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:26:01.867 4088 3038340490344 MainThread INFO nova.compute.manager [req-315ac7fe-769e-4dc1-960c-316c55262163 - - - - -] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:26:03.561 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.vmops [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:26:03.561 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000083" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:26:03.561 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000083" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:26:03.577 4088 3038342147064 MainThread DEBUG os_win.utils.compute.vmutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Successfully changed vm state of instance-00000083 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:26:03.577 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.vmops [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Successfully changed state of VM instance-00000083 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:26:03.619 4088 3038342147064 MainThread DEBUG os_win.utils.jobutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': '471E099B-5B6E-402E-A90E-5B6CF845BF52', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14644), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:26:03.749 4088 3038342147064 MainThread DEBUG os_win.utils.jobutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job succeeded: {'InstanceID': '471E099B-5B6E-402E-A90E-5B6CF845BF52', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=105971), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:26:03.749 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000083" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:26:03.749 4088 3038342147064 MainThread DEBUG os_win.utils.pathutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Removing directory: C:\openstack\instances\instance-00000083 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:26:03.749 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000083" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:26:03.749 4088 3038342147064 MainThread ERROR nova.compute.manager [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000083' failed to start. Not enough memory in the system to start the virtual machine instance-00000083. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000083' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Not enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) 'instance-00000083' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Error code: 32778. 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Traceback (most recent call last): 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] return function(*args, **kwargs) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] admin_password, network_info, block_device_info) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] return function(self, *args, **kwds) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self.force_reraise() 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] raise self.value 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] should_plug_vifs=False) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 'req_state': req_state}) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self.force_reraise() 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] raise self.value 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] time.sleep(sleep_time) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self.force_reraise() 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] raise self.value 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] return f(*args, **kwargs) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] return self._wait_for_job(job_path) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] error_desc=err_desc) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000083' failed to start. 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Not enough memory in the system to start the virtual machine instance-00000083. 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000083' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Not enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 'instance-00000083' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Error code: 32778. 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] During handling of the above exception, another exception occurred: 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Traceback (most recent call last): 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] yield resources 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] accel_info=accel_info) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] return function(*args, **kwargs) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] admin_password, network_info, block_device_info) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] return function(self, *args, **kwds) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self.force_reraise() 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] raise self.value 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] should_plug_vifs=False) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 'req_state': req_state}) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self.force_reraise() 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] raise self.value 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] time.sleep(sleep_time) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self.force_reraise() 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] raise self.value 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] return f(*args, **kwargs) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] return self._wait_for_job(job_path) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] error_desc=err_desc) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000083' failed to start. 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Not enough memory in the system to start the virtual machine instance-00000083. 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000083' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Not enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 'instance-00000083' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Error code: 32778. 2021-09-10 17:26:03.749 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:03.749 4088 3038342147064 MainThread INFO nova.compute.manager [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Terminating instance 2021-09-10 17:26:03.749 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:26:03.749 4088 3038342147064 MainThread INFO nova.virt.hyperv.vmops [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Got request to destroy instance 2021-09-10 17:26:03.788 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.vmops [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:26:03.788 4088 3038342147064 MainThread DEBUG os_brick.initiator.windows.iscsi [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-5f36efd2-4359-43b8-bbad-c199178f098b', 'target_lun': 0, 'volume_id': '5f36efd2-4359-43b8-bbad-c199178f098b', 'auth_method': 'CHAP', 'auth_username': 'DhfLE9qb4MypNwLEAe2n', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:26:03.788 4088 3038342147064 MainThread DEBUG os_win.utils.storage.diskutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:26:03.885 4088 3038342147064 MainThread DEBUG os_win.utils.storage.diskutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:26:03.885 4088 3038342147064 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-5f36efd2-4359-43b8-bbad-c199178f098b logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 17:26:03.953 4088 3038342147064 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Removing iSCSI target persistent login: iqn.2010-10.org.openstack:volume-5f36efd2-4359-43b8-bbad-c199178f098b _remove_target_persistent_logins c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:495 2021-09-10 17:26:03.953 4088 3038342147064 MainThread DEBUG os_brick.initiator.windows.iscsi [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] <== disconnect_volume: return (165ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:26:03.953 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000083" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:26:03.953 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000083" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:26:03.953 4088 3038342147064 MainThread INFO nova.compute.manager [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Took 0.20 seconds to destroy the instance on the hypervisor. 2021-09-10 17:26:05.490 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:26:05.490 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:26:05.490 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:26:05.490 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:26:07.210 4088 3038342147064 MainThread INFO nova.compute.manager [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Took 3.25 seconds to detach 1 volumes for instance. 2021-09-10 17:26:07.210 4088 3038342147064 MainThread DEBUG nova.compute.claims [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:26:07.210 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:26:07.303 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.hostops [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:26:07.319 4088 3038342147064 MainThread DEBUG nova.virt.hyperv.hostops [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:26:07.511 4088 3038342147064 MainThread DEBUG nova.compute.provider_tree [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:26:07.530 4088 3038342147064 MainThread DEBUG nova.scheduler.client.report [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:26:07.530 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.329s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:26:07.530 4088 3038342147064 MainThread ERROR nova.compute.manager [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000083' failed to start. Not enough memory in the system to start the virtual machine instance-00000083. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000083' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Not enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) 'instance-00000083' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Error code: 32778. 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Traceback (most recent call last): 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] return function(*args, **kwargs) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] admin_password, network_info, block_device_info) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] return function(self, *args, **kwds) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self.force_reraise() 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] raise self.value 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] should_plug_vifs=False) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 'req_state': req_state}) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self.force_reraise() 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] raise self.value 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] time.sleep(sleep_time) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self.force_reraise() 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] raise self.value 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] return f(*args, **kwargs) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] return self._wait_for_job(job_path) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] error_desc=err_desc) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000083' failed to start. 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Not enough memory in the system to start the virtual machine instance-00000083. 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000083' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Not enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 'instance-00000083' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Error code: 32778. 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] During handling of the above exception, another exception occurred: 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Traceback (most recent call last): 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] accel_info=accel_info) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] return function(*args, **kwargs) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] admin_password, network_info, block_device_info) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] return function(self, *args, **kwds) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self.force_reraise() 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] raise self.value 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] should_plug_vifs=False) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 'req_state': req_state}) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self.force_reraise() 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] raise self.value 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] time.sleep(sleep_time) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self.force_reraise() 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] raise self.value 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] return f(*args, **kwargs) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] return self._wait_for_job(job_path) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] error_desc=err_desc) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000083' failed to start. 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Not enough memory in the system to start the virtual machine instance-00000083. 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000083' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Not enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 'instance-00000083' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Error code: 32778. 2021-09-10 17:26:07.530 4088 3038342147064 MainThread TRACE nova.compute.manager [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] 2021-09-10 17:26:07.545 4088 3038342147064 MainThread DEBUG nova.compute.utils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] WMI job failed with status 10. Error summary description: 'instance-00000083' failed to start. Not enough memory in the system to start the virtual machine instance-00000083. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:26:07.545 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Build of instance 996ac19a-6395-455e-85e7-1fc5add701a3 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000083' failed to start. Not enough memory in the system to start the virtual machine instance-00000083. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000083' failed to start. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Not enough memory in the system to start the virtual machine instance-00000083 with ram size 1024 megabytes. (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) 'instance-00000083' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 0EE916E7-7DF0-4713-91BE-A2853E44FA40) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:26:07.545 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:26:07.545 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:26:07.545 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:26:07.545 4088 3038342147064 MainThread DEBUG nova.network.neutron [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:26:08.006 4088 3038342147064 MainThread DEBUG nova.network.neutron [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:26:08.036 4088 3038342147064 MainThread INFO nova.compute.manager [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 996ac19a-6395-455e-85e7-1fc5add701a3] Took 0.49 seconds to deallocate network for instance. 2021-09-10 17:26:08.205 4088 3038342147064 MainThread INFO nova.scheduler.client.report [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Deleted allocations for instance 996ac19a-6395-455e-85e7-1fc5add701a3 2021-09-10 17:26:08.220 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-8747b1e5-700e-4b27-978d-57ba2007b70d 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "996ac19a-6395-455e-85e7-1fc5add701a3" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 29.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:26:09.484 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:26:09.484 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:26:11.481 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:26:12.482 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:26:12.482 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:26:12.553 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:26:12.553 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:26:13.076 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Updating instance_info_cache with network_info: [{"id": "83b451dc-a198-4ccd-9f65-c8fe6343aea3", "address": "fa:16:3e:44:7f:92", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap83b451dc-a1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:26:13.092 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:26:13.092 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:26:13.092 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:26:13.116 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:26:13.116 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:26:13.116 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:26:13.116 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:26:13.139 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:26:13.365 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2217MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:26:13.365 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:26:13.507 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:26:13.507 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:26:13.507 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:26:13.507 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:26:13.507 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:26:13.507 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:26:13.507 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:26:13.507 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:26:13.507 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:26:13.507 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:26:13.507 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:26:13.507 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:26:13.507 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:26:13.507 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:26:13.507 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:26:13.539 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:26:13.548 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:26:13.757 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:26:13.768 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:26:13.768 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:26:13.768 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:26:27.492 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._run_image_cache_manager_pass run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:26:27.492 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use..do_register_storage_use" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:26:27.492 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "storage-registry-lock" released by "nova.virt.storage_users.register_storage_use..do_register_storage_use" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:26:27.492 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users..do_get_storage_users" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:26:27.492 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "storage-registry-lock" released by "nova.virt.storage_users.get_storage_users..do_get_storage_users" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:26:55.186 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "58aa12fc-aae6-43d2-8479-9e7a28651c3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:26:55.210 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:26:55.296 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:26:55.296 4088 3038342144600 MainThread DEBUG nova.virt.hardware [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:26:55.296 4088 3038342144600 MainThread INFO nova.compute.claims [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Claim successful on node n-h2-808474-1 2021-09-10 17:26:55.403 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.hostops [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:26:55.434 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.hostops [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:26:55.632 4088 3038342144600 MainThread DEBUG nova.compute.provider_tree [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:26:55.653 4088 3038342144600 MainThread DEBUG nova.scheduler.client.report [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:26:55.653 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:26:55.653 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:26:55.711 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:26:55.726 4088 3038342144424 GreenThread-121 DEBUG nova.compute.manager [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:26:55.726 4088 3038342144424 GreenThread-121 DEBUG nova.network.neutron [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:26:55.781 4088 3038342144600 MainThread INFO nova.virt.block_device [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Booting with volume 1379018d-523d-44fa-961c-1c45d19b8980 at /dev/sda 2021-09-10 17:26:55.840 4088 3038342144424 GreenThread-121 DEBUG nova.policy [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82eacb807eb449a28e17290cd4d841d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0aa6ac8af84d7291f244f216bb94b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:26:55.840 4088 3038342144600 MainThread DEBUG os_brick.utils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:26:55.840 4088 3038342144600 MainThread DEBUG os_brick.utils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] <== get_connector_properties: return (0ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:26:55.840 4088 3038342144600 MainThread DEBUG nova.virt.block_device [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Updating existing volume attachment record: 0f97bd23-314c-4366-8339-6f959e70d9c0 _volume_attach c:\openstack\build\nova\nova\virt\block_device.py:556 2021-09-10 17:26:56.450 4088 3038342144424 GreenThread-121 DEBUG nova.network.neutron [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Successfully created port: a5fba3a7-abd2-4d63-a0d2-a6ce78184f99 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:26:57.117 4088 3038342144424 GreenThread-121 DEBUG nova.network.neutron [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Successfully updated port: a5fba3a7-abd2-4d63-a0d2-a6ce78184f99 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:26:57.132 4088 3038342144424 GreenThread-121 DEBUG oslo_concurrency.lockutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Acquired lock "refresh_cache-58aa12fc-aae6-43d2-8479-9e7a28651c3b" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:26:57.132 4088 3038342144424 GreenThread-121 DEBUG nova.network.neutron [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:26:57.186 4088 3038342145304 MainThread DEBUG nova.compute.manager [req-1172c187-b0e5-4109-b0b0-ec3991dd05a4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Received event network-changed-a5fba3a7-abd2-4d63-a0d2-a6ce78184f99 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:26:57.186 4088 3038342145304 MainThread DEBUG nova.compute.manager [req-1172c187-b0e5-4109-b0b0-ec3991dd05a4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Refreshing instance network info cache due to event network-changed-a5fba3a7-abd2-4d63-a0d2-a6ce78184f99. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:26:57.231 4088 3038342144424 GreenThread-121 DEBUG nova.network.neutron [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:26:57.548 4088 3038342144424 GreenThread-121 DEBUG nova.network.neutron [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Updating instance_info_cache with network_info: [{"id": "a5fba3a7-abd2-4d63-a0d2-a6ce78184f99", "address": "fa:16:3e:b4:e1:b3", "network": {"id": "385c7b14-693f-45e3-86cf-8a54c842098b", "bridge": null, "label": "tempest-TestVolumeBootPattern-577893151-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d0aa6ac8af84d7291f244f216bb94b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa5fba3a7-ab", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:26:57.590 4088 3038342144424 GreenThread-121 DEBUG oslo_concurrency.lockutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Releasing lock "refresh_cache-58aa12fc-aae6-43d2-8479-9e7a28651c3b" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:26:57.590 4088 3038342144424 GreenThread-121 DEBUG nova.compute.manager [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Instance network_info: |[{"id": "a5fba3a7-abd2-4d63-a0d2-a6ce78184f99", "address": "fa:16:3e:b4:e1:b3", "network": {"id": "385c7b14-693f-45e3-86cf-8a54c842098b", "bridge": null, "label": "tempest-TestVolumeBootPattern-577893151-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d0aa6ac8af84d7291f244f216bb94b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa5fba3a7-ab", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:26:57.590 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-1172c187-b0e5-4109-b0b0-ec3991dd05a4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-58aa12fc-aae6-43d2-8479-9e7a28651c3b" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:26:57.590 4088 3038342145304 MainThread DEBUG nova.network.neutron [req-1172c187-b0e5-4109-b0b0-ec3991dd05a4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Refreshing network info cache for port a5fba3a7-abd2-4d63-a0d2-a6ce78184f99 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:26:58.342 4088 3038342145304 MainThread DEBUG nova.network.neutron [req-1172c187-b0e5-4109-b0b0-ec3991dd05a4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Updated VIF entry in instance network info cache for port a5fba3a7-abd2-4d63-a0d2-a6ce78184f99. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:26:58.342 4088 3038342145304 MainThread DEBUG nova.network.neutron [req-1172c187-b0e5-4109-b0b0-ec3991dd05a4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Updating instance_info_cache with network_info: [{"id": "a5fba3a7-abd2-4d63-a0d2-a6ce78184f99", "address": "fa:16:3e:b4:e1:b3", "network": {"id": "385c7b14-693f-45e3-86cf-8a54c842098b", "bridge": null, "label": "tempest-TestVolumeBootPattern-577893151-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d0aa6ac8af84d7291f244f216bb94b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa5fba3a7-ab", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:26:58.382 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-1172c187-b0e5-4109-b0b0-ec3991dd05a4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-58aa12fc-aae6-43d2-8479-9e7a28651c3b" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:26:59.824 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:26:59.840 4088 3038342144600 MainThread INFO nova.virt.hyperv.vmops [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Spawning new instance 2021-09-10 17:26:59.856 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000084" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:26:59.856 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000084" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:26:59.866 4088 3038342144600 MainThread DEBUG nova.block_device [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] block_device_list ['sda'] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:26:59.866 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Preparing to wait for external event network-vif-plugged-a5fba3a7-abd2-4d63-a0d2-a6ce78184f99 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:26:59.866 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "58aa12fc-aae6-43d2-8479-9e7a28651c3b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:26:59.866 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "58aa12fc-aae6-43d2-8479-9e7a28651c3b-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:26:59.866 4088 3038342144600 MainThread DEBUG os_win.utils.compute.vmutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Creating VM instance-00000084 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:27:00.575 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:27:00.918 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.volumeops [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Attaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-1379018d-523d-44fa-961c-1c45d19b8980', 'target_lun': 0, 'volume_id': '1379018d-523d-44fa-961c-1c45d19b8980', 'auth_method': 'CHAP', 'auth_username': 'ZhSmYdnG6t2N8fdpK8zj', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'reserved', 'instance': '58aa12fc-aae6-43d2-8479-9e7a28651c3b', 'attached_at': '', 'detached_at': '', 'volume_id': '1379018d-523d-44fa-961c-1c45d19b8980', 'serial': '1379018d-523d-44fa-961c-1c45d19b8980'} to instance-00000084 _attach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:108 2021-09-10 17:27:00.918 4088 3038342144600 MainThread DEBUG os_brick.initiator.windows.iscsi [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-1379018d-523d-44fa-961c-1c45d19b8980', 'target_lun': 0, 'volume_id': '1379018d-523d-44fa-961c-1c45d19b8980', 'auth_method': 'CHAP', 'auth_username': 'ZhSmYdnG6t2N8fdpK8zj', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:27:00.931 4088 3038342144600 MainThread INFO os_brick.initiator.windows.iscsi [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Attempting to establish an iSCSI session to target iqn.2010-10.org.openstack:volume-1379018d-523d-44fa-961c-1c45d19b8980 on portal 10.222.0.55:3260 accessing LUN 0 using initiator None. 2021-09-10 17:27:00.931 4088 3038342144600 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Logging in iSCSI target iqn.2010-10.org.openstack:volume-1379018d-523d-44fa-961c-1c45d19b8980 login_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:401 2021-09-10 17:27:05.965 4088 3038342144600 MainThread DEBUG os_win.utils.storage.diskutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:27:06.092 4088 3038342144600 MainThread DEBUG os_win.utils.storage.diskutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:27:06.152 4088 3038342144600 MainThread DEBUG os_brick.initiator.windows.iscsi [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] <== connect_volume: return (5221ms) {'type': 'block', 'path': '\\\\.\\PhysicalDrive1', 'number': 1, 'scsi_wwn': '3600140585F066191FAE4A03A51DBA250'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:27:06.484 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:27:06.484 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:27:06.484 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:27:06.727 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:27:07.480 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:27:09.474 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:27:09.496 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:27:10.513 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:27:11.477 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:27:12.695 4088 3038342144776 MainThread DEBUG nova.compute.manager [req-9e828713-cc94-4291-b8f0-9853d4a4cfe5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Received event network-vif-plugged-a5fba3a7-abd2-4d63-a0d2-a6ce78184f99 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:27:12.695 4088 3038342144776 MainThread DEBUG oslo_concurrency.lockutils [req-9e828713-cc94-4291-b8f0-9853d4a4cfe5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "58aa12fc-aae6-43d2-8479-9e7a28651c3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:12.695 4088 3038342144776 MainThread DEBUG oslo_concurrency.lockutils [req-9e828713-cc94-4291-b8f0-9853d4a4cfe5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "58aa12fc-aae6-43d2-8479-9e7a28651c3b-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:12.695 4088 3038342144776 MainThread DEBUG nova.compute.manager [req-9e828713-cc94-4291-b8f0-9853d4a4cfe5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Processing event network-vif-plugged-a5fba3a7-abd2-4d63-a0d2-a6ce78184f99 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:27:12.717 4088 3038342144600 MainThread INFO nova.virt.hyperv.vmops [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Using config drive for instance 2021-09-10 17:27:12.837 4088 3038342144600 MainThread INFO nova.virt.hyperv.vmops [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Creating config drive at C:\openstack\instances\instance-00000084\configdrive.iso 2021-09-10 17:27:12.930 4088 3038342144600 MainThread DEBUG oslo_concurrency.processutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000084\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp_60hms9i execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:27:13.248 4088 3038342144600 MainThread DEBUG oslo_concurrency.processutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000084\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp_60hms9i" returned: 0 in 0.312s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:27:13.480 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:27:13.488 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:27:13.509 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:13.509 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:13.509 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:27:13.509 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:27:13.524 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:27:13.769 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Setting boot order for instance: instance-00000084: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:27:13.805 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2218MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:27:13.805 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:13.852 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:27:13.906 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': 'E745CE0E-F4EE-48CD-B41F-C4AD5D400BA6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=36534), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:27:14.009 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:27:14.009 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:27:14.009 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:27:14.009 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:27:14.009 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:27:14.009 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:27:14.009 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:27:14.009 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:27:14.009 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:27:14.009 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:27:14.009 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:27:14.009 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:27:14.009 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:27:14.009 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 58aa12fc-aae6-43d2-8479-9e7a28651c3b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:27:14.009 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:27:14.024 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:27:14.035 4088 3038342144600 MainThread ERROR os_win.utils.jobutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000084\' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)instance-00000084311A3FC2-7107-4CAA-B29A-DFFFA85754FF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)instance-00000084311A3FC2-7107-4CAA-B29A-DFFFA85754FF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000084\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)instance-00000084311A3FC2-7107-4CAA-B29A-DFFFA85754FF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E745CE0E-F4EE-48CD-B41F-C4AD5D400BA6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114886), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 27, 13), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 27, 13), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000084' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)\n\nNot enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)\n\n'instance-00000084' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)", 'ErrorSummaryDescription': "'instance-00000084' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000084.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:27:14.035 4088 3038342144600 MainThread DEBUG os_win._utils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000084' failed to start. Not enough memory in the system to start the virtual machine instance-00000084. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000084' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Not enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) 'instance-00000084' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1825714111328125 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:27:14.072 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing inventories for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:757 2021-09-10 17:27:14.072 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000084" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:14.072 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000084" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:14.072 4088 3038342144424 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:27:14.072 4088 3038342144424 MainThread INFO nova.compute.manager [-] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] VM Stopped (Lifecycle Event) 2021-09-10 17:27:14.092 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-22611f37-913a-4e02-9695-1beeeef0bfb6 - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:27:14.092 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.vmops [req-22611f37-913a-4e02-9695-1beeeef0bfb6 - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:14.092 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Updating ProviderTree inventory for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 from _refresh_and_get_inventory using data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} _refresh_and_get_inventory c:\openstack\build\nova\nova\scheduler\client\report.py:723 2021-09-10 17:27:14.092 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Updating inventory in ProviderTree for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 with inventory: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:176 2021-09-10 17:27:14.123 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing aggregate associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, aggregates: None _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:766 2021-09-10 17:27:14.152 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-22611f37-913a-4e02-9695-1beeeef0bfb6 - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:27:14.152 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing trait associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_VHD,COMPUTE_IMAGE_TYPE_VHDX,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:778 2021-09-10 17:27:14.152 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:27:14.152 4088 3038342144424 MainThread INFO nova.compute.manager [req-22611f37-913a-4e02-9695-1beeeef0bfb6 - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:27:14.188 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:27:14.374 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:27:14.402 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:27:14.402 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:27:14.402 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:15.048 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': '1D2912D3-DFE3-4E88-B61F-7F2AEBBC539B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15095), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:27:15.195 4088 3038342144600 MainThread ERROR os_win.utils.jobutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000084\' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)instance-00000084311A3FC2-7107-4CAA-B29A-DFFFA85754FF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)instance-00000084311A3FC2-7107-4CAA-B29A-DFFFA85754FF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000084\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)instance-00000084311A3FC2-7107-4CAA-B29A-DFFFA85754FF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1D2912D3-DFE3-4E88-B61F-7F2AEBBC539B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114278), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 27, 15), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 27, 15), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000084' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)\n\nNot enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)\n\n'instance-00000084' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)", 'ErrorSummaryDescription': "'instance-00000084' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000084.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:27:15.195 4088 3038342144600 MainThread DEBUG os_win._utils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000084' failed to start. Not enough memory in the system to start the virtual machine instance-00000084. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000084' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Not enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) 'instance-00000084' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3431987762451172 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:27:15.243 4088 3038342144424 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:27:15.243 4088 3038342144424 MainThread INFO nova.compute.manager [-] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] VM Stopped (Lifecycle Event) 2021-09-10 17:27:15.243 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000084" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:15.243 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000084" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:15.258 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-bc029e4b-75f7-4c56-900d-c9fef2849ecf - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:27:15.258 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.vmops [req-bc029e4b-75f7-4c56-900d-c9fef2849ecf - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:15.303 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-bc029e4b-75f7-4c56-900d-c9fef2849ecf - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:27:15.321 4088 3038342144424 MainThread INFO nova.compute.manager [req-bc029e4b-75f7-4c56-900d-c9fef2849ecf - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:27:15.399 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:27:15.399 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:27:15.477 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-9db39d70-5120-4de4-bb87-480a6efb8a3a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:27:15.477 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:27:15.962 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Updating instance_info_cache with network_info: [{"id": "66953b8a-00d2-4045-8dae-abe4c015822d", "address": "fa:16:3e:7a:90:37", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap66953b8a-00", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:27:15.986 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-9db39d70-5120-4de4-bb87-480a6efb8a3a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:27:15.986 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:27:15.986 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_power_states run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:27:16.055 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 18930e09-cd62-4d3e-b27f-e9541dfa3efc _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:27:16.055 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:27:16.055 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 66c5445c-c347-4833-8af8-58ba8ff6d95e _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:27:16.055 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:27:16.055 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9db39d70-5120-4de4-bb87-480a6efb8a3a _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:27:16.055 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 0e77fafa-3f8a-4513-bb64-518c77e99029 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:27:16.055 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 50586591-86ba-41be-b4e1-5004ea0d76dd _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:27:16.055 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 98da4c02-e4db-4a02-a807-c737f9038672 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:27:16.055 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 359fd482-69f5-4194-9466-f46ea31258d3 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:27:16.055 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 6a33a253-c7b1-44b1-bdc0-eca64733ab55 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:27:16.055 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 592bb39a-81cb-43f8-a643-b04092bd9e8a _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:27:16.055 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9446e666-4364-4dcd-b041-405653a856bd _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:27:16.055 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9bb2d354-2d76-40ea-8b9c-b18a21edefbb _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:27:16.055 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 58aa12fc-aae6-43d2-8479-9e7a28651c3b _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:27:16.055 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:16.055 4088 3038342145304 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:16.055 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:16.055 4088 3038342146888 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:16.055 4088 3038342146536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:16.055 4088 3038342146536 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:16.055 4088 3038342257304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9446e666-4364-4dcd-b041-405653a856bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:16.071 4088 3038342257304 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 9446e666-4364-4dcd-b041-405653a856bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:16.071 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:16.071 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:16.071 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:16.071 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:16.071 4088 3038342255368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:16.071 4088 3038342255368 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:16.075 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "359fd482-69f5-4194-9466-f46ea31258d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:16.075 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:16.075 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "98da4c02-e4db-4a02-a807-c737f9038672" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:16.075 4088 3038296678072 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:16.075 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:16.075 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:16.075 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:16.075 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:16.075 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:16.075 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:16.075 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:16.075 4088 3038342144248 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:16.173 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.109s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:16.203 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.125s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:16.203 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.125s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:16.237 4088 3038342257304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9446e666-4364-4dcd-b041-405653a856bd" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.172s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:16.248 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': 'B3A7A3C8-9522-4780-A306-E5C74260C696', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14654), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:27:16.248 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "98da4c02-e4db-4a02-a807-c737f9038672" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.172s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:16.248 4088 3038342146536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.187s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:16.248 4088 3038296678248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "359fd482-69f5-4194-9466-f46ea31258d3" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.172s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:16.248 4088 3038342255368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.172s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:16.289 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.219s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:16.289 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.234s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:16.289 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.219s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:16.303 4088 3038342144248 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.235s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:16.303 4088 3038342144424 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.235s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:16.384 4088 3038342144600 MainThread ERROR os_win.utils.jobutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000084\' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)instance-00000084311A3FC2-7107-4CAA-B29A-DFFFA85754FF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)instance-00000084311A3FC2-7107-4CAA-B29A-DFFFA85754FF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000084\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)instance-00000084311A3FC2-7107-4CAA-B29A-DFFFA85754FF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B3A7A3C8-9522-4780-A306-E5C74260C696', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114917), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 27, 16), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 27, 16), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000084' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)\n\nNot enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)\n\n'instance-00000084' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)", 'ErrorSummaryDescription': "'instance-00000084' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000084.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:27:16.384 4088 3038342144600 MainThread DEBUG os_win._utils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000084' failed to start. Not enough memory in the system to start the virtual machine instance-00000084. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000084' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Not enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) 'instance-00000084' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5313849449157715 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:27:16.446 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000084" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:16.446 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000084" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:16.446 4088 3038296678248 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:27:16.446 4088 3038296678248 MainThread INFO nova.compute.manager [-] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] VM Stopped (Lifecycle Event) 2021-09-10 17:27:16.461 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-f3049975-b7f7-45fe-8569-cfc77d0432e3 - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:27:16.461 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-f3049975-b7f7-45fe-8569-cfc77d0432e3 - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:16.476 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_incomplete_migrations run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:27:16.476 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances with incomplete migration _cleanup_incomplete_migrations c:\openstack\build\nova\nova\compute\manager.py:10640 2021-09-10 17:27:16.499 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-f3049975-b7f7-45fe-8569-cfc77d0432e3 - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:27:16.522 4088 3038296678248 MainThread INFO nova.compute.manager [req-f3049975-b7f7-45fe-8569-cfc77d0432e3 - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:27:17.402 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': '2C90AB11-8546-4082-936B-6BE3B3A73A2E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15443), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:27:17.561 4088 3038342144600 MainThread ERROR os_win.utils.jobutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000084\' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)instance-00000084311A3FC2-7107-4CAA-B29A-DFFFA85754FF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)instance-00000084311A3FC2-7107-4CAA-B29A-DFFFA85754FF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000084\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)instance-00000084311A3FC2-7107-4CAA-B29A-DFFFA85754FF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '2C90AB11-8546-4082-936B-6BE3B3A73A2E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111304), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 27, 17), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 27, 17), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000084' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)\n\nNot enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)\n\n'instance-00000084' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)", 'ErrorSummaryDescription': "'instance-00000084' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000084.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:27:17.561 4088 3038342144600 MainThread DEBUG os_win._utils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000084' failed to start. Not enough memory in the system to start the virtual machine instance-00000084. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000084' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Not enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) 'instance-00000084' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7084732055664062 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:27:17.601 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000084" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:17.601 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000084" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:17.601 4088 3038296678248 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:27:17.601 4088 3038296678248 MainThread INFO nova.compute.manager [-] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] VM Stopped (Lifecycle Event) 2021-09-10 17:27:17.608 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-c8e94dee-bd22-4137-9b6a-8675cf652d3e - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:27:17.608 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-c8e94dee-bd22-4137-9b6a-8675cf652d3e - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:17.663 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-c8e94dee-bd22-4137-9b6a-8675cf652d3e - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:27:17.680 4088 3038296678248 MainThread INFO nova.compute.manager [req-c8e94dee-bd22-4137-9b6a-8675cf652d3e - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:27:18.592 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': 'BD7D90B6-9407-4014-8BEA-127B50CC9DCA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18405), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:27:18.734 4088 3038342144600 MainThread ERROR os_win.utils.jobutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000084\' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)instance-00000084311A3FC2-7107-4CAA-B29A-DFFFA85754FF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)instance-00000084311A3FC2-7107-4CAA-B29A-DFFFA85754FF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000084\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)instance-00000084311A3FC2-7107-4CAA-B29A-DFFFA85754FF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BD7D90B6-9407-4014-8BEA-127B50CC9DCA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114017), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 27, 18), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 27, 18), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000084' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)\n\nNot enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)\n\n'instance-00000084' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)", 'ErrorSummaryDescription': "'instance-00000084' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000084.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:27:18.734 4088 3038342144600 MainThread DEBUG os_win._utils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000084' failed to start. Not enough memory in the system to start the virtual machine instance-00000084. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000084' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Not enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) 'instance-00000084' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.8814697265625 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:27:18.781 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000084" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:18.781 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000084" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:18.781 4088 3038296678248 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:27:18.781 4088 3038296678248 MainThread INFO nova.compute.manager [-] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] VM Stopped (Lifecycle Event) 2021-09-10 17:27:18.797 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-54811fd8-57c3-4447-b76d-85842daba1d0 - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:27:18.797 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-54811fd8-57c3-4447-b76d-85842daba1d0 - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:18.841 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-54811fd8-57c3-4447-b76d-85842daba1d0 - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:27:18.871 4088 3038296678248 MainThread INFO nova.compute.manager [req-54811fd8-57c3-4447-b76d-85842daba1d0 - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:27:19.747 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': '16921910-968D-44F9-B294-3881E9E87F3F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15554), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:27:19.899 4088 3038342144600 MainThread ERROR os_win.utils.jobutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000084\' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)instance-00000084311A3FC2-7107-4CAA-B29A-DFFFA85754FF12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)instance-00000084311A3FC2-7107-4CAA-B29A-DFFFA85754FF10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000084\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)instance-00000084311A3FC2-7107-4CAA-B29A-DFFFA85754FF%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '16921910-968D-44F9-B294-3881E9E87F3F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112321), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 27, 19), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 27, 19), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000084' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)\n\nNot enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)\n\n'instance-00000084' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF)", 'ErrorSummaryDescription': "'instance-00000084' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000084.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:27:19.899 4088 3038342144600 MainThread ERROR nova.virt.hyperv.vmops [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Failed to change vm state of instance-00000084 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000084' failed to start. 2021-09-10 17:27:19.899 4088 3038342144600 MainThread INFO nova.virt.hyperv.vmops [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Got request to destroy instance 2021-09-10 17:27:19.931 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000084" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:19.931 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000084" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:19.931 4088 3038296678248 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:27:19.931 4088 3038296678248 MainThread INFO nova.compute.manager [-] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] VM Stopped (Lifecycle Event) 2021-09-10 17:27:19.962 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-e5917a35-cad1-41d8-a447-ebb365a029f1 - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:27:19.962 4088 3038296678248 MainThread DEBUG nova.virt.hyperv.vmops [req-e5917a35-cad1-41d8-a447-ebb365a029f1 - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:27:20.009 4088 3038296678248 MainThread DEBUG nova.compute.manager [req-e5917a35-cad1-41d8-a447-ebb365a029f1 - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:27:20.027 4088 3038296678248 MainThread INFO nova.compute.manager [req-e5917a35-cad1-41d8-a447-ebb365a029f1 - - - - -] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:27:21.713 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:27:21.713 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000084" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:21.713 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000084" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:21.728 4088 3038342144600 MainThread DEBUG os_win.utils.compute.vmutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Successfully changed vm state of instance-00000084 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:27:21.728 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Successfully changed state of VM instance-00000084 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:27:21.744 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:27:21.761 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Waiting for WMI job: {'InstanceID': 'C3A569BD-8115-4BE0-8B43-B90CF5824317', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14728), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:27:21.875 4088 3038342144600 MainThread DEBUG os_win.utils.jobutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] WMI job succeeded: {'InstanceID': 'C3A569BD-8115-4BE0-8B43-B90CF5824317', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=114080), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:27:21.875 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000084" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:21.875 4088 3038342144600 MainThread DEBUG os_win.utils.pathutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Removing directory: C:\openstack\instances\instance-00000084 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:27:21.875 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000084" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:21.875 4088 3038342144600 MainThread ERROR nova.compute.manager [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000084' failed to start. Not enough memory in the system to start the virtual machine instance-00000084. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000084' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Not enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) 'instance-00000084' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Error code: 32778. 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Traceback (most recent call last): 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] return function(*args, **kwargs) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] admin_password, network_info, block_device_info) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] return function(self, *args, **kwds) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self.force_reraise() 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] raise self.value 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] should_plug_vifs=False) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 'req_state': req_state}) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self.force_reraise() 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] raise self.value 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] time.sleep(sleep_time) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self.force_reraise() 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] raise self.value 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] return f(*args, **kwargs) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] return self._wait_for_job(job_path) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] error_desc=err_desc) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000084' failed to start. 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Not enough memory in the system to start the virtual machine instance-00000084. 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000084' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Not enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 'instance-00000084' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Error code: 32778. 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] During handling of the above exception, another exception occurred: 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Traceback (most recent call last): 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] yield resources 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] accel_info=accel_info) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] return function(*args, **kwargs) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] admin_password, network_info, block_device_info) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] return function(self, *args, **kwds) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self.force_reraise() 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] raise self.value 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] should_plug_vifs=False) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 'req_state': req_state}) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self.force_reraise() 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] raise self.value 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] time.sleep(sleep_time) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self.force_reraise() 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] raise self.value 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] return f(*args, **kwargs) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] return self._wait_for_job(job_path) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] error_desc=err_desc) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000084' failed to start. 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Not enough memory in the system to start the virtual machine instance-00000084. 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000084' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Not enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 'instance-00000084' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Error code: 32778. 2021-09-10 17:27:21.875 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:21.875 4088 3038342144600 MainThread INFO nova.compute.manager [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Terminating instance 2021-09-10 17:27:21.875 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:27:21.875 4088 3038342144600 MainThread INFO nova.virt.hyperv.vmops [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Got request to destroy instance 2021-09-10 17:27:21.904 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.vmops [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:27:21.904 4088 3038342144600 MainThread DEBUG os_brick.initiator.windows.iscsi [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-1379018d-523d-44fa-961c-1c45d19b8980', 'target_lun': 0, 'volume_id': '1379018d-523d-44fa-961c-1c45d19b8980', 'auth_method': 'CHAP', 'auth_username': 'ZhSmYdnG6t2N8fdpK8zj', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:27:21.904 4088 3038342144600 MainThread DEBUG os_win.utils.storage.diskutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:27:21.995 4088 3038342144600 MainThread DEBUG os_win.utils.storage.diskutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:27:22.011 4088 3038342144600 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-1379018d-523d-44fa-961c-1c45d19b8980 logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 17:27:22.083 4088 3038342144600 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Removing iSCSI target persistent login: iqn.2010-10.org.openstack:volume-1379018d-523d-44fa-961c-1c45d19b8980 _remove_target_persistent_logins c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:495 2021-09-10 17:27:22.083 4088 3038342144600 MainThread DEBUG os_brick.initiator.windows.iscsi [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] <== disconnect_volume: return (179ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:27:22.083 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000084" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:22.083 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "instance-00000084" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:22.083 4088 3038342144600 MainThread INFO nova.compute.manager [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Took 0.22 seconds to destroy the instance on the hypervisor. 2021-09-10 17:27:24.762 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-80df19fd-2a90-4198-b375-99c2984fee63 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Received event network-vif-unplugged-a5fba3a7-abd2-4d63-a0d2-a6ce78184f99 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:27:24.762 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-80df19fd-2a90-4198-b375-99c2984fee63 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "58aa12fc-aae6-43d2-8479-9e7a28651c3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:24.762 4088 3038296678072 MainThread DEBUG oslo_concurrency.lockutils [req-80df19fd-2a90-4198-b375-99c2984fee63 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "58aa12fc-aae6-43d2-8479-9e7a28651c3b-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:24.762 4088 3038296678072 MainThread DEBUG nova.compute.manager [req-80df19fd-2a90-4198-b375-99c2984fee63 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] No waiting events found dispatching network-vif-unplugged-a5fba3a7-abd2-4d63-a0d2-a6ce78184f99 pop_instance_event c:\openstack\build\nova\nova\compute\manager.py:319 2021-09-10 17:27:24.762 4088 3038296678072 MainThread WARNING nova.compute.manager [req-80df19fd-2a90-4198-b375-99c2984fee63 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Received unexpected event network-vif-unplugged-a5fba3a7-abd2-4d63-a0d2-a6ce78184f99 for instance with vm_state building and task_state spawning. 2021-09-10 17:27:25.322 4088 3038342144600 MainThread INFO nova.compute.manager [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Took 3.23 seconds to detach 1 volumes for instance. 2021-09-10 17:27:25.322 4088 3038342144600 MainThread DEBUG nova.compute.claims [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:27:25.322 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:25.417 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.hostops [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:27:25.432 4088 3038342144600 MainThread DEBUG nova.virt.hyperv.hostops [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:27:25.636 4088 3038342144600 MainThread DEBUG nova.compute.provider_tree [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:27:25.649 4088 3038342144600 MainThread DEBUG nova.scheduler.client.report [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:27:25.649 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.329s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:25.649 4088 3038342144600 MainThread ERROR nova.compute.manager [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000084' failed to start. Not enough memory in the system to start the virtual machine instance-00000084. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000084' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Not enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) 'instance-00000084' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Error code: 32778. 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Traceback (most recent call last): 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] return function(*args, **kwargs) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] admin_password, network_info, block_device_info) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] return function(self, *args, **kwds) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self.force_reraise() 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] raise self.value 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] should_plug_vifs=False) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 'req_state': req_state}) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self.force_reraise() 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] raise self.value 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] time.sleep(sleep_time) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self.force_reraise() 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] raise self.value 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] return f(*args, **kwargs) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] return self._wait_for_job(job_path) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] error_desc=err_desc) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000084' failed to start. 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Not enough memory in the system to start the virtual machine instance-00000084. 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000084' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Not enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 'instance-00000084' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Error code: 32778. 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] During handling of the above exception, another exception occurred: 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Traceback (most recent call last): 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] accel_info=accel_info) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] return function(*args, **kwargs) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] admin_password, network_info, block_device_info) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] return function(self, *args, **kwds) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self.force_reraise() 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] raise self.value 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] should_plug_vifs=False) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 'req_state': req_state}) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self.force_reraise() 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] raise self.value 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] time.sleep(sleep_time) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self.force_reraise() 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] raise self.value 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] return f(*args, **kwargs) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] return self._wait_for_job(job_path) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] error_desc=err_desc) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000084' failed to start. 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Not enough memory in the system to start the virtual machine instance-00000084. 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000084' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Not enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 'instance-00000084' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Error code: 32778. 2021-09-10 17:27:25.649 4088 3038342144600 MainThread TRACE nova.compute.manager [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] 2021-09-10 17:27:25.649 4088 3038342144600 MainThread DEBUG nova.compute.utils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] WMI job failed with status 10. Error summary description: 'instance-00000084' failed to start. Not enough memory in the system to start the virtual machine instance-00000084. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:27:25.649 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Build of instance 58aa12fc-aae6-43d2-8479-9e7a28651c3b was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000084' failed to start. Not enough memory in the system to start the virtual machine instance-00000084. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000084' failed to start. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Not enough memory in the system to start the virtual machine instance-00000084 with ram size 1024 megabytes. (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) 'instance-00000084' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 311A3FC2-7107-4CAA-B29A-DFFFA85754FF) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:27:25.667 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:27:25.667 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:27:25.667 4088 3038342144600 MainThread DEBUG nova.compute.manager [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:27:25.667 4088 3038342144600 MainThread DEBUG nova.network.neutron [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:27:26.150 4088 3038342144600 MainThread DEBUG nova.network.neutron [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:27:26.167 4088 3038342144600 MainThread INFO nova.compute.manager [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] Took 0.50 seconds to deallocate network for instance. 2021-09-10 17:27:26.323 4088 3038342144600 MainThread INFO nova.scheduler.client.report [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Deleted allocations for instance 58aa12fc-aae6-43d2-8479-9e7a28651c3b 2021-09-10 17:27:26.355 4088 3038342144600 MainThread DEBUG oslo_concurrency.lockutils [req-ce724d14-5a80-4849-837d-f825354b7a92 82eacb807eb449a28e17290cd4d841d0 8d0aa6ac8af84d7291f244f216bb94b1 - default default] Lock "58aa12fc-aae6-43d2-8479-9e7a28651c3b" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 31.172s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:26.355 4088 3038342255544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "58aa12fc-aae6-43d2-8479-9e7a28651c3b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 10.282s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:27:26.355 4088 3038342255544 MainThread INFO nova.compute.manager [-] [instance: 58aa12fc-aae6-43d2-8479-9e7a28651c3b] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:27:26.355 4088 3038342255544 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "58aa12fc-aae6-43d2-8479-9e7a28651c3b" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:27:31.478 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._run_pending_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:27:31.478 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10602 2021-09-10 17:27:31.489 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] There are 0 instances to clean _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10611 2021-09-10 17:28:01.494 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:28:06.119 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Lock "3568f444-8a4d-4c97-8bb4-ef66ca1eae4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:06.148 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:28:06.230 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:06.230 4088 3038342257832 MainThread DEBUG nova.virt.hardware [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:28:06.230 4088 3038342257832 MainThread INFO nova.compute.claims [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Claim successful on node n-h2-808474-1 2021-09-10 17:28:06.315 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.hostops [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:28:06.338 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.hostops [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:28:06.476 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:28:06.476 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:28:06.476 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:28:06.565 4088 3038342257832 MainThread DEBUG nova.compute.provider_tree [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:28:06.576 4088 3038342257832 MainThread DEBUG nova.scheduler.client.report [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:28:06.576 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:06.576 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:28:06.650 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:28:06.650 4088 3038342258360 GreenThread-122 DEBUG nova.compute.manager [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:28:06.650 4088 3038342258360 GreenThread-122 DEBUG nova.network.neutron [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:28:06.759 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:28:06.780 4088 3038342257832 MainThread INFO nova.virt.hyperv.vmops [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Spawning new instance 2021-09-10 17:28:06.780 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Lock "instance-00000085" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:06.780 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Lock "instance-00000085" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:06.780 4088 3038342257832 MainThread DEBUG nova.block_device [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:28:06.780 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:06.780 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:06.806 4088 3038342258360 GreenThread-122 DEBUG nova.policy [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b513993c7b2a49f58a5612ac6bf20582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8959bb67354f96b60bf89ed2bef450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:28:06.814 4088 3038342257832 MainThread DEBUG os_win.utils.pathutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Creating directory: C:\openstack\instances\instance-00000085 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:28:06.814 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000085\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:28:07.037 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Resizing VHD C:\openstack\instances\instance-00000085\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:28:07.368 4088 3038342258360 GreenThread-122 DEBUG nova.network.neutron [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Successfully created port: bda31149-0a86-4bcf-b6d7-6e27fc42aed2 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:28:07.478 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:28:07.994 4088 3038342258360 GreenThread-122 DEBUG nova.network.neutron [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Successfully updated port: bda31149-0a86-4bcf-b6d7-6e27fc42aed2 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:28:08.025 4088 3038342258360 GreenThread-122 DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Acquired lock "refresh_cache-3568f444-8a4d-4c97-8bb4-ef66ca1eae4f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:28:08.025 4088 3038342258360 GreenThread-122 DEBUG nova.network.neutron [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:28:08.025 4088 3038342257304 MainThread DEBUG nova.compute.manager [req-55c9611d-b016-45ca-a05d-531f6e53b7db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Received event network-changed-bda31149-0a86-4bcf-b6d7-6e27fc42aed2 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:28:08.025 4088 3038342257304 MainThread DEBUG nova.compute.manager [req-55c9611d-b016-45ca-a05d-531f6e53b7db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Refreshing instance network info cache due to event network-changed-bda31149-0a86-4bcf-b6d7-6e27fc42aed2. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:28:08.087 4088 3038342258360 GreenThread-122 DEBUG nova.network.neutron [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:28:08.431 4088 3038342258360 GreenThread-122 DEBUG nova.network.neutron [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Updating instance_info_cache with network_info: [{"id": "bda31149-0a86-4bcf-b6d7-6e27fc42aed2", "address": "fa:16:3e:80:3d:3d", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapbda31149-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:28:08.447 4088 3038342258360 GreenThread-122 DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Releasing lock "refresh_cache-3568f444-8a4d-4c97-8bb4-ef66ca1eae4f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:28:08.447 4088 3038342258360 GreenThread-122 DEBUG nova.compute.manager [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Instance network_info: |[{"id": "bda31149-0a86-4bcf-b6d7-6e27fc42aed2", "address": "fa:16:3e:80:3d:3d", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapbda31149-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:28:08.447 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Preparing to wait for external event network-vif-plugged-bda31149-0a86-4bcf-b6d7-6e27fc42aed2 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:28:08.447 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Lock "3568f444-8a4d-4c97-8bb4-ef66ca1eae4f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:08.447 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Lock "3568f444-8a4d-4c97-8bb4-ef66ca1eae4f-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:08.447 4088 3038342257832 MainThread DEBUG os_win.utils.compute.vmutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Creating VM instance-00000085 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:28:08.447 4088 3038342257304 MainThread DEBUG oslo_concurrency.lockutils [req-55c9611d-b016-45ca-a05d-531f6e53b7db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-3568f444-8a4d-4c97-8bb4-ef66ca1eae4f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:28:08.447 4088 3038342257304 MainThread DEBUG nova.network.neutron [req-55c9611d-b016-45ca-a05d-531f6e53b7db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Refreshing network info cache for port bda31149-0a86-4bcf-b6d7-6e27fc42aed2 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:28:08.904 4088 3038342257304 MainThread DEBUG nova.network.neutron [req-55c9611d-b016-45ca-a05d-531f6e53b7db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Updated VIF entry in instance network info cache for port bda31149-0a86-4bcf-b6d7-6e27fc42aed2. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:28:08.904 4088 3038342257304 MainThread DEBUG nova.network.neutron [req-55c9611d-b016-45ca-a05d-531f6e53b7db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Updating instance_info_cache with network_info: [{"id": "bda31149-0a86-4bcf-b6d7-6e27fc42aed2", "address": "fa:16:3e:80:3d:3d", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapbda31149-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:28:08.931 4088 3038342257304 MainThread DEBUG oslo_concurrency.lockutils [req-55c9611d-b016-45ca-a05d-531f6e53b7db 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-3568f444-8a4d-4c97-8bb4-ef66ca1eae4f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:28:09.477 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:28:10.104 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:28:12.483 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:28:13.494 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:28:13.510 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:13.510 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:13.510 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:28:13.510 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:28:13.526 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:28:13.717 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2220MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:28:13.717 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:13.869 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:28:13.869 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:28:13.869 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:28:13.869 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:28:13.869 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:28:13.869 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:28:13.869 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:28:13.869 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:28:13.869 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:28:13.885 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:28:13.885 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:28:13.885 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:28:13.885 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:28:13.885 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:28:13.885 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:28:13.885 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=14GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:28:13.906 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:28:13.919 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:28:14.125 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:28:14.150 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:28:14.150 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:28:14.150 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:15.041 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-543fd4ee-5f29-45df-8dde-47a836d691a9 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Received event network-vif-plugged-bda31149-0a86-4bcf-b6d7-6e27fc42aed2 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:28:15.041 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-543fd4ee-5f29-45df-8dde-47a836d691a9 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "3568f444-8a4d-4c97-8bb4-ef66ca1eae4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:15.041 4088 3038342258360 MainThread DEBUG oslo_concurrency.lockutils [req-543fd4ee-5f29-45df-8dde-47a836d691a9 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "3568f444-8a4d-4c97-8bb4-ef66ca1eae4f-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:15.041 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-543fd4ee-5f29-45df-8dde-47a836d691a9 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Processing event network-vif-plugged-bda31149-0a86-4bcf-b6d7-6e27fc42aed2 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:28:15.078 4088 3038342257832 MainThread INFO nova.virt.hyperv.vmops [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Using config drive for instance 2021-09-10 17:28:15.165 4088 3038342257832 MainThread INFO nova.virt.hyperv.vmops [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Creating config drive at C:\openstack\instances\instance-00000085\configdrive.iso 2021-09-10 17:28:15.275 4088 3038342257832 MainThread DEBUG oslo_concurrency.processutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000085\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpv2w648r4 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:28:15.572 4088 3038342257832 MainThread DEBUG oslo_concurrency.processutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000085\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpv2w648r4" returned: 0 in 0.296s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:28:16.079 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Setting boot order for instance: instance-00000085: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:28:16.165 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:28:16.165 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:28:16.209 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Waiting for WMI job: {'InstanceID': 'CBE2730D-3132-4737-9203-F3B2F8292CE1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19418), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:28:16.354 4088 3038342257832 MainThread ERROR os_win.utils.jobutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000085\' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)instance-00000085F5FCA695-7B9F-4534-9092-C472A9FA577612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)instance-00000085F5FCA695-7B9F-4534-9092-C472A9FA577610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000085\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)instance-00000085F5FCA695-7B9F-4534-9092-C472A9FA5776%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'CBE2730D-3132-4737-9203-F3B2F8292CE1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=125028), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 28, 16), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 28, 16), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000085' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)\n\nNot enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)\n\n'instance-00000085' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)", 'ErrorSummaryDescription': "'instance-00000085' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000085.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:28:16.354 4088 3038342257832 MainThread DEBUG os_win._utils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000085' failed to start. Not enough memory in the system to start the virtual machine instance-00000085. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000085' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Not enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) 'instance-00000085' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18833351135253906 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:28:16.384 4088 3038342255368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000085" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:16.384 4088 3038342255368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000085" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:16.384 4088 3038342257304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:28:16.384 4088 3038342257304 MainThread INFO nova.compute.manager [-] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] VM Stopped (Lifecycle Event) 2021-09-10 17:28:16.400 4088 3038342257304 MainThread DEBUG nova.compute.manager [req-94e89a0e-cb7e-407b-bb4b-f7cd7e56bc49 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:28:16.400 4088 3038342257304 MainThread DEBUG nova.virt.hyperv.vmops [req-94e89a0e-cb7e-407b-bb4b-f7cd7e56bc49 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:28:16.462 4088 3038342257304 MainThread DEBUG nova.compute.manager [req-94e89a0e-cb7e-407b-bb4b-f7cd7e56bc49 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:28:16.478 4088 3038342257304 MainThread INFO nova.compute.manager [req-94e89a0e-cb7e-407b-bb4b-f7cd7e56bc49 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:28:16.510 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:28:16.510 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:28:16.588 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-0e77fafa-3f8a-4513-bb64-518c77e99029" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:28:16.588 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:28:17.072 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Updating instance_info_cache with network_info: [{"id": "a8d3d6fd-c535-4f42-b11d-348191f22a38", "address": "fa:16:3e:61:e8:c4", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa8d3d6fd-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:28:17.088 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-0e77fafa-3f8a-4513-bb64-518c77e99029" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:28:17.088 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:28:17.400 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Waiting for WMI job: {'InstanceID': 'AF172FE1-A089-45AD-B9BC-0C5B1E2FEFE0', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15680), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:28:17.540 4088 3038342257832 MainThread ERROR os_win.utils.jobutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000085\' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)instance-00000085F5FCA695-7B9F-4534-9092-C472A9FA577612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)instance-00000085F5FCA695-7B9F-4534-9092-C472A9FA577610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000085\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)instance-00000085F5FCA695-7B9F-4534-9092-C472A9FA5776%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'AF172FE1-A089-45AD-B9BC-0C5B1E2FEFE0', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117908), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 28, 17), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 28, 17), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000085' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)\n\nNot enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)\n\n'instance-00000085' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)", 'ErrorSummaryDescription': "'instance-00000085' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000085.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:28:17.540 4088 3038342257832 MainThread DEBUG os_win._utils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000085' failed to start. Not enough memory in the system to start the virtual machine instance-00000085. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000085' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Not enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) 'instance-00000085' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3750407695770264 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:28:17.591 4088 3038342257304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000085" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:17.591 4088 3038342257304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000085" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:17.591 4088 3038342258360 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:28:17.591 4088 3038342258360 MainThread INFO nova.compute.manager [-] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] VM Stopped (Lifecycle Event) 2021-09-10 17:28:17.603 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-3084bdf3-95e7-4acd-a798-d0606a9ca349 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:28:17.603 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.vmops [req-3084bdf3-95e7-4acd-a798-d0606a9ca349 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:28:17.634 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-3084bdf3-95e7-4acd-a798-d0606a9ca349 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:28:17.665 4088 3038342258360 MainThread INFO nova.compute.manager [req-3084bdf3-95e7-4acd-a798-d0606a9ca349 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:28:18.573 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Waiting for WMI job: {'InstanceID': 'C0302055-56F5-4C0F-BC58-253E57B1E5FF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16673), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:28:18.728 4088 3038342257832 MainThread ERROR os_win.utils.jobutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000085\' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)instance-00000085F5FCA695-7B9F-4534-9092-C472A9FA577612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)instance-00000085F5FCA695-7B9F-4534-9092-C472A9FA577610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000085\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)instance-00000085F5FCA695-7B9F-4534-9092-C472A9FA5776%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C0302055-56F5-4C0F-BC58-253E57B1E5FF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=109648), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 28, 18), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 28, 18), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000085' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)\n\nNot enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)\n\n'instance-00000085' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)", 'ErrorSummaryDescription': "'instance-00000085' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000085.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:28:18.728 4088 3038342257832 MainThread DEBUG os_win._utils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000085' failed to start. Not enough memory in the system to start the virtual machine instance-00000085. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000085' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Not enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) 'instance-00000085' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5628888607025146 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:28:18.728 4088 3038342258360 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:28:18.728 4088 3038342258360 MainThread INFO nova.compute.manager [-] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] VM Stopped (Lifecycle Event) 2021-09-10 17:28:18.728 4088 3038342257304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000085" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:18.728 4088 3038342257304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000085" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:18.760 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-c3bbe07a-71fe-4915-a420-92185e9c7000 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:28:18.760 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.vmops [req-c3bbe07a-71fe-4915-a420-92185e9c7000 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:28:18.806 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-c3bbe07a-71fe-4915-a420-92185e9c7000 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:28:18.821 4088 3038342258360 MainThread INFO nova.compute.manager [req-c3bbe07a-71fe-4915-a420-92185e9c7000 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:28:19.760 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Waiting for WMI job: {'InstanceID': 'D299D1CC-A6EB-4791-A946-C7BE43B586BF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14727), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:28:19.898 4088 3038342257832 MainThread ERROR os_win.utils.jobutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000085\' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)instance-00000085F5FCA695-7B9F-4534-9092-C472A9FA577612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)instance-00000085F5FCA695-7B9F-4534-9092-C472A9FA577610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000085\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)instance-00000085F5FCA695-7B9F-4534-9092-C472A9FA5776%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D299D1CC-A6EB-4791-A946-C7BE43B586BF', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110485), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 28, 19), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 28, 19), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000085' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)\n\nNot enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)\n\n'instance-00000085' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)", 'ErrorSummaryDescription': "'instance-00000085' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000085.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:28:19.898 4088 3038342257832 MainThread DEBUG os_win._utils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000085' failed to start. Not enough memory in the system to start the virtual machine instance-00000085. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000085' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Not enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) 'instance-00000085' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.732377767562866 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:28:19.918 4088 3038342258360 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:28:19.918 4088 3038342258360 MainThread INFO nova.compute.manager [-] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] VM Stopped (Lifecycle Event) 2021-09-10 17:28:19.918 4088 3038342257304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000085" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:19.918 4088 3038342257304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000085" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:19.948 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-ba33c7dd-6070-4fb1-9fec-1006cfbf6d9d - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:28:19.948 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.vmops [req-ba33c7dd-6070-4fb1-9fec-1006cfbf6d9d - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:28:19.995 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-ba33c7dd-6070-4fb1-9fec-1006cfbf6d9d - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:28:20.010 4088 3038342258360 MainThread INFO nova.compute.manager [req-ba33c7dd-6070-4fb1-9fec-1006cfbf6d9d - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:28:20.918 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Waiting for WMI job: {'InstanceID': '33019400-B2F7-4343-8C19-F887495DC109', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16350), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:28:21.063 4088 3038342257832 MainThread ERROR os_win.utils.jobutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000085\' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)instance-00000085F5FCA695-7B9F-4534-9092-C472A9FA577612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)instance-00000085F5FCA695-7B9F-4534-9092-C472A9FA577610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000085\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)instance-00000085F5FCA695-7B9F-4534-9092-C472A9FA5776%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '33019400-B2F7-4343-8C19-F887495DC109', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117064), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 28, 20), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 28, 21), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000085' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)\n\nNot enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)\n\n'instance-00000085' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)", 'ErrorSummaryDescription': "'instance-00000085' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000085.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:28:21.063 4088 3038342257832 MainThread DEBUG os_win._utils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000085' failed to start. Not enough memory in the system to start the virtual machine instance-00000085. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000085' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Not enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) 'instance-00000085' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.8977131843566895 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:28:21.092 4088 3038342257304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000085" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:21.092 4088 3038342257304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000085" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:21.092 4088 3038342258360 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:28:21.092 4088 3038342258360 MainThread INFO nova.compute.manager [-] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] VM Stopped (Lifecycle Event) 2021-09-10 17:28:21.122 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-88e91fbc-6362-4ff2-a527-864488ec3881 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:28:21.122 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.vmops [req-88e91fbc-6362-4ff2-a527-864488ec3881 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:28:21.172 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-88e91fbc-6362-4ff2-a527-864488ec3881 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:28:21.196 4088 3038342258360 MainThread INFO nova.compute.manager [req-88e91fbc-6362-4ff2-a527-864488ec3881 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:28:22.088 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Waiting for WMI job: {'InstanceID': '441B9594-8831-423C-96C5-8150490BA4FC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16025), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:28:22.275 4088 3038342258360 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:28:22.275 4088 3038342258360 MainThread INFO nova.compute.manager [-] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] VM Stopped (Lifecycle Event) 2021-09-10 17:28:22.291 4088 3038342257304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000085" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:22.291 4088 3038342257304 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000085" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:22.307 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-8f46356a-1e51-46a3-b981-12d1416e1454 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:28:22.307 4088 3038342258360 MainThread DEBUG nova.virt.hyperv.vmops [req-8f46356a-1e51-46a3-b981-12d1416e1454 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:28:22.337 4088 3038342257832 MainThread ERROR os_win.utils.jobutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000085\' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)instance-00000085F5FCA695-7B9F-4534-9092-C472A9FA577612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)instance-00000085F5FCA695-7B9F-4534-9092-C472A9FA577610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000085\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)instance-00000085F5FCA695-7B9F-4534-9092-C472A9FA5776%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '441B9594-8831-423C-96C5-8150490BA4FC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=142122), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 28, 22), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 28, 22), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000085' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)\n\nNot enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)\n\n'instance-00000085' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776)", 'ErrorSummaryDescription': "'instance-00000085' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000085.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:28:22.337 4088 3038342257832 MainThread ERROR nova.virt.hyperv.vmops [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Failed to change vm state of instance-00000085 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000085' failed to start. 2021-09-10 17:28:22.337 4088 3038342257832 MainThread INFO nova.virt.hyperv.vmops [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Got request to destroy instance 2021-09-10 17:28:22.357 4088 3038342258360 MainThread DEBUG nova.compute.manager [req-8f46356a-1e51-46a3-b981-12d1416e1454 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:28:22.357 4088 3038342258360 MainThread INFO nova.compute.manager [req-8f46356a-1e51-46a3-b981-12d1416e1454 - - - - -] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:28:24.125 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:28:24.125 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Lock "instance-00000085" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:24.125 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Lock "instance-00000085" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:24.149 4088 3038342257832 MainThread DEBUG os_win.utils.compute.vmutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Successfully changed vm state of instance-00000085 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:28:24.149 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Successfully changed state of VM instance-00000085 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:28:24.197 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Waiting for WMI job: {'InstanceID': '1A351781-504F-4419-880C-180712614868', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17911), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:28:24.340 4088 3038342257832 MainThread DEBUG os_win.utils.jobutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] WMI job succeeded: {'InstanceID': '1A351781-504F-4419-880C-180712614868', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=109950), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:28:24.340 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Lock "instance-00000085" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:24.340 4088 3038342257832 MainThread DEBUG os_win.utils.pathutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Removing directory: C:\openstack\instances\instance-00000085 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:28:24.340 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Lock "instance-00000085" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:24.340 4088 3038342257832 MainThread ERROR nova.compute.manager [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000085' failed to start. Not enough memory in the system to start the virtual machine instance-00000085. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000085' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Not enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) 'instance-00000085' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Error code: 32778. 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Traceback (most recent call last): 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] return function(*args, **kwargs) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] admin_password, network_info, block_device_info) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] return function(self, *args, **kwds) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self.force_reraise() 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] raise self.value 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] should_plug_vifs=False) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 'req_state': req_state}) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self.force_reraise() 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] raise self.value 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] time.sleep(sleep_time) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self.force_reraise() 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] raise self.value 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] return f(*args, **kwargs) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] return self._wait_for_job(job_path) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] error_desc=err_desc) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000085' failed to start. 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Not enough memory in the system to start the virtual machine instance-00000085. 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000085' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Not enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 'instance-00000085' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Error code: 32778. 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] During handling of the above exception, another exception occurred: 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Traceback (most recent call last): 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] yield resources 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] accel_info=accel_info) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] return function(*args, **kwargs) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] admin_password, network_info, block_device_info) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] return function(self, *args, **kwds) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self.force_reraise() 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] raise self.value 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] should_plug_vifs=False) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 'req_state': req_state}) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self.force_reraise() 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] raise self.value 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] time.sleep(sleep_time) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self.force_reraise() 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] raise self.value 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] return f(*args, **kwargs) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] return self._wait_for_job(job_path) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] error_desc=err_desc) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000085' failed to start. 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Not enough memory in the system to start the virtual machine instance-00000085. 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000085' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Not enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 'instance-00000085' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Error code: 32778. 2021-09-10 17:28:24.340 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.340 4088 3038342257832 MainThread INFO nova.compute.manager [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Terminating instance 2021-09-10 17:28:24.340 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:28:24.356 4088 3038342257832 MainThread INFO nova.virt.hyperv.vmops [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Got request to destroy instance 2021-09-10 17:28:24.356 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.vmops [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:28:24.356 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Lock "instance-00000085" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:24.356 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Lock "instance-00000085" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:24.356 4088 3038342257832 MainThread INFO nova.compute.manager [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Took 0.00 seconds to destroy the instance on the hypervisor. 2021-09-10 17:28:24.356 4088 3038342257832 MainThread DEBUG nova.compute.claims [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:28:24.356 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:24.463 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.hostops [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:28:24.480 4088 3038342257832 MainThread DEBUG nova.virt.hyperv.hostops [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:28:24.731 4088 3038342257832 MainThread DEBUG nova.compute.provider_tree [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:28:24.744 4088 3038342257832 MainThread DEBUG nova.scheduler.client.report [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:28:24.744 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.390s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:24.744 4088 3038342257832 MainThread ERROR nova.compute.manager [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000085' failed to start. Not enough memory in the system to start the virtual machine instance-00000085. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000085' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Not enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) 'instance-00000085' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Error code: 32778. 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Traceback (most recent call last): 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] return function(*args, **kwargs) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] admin_password, network_info, block_device_info) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] return function(self, *args, **kwds) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self.force_reraise() 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] raise self.value 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] should_plug_vifs=False) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 'req_state': req_state}) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self.force_reraise() 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] raise self.value 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] time.sleep(sleep_time) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self.force_reraise() 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] raise self.value 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] return f(*args, **kwargs) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] return self._wait_for_job(job_path) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] error_desc=err_desc) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000085' failed to start. 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Not enough memory in the system to start the virtual machine instance-00000085. 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000085' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Not enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 'instance-00000085' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Error code: 32778. 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] During handling of the above exception, another exception occurred: 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Traceback (most recent call last): 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] accel_info=accel_info) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] return function(*args, **kwargs) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] admin_password, network_info, block_device_info) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] return function(self, *args, **kwds) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self.force_reraise() 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] raise self.value 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] should_plug_vifs=False) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 'req_state': req_state}) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self.force_reraise() 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] raise self.value 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] time.sleep(sleep_time) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self.force_reraise() 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] raise self.value 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] return f(*args, **kwargs) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] return self._wait_for_job(job_path) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] error_desc=err_desc) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000085' failed to start. 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Not enough memory in the system to start the virtual machine instance-00000085. 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000085' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Not enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 'instance-00000085' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Error code: 32778. 2021-09-10 17:28:24.744 4088 3038342257832 MainThread TRACE nova.compute.manager [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] 2021-09-10 17:28:24.744 4088 3038342257832 MainThread DEBUG nova.compute.utils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] WMI job failed with status 10. Error summary description: 'instance-00000085' failed to start. Not enough memory in the system to start the virtual machine instance-00000085. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:28:24.744 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Build of instance 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000085' failed to start. Not enough memory in the system to start the virtual machine instance-00000085. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000085' failed to start. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Not enough memory in the system to start the virtual machine instance-00000085 with ram size 1024 megabytes. (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) 'instance-00000085' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID F5FCA695-7B9F-4534-9092-C472A9FA5776) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:28:24.744 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:28:24.744 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:28:24.744 4088 3038342257832 MainThread DEBUG nova.compute.manager [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:28:24.744 4088 3038342257832 MainThread DEBUG nova.network.neutron [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:28:25.236 4088 3038342257832 MainThread DEBUG nova.network.neutron [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:28:25.247 4088 3038342257832 MainThread INFO nova.compute.manager [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] [instance: 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f] Took 0.50 seconds to deallocate network for instance. 2021-09-10 17:28:25.385 4088 3038342257832 MainThread INFO nova.scheduler.client.report [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Deleted allocations for instance 3568f444-8a4d-4c97-8bb4-ef66ca1eae4f 2021-09-10 17:28:25.432 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [req-dfdc8377-fe21-48ed-b3cc-906ef23770d4 b513993c7b2a49f58a5612ac6bf20582 ce8959bb67354f96b60bf89ed2bef450 - default default] Lock "3568f444-8a4d-4c97-8bb4-ef66ca1eae4f" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.313s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:52.509 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Lock "2593bf32-6e0d-4942-9e43-2e781b198fab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:52.524 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:28:52.619 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:52.619 4088 3038342258008 MainThread DEBUG nova.virt.hardware [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:28:52.619 4088 3038342258008 MainThread INFO nova.compute.claims [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Claim successful on node n-h2-808474-1 2021-09-10 17:28:52.717 4088 3038342258008 MainThread DEBUG nova.virt.hyperv.hostops [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:28:52.717 4088 3038342258008 MainThread DEBUG nova.virt.hyperv.hostops [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:28:52.916 4088 3038342258008 MainThread DEBUG nova.compute.provider_tree [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:28:52.946 4088 3038342258008 MainThread DEBUG nova.scheduler.client.report [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:28:52.946 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:52.946 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:28:52.993 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:28:53.023 4088 3038342257832 GreenThread-123 DEBUG nova.compute.manager [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:28:53.025 4088 3038342257832 GreenThread-123 DEBUG nova.network.neutron [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:28:53.132 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:28:53.132 4088 3038342257832 GreenThread-123 DEBUG nova.policy [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49db170bc6d5400aa9ebfb5a82a74ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df26eb38b4042e58ed51a4332022a9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:28:53.143 4088 3038342258008 MainThread INFO nova.virt.hyperv.vmops [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Spawning new instance 2021-09-10 17:28:53.149 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Lock "instance-00000086" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:53.149 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Lock "instance-00000086" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:53.149 4088 3038342258008 MainThread DEBUG nova.block_device [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:28:53.149 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:53.149 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:53.167 4088 3038342258008 MainThread DEBUG os_win.utils.pathutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Creating directory: C:\openstack\instances\instance-00000086 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:28:53.167 4088 3038342258008 MainThread DEBUG nova.virt.hyperv.vmops [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000086\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:28:53.383 4088 3038342258008 MainThread DEBUG nova.virt.hyperv.vmops [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Resizing VHD C:\openstack\instances\instance-00000086\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:28:53.666 4088 3038342257832 GreenThread-123 DEBUG nova.network.neutron [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Successfully created port: 177a8896-6dcd-4206-83b7-73431747e6bd _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:28:54.257 4088 3038342257832 GreenThread-123 DEBUG nova.network.neutron [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Successfully updated port: 177a8896-6dcd-4206-83b7-73431747e6bd _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:28:54.275 4088 3038342257832 GreenThread-123 DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Acquired lock "refresh_cache-2593bf32-6e0d-4942-9e43-2e781b198fab" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:28:54.275 4088 3038342257832 GreenThread-123 DEBUG nova.network.neutron [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:28:54.306 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-e38feb78-de5e-483d-8da9-92584e353890 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Received event network-changed-177a8896-6dcd-4206-83b7-73431747e6bd external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:28:54.306 4088 3038338906600 MainThread DEBUG nova.compute.manager [req-e38feb78-de5e-483d-8da9-92584e353890 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Refreshing instance network info cache due to event network-changed-177a8896-6dcd-4206-83b7-73431747e6bd. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:28:54.337 4088 3038342257832 GreenThread-123 DEBUG nova.network.neutron [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:28:54.650 4088 3038342257832 GreenThread-123 DEBUG nova.network.neutron [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Updating instance_info_cache with network_info: [{"id": "177a8896-6dcd-4206-83b7-73431747e6bd", "address": "fa:16:3e:ba:85:82", "network": {"id": "8d49abc1-73c3-44ea-a0ca-c19705eb8ff4", "bridge": null, "label": "tempest-DeleteServersTestJSON-1955226753-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5df26eb38b4042e58ed51a4332022a9c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap177a8896-6d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:28:54.665 4088 3038342257832 GreenThread-123 DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Releasing lock "refresh_cache-2593bf32-6e0d-4942-9e43-2e781b198fab" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:28:54.665 4088 3038342257832 GreenThread-123 DEBUG nova.compute.manager [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Instance network_info: |[{"id": "177a8896-6dcd-4206-83b7-73431747e6bd", "address": "fa:16:3e:ba:85:82", "network": {"id": "8d49abc1-73c3-44ea-a0ca-c19705eb8ff4", "bridge": null, "label": "tempest-DeleteServersTestJSON-1955226753-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5df26eb38b4042e58ed51a4332022a9c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap177a8896-6d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:28:54.665 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Preparing to wait for external event network-vif-plugged-177a8896-6dcd-4206-83b7-73431747e6bd prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:28:54.681 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Lock "2593bf32-6e0d-4942-9e43-2e781b198fab-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:54.681 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Lock "2593bf32-6e0d-4942-9e43-2e781b198fab-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:54.681 4088 3038342258008 MainThread DEBUG os_win.utils.compute.vmutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Creating VM instance-00000086 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:28:54.681 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-e38feb78-de5e-483d-8da9-92584e353890 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-2593bf32-6e0d-4942-9e43-2e781b198fab" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:28:54.681 4088 3038338906600 MainThread DEBUG nova.network.neutron [req-e38feb78-de5e-483d-8da9-92584e353890 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Refreshing network info cache for port 177a8896-6dcd-4206-83b7-73431747e6bd _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:28:55.149 4088 3038338906600 MainThread DEBUG nova.network.neutron [req-e38feb78-de5e-483d-8da9-92584e353890 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Updated VIF entry in instance network info cache for port 177a8896-6dcd-4206-83b7-73431747e6bd. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:28:55.149 4088 3038338906600 MainThread DEBUG nova.network.neutron [req-e38feb78-de5e-483d-8da9-92584e353890 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Updating instance_info_cache with network_info: [{"id": "177a8896-6dcd-4206-83b7-73431747e6bd", "address": "fa:16:3e:ba:85:82", "network": {"id": "8d49abc1-73c3-44ea-a0ca-c19705eb8ff4", "bridge": null, "label": "tempest-DeleteServersTestJSON-1955226753-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5df26eb38b4042e58ed51a4332022a9c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap177a8896-6d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:28:55.165 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [req-e38feb78-de5e-483d-8da9-92584e353890 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-2593bf32-6e0d-4942-9e43-2e781b198fab" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:28:56.337 4088 3038342258008 MainThread DEBUG nova.virt.hyperv.vmops [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:28:59.306 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-3203393e-b557-4ab5-8dbd-2727af54d875 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Received event network-vif-plugged-177a8896-6dcd-4206-83b7-73431747e6bd external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:28:59.306 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [req-3203393e-b557-4ab5-8dbd-2727af54d875 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "2593bf32-6e0d-4942-9e43-2e781b198fab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:28:59.306 4088 3038342256072 MainThread DEBUG oslo_concurrency.lockutils [req-3203393e-b557-4ab5-8dbd-2727af54d875 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "2593bf32-6e0d-4942-9e43-2e781b198fab-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:28:59.306 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-3203393e-b557-4ab5-8dbd-2727af54d875 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Processing event network-vif-plugged-177a8896-6dcd-4206-83b7-73431747e6bd _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:28:59.351 4088 3038342258008 MainThread INFO nova.virt.hyperv.vmops [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Using config drive for instance 2021-09-10 17:28:59.443 4088 3038342258008 MainThread INFO nova.virt.hyperv.vmops [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Creating config drive at C:\openstack\instances\instance-00000086\configdrive.iso 2021-09-10 17:28:59.540 4088 3038342258008 MainThread DEBUG oslo_concurrency.processutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000086\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpe32ga0bx execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:28:59.850 4088 3038342258008 MainThread DEBUG oslo_concurrency.processutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000086\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpe32ga0bx" returned: 0 in 0.313s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:29:00.351 4088 3038342258008 MainThread DEBUG nova.virt.hyperv.vmops [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Setting boot order for instance: instance-00000086: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:29:00.445 4088 3038342258008 MainThread DEBUG nova.virt.hyperv.vmops [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:29:00.470 4088 3038342258008 MainThread DEBUG os_win.utils.jobutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Waiting for WMI job: {'InstanceID': 'EB685F97-297B-4261-BC52-27BBD03D3F5B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15284), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:29:00.632 4088 3038342258008 MainThread ERROR os_win.utils.jobutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] WMI job failed: {'RawErrors': (('124\'instance-00000086\' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)instance-00000086591816DD-4C77-4B15-BE4B-F4FB1250346A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)instance-00000086591816DD-4C77-4B15-BE4B-F4FB1250346A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000086\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)instance-00000086591816DD-4C77-4B15-BE4B-F4FB1250346A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'EB685F97-297B-4261-BC52-27BBD03D3F5B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113953), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 29), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 29), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000086' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)\n\nNot enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)\n\n'instance-00000086' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)", 'ErrorSummaryDescription': "'instance-00000086' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000086.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:29:00.632 4088 3038342258008 MainThread DEBUG os_win._utils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000086' failed to start. Not enough memory in the system to start the virtual machine instance-00000086. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000086' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Not enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) 'instance-00000086' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1868302822113037 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:29:00.649 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000086" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:00.649 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000086" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:00.649 4088 3038342256072 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:29:00.649 4088 3038342256072 MainThread INFO nova.compute.manager [-] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] VM Stopped (Lifecycle Event) 2021-09-10 17:29:00.649 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-7ab26fbd-a1e9-4e1c-986f-b545e8f313b0 - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:29:00.649 4088 3038342256072 MainThread DEBUG nova.virt.hyperv.vmops [req-7ab26fbd-a1e9-4e1c-986f-b545e8f313b0 - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:29:00.701 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-7ab26fbd-a1e9-4e1c-986f-b545e8f313b0 - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:29:00.743 4088 3038342256072 MainThread INFO nova.compute.manager [req-7ab26fbd-a1e9-4e1c-986f-b545e8f313b0 - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:29:01.668 4088 3038342258008 MainThread DEBUG os_win.utils.jobutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Waiting for WMI job: {'InstanceID': 'B8933E44-23F3-4421-9A04-4573224FAA1F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14692), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:29:01.806 4088 3038342258008 MainThread ERROR os_win.utils.jobutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] WMI job failed: {'RawErrors': (('124\'instance-00000086\' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)instance-00000086591816DD-4C77-4B15-BE4B-F4FB1250346A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)instance-00000086591816DD-4C77-4B15-BE4B-F4FB1250346A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000086\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)instance-00000086591816DD-4C77-4B15-BE4B-F4FB1250346A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B8933E44-23F3-4421-9A04-4573224FAA1F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111609), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 29, 1), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 29, 1), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000086' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)\n\nNot enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)\n\n'instance-00000086' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)", 'ErrorSummaryDescription': "'instance-00000086' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000086.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:29:01.806 4088 3038342258008 MainThread DEBUG os_win._utils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000086' failed to start. Not enough memory in the system to start the virtual machine instance-00000086. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000086' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Not enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) 'instance-00000086' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3604366779327393 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:29:01.867 4088 3038342256072 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:29:01.867 4088 3038342256072 MainThread INFO nova.compute.manager [-] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] VM Stopped (Lifecycle Event) 2021-09-10 17:29:01.867 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000086" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:01.867 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000086" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:01.895 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-67a9046f-a780-40e2-833f-f60eed0265f7 - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:29:01.895 4088 3038342256072 MainThread DEBUG nova.virt.hyperv.vmops [req-67a9046f-a780-40e2-833f-f60eed0265f7 - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:29:01.945 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-67a9046f-a780-40e2-833f-f60eed0265f7 - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:29:01.954 4088 3038342256072 MainThread INFO nova.compute.manager [req-67a9046f-a780-40e2-833f-f60eed0265f7 - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:29:02.851 4088 3038342258008 MainThread DEBUG os_win.utils.jobutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Waiting for WMI job: {'InstanceID': '5E57DE5C-627E-47FD-A164-DF990DE48DA9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15474), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:29:02.996 4088 3038342258008 MainThread ERROR os_win.utils.jobutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] WMI job failed: {'RawErrors': (('124\'instance-00000086\' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)instance-00000086591816DD-4C77-4B15-BE4B-F4FB1250346A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)instance-00000086591816DD-4C77-4B15-BE4B-F4FB1250346A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000086\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)instance-00000086591816DD-4C77-4B15-BE4B-F4FB1250346A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5E57DE5C-627E-47FD-A164-DF990DE48DA9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=109814), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 29, 2), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 29, 2), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000086' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)\n\nNot enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)\n\n'instance-00000086' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)", 'ErrorSummaryDescription': "'instance-00000086' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000086.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:29:02.996 4088 3038342258008 MainThread DEBUG os_win._utils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000086' failed to start. Not enough memory in the system to start the virtual machine instance-00000086. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000086' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Not enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) 'instance-00000086' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5503792762756348 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:29:03.019 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000086" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:03.019 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000086" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:03.019 4088 3038342256072 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:29:03.019 4088 3038342256072 MainThread INFO nova.compute.manager [-] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] VM Stopped (Lifecycle Event) 2021-09-10 17:29:03.036 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-48159b89-93ed-4582-817e-72bb190b9f4f - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:29:03.036 4088 3038342256072 MainThread DEBUG nova.virt.hyperv.vmops [req-48159b89-93ed-4582-817e-72bb190b9f4f - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:29:03.088 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-48159b89-93ed-4582-817e-72bb190b9f4f - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:29:03.116 4088 3038342256072 MainThread INFO nova.compute.manager [req-48159b89-93ed-4582-817e-72bb190b9f4f - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:29:03.476 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:29:04.012 4088 3038342258008 MainThread DEBUG os_win.utils.jobutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Waiting for WMI job: {'InstanceID': '96AF9AE1-60AC-45AF-8125-1386A9F44887', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16181), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:29:04.164 4088 3038342258008 MainThread ERROR os_win.utils.jobutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] WMI job failed: {'RawErrors': (('124\'instance-00000086\' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)instance-00000086591816DD-4C77-4B15-BE4B-F4FB1250346A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)instance-00000086591816DD-4C77-4B15-BE4B-F4FB1250346A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000086\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)instance-00000086591816DD-4C77-4B15-BE4B-F4FB1250346A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '96AF9AE1-60AC-45AF-8125-1386A9F44887', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110081), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 29, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 29, 4), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000086' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)\n\nNot enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)\n\n'instance-00000086' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)", 'ErrorSummaryDescription': "'instance-00000086' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000086.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:29:04.164 4088 3038342258008 MainThread DEBUG os_win._utils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000086' failed to start. Not enough memory in the system to start the virtual machine instance-00000086. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000086' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Not enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) 'instance-00000086' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.718348979949951 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:29:04.196 4088 3038342256072 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:29:04.196 4088 3038342256072 MainThread INFO nova.compute.manager [-] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] VM Stopped (Lifecycle Event) 2021-09-10 17:29:04.196 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000086" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:04.196 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000086" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:04.212 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-9cd9d094-2cdf-4c07-adaa-ee3cad57e146 - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:29:04.212 4088 3038342256072 MainThread DEBUG nova.virt.hyperv.vmops [req-9cd9d094-2cdf-4c07-adaa-ee3cad57e146 - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:29:04.259 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-9cd9d094-2cdf-4c07-adaa-ee3cad57e146 - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:29:04.275 4088 3038342256072 MainThread INFO nova.compute.manager [req-9cd9d094-2cdf-4c07-adaa-ee3cad57e146 - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:29:05.182 4088 3038342258008 MainThread DEBUG os_win.utils.jobutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Waiting for WMI job: {'InstanceID': '0707A295-A806-4611-805C-13FD8DFC6C40', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14570), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:29:05.320 4088 3038342258008 MainThread ERROR os_win.utils.jobutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] WMI job failed: {'RawErrors': (('124\'instance-00000086\' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)instance-00000086591816DD-4C77-4B15-BE4B-F4FB1250346A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)instance-00000086591816DD-4C77-4B15-BE4B-F4FB1250346A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000086\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)instance-00000086591816DD-4C77-4B15-BE4B-F4FB1250346A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0707A295-A806-4611-805C-13FD8DFC6C40', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111234), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 29, 5), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 29, 5), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000086' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)\n\nNot enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)\n\n'instance-00000086' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)", 'ErrorSummaryDescription': "'instance-00000086' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000086.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:29:05.320 4088 3038342258008 MainThread DEBUG os_win._utils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000086' failed to start. Not enough memory in the system to start the virtual machine instance-00000086. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000086' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Not enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) 'instance-00000086' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.874168634414673 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:29:05.353 4088 3038342256072 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:29:05.353 4088 3038342256072 MainThread INFO nova.compute.manager [-] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] VM Stopped (Lifecycle Event) 2021-09-10 17:29:05.353 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000086" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:05.353 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000086" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:05.388 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-d31bdbf9-6094-4998-a58e-f41f24d769f7 - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:29:05.388 4088 3038342256072 MainThread DEBUG nova.virt.hyperv.vmops [req-d31bdbf9-6094-4998-a58e-f41f24d769f7 - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:29:05.434 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-d31bdbf9-6094-4998-a58e-f41f24d769f7 - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:29:05.462 4088 3038342256072 MainThread INFO nova.compute.manager [req-d31bdbf9-6094-4998-a58e-f41f24d769f7 - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:29:06.368 4088 3038342258008 MainThread DEBUG os_win.utils.jobutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Waiting for WMI job: {'InstanceID': '73F0632B-C61E-4FFD-9A92-558ED82147F2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15619), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:29:06.477 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:29:06.509 4088 3038342258008 MainThread ERROR os_win.utils.jobutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] WMI job failed: {'RawErrors': (('124\'instance-00000086\' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)instance-00000086591816DD-4C77-4B15-BE4B-F4FB1250346A12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)instance-00000086591816DD-4C77-4B15-BE4B-F4FB1250346A10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000086\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)instance-00000086591816DD-4C77-4B15-BE4B-F4FB1250346A%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '73F0632B-C61E-4FFD-9A92-558ED82147F2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111436), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 29, 6), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 29, 6), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000086' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)\n\nNot enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)\n\n'instance-00000086' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A)", 'ErrorSummaryDescription': "'instance-00000086' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000086.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:29:06.509 4088 3038342258008 MainThread ERROR nova.virt.hyperv.vmops [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Failed to change vm state of instance-00000086 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000086' failed to start. 2021-09-10 17:29:06.509 4088 3038342258008 MainThread INFO nova.virt.hyperv.vmops [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Got request to destroy instance 2021-09-10 17:29:06.561 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000086" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:06.561 4088 3038342257832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000086" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:06.561 4088 3038342256072 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:29:06.561 4088 3038342256072 MainThread INFO nova.compute.manager [-] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] VM Stopped (Lifecycle Event) 2021-09-10 17:29:06.618 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-6639408e-edff-47e7-b52f-0aa9f5b5939f - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:29:06.618 4088 3038342256072 MainThread DEBUG nova.virt.hyperv.vmops [req-6639408e-edff-47e7-b52f-0aa9f5b5939f - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:29:06.652 4088 3038342256072 MainThread DEBUG nova.compute.manager [req-6639408e-edff-47e7-b52f-0aa9f5b5939f - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:29:06.679 4088 3038342256072 MainThread INFO nova.compute.manager [req-6639408e-edff-47e7-b52f-0aa9f5b5939f - - - - -] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:29:07.476 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:29:07.476 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:29:08.338 4088 3038342258008 MainThread DEBUG nova.virt.hyperv.vmops [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:29:08.338 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Lock "instance-00000086" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:08.338 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Lock "instance-00000086" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:08.376 4088 3038342258008 MainThread DEBUG os_win.utils.compute.vmutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Successfully changed vm state of instance-00000086 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:29:08.376 4088 3038342258008 MainThread DEBUG nova.virt.hyperv.vmops [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Successfully changed state of VM instance-00000086 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:29:08.431 4088 3038342258008 MainThread DEBUG os_win.utils.jobutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Waiting for WMI job: {'InstanceID': '1417AE6B-EBDA-4E99-A9B5-22E8F514F7D7', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15925), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:29:08.540 4088 3038342258008 MainThread DEBUG os_win.utils.jobutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] WMI job succeeded: {'InstanceID': '1417AE6B-EBDA-4E99-A9B5-22E8F514F7D7', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=101191), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:29:08.540 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Lock "instance-00000086" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:08.540 4088 3038342258008 MainThread DEBUG os_win.utils.pathutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Removing directory: C:\openstack\instances\instance-00000086 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:29:08.540 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Lock "instance-00000086" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:08.540 4088 3038342258008 MainThread ERROR nova.compute.manager [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000086' failed to start. Not enough memory in the system to start the virtual machine instance-00000086. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000086' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Not enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) 'instance-00000086' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Error code: 32778. 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Traceback (most recent call last): 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] return function(*args, **kwargs) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] admin_password, network_info, block_device_info) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] return function(self, *args, **kwds) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self.force_reraise() 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] raise self.value 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] should_plug_vifs=False) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 'req_state': req_state}) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self.force_reraise() 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] raise self.value 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] time.sleep(sleep_time) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self.force_reraise() 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] raise self.value 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] return f(*args, **kwargs) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] return self._wait_for_job(job_path) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] error_desc=err_desc) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000086' failed to start. 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Not enough memory in the system to start the virtual machine instance-00000086. 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000086' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Not enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 'instance-00000086' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Error code: 32778. 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] During handling of the above exception, another exception occurred: 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Traceback (most recent call last): 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] yield resources 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] accel_info=accel_info) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] return function(*args, **kwargs) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] admin_password, network_info, block_device_info) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] return function(self, *args, **kwds) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self.force_reraise() 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] raise self.value 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] should_plug_vifs=False) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 'req_state': req_state}) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self.force_reraise() 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] raise self.value 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] time.sleep(sleep_time) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self.force_reraise() 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] raise self.value 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] return f(*args, **kwargs) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] return self._wait_for_job(job_path) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] error_desc=err_desc) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000086' failed to start. 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Not enough memory in the system to start the virtual machine instance-00000086. 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000086' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Not enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 'instance-00000086' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Error code: 32778. 2021-09-10 17:29:08.540 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.540 4088 3038342258008 MainThread INFO nova.compute.manager [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Terminating instance 2021-09-10 17:29:08.540 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:29:08.540 4088 3038342258008 MainThread INFO nova.virt.hyperv.vmops [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Got request to destroy instance 2021-09-10 17:29:08.569 4088 3038342258008 MainThread DEBUG nova.virt.hyperv.vmops [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:29:08.569 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Lock "instance-00000086" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:08.569 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Lock "instance-00000086" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:08.569 4088 3038342258008 MainThread INFO nova.compute.manager [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:29:08.569 4088 3038342258008 MainThread DEBUG nova.compute.claims [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:29:08.585 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:08.668 4088 3038342258008 MainThread DEBUG nova.virt.hyperv.hostops [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:29:08.687 4088 3038342258008 MainThread DEBUG nova.virt.hyperv.hostops [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:29:08.880 4088 3038342258008 MainThread DEBUG nova.compute.provider_tree [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:29:08.899 4088 3038342258008 MainThread DEBUG nova.scheduler.client.report [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:29:08.899 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.313s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:08.899 4088 3038342258008 MainThread ERROR nova.compute.manager [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000086' failed to start. Not enough memory in the system to start the virtual machine instance-00000086. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000086' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Not enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) 'instance-00000086' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Error code: 32778. 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Traceback (most recent call last): 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] return function(*args, **kwargs) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] admin_password, network_info, block_device_info) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] return function(self, *args, **kwds) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self.force_reraise() 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] raise self.value 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] should_plug_vifs=False) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 'req_state': req_state}) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self.force_reraise() 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] raise self.value 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] time.sleep(sleep_time) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self.force_reraise() 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] raise self.value 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] return f(*args, **kwargs) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] return self._wait_for_job(job_path) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] error_desc=err_desc) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000086' failed to start. 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Not enough memory in the system to start the virtual machine instance-00000086. 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000086' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Not enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 'instance-00000086' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Error code: 32778. 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] During handling of the above exception, another exception occurred: 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Traceback (most recent call last): 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] accel_info=accel_info) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] return function(*args, **kwargs) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] admin_password, network_info, block_device_info) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] return function(self, *args, **kwds) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self.force_reraise() 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] raise self.value 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] should_plug_vifs=False) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 'req_state': req_state}) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self.force_reraise() 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] raise self.value 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] time.sleep(sleep_time) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self.force_reraise() 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] raise self.value 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] return f(*args, **kwargs) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] return self._wait_for_job(job_path) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] error_desc=err_desc) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000086' failed to start. 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Not enough memory in the system to start the virtual machine instance-00000086. 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000086' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Not enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 'instance-00000086' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Error code: 32778. 2021-09-10 17:29:08.899 4088 3038342258008 MainThread TRACE nova.compute.manager [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] 2021-09-10 17:29:08.899 4088 3038342258008 MainThread DEBUG nova.compute.utils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] WMI job failed with status 10. Error summary description: 'instance-00000086' failed to start. Not enough memory in the system to start the virtual machine instance-00000086. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:29:08.899 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Build of instance 2593bf32-6e0d-4942-9e43-2e781b198fab was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000086' failed to start. Not enough memory in the system to start the virtual machine instance-00000086. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000086' failed to start. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Not enough memory in the system to start the virtual machine instance-00000086 with ram size 1024 megabytes. (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) 'instance-00000086' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 591816DD-4C77-4B15-BE4B-F4FB1250346A) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:29:08.899 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:29:08.899 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:29:08.899 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:29:08.899 4088 3038342258008 MainThread DEBUG nova.network.neutron [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:29:09.373 4088 3038342258008 MainThread DEBUG nova.network.neutron [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:29:09.398 4088 3038342258008 MainThread INFO nova.compute.manager [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] [instance: 2593bf32-6e0d-4942-9e43-2e781b198fab] Took 0.50 seconds to deallocate network for instance. 2021-09-10 17:29:09.478 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:29:09.478 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:29:09.524 4088 3038342258008 MainThread INFO nova.scheduler.client.report [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Deleted allocations for instance 2593bf32-6e0d-4942-9e43-2e781b198fab 2021-09-10 17:29:09.556 4088 3038342258008 MainThread DEBUG oslo_concurrency.lockutils [req-681252e5-461f-4e4e-960b-9c29547c8091 49db170bc6d5400aa9ebfb5a82a74ca6 5df26eb38b4042e58ed51a4332022a9c - default default] Lock "2593bf32-6e0d-4942-9e43-2e781b198fab" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.047s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:11.476 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:29:13.485 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:29:13.485 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:29:13.485 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:13.485 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:13.485 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:29:13.485 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:29:13.507 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:29:13.725 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2219MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:29:13.725 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:13.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:29:13.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:29:13.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:29:13.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:29:13.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:29:13.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:29:13.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:29:13.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:29:13.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:29:13.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:29:13.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:29:13.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:29:13.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:29:13.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:29:13.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:29:13.893 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:29:13.913 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:29:14.132 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:29:14.147 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:29:14.147 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:29:14.147 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:17.147 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:29:17.147 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:29:17.219 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-50586591-86ba-41be-b4e1-5004ea0d76dd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:29:17.219 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:29:17.727 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Updating instance_info_cache with network_info: [{"id": "ad57189e-6845-4bd3-a7d1-681004b754a9", "address": "fa:16:3e:7f:ee:91", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapad57189e-68", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:29:17.727 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-50586591-86ba-41be-b4e1-5004ea0d76dd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:29:17.727 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:29:17.727 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:29:26.745 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:29:32.506 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "ff096eb1-eabf-47db-b43c-94d9879eba49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:32.525 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:29:32.615 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:32.615 4088 3038338906072 MainThread DEBUG nova.virt.hardware [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:29:32.615 4088 3038338906072 MainThread INFO nova.compute.claims [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Claim successful on node n-h2-808474-1 2021-09-10 17:29:32.698 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.hostops [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:29:32.731 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.hostops [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:29:32.939 4088 3038338906072 MainThread DEBUG nova.compute.provider_tree [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:29:32.959 4088 3038338906072 MainThread DEBUG nova.scheduler.client.report [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:29:32.959 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:32.959 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:29:33.010 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:29:33.026 4088 3038338906952 GreenThread-124 DEBUG nova.compute.manager [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:29:33.026 4088 3038338906952 GreenThread-124 DEBUG nova.network.neutron [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:29:33.131 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:29:33.147 4088 3038338906952 GreenThread-124 DEBUG nova.policy [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '652641e6ad894a5cbe0cbe09bd677e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece1a15a5d64ee19aacaadbaf9c9c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:29:33.147 4088 3038338906072 MainThread INFO nova.virt.hyperv.vmops [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Spawning new instance 2021-09-10 17:29:33.167 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "instance-00000087" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:33.167 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "instance-00000087" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:33.167 4088 3038338906072 MainThread DEBUG nova.block_device [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:29:33.167 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:33.167 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:33.167 4088 3038338906072 MainThread DEBUG os_win.utils.pathutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Creating directory: C:\openstack\instances\instance-00000087 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:29:33.167 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000087\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:29:33.401 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Resizing VHD C:\openstack\instances\instance-00000087\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:29:33.698 4088 3038338906952 GreenThread-124 DEBUG nova.network.neutron [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Successfully created port: 92c548d0-3d48-4e5e-a463-89a7e35d7209 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:29:34.278 4088 3038338906952 GreenThread-124 DEBUG nova.network.neutron [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Successfully updated port: 92c548d0-3d48-4e5e-a463-89a7e35d7209 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:29:34.292 4088 3038338906952 GreenThread-124 DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Acquired lock "refresh_cache-ff096eb1-eabf-47db-b43c-94d9879eba49" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:29:34.292 4088 3038338906952 GreenThread-124 DEBUG nova.network.neutron [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:29:34.307 4088 3038338906776 MainThread DEBUG nova.compute.manager [req-72e08091-caee-4de3-86eb-7f452d5e8eef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Received event network-changed-92c548d0-3d48-4e5e-a463-89a7e35d7209 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:29:34.307 4088 3038338906776 MainThread DEBUG nova.compute.manager [req-72e08091-caee-4de3-86eb-7f452d5e8eef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Refreshing instance network info cache due to event network-changed-92c548d0-3d48-4e5e-a463-89a7e35d7209. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:29:34.367 4088 3038338906952 GreenThread-124 DEBUG nova.network.neutron [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:29:34.682 4088 3038338906952 GreenThread-124 DEBUG nova.network.neutron [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Updating instance_info_cache with network_info: [{"id": "92c548d0-3d48-4e5e-a463-89a7e35d7209", "address": "fa:16:3e:45:a8:80", "network": {"id": "5bc38b74-b79c-4494-8f9f-215ac9066c53", "bridge": null, "label": "tempest-ServerDiskConfigTestJSON-45318911-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5ece1a15a5d64ee19aacaadbaf9c9c95", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap92c548d0-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:29:34.709 4088 3038338906952 GreenThread-124 DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Releasing lock "refresh_cache-ff096eb1-eabf-47db-b43c-94d9879eba49" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:29:34.709 4088 3038338906952 GreenThread-124 DEBUG nova.compute.manager [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Instance network_info: |[{"id": "92c548d0-3d48-4e5e-a463-89a7e35d7209", "address": "fa:16:3e:45:a8:80", "network": {"id": "5bc38b74-b79c-4494-8f9f-215ac9066c53", "bridge": null, "label": "tempest-ServerDiskConfigTestJSON-45318911-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5ece1a15a5d64ee19aacaadbaf9c9c95", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap92c548d0-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:29:34.709 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Preparing to wait for external event network-vif-plugged-92c548d0-3d48-4e5e-a463-89a7e35d7209 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:29:34.709 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "ff096eb1-eabf-47db-b43c-94d9879eba49-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:34.709 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "ff096eb1-eabf-47db-b43c-94d9879eba49-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:34.709 4088 3038338906072 MainThread DEBUG os_win.utils.compute.vmutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Creating VM instance-00000087 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:29:34.709 4088 3038338906776 MainThread DEBUG oslo_concurrency.lockutils [req-72e08091-caee-4de3-86eb-7f452d5e8eef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-ff096eb1-eabf-47db-b43c-94d9879eba49" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:29:34.709 4088 3038338906776 MainThread DEBUG nova.network.neutron [req-72e08091-caee-4de3-86eb-7f452d5e8eef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Refreshing network info cache for port 92c548d0-3d48-4e5e-a463-89a7e35d7209 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:29:35.182 4088 3038338906776 MainThread DEBUG nova.network.neutron [req-72e08091-caee-4de3-86eb-7f452d5e8eef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Updated VIF entry in instance network info cache for port 92c548d0-3d48-4e5e-a463-89a7e35d7209. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:29:35.182 4088 3038338906776 MainThread DEBUG nova.network.neutron [req-72e08091-caee-4de3-86eb-7f452d5e8eef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Updating instance_info_cache with network_info: [{"id": "92c548d0-3d48-4e5e-a463-89a7e35d7209", "address": "fa:16:3e:45:a8:80", "network": {"id": "5bc38b74-b79c-4494-8f9f-215ac9066c53", "bridge": null, "label": "tempest-ServerDiskConfigTestJSON-45318911-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5ece1a15a5d64ee19aacaadbaf9c9c95", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap92c548d0-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:29:35.182 4088 3038338906776 MainThread DEBUG oslo_concurrency.lockutils [req-72e08091-caee-4de3-86eb-7f452d5e8eef 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-ff096eb1-eabf-47db-b43c-94d9879eba49" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:29:36.369 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:29:41.506 4088 3038338907480 MainThread DEBUG nova.compute.manager [req-aec45e26-75c0-4c06-bc03-30ee754f9e89 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Received event network-vif-plugged-92c548d0-3d48-4e5e-a463-89a7e35d7209 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:29:41.506 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-aec45e26-75c0-4c06-bc03-30ee754f9e89 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "ff096eb1-eabf-47db-b43c-94d9879eba49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:41.506 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [req-aec45e26-75c0-4c06-bc03-30ee754f9e89 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "ff096eb1-eabf-47db-b43c-94d9879eba49-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:41.506 4088 3038338907480 MainThread DEBUG nova.compute.manager [req-aec45e26-75c0-4c06-bc03-30ee754f9e89 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Processing event network-vif-plugged-92c548d0-3d48-4e5e-a463-89a7e35d7209 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:29:41.537 4088 3038338906072 MainThread INFO nova.virt.hyperv.vmops [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Using config drive for instance 2021-09-10 17:29:41.650 4088 3038338906072 MainThread INFO nova.virt.hyperv.vmops [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Creating config drive at C:\openstack\instances\instance-00000087\configdrive.iso 2021-09-10 17:29:41.744 4088 3038338906072 MainThread DEBUG oslo_concurrency.processutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000087\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp4xs9v6ur execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:29:42.057 4088 3038338906072 MainThread DEBUG oslo_concurrency.processutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000087\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp4xs9v6ur" returned: 0 in 0.313s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:29:42.557 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Setting boot order for instance: instance-00000087: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:29:42.656 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:29:42.695 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Waiting for WMI job: {'InstanceID': '9AD52296-0CB6-403F-ABFD-7144514257DE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20300), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:29:42.837 4088 3038338906072 MainThread ERROR os_win.utils.jobutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000087\' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)instance-000000876DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)instance-000000876DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000087\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)instance-000000876DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9AD52296-0CB6-403F-ABFD-7144514257DE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112701), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 29, 42), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 29, 42), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000087' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)\n\nNot enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)\n\n'instance-00000087' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)", 'ErrorSummaryDescription': "'instance-00000087' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000087.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:29:42.837 4088 3038338906072 MainThread DEBUG os_win._utils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000087' failed to start. Not enough memory in the system to start the virtual machine instance-00000087. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000087' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Not enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) 'instance-00000087' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18130922317504883 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:29:42.881 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000087" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:42.881 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000087" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:42.881 4088 3038338906952 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:29:42.881 4088 3038338906952 MainThread INFO nova.compute.manager [-] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] VM Stopped (Lifecycle Event) 2021-09-10 17:29:42.901 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-7363e362-e070-432a-81ac-4a39bd8aa9c6 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:29:42.901 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.vmops [req-7363e362-e070-432a-81ac-4a39bd8aa9c6 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:29:42.948 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-7363e362-e070-432a-81ac-4a39bd8aa9c6 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:29:42.979 4088 3038338906952 MainThread INFO nova.compute.manager [req-7363e362-e070-432a-81ac-4a39bd8aa9c6 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:29:43.869 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Waiting for WMI job: {'InstanceID': '8F8F2868-B85B-4163-AC02-0ED81FD3AE7C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14648), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:29:44.021 4088 3038338906072 MainThread ERROR os_win.utils.jobutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000087\' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)instance-000000876DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)instance-000000876DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000087\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)instance-000000876DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '8F8F2868-B85B-4163-AC02-0ED81FD3AE7C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115852), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 29, 43), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 29, 43), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000087' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)\n\nNot enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)\n\n'instance-00000087' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)", 'ErrorSummaryDescription': "'instance-00000087' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000087.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:29:44.021 4088 3038338906072 MainThread DEBUG os_win._utils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000087' failed to start. Not enough memory in the system to start the virtual machine instance-00000087. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000087' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Not enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) 'instance-00000087' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.365405797958374 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:29:44.041 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000087" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:44.041 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000087" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:44.056 4088 3038338906952 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:29:44.056 4088 3038338906952 MainThread INFO nova.compute.manager [-] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] VM Stopped (Lifecycle Event) 2021-09-10 17:29:44.072 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-70db9c78-abfc-4fc2-b399-c1035f3d5aa1 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:29:44.072 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.vmops [req-70db9c78-abfc-4fc2-b399-c1035f3d5aa1 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:29:44.119 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-70db9c78-abfc-4fc2-b399-c1035f3d5aa1 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:29:44.135 4088 3038338906952 MainThread INFO nova.compute.manager [req-70db9c78-abfc-4fc2-b399-c1035f3d5aa1 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:29:45.043 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Waiting for WMI job: {'InstanceID': '5A486508-1AD6-4EB5-9946-0EFE15F9B7F1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15250), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:29:45.181 4088 3038338906072 MainThread ERROR os_win.utils.jobutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000087\' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)instance-000000876DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)instance-000000876DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000087\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)instance-000000876DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5A486508-1AD6-4EB5-9946-0EFE15F9B7F1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=109987), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 29, 45), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 29, 45), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000087' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)\n\nNot enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)\n\n'instance-00000087' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)", 'ErrorSummaryDescription': "'instance-00000087' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000087.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:29:45.181 4088 3038338906072 MainThread DEBUG os_win._utils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000087' failed to start. Not enough memory in the system to start the virtual machine instance-00000087. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000087' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Not enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) 'instance-00000087' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5254690647125244 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:29:45.229 4088 3038338906952 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:29:45.229 4088 3038338906952 MainThread INFO nova.compute.manager [-] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] VM Stopped (Lifecycle Event) 2021-09-10 17:29:45.229 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000087" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:45.229 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000087" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:45.244 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-f1f00453-4bbb-47fe-9cf8-ce82f79b5770 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:29:45.244 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.vmops [req-f1f00453-4bbb-47fe-9cf8-ce82f79b5770 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:29:45.291 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-f1f00453-4bbb-47fe-9cf8-ce82f79b5770 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:29:45.318 4088 3038338906952 MainThread INFO nova.compute.manager [req-f1f00453-4bbb-47fe-9cf8-ce82f79b5770 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:29:46.212 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Waiting for WMI job: {'InstanceID': 'C9FDD645-824D-46FE-A323-5CFCEF682937', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14851), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:29:46.351 4088 3038338906072 MainThread ERROR os_win.utils.jobutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000087\' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)instance-000000876DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)instance-000000876DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000087\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)instance-000000876DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C9FDD645-824D-46FE-A323-5CFCEF682937', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110725), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 29, 46), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 29, 46), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000087' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)\n\nNot enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)\n\n'instance-00000087' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)", 'ErrorSummaryDescription': "'instance-00000087' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000087.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:29:46.351 4088 3038338906072 MainThread DEBUG os_win._utils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000087' failed to start. Not enough memory in the system to start the virtual machine instance-00000087. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000087' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Not enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) 'instance-00000087' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.69551944732666 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:29:46.396 4088 3038338906952 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:29:46.396 4088 3038338906952 MainThread INFO nova.compute.manager [-] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] VM Stopped (Lifecycle Event) 2021-09-10 17:29:46.396 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000087" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:46.396 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000087" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:46.416 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-1574ce58-30eb-44f8-941a-ae69e1beb98d - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:29:46.416 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.vmops [req-1574ce58-30eb-44f8-941a-ae69e1beb98d - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:29:46.462 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-1574ce58-30eb-44f8-941a-ae69e1beb98d - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:29:46.462 4088 3038338906952 MainThread INFO nova.compute.manager [req-1574ce58-30eb-44f8-941a-ae69e1beb98d - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:29:47.369 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Waiting for WMI job: {'InstanceID': '035852AC-694D-442B-888E-8BE5F2629A6B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14581), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:29:47.510 4088 3038338906072 MainThread ERROR os_win.utils.jobutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000087\' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)instance-000000876DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)instance-000000876DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000087\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)instance-000000876DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '035852AC-694D-442B-888E-8BE5F2629A6B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110154), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 29, 47), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 29, 47), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000087' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)\n\nNot enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)\n\n'instance-00000087' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)", 'ErrorSummaryDescription': "'instance-00000087' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000087.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:29:47.510 4088 3038338906072 MainThread DEBUG os_win._utils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000087' failed to start. Not enough memory in the system to start the virtual machine instance-00000087. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000087' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Not enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) 'instance-00000087' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.8542070388793945 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:29:47.540 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000087" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:47.540 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000087" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:47.540 4088 3038338906952 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:29:47.540 4088 3038338906952 MainThread INFO nova.compute.manager [-] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] VM Stopped (Lifecycle Event) 2021-09-10 17:29:47.572 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-4c4ad2bd-690f-4d63-bc18-f67d2bf0dbf8 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:29:47.572 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.vmops [req-4c4ad2bd-690f-4d63-bc18-f67d2bf0dbf8 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:29:47.619 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-4c4ad2bd-690f-4d63-bc18-f67d2bf0dbf8 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:29:47.635 4088 3038338906952 MainThread INFO nova.compute.manager [req-4c4ad2bd-690f-4d63-bc18-f67d2bf0dbf8 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:29:48.542 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Waiting for WMI job: {'InstanceID': 'F90469F4-EDC6-479D-877E-DE01FEF255B7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15823), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:29:48.681 4088 3038338906072 MainThread ERROR os_win.utils.jobutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000087\' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)instance-000000876DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)instance-000000876DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000087\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)instance-000000876DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'F90469F4-EDC6-479D-877E-DE01FEF255B7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120585), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 29, 48), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 29, 48), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000087' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)\n\nNot enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)\n\n'instance-00000087' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D)", 'ErrorSummaryDescription': "'instance-00000087' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000087.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:29:48.701 4088 3038338906072 MainThread ERROR nova.virt.hyperv.vmops [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Failed to change vm state of instance-00000087 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000087' failed to start. 2021-09-10 17:29:48.701 4088 3038338906072 MainThread INFO nova.virt.hyperv.vmops [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Got request to destroy instance 2021-09-10 17:29:48.740 4088 3038338906952 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:29:48.740 4088 3038338906952 MainThread INFO nova.compute.manager [-] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] VM Stopped (Lifecycle Event) 2021-09-10 17:29:48.743 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000087" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:48.743 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000087" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:48.743 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-4ac8f156-a246-4dce-bf87-f0d1650f6016 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:29:48.743 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.vmops [req-4ac8f156-a246-4dce-bf87-f0d1650f6016 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:29:48.806 4088 3038338906952 MainThread DEBUG nova.compute.manager [req-4ac8f156-a246-4dce-bf87-f0d1650f6016 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:29:48.827 4088 3038338906952 MainThread INFO nova.compute.manager [req-4ac8f156-a246-4dce-bf87-f0d1650f6016 - - - - -] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:29:50.522 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:29:50.522 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "instance-00000087" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:50.522 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "instance-00000087" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:50.522 4088 3038338906072 MainThread DEBUG os_win.utils.compute.vmutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Successfully changed vm state of instance-00000087 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:29:50.522 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Successfully changed state of VM instance-00000087 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:29:50.583 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Waiting for WMI job: {'InstanceID': '63090080-CBB5-420D-A8A2-048870CE7A7A', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=13903), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:29:50.724 4088 3038338906072 MainThread DEBUG os_win.utils.jobutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] WMI job succeeded: {'InstanceID': '63090080-CBB5-420D-A8A2-048870CE7A7A', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=104232), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:29:50.724 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "instance-00000087" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:50.724 4088 3038338906072 MainThread DEBUG os_win.utils.pathutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Removing directory: C:\openstack\instances\instance-00000087 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:29:50.724 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "instance-00000087" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:50.724 4088 3038338906072 MainThread ERROR nova.compute.manager [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000087' failed to start. Not enough memory in the system to start the virtual machine instance-00000087. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000087' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Not enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) 'instance-00000087' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Error code: 32778. 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Traceback (most recent call last): 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] return function(*args, **kwargs) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] admin_password, network_info, block_device_info) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] return function(self, *args, **kwds) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self.force_reraise() 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] raise self.value 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] should_plug_vifs=False) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 'req_state': req_state}) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self.force_reraise() 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] raise self.value 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] time.sleep(sleep_time) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self.force_reraise() 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] raise self.value 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] return f(*args, **kwargs) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] return self._wait_for_job(job_path) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] error_desc=err_desc) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000087' failed to start. 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Not enough memory in the system to start the virtual machine instance-00000087. 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000087' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Not enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 'instance-00000087' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Error code: 32778. 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] During handling of the above exception, another exception occurred: 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Traceback (most recent call last): 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] yield resources 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] accel_info=accel_info) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] return function(*args, **kwargs) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] admin_password, network_info, block_device_info) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] return function(self, *args, **kwds) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self.force_reraise() 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] raise self.value 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] should_plug_vifs=False) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 'req_state': req_state}) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self.force_reraise() 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] raise self.value 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] time.sleep(sleep_time) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self.force_reraise() 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] raise self.value 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] return f(*args, **kwargs) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] return self._wait_for_job(job_path) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] error_desc=err_desc) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000087' failed to start. 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Not enough memory in the system to start the virtual machine instance-00000087. 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000087' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Not enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 'instance-00000087' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Error code: 32778. 2021-09-10 17:29:50.724 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:50.724 4088 3038338906072 MainThread INFO nova.compute.manager [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Terminating instance 2021-09-10 17:29:50.724 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:29:50.724 4088 3038338906072 MainThread INFO nova.virt.hyperv.vmops [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Got request to destroy instance 2021-09-10 17:29:50.745 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.vmops [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:29:50.745 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "instance-00000087" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:50.745 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "instance-00000087" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:50.745 4088 3038338906072 MainThread INFO nova.compute.manager [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Took 0.01 seconds to destroy the instance on the hypervisor. 2021-09-10 17:29:50.745 4088 3038338906072 MainThread DEBUG nova.compute.claims [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:29:50.745 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:29:50.822 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.hostops [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:29:50.849 4088 3038338906072 MainThread DEBUG nova.virt.hyperv.hostops [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:29:51.052 4088 3038338906072 MainThread DEBUG nova.compute.provider_tree [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:29:51.069 4088 3038338906072 MainThread DEBUG nova.scheduler.client.report [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:29:51.069 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:29:51.069 4088 3038338906072 MainThread ERROR nova.compute.manager [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000087' failed to start. Not enough memory in the system to start the virtual machine instance-00000087. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000087' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Not enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) 'instance-00000087' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Error code: 32778. 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Traceback (most recent call last): 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] return function(*args, **kwargs) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] admin_password, network_info, block_device_info) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] return function(self, *args, **kwds) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self.force_reraise() 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] raise self.value 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] should_plug_vifs=False) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 'req_state': req_state}) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self.force_reraise() 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] raise self.value 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] time.sleep(sleep_time) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self.force_reraise() 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] raise self.value 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] return f(*args, **kwargs) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] return self._wait_for_job(job_path) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] error_desc=err_desc) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000087' failed to start. 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Not enough memory in the system to start the virtual machine instance-00000087. 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000087' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Not enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 'instance-00000087' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Error code: 32778. 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] During handling of the above exception, another exception occurred: 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Traceback (most recent call last): 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] accel_info=accel_info) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] return function(*args, **kwargs) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] admin_password, network_info, block_device_info) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] return function(self, *args, **kwds) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self.force_reraise() 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] raise self.value 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] should_plug_vifs=False) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 'req_state': req_state}) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self.force_reraise() 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] raise self.value 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] time.sleep(sleep_time) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self.force_reraise() 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] raise self.value 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] return f(*args, **kwargs) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] return self._wait_for_job(job_path) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] error_desc=err_desc) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000087' failed to start. 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Not enough memory in the system to start the virtual machine instance-00000087. 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000087' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Not enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 'instance-00000087' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Error code: 32778. 2021-09-10 17:29:51.069 4088 3038338906072 MainThread TRACE nova.compute.manager [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] 2021-09-10 17:29:51.069 4088 3038338906072 MainThread DEBUG nova.compute.utils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] WMI job failed with status 10. Error summary description: 'instance-00000087' failed to start. Not enough memory in the system to start the virtual machine instance-00000087. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:29:51.069 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Build of instance ff096eb1-eabf-47db-b43c-94d9879eba49 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000087' failed to start. Not enough memory in the system to start the virtual machine instance-00000087. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000087' failed to start. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Not enough memory in the system to start the virtual machine instance-00000087 with ram size 1024 megabytes. (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) 'instance-00000087' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DB1CD7B-FC01-4B03-A2A5-82DE18F4C30D) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:29:51.069 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:29:51.069 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:29:51.069 4088 3038338906072 MainThread DEBUG nova.compute.manager [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:29:51.069 4088 3038338906072 MainThread DEBUG nova.network.neutron [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:29:51.552 4088 3038338906072 MainThread DEBUG nova.network.neutron [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:29:51.568 4088 3038338906072 MainThread INFO nova.compute.manager [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ff096eb1-eabf-47db-b43c-94d9879eba49] Took 0.50 seconds to deallocate network for instance. 2021-09-10 17:29:51.694 4088 3038338906072 MainThread INFO nova.scheduler.client.report [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Deleted allocations for instance ff096eb1-eabf-47db-b43c-94d9879eba49 2021-09-10 17:29:51.745 4088 3038338906072 MainThread DEBUG oslo_concurrency.lockutils [req-579ef65c-265c-49b3-a106-8e680dfcf134 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "ff096eb1-eabf-47db-b43c-94d9879eba49" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.234s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:05.526 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:30:07.473 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:30:08.489 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:30:08.489 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:30:09.489 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:30:10.655 4088 3038360563960 MainThread DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "ee88e2a3-1118-4d2d-8706-7596a4f77aa7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:10.676 4088 3038360563960 MainThread DEBUG nova.compute.manager [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:30:10.743 4088 3038360563960 MainThread DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:10.743 4088 3038360563960 MainThread DEBUG nova.virt.hardware [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:30:10.743 4088 3038360563960 MainThread INFO nova.compute.claims [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Claim successful on node n-h2-808474-1 2021-09-10 17:30:10.848 4088 3038360563960 MainThread DEBUG nova.virt.hyperv.hostops [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:30:10.869 4088 3038360563960 MainThread DEBUG nova.virt.hyperv.hostops [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:30:11.067 4088 3038360563960 MainThread DEBUG nova.compute.provider_tree [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:30:11.083 4088 3038360563960 MainThread DEBUG nova.scheduler.client.report [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:30:11.088 4088 3038360563960 MainThread DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:11.088 4088 3038360563960 MainThread DEBUG nova.compute.manager [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:30:11.145 4088 3038360563960 MainThread DEBUG nova.compute.manager [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:30:11.145 4088 3038360563784 GreenThread-125 DEBUG nova.compute.manager [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:30:11.145 4088 3038360563784 GreenThread-125 DEBUG nova.network.neutron [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:30:11.262 4088 3038360563960 MainThread DEBUG nova.compute.manager [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:30:11.262 4088 3038360563784 GreenThread-125 DEBUG nova.policy [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '652641e6ad894a5cbe0cbe09bd677e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece1a15a5d64ee19aacaadbaf9c9c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:30:11.262 4088 3038360563960 MainThread INFO nova.virt.hyperv.vmops [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Spawning new instance 2021-09-10 17:30:11.277 4088 3038360563960 MainThread DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "instance-00000088" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:11.277 4088 3038360563960 MainThread DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "instance-00000088" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:11.277 4088 3038360563960 MainThread DEBUG nova.block_device [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:30:11.277 4088 3038360563960 MainThread DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:11.277 4088 3038360563960 MainThread DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:11.294 4088 3038360563960 MainThread DEBUG os_win.utils.pathutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Creating directory: C:\openstack\instances\instance-00000088 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:30:11.294 4088 3038360563960 MainThread DEBUG nova.virt.hyperv.vmops [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000088\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:30:11.479 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:30:11.520 4088 3038360563960 MainThread DEBUG nova.virt.hyperv.vmops [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Resizing VHD C:\openstack\instances\instance-00000088\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:30:11.823 4088 3038360563784 GreenThread-125 DEBUG nova.network.neutron [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Successfully created port: 217f7d41-8d9c-42ac-82a9-d8d972f8262e _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:30:12.417 4088 3038360563784 GreenThread-125 DEBUG nova.network.neutron [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Successfully updated port: 217f7d41-8d9c-42ac-82a9-d8d972f8262e _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:30:12.433 4088 3038360563784 GreenThread-125 DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Acquired lock "refresh_cache-ee88e2a3-1118-4d2d-8706-7596a4f77aa7" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:30:12.433 4088 3038360563784 GreenThread-125 DEBUG nova.network.neutron [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:30:12.446 4088 3038360564664 MainThread DEBUG nova.compute.manager [req-b63d8970-60c9-4b41-9a07-e6d6a6414904 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Received event network-changed-217f7d41-8d9c-42ac-82a9-d8d972f8262e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:30:12.446 4088 3038360564664 MainThread DEBUG nova.compute.manager [req-b63d8970-60c9-4b41-9a07-e6d6a6414904 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Refreshing instance network info cache due to event network-changed-217f7d41-8d9c-42ac-82a9-d8d972f8262e. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:30:12.495 4088 3038360563784 GreenThread-125 DEBUG nova.network.neutron [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:30:12.801 4088 3038360563784 GreenThread-125 DEBUG nova.network.neutron [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Updating instance_info_cache with network_info: [{"id": "217f7d41-8d9c-42ac-82a9-d8d972f8262e", "address": "fa:16:3e:fb:b2:3f", "network": {"id": "5bc38b74-b79c-4494-8f9f-215ac9066c53", "bridge": null, "label": "tempest-ServerDiskConfigTestJSON-45318911-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5ece1a15a5d64ee19aacaadbaf9c9c95", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap217f7d41-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:30:12.832 4088 3038360563784 GreenThread-125 DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Releasing lock "refresh_cache-ee88e2a3-1118-4d2d-8706-7596a4f77aa7" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:30:12.834 4088 3038360563784 GreenThread-125 DEBUG nova.compute.manager [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Instance network_info: |[{"id": "217f7d41-8d9c-42ac-82a9-d8d972f8262e", "address": "fa:16:3e:fb:b2:3f", "network": {"id": "5bc38b74-b79c-4494-8f9f-215ac9066c53", "bridge": null, "label": "tempest-ServerDiskConfigTestJSON-45318911-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5ece1a15a5d64ee19aacaadbaf9c9c95", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap217f7d41-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:30:12.834 4088 3038360564664 MainThread DEBUG oslo_concurrency.lockutils [req-b63d8970-60c9-4b41-9a07-e6d6a6414904 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-ee88e2a3-1118-4d2d-8706-7596a4f77aa7" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:30:12.834 4088 3038360564664 MainThread DEBUG nova.network.neutron [req-b63d8970-60c9-4b41-9a07-e6d6a6414904 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Refreshing network info cache for port 217f7d41-8d9c-42ac-82a9-d8d972f8262e _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:30:12.834 4088 3038360563960 MainThread DEBUG nova.compute.manager [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Preparing to wait for external event network-vif-plugged-217f7d41-8d9c-42ac-82a9-d8d972f8262e prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:30:12.834 4088 3038360563960 MainThread DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "ee88e2a3-1118-4d2d-8706-7596a4f77aa7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:12.834 4088 3038360563960 MainThread DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "ee88e2a3-1118-4d2d-8706-7596a4f77aa7-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:12.834 4088 3038360563960 MainThread DEBUG os_win.utils.compute.vmutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Creating VM instance-00000088 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:30:13.489 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:30:13.618 4088 3038360564664 MainThread DEBUG nova.network.neutron [req-b63d8970-60c9-4b41-9a07-e6d6a6414904 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Updated VIF entry in instance network info cache for port 217f7d41-8d9c-42ac-82a9-d8d972f8262e. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:30:13.618 4088 3038360564664 MainThread DEBUG nova.network.neutron [req-b63d8970-60c9-4b41-9a07-e6d6a6414904 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Updating instance_info_cache with network_info: [{"id": "217f7d41-8d9c-42ac-82a9-d8d972f8262e", "address": "fa:16:3e:fb:b2:3f", "network": {"id": "5bc38b74-b79c-4494-8f9f-215ac9066c53", "bridge": null, "label": "tempest-ServerDiskConfigTestJSON-45318911-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5ece1a15a5d64ee19aacaadbaf9c9c95", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap217f7d41-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:30:13.641 4088 3038360564664 MainThread DEBUG oslo_concurrency.lockutils [req-b63d8970-60c9-4b41-9a07-e6d6a6414904 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-ee88e2a3-1118-4d2d-8706-7596a4f77aa7" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:30:14.417 4088 3038360563960 MainThread DEBUG nova.virt.hyperv.vmops [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:30:14.473 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:30:14.489 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:14.489 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:14.489 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:30:14.489 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:30:14.507 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:30:14.745 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2225MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:30:14.745 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:14.917 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:30:14.917 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:30:14.917 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:30:14.917 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:30:14.917 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:30:14.932 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:30:14.932 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:30:14.932 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:30:14.932 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:30:14.932 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:30:14.932 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:30:14.932 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:30:14.932 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:30:14.932 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ee88e2a3-1118-4d2d-8706-7596a4f77aa7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:30:14.932 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:30:14.932 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=14GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:30:14.949 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:30:14.973 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:30:15.187 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:30:15.199 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:30:15.199 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:30:15.199 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:17.197 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:30:17.197 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:30:17.260 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-98da4c02-e4db-4a02-a807-c737f9038672" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:30:17.260 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:30:17.785 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Updating instance_info_cache with network_info: [{"id": "51e81291-5d40-4203-b72f-f016060edd87", "address": "fa:16:3e:82:36:43", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap51e81291-5d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:30:17.805 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-98da4c02-e4db-4a02-a807-c737f9038672" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:30:17.805 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:30:19.473 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:30:19.667 4088 3038360564136 MainThread DEBUG nova.compute.manager [req-6771c491-6968-419c-9757-1a913bbdf4f8 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Received event network-vif-plugged-217f7d41-8d9c-42ac-82a9-d8d972f8262e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:30:19.667 4088 3038360564136 MainThread DEBUG oslo_concurrency.lockutils [req-6771c491-6968-419c-9757-1a913bbdf4f8 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "ee88e2a3-1118-4d2d-8706-7596a4f77aa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:19.667 4088 3038360564136 MainThread DEBUG oslo_concurrency.lockutils [req-6771c491-6968-419c-9757-1a913bbdf4f8 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "ee88e2a3-1118-4d2d-8706-7596a4f77aa7-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:19.667 4088 3038360564136 MainThread DEBUG nova.compute.manager [req-6771c491-6968-419c-9757-1a913bbdf4f8 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Processing event network-vif-plugged-217f7d41-8d9c-42ac-82a9-d8d972f8262e _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:30:19.692 4088 3038360563960 MainThread INFO nova.virt.hyperv.vmops [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Using config drive for instance 2021-09-10 17:30:19.793 4088 3038360563960 MainThread INFO nova.virt.hyperv.vmops [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Creating config drive at C:\openstack\instances\instance-00000088\configdrive.iso 2021-09-10 17:30:19.895 4088 3038360563960 MainThread DEBUG oslo_concurrency.processutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000088\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp2ng1mtiq execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:30:20.214 4088 3038360563960 MainThread DEBUG oslo_concurrency.processutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000088\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp2ng1mtiq" returned: 0 in 0.312s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:30:20.693 4088 3038360563960 MainThread DEBUG nova.virt.hyperv.vmops [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Setting boot order for instance: instance-00000088: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:30:20.797 4088 3038360563960 MainThread DEBUG nova.virt.hyperv.vmops [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:30:20.831 4088 3038360563960 MainThread DEBUG os_win.utils.jobutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Waiting for WMI job: {'InstanceID': '75675B8F-3D18-4F83-B574-DBECCB6E967A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14801), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:30:20.976 4088 3038360563960 MainThread ERROR os_win.utils.jobutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000088\' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)instance-0000008821AC1C43-96BB-415A-965E-7BA8EDD013E512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)instance-0000008821AC1C43-96BB-415A-965E-7BA8EDD013E510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000088\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)instance-0000008821AC1C43-96BB-415A-965E-7BA8EDD013E5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '75675B8F-3D18-4F83-B574-DBECCB6E967A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=124468), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 30, 20), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 30, 20), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000088' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)\n\nNot enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)\n\n'instance-00000088' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)", 'ErrorSummaryDescription': "'instance-00000088' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000088.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:30:20.976 4088 3038360563960 MainThread DEBUG os_win._utils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000088' failed to start. Not enough memory in the system to start the virtual machine instance-00000088. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000088' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Not enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) 'instance-00000088' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1789703369140625 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:30:21.006 4088 3038360563784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000088" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:21.006 4088 3038360563784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000088" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:21.006 4088 3038360564488 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:30:21.006 4088 3038360564488 MainThread INFO nova.compute.manager [-] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] VM Stopped (Lifecycle Event) 2021-09-10 17:30:21.041 4088 3038360564488 MainThread DEBUG nova.compute.manager [req-4143a406-54db-4846-a91b-a29a9dc76077 - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:30:21.041 4088 3038360564488 MainThread DEBUG nova.virt.hyperv.vmops [req-4143a406-54db-4846-a91b-a29a9dc76077 - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:30:21.085 4088 3038360564488 MainThread DEBUG nova.compute.manager [req-4143a406-54db-4846-a91b-a29a9dc76077 - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:30:21.104 4088 3038360564488 MainThread INFO nova.compute.manager [req-4143a406-54db-4846-a91b-a29a9dc76077 - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:30:21.996 4088 3038360563960 MainThread DEBUG os_win.utils.jobutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Waiting for WMI job: {'InstanceID': '1A38E2F3-F257-468E-AA34-0536F17BD221', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15365), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:30:22.151 4088 3038360563960 MainThread ERROR os_win.utils.jobutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000088\' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)instance-0000008821AC1C43-96BB-415A-965E-7BA8EDD013E512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)instance-0000008821AC1C43-96BB-415A-965E-7BA8EDD013E510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000088\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)instance-0000008821AC1C43-96BB-415A-965E-7BA8EDD013E5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1A38E2F3-F257-468E-AA34-0536F17BD221', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112170), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 30, 21), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 30, 22), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000088' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)\n\nNot enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)\n\n'instance-00000088' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)", 'ErrorSummaryDescription': "'instance-00000088' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000088.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:30:22.151 4088 3038360563960 MainThread DEBUG os_win._utils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000088' failed to start. Not enough memory in the system to start the virtual machine instance-00000088. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000088' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Not enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) 'instance-00000088' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3540656566619873 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:30:22.165 4088 3038360563784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000088" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:22.165 4088 3038360563784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000088" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:22.165 4088 3038360564488 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:30:22.165 4088 3038360564488 MainThread INFO nova.compute.manager [-] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] VM Stopped (Lifecycle Event) 2021-09-10 17:30:22.199 4088 3038360564488 MainThread DEBUG nova.compute.manager [req-e9a1ebd3-a193-4ff8-b39c-287f2f0ed11f - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:30:22.199 4088 3038360564488 MainThread DEBUG nova.virt.hyperv.vmops [req-e9a1ebd3-a193-4ff8-b39c-287f2f0ed11f - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:30:22.254 4088 3038360564488 MainThread DEBUG nova.compute.manager [req-e9a1ebd3-a193-4ff8-b39c-287f2f0ed11f - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:30:22.276 4088 3038360564488 MainThread INFO nova.compute.manager [req-e9a1ebd3-a193-4ff8-b39c-287f2f0ed11f - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:30:23.182 4088 3038360563960 MainThread DEBUG os_win.utils.jobutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Waiting for WMI job: {'InstanceID': '8F5162C9-9719-4180-ADA9-867D9B774827', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15301), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:30:23.334 4088 3038360563960 MainThread ERROR os_win.utils.jobutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000088\' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)instance-0000008821AC1C43-96BB-415A-965E-7BA8EDD013E512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)instance-0000008821AC1C43-96BB-415A-965E-7BA8EDD013E510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000088\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)instance-0000008821AC1C43-96BB-415A-965E-7BA8EDD013E5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '8F5162C9-9719-4180-ADA9-867D9B774827', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111135), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 30, 23), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 30, 23), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000088' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)\n\nNot enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)\n\n'instance-00000088' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)", 'ErrorSummaryDescription': "'instance-00000088' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000088.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:30:23.334 4088 3038360563960 MainThread DEBUG os_win._utils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000088' failed to start. Not enough memory in the system to start the virtual machine instance-00000088. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000088' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Not enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) 'instance-00000088' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.53759503364563 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:30:23.379 4088 3038360563784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000088" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:23.379 4088 3038360563784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000088" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:23.379 4088 3038360564488 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:30:23.379 4088 3038360564488 MainThread INFO nova.compute.manager [-] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] VM Stopped (Lifecycle Event) 2021-09-10 17:30:23.379 4088 3038360564488 MainThread DEBUG nova.compute.manager [req-eec2fad9-f71f-4898-a14c-3503d45cccb5 - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:30:23.379 4088 3038360564488 MainThread DEBUG nova.virt.hyperv.vmops [req-eec2fad9-f71f-4898-a14c-3503d45cccb5 - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:30:23.441 4088 3038360564488 MainThread DEBUG nova.compute.manager [req-eec2fad9-f71f-4898-a14c-3503d45cccb5 - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:30:23.473 4088 3038360564488 MainThread INFO nova.compute.manager [req-eec2fad9-f71f-4898-a14c-3503d45cccb5 - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:30:24.356 4088 3038360563960 MainThread DEBUG os_win.utils.jobutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Waiting for WMI job: {'InstanceID': '20A1AB72-4AC6-466C-9F93-CFDE51C4FE7F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15100), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:30:24.505 4088 3038360563960 MainThread ERROR os_win.utils.jobutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000088\' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)instance-0000008821AC1C43-96BB-415A-965E-7BA8EDD013E512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)instance-0000008821AC1C43-96BB-415A-965E-7BA8EDD013E510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000088\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)instance-0000008821AC1C43-96BB-415A-965E-7BA8EDD013E5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '20A1AB72-4AC6-466C-9F93-CFDE51C4FE7F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112640), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 30, 24), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 30, 24), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000088' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)\n\nNot enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)\n\n'instance-00000088' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)", 'ErrorSummaryDescription': "'instance-00000088' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000088.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:30:24.505 4088 3038360563960 MainThread DEBUG os_win._utils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000088' failed to start. Not enough memory in the system to start the virtual machine instance-00000088. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000088' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Not enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) 'instance-00000088' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7086470127105713 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:30:24.537 4088 3038360564488 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:30:24.537 4088 3038360564488 MainThread INFO nova.compute.manager [-] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] VM Stopped (Lifecycle Event) 2021-09-10 17:30:24.537 4088 3038360563784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000088" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:24.537 4088 3038360563784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000088" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:24.566 4088 3038360564488 MainThread DEBUG nova.compute.manager [req-20ddb4b1-0aab-4617-88a5-b1613a6c350b - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:30:24.566 4088 3038360564488 MainThread DEBUG nova.virt.hyperv.vmops [req-20ddb4b1-0aab-4617-88a5-b1613a6c350b - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:30:24.615 4088 3038360564488 MainThread DEBUG nova.compute.manager [req-20ddb4b1-0aab-4617-88a5-b1613a6c350b - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:30:24.615 4088 3038360564488 MainThread INFO nova.compute.manager [req-20ddb4b1-0aab-4617-88a5-b1613a6c350b - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:30:25.551 4088 3038360563960 MainThread DEBUG os_win.utils.jobutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Waiting for WMI job: {'InstanceID': '13304428-01DB-4591-844F-D55315DE3BFC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15003), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:30:25.708 4088 3038360563960 MainThread ERROR os_win.utils.jobutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000088\' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)instance-0000008821AC1C43-96BB-415A-965E-7BA8EDD013E512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)instance-0000008821AC1C43-96BB-415A-965E-7BA8EDD013E510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000088\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)instance-0000008821AC1C43-96BB-415A-965E-7BA8EDD013E5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '13304428-01DB-4591-844F-D55315DE3BFC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111281), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 30, 25), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 30, 25), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000088' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)\n\nNot enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)\n\n'instance-00000088' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)", 'ErrorSummaryDescription': "'instance-00000088' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000088.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:30:25.708 4088 3038360563960 MainThread DEBUG os_win._utils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000088' failed to start. Not enough memory in the system to start the virtual machine instance-00000088. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000088' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Not enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) 'instance-00000088' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.91163182258606 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:30:25.729 4088 3038360564488 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:30:25.729 4088 3038360564488 MainThread INFO nova.compute.manager [-] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] VM Stopped (Lifecycle Event) 2021-09-10 17:30:25.729 4088 3038360563784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000088" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:25.729 4088 3038360563784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000088" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:25.754 4088 3038360564488 MainThread DEBUG nova.compute.manager [req-90fdee00-5625-44b6-828c-dcf2be94b8c0 - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:30:25.754 4088 3038360564488 MainThread DEBUG nova.virt.hyperv.vmops [req-90fdee00-5625-44b6-828c-dcf2be94b8c0 - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:30:25.806 4088 3038360564488 MainThread DEBUG nova.compute.manager [req-90fdee00-5625-44b6-828c-dcf2be94b8c0 - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:30:25.832 4088 3038360564488 MainThread INFO nova.compute.manager [req-90fdee00-5625-44b6-828c-dcf2be94b8c0 - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:30:26.744 4088 3038360563960 MainThread DEBUG os_win.utils.jobutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Waiting for WMI job: {'InstanceID': '71A480CB-8835-41EE-936C-76C76C371383', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14692), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:30:26.879 4088 3038360563960 MainThread ERROR os_win.utils.jobutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000088\' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)instance-0000008821AC1C43-96BB-415A-965E-7BA8EDD013E512030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)instance-0000008821AC1C43-96BB-415A-965E-7BA8EDD013E510243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000088\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)instance-0000008821AC1C43-96BB-415A-965E-7BA8EDD013E5%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '71A480CB-8835-41EE-936C-76C76C371383', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111112), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 30, 26), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 30, 26), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000088' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)\n\nNot enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)\n\n'instance-00000088' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5)", 'ErrorSummaryDescription': "'instance-00000088' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000088.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:30:26.879 4088 3038360563960 MainThread ERROR nova.virt.hyperv.vmops [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Failed to change vm state of instance-00000088 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000088' failed to start. 2021-09-10 17:30:26.879 4088 3038360563960 MainThread INFO nova.virt.hyperv.vmops [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Got request to destroy instance 2021-09-10 17:30:26.926 4088 3038360564488 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:30:26.926 4088 3038360564488 MainThread INFO nova.compute.manager [-] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] VM Stopped (Lifecycle Event) 2021-09-10 17:30:26.926 4088 3038360563784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000088" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:26.926 4088 3038360563784 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000088" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:26.948 4088 3038360564488 MainThread DEBUG nova.compute.manager [req-35ed8ea2-8901-478a-949c-fc1a852a7f66 - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:30:26.948 4088 3038360564488 MainThread DEBUG nova.virt.hyperv.vmops [req-35ed8ea2-8901-478a-949c-fc1a852a7f66 - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:30:26.985 4088 3038360564488 MainThread DEBUG nova.compute.manager [req-35ed8ea2-8901-478a-949c-fc1a852a7f66 - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:30:27.022 4088 3038360564488 MainThread INFO nova.compute.manager [req-35ed8ea2-8901-478a-949c-fc1a852a7f66 - - - - -] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:30:28.820 4088 3038360563960 MainThread DEBUG nova.virt.hyperv.vmops [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:30:28.820 4088 3038360563960 MainThread DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "instance-00000088" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:28.820 4088 3038360563960 MainThread DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "instance-00000088" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:28.820 4088 3038360563960 MainThread DEBUG os_win.utils.compute.vmutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Successfully changed vm state of instance-00000088 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:30:28.820 4088 3038360563960 MainThread DEBUG nova.virt.hyperv.vmops [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Successfully changed state of VM instance-00000088 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:30:28.890 4088 3038360563960 MainThread DEBUG os_win.utils.jobutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Waiting for WMI job: {'InstanceID': '204594B3-E1A4-4017-A31F-AEABAFE061BD', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=13708), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:30:29.024 4088 3038360563960 MainThread DEBUG os_win.utils.jobutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] WMI job succeeded: {'InstanceID': '204594B3-E1A4-4017-A31F-AEABAFE061BD', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=105185), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:30:29.024 4088 3038360563960 MainThread DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "instance-00000088" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:29.024 4088 3038360563960 MainThread DEBUG os_win.utils.pathutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Removing directory: C:\openstack\instances\instance-00000088 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:30:29.024 4088 3038360563960 MainThread DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "instance-00000088" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:29.024 4088 3038360563960 MainThread ERROR nova.compute.manager [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000088' failed to start. Not enough memory in the system to start the virtual machine instance-00000088. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000088' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Not enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) 'instance-00000088' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Error code: 32778. 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Traceback (most recent call last): 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] return function(*args, **kwargs) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] admin_password, network_info, block_device_info) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] return function(self, *args, **kwds) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self.force_reraise() 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] raise self.value 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] should_plug_vifs=False) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 'req_state': req_state}) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self.force_reraise() 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] raise self.value 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] time.sleep(sleep_time) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self.force_reraise() 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] raise self.value 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] return f(*args, **kwargs) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] return self._wait_for_job(job_path) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] error_desc=err_desc) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000088' failed to start. 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Not enough memory in the system to start the virtual machine instance-00000088. 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000088' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Not enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 'instance-00000088' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Error code: 32778. 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] During handling of the above exception, another exception occurred: 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Traceback (most recent call last): 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] yield resources 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] accel_info=accel_info) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] return function(*args, **kwargs) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] admin_password, network_info, block_device_info) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] return function(self, *args, **kwds) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self.force_reraise() 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] raise self.value 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] should_plug_vifs=False) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 'req_state': req_state}) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self.force_reraise() 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] raise self.value 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] time.sleep(sleep_time) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self.force_reraise() 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] raise self.value 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] return f(*args, **kwargs) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] return self._wait_for_job(job_path) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] error_desc=err_desc) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000088' failed to start. 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Not enough memory in the system to start the virtual machine instance-00000088. 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000088' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Not enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 'instance-00000088' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Error code: 32778. 2021-09-10 17:30:29.024 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.024 4088 3038360563960 MainThread INFO nova.compute.manager [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Terminating instance 2021-09-10 17:30:29.024 4088 3038360563960 MainThread DEBUG nova.compute.manager [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:30:29.024 4088 3038360563960 MainThread INFO nova.virt.hyperv.vmops [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Got request to destroy instance 2021-09-10 17:30:29.057 4088 3038360563960 MainThread DEBUG nova.virt.hyperv.vmops [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:30:29.057 4088 3038360563960 MainThread DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "instance-00000088" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:29.057 4088 3038360563960 MainThread DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "instance-00000088" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:29.057 4088 3038360563960 MainThread INFO nova.compute.manager [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:30:29.057 4088 3038360563960 MainThread DEBUG nova.compute.claims [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:30:29.057 4088 3038360563960 MainThread DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:29.146 4088 3038360563960 MainThread DEBUG nova.virt.hyperv.hostops [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:30:29.166 4088 3038360563960 MainThread DEBUG nova.virt.hyperv.hostops [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:30:29.370 4088 3038360563960 MainThread DEBUG nova.compute.provider_tree [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:30:29.388 4088 3038360563960 MainThread DEBUG nova.scheduler.client.report [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:30:29.388 4088 3038360563960 MainThread DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:29.388 4088 3038360563960 MainThread ERROR nova.compute.manager [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000088' failed to start. Not enough memory in the system to start the virtual machine instance-00000088. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000088' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Not enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) 'instance-00000088' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Error code: 32778. 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Traceback (most recent call last): 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] return function(*args, **kwargs) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] admin_password, network_info, block_device_info) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] return function(self, *args, **kwds) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self.force_reraise() 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] raise self.value 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] should_plug_vifs=False) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 'req_state': req_state}) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self.force_reraise() 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] raise self.value 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] time.sleep(sleep_time) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self.force_reraise() 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] raise self.value 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] return f(*args, **kwargs) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] return self._wait_for_job(job_path) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] error_desc=err_desc) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000088' failed to start. 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Not enough memory in the system to start the virtual machine instance-00000088. 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000088' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Not enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 'instance-00000088' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Error code: 32778. 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] During handling of the above exception, another exception occurred: 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Traceback (most recent call last): 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] accel_info=accel_info) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] return function(*args, **kwargs) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] admin_password, network_info, block_device_info) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] return function(self, *args, **kwds) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self.force_reraise() 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] raise self.value 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] should_plug_vifs=False) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 'req_state': req_state}) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self.force_reraise() 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] raise self.value 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] time.sleep(sleep_time) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self.force_reraise() 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] raise self.value 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] return f(*args, **kwargs) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] return self._wait_for_job(job_path) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] error_desc=err_desc) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000088' failed to start. 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Not enough memory in the system to start the virtual machine instance-00000088. 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000088' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Not enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 'instance-00000088' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Error code: 32778. 2021-09-10 17:30:29.388 4088 3038360563960 MainThread TRACE nova.compute.manager [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] 2021-09-10 17:30:29.399 4088 3038360563960 MainThread DEBUG nova.compute.utils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] WMI job failed with status 10. Error summary description: 'instance-00000088' failed to start. Not enough memory in the system to start the virtual machine instance-00000088. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:30:29.399 4088 3038360563960 MainThread DEBUG nova.compute.manager [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Build of instance ee88e2a3-1118-4d2d-8706-7596a4f77aa7 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000088' failed to start. Not enough memory in the system to start the virtual machine instance-00000088. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000088' failed to start. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Not enough memory in the system to start the virtual machine instance-00000088 with ram size 1024 megabytes. (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) 'instance-00000088' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 21AC1C43-96BB-415A-965E-7BA8EDD013E5) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:30:29.399 4088 3038360563960 MainThread DEBUG nova.compute.manager [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:30:29.399 4088 3038360563960 MainThread DEBUG nova.compute.manager [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:30:29.399 4088 3038360563960 MainThread DEBUG nova.compute.manager [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:30:29.399 4088 3038360563960 MainThread DEBUG nova.network.neutron [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:30:29.870 4088 3038360563960 MainThread DEBUG nova.network.neutron [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:30:29.894 4088 3038360563960 MainThread INFO nova.compute.manager [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] [instance: ee88e2a3-1118-4d2d-8706-7596a4f77aa7] Took 0.50 seconds to deallocate network for instance. 2021-09-10 17:30:30.010 4088 3038360563960 MainThread INFO nova.scheduler.client.report [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Deleted allocations for instance ee88e2a3-1118-4d2d-8706-7596a4f77aa7 2021-09-10 17:30:30.041 4088 3038360563960 MainThread DEBUG oslo_concurrency.lockutils [req-02cc0c9d-0f98-410b-b70b-68f9c5b0eaaf 652641e6ad894a5cbe0cbe09bd677e6f 5ece1a15a5d64ee19aacaadbaf9c9c95 - default default] Lock "ee88e2a3-1118-4d2d-8706-7596a4f77aa7" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.375s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:57.028 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Lock "27dff516-729a-44df-9cf5-583985f4ec93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:57.044 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:30:57.153 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:57.153 4088 3038360566072 MainThread DEBUG nova.virt.hardware [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:30:57.153 4088 3038360566072 MainThread INFO nova.compute.claims [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Claim successful on node n-h2-808474-1 2021-09-10 17:30:57.244 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.hostops [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:30:57.278 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.hostops [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:30:57.487 4088 3038360566072 MainThread DEBUG nova.compute.provider_tree [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:30:57.503 4088 3038360566072 MainThread DEBUG nova.scheduler.client.report [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:30:57.503 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:57.503 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:30:57.559 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:30:57.574 4088 3038360565896 GreenThread-126 DEBUG nova.compute.manager [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:30:57.574 4088 3038360565896 GreenThread-126 DEBUG nova.network.neutron [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:30:57.699 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:30:57.699 4088 3038360565896 GreenThread-126 DEBUG nova.policy [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56b46e8aaf0e4c24ad2cbac5d029d70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66a56bcea974021b9292220f9d4cade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:30:57.710 4088 3038360566072 MainThread INFO nova.virt.hyperv.vmops [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Spawning new instance 2021-09-10 17:30:57.725 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Lock "instance-00000089" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:57.725 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Lock "instance-00000089" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:57.725 4088 3038360566072 MainThread DEBUG nova.block_device [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:30:57.725 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:57.725 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:57.725 4088 3038360566072 MainThread DEBUG os_win.utils.pathutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Creating directory: C:\openstack\instances\instance-00000089 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:30:57.725 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.vmops [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000089\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:30:57.956 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.vmops [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Resizing VHD C:\openstack\instances\instance-00000089\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:30:58.299 4088 3038360565896 GreenThread-126 DEBUG nova.network.neutron [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Successfully created port: 5bb7be93-df3b-4aa3-bd31-02ec4cfb2417 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:30:58.918 4088 3038360565896 GreenThread-126 DEBUG nova.network.neutron [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Successfully updated port: 5bb7be93-df3b-4aa3-bd31-02ec4cfb2417 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:30:58.934 4088 3038360565896 GreenThread-126 DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Acquired lock "refresh_cache-27dff516-729a-44df-9cf5-583985f4ec93" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:30:58.934 4088 3038360565896 GreenThread-126 DEBUG nova.network.neutron [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:30:58.997 4088 3038360565896 GreenThread-126 DEBUG nova.network.neutron [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:30:59.027 4088 3038360566424 MainThread DEBUG nova.compute.manager [req-1bd6fcd3-29b8-42de-a66b-aa37ccb15934 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Received event network-changed-5bb7be93-df3b-4aa3-bd31-02ec4cfb2417 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:30:59.027 4088 3038360566424 MainThread DEBUG nova.compute.manager [req-1bd6fcd3-29b8-42de-a66b-aa37ccb15934 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Refreshing instance network info cache due to event network-changed-5bb7be93-df3b-4aa3-bd31-02ec4cfb2417. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:30:59.316 4088 3038360565896 GreenThread-126 DEBUG nova.network.neutron [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Updating instance_info_cache with network_info: [{"id": "5bb7be93-df3b-4aa3-bd31-02ec4cfb2417", "address": "fa:16:3e:a0:b6:19", "network": {"id": "2c384598-3634-4c1c-880c-a730d12034e6", "bridge": null, "label": "tempest-ServerActionsTestJSON-434213352-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c66a56bcea974021b9292220f9d4cade", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap5bb7be93-df", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:30:59.347 4088 3038360565896 GreenThread-126 DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Releasing lock "refresh_cache-27dff516-729a-44df-9cf5-583985f4ec93" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:30:59.347 4088 3038360565896 GreenThread-126 DEBUG nova.compute.manager [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Instance network_info: |[{"id": "5bb7be93-df3b-4aa3-bd31-02ec4cfb2417", "address": "fa:16:3e:a0:b6:19", "network": {"id": "2c384598-3634-4c1c-880c-a730d12034e6", "bridge": null, "label": "tempest-ServerActionsTestJSON-434213352-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c66a56bcea974021b9292220f9d4cade", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap5bb7be93-df", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:30:59.347 4088 3038360566424 MainThread DEBUG oslo_concurrency.lockutils [req-1bd6fcd3-29b8-42de-a66b-aa37ccb15934 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-27dff516-729a-44df-9cf5-583985f4ec93" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:30:59.347 4088 3038360566424 MainThread DEBUG nova.network.neutron [req-1bd6fcd3-29b8-42de-a66b-aa37ccb15934 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Refreshing network info cache for port 5bb7be93-df3b-4aa3-bd31-02ec4cfb2417 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:30:59.347 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Preparing to wait for external event network-vif-plugged-5bb7be93-df3b-4aa3-bd31-02ec4cfb2417 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:30:59.347 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Lock "27dff516-729a-44df-9cf5-583985f4ec93-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:30:59.347 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Lock "27dff516-729a-44df-9cf5-583985f4ec93-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:30:59.347 4088 3038360566072 MainThread DEBUG os_win.utils.compute.vmutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Creating VM instance-00000089 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:30:59.817 4088 3038360566424 MainThread DEBUG nova.network.neutron [req-1bd6fcd3-29b8-42de-a66b-aa37ccb15934 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Updated VIF entry in instance network info cache for port 5bb7be93-df3b-4aa3-bd31-02ec4cfb2417. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:30:59.817 4088 3038360566424 MainThread DEBUG nova.network.neutron [req-1bd6fcd3-29b8-42de-a66b-aa37ccb15934 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Updating instance_info_cache with network_info: [{"id": "5bb7be93-df3b-4aa3-bd31-02ec4cfb2417", "address": "fa:16:3e:a0:b6:19", "network": {"id": "2c384598-3634-4c1c-880c-a730d12034e6", "bridge": null, "label": "tempest-ServerActionsTestJSON-434213352-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c66a56bcea974021b9292220f9d4cade", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap5bb7be93-df", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:30:59.817 4088 3038360566424 MainThread DEBUG oslo_concurrency.lockutils [req-1bd6fcd3-29b8-42de-a66b-aa37ccb15934 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-27dff516-729a-44df-9cf5-583985f4ec93" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:31:01.035 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.vmops [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:31:06.009 4088 3038360566776 MainThread DEBUG nova.compute.manager [req-8560785d-2660-4795-829a-c31adc93931b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Received event network-vif-plugged-5bb7be93-df3b-4aa3-bd31-02ec4cfb2417 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:31:06.009 4088 3038360566776 MainThread DEBUG oslo_concurrency.lockutils [req-8560785d-2660-4795-829a-c31adc93931b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "27dff516-729a-44df-9cf5-583985f4ec93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:06.009 4088 3038360566776 MainThread DEBUG oslo_concurrency.lockutils [req-8560785d-2660-4795-829a-c31adc93931b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "27dff516-729a-44df-9cf5-583985f4ec93-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:06.009 4088 3038360566776 MainThread DEBUG nova.compute.manager [req-8560785d-2660-4795-829a-c31adc93931b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Processing event network-vif-plugged-5bb7be93-df3b-4aa3-bd31-02ec4cfb2417 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:31:06.045 4088 3038360566072 MainThread INFO nova.virt.hyperv.vmops [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Using config drive for instance 2021-09-10 17:31:06.151 4088 3038360566072 MainThread INFO nova.virt.hyperv.vmops [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Creating config drive at C:\openstack\instances\instance-00000089\configdrive.iso 2021-09-10 17:31:06.268 4088 3038360566072 MainThread DEBUG oslo_concurrency.processutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000089\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmphprn_yhv execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:31:06.612 4088 3038360566072 MainThread DEBUG oslo_concurrency.processutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000089\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmphprn_yhv" returned: 0 in 0.343s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:31:07.103 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.vmops [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Setting boot order for instance: instance-00000089: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:31:07.213 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.vmops [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:31:07.248 4088 3038360566072 MainThread DEBUG os_win.utils.jobutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Waiting for WMI job: {'InstanceID': 'A092C3E8-0282-4597-8DB3-8E633A6249C5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20246), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:31:07.395 4088 3038360566072 MainThread ERROR os_win.utils.jobutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] WMI job failed: {'RawErrors': (('124\'instance-00000089\' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)instance-0000008929481B44-8CB0-47FD-B45A-ADF610FD709712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)instance-0000008929481B44-8CB0-47FD-B45A-ADF610FD709710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000089\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)instance-0000008929481B44-8CB0-47FD-B45A-ADF610FD7097%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A092C3E8-0282-4597-8DB3-8E633A6249C5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114571), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 31, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 31, 7), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000089' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)\n\nNot enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)\n\n'instance-00000089' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)", 'ErrorSummaryDescription': "'instance-00000089' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000089.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:31:07.395 4088 3038360566072 MainThread DEBUG os_win._utils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000089' failed to start. Not enough memory in the system to start the virtual machine instance-00000089. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000089' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Not enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) 'instance-00000089' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18140697479248047 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:31:07.413 4088 3038360565896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:31:07.413 4088 3038360565896 MainThread INFO nova.compute.manager [-] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] VM Stopped (Lifecycle Event) 2021-09-10 17:31:07.413 4088 3038360566776 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000089" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:07.413 4088 3038360566776 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000089" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:07.440 4088 3038360565896 MainThread DEBUG nova.compute.manager [req-8323d35d-3143-470f-941c-6aaecf84dcf3 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:31:07.440 4088 3038360565896 MainThread DEBUG nova.virt.hyperv.vmops [req-8323d35d-3143-470f-941c-6aaecf84dcf3 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:31:07.471 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:31:07.498 4088 3038360565896 MainThread DEBUG nova.compute.manager [req-8323d35d-3143-470f-941c-6aaecf84dcf3 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:31:07.513 4088 3038360565896 MainThread INFO nova.compute.manager [req-8323d35d-3143-470f-941c-6aaecf84dcf3 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:31:08.415 4088 3038360566072 MainThread DEBUG os_win.utils.jobutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Waiting for WMI job: {'InstanceID': 'A3E53D1E-78F6-49C1-BDCC-FD460E10A8A3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14996), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:31:08.536 4088 3038360566072 MainThread ERROR os_win.utils.jobutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] WMI job failed: {'RawErrors': (('124\'instance-00000089\' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)instance-0000008929481B44-8CB0-47FD-B45A-ADF610FD709712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)instance-0000008929481B44-8CB0-47FD-B45A-ADF610FD709710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000089\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)instance-0000008929481B44-8CB0-47FD-B45A-ADF610FD7097%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'A3E53D1E-78F6-49C1-BDCC-FD460E10A8A3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113696), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 31, 8), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 31, 8), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000089' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)\n\nNot enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)\n\n'instance-00000089' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)", 'ErrorSummaryDescription': "'instance-00000089' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000089.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:31:08.536 4088 3038360566072 MainThread DEBUG os_win._utils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000089' failed to start. Not enough memory in the system to start the virtual machine instance-00000089. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000089' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Not enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) 'instance-00000089' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3232693672180176 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:31:08.571 4088 3038360566776 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000089" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:08.571 4088 3038360566776 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000089" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:08.571 4088 3038360565896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:31:08.592 4088 3038360565896 MainThread INFO nova.compute.manager [-] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] VM Stopped (Lifecycle Event) 2021-09-10 17:31:08.607 4088 3038360565896 MainThread DEBUG nova.compute.manager [req-3e9245d2-11f1-48f6-b6c0-dd985a355071 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:31:08.607 4088 3038360565896 MainThread DEBUG nova.virt.hyperv.vmops [req-3e9245d2-11f1-48f6-b6c0-dd985a355071 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:31:08.643 4088 3038360565896 MainThread DEBUG nova.compute.manager [req-3e9245d2-11f1-48f6-b6c0-dd985a355071 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:31:08.661 4088 3038360565896 MainThread INFO nova.compute.manager [req-3e9245d2-11f1-48f6-b6c0-dd985a355071 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:31:09.471 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:31:09.471 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:31:09.552 4088 3038360566072 MainThread DEBUG os_win.utils.jobutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Waiting for WMI job: {'InstanceID': '13E428C6-9581-4259-8A62-1BE87D0FE21D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15877), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:31:09.695 4088 3038360566072 MainThread ERROR os_win.utils.jobutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] WMI job failed: {'RawErrors': (('124\'instance-00000089\' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)instance-0000008929481B44-8CB0-47FD-B45A-ADF610FD709712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)instance-0000008929481B44-8CB0-47FD-B45A-ADF610FD709710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000089\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)instance-0000008929481B44-8CB0-47FD-B45A-ADF610FD7097%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '13E428C6-9581-4259-8A62-1BE87D0FE21D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112459), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 31, 9), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 31, 9), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000089' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)\n\nNot enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)\n\n'instance-00000089' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)", 'ErrorSummaryDescription': "'instance-00000089' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000089.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:31:09.695 4088 3038360566072 MainThread DEBUG os_win._utils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000089' failed to start. Not enough memory in the system to start the virtual machine instance-00000089. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000089' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Not enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) 'instance-00000089' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.4821364879608154 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:31:09.730 4088 3038360565896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:31:09.730 4088 3038360565896 MainThread INFO nova.compute.manager [-] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] VM Stopped (Lifecycle Event) 2021-09-10 17:31:09.750 4088 3038360566776 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000089" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:09.750 4088 3038360566776 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000089" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:09.768 4088 3038360565896 MainThread DEBUG nova.compute.manager [req-3f27080a-4699-4490-b53f-b836fb1ff1f9 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:31:09.768 4088 3038360565896 MainThread DEBUG nova.virt.hyperv.vmops [req-3f27080a-4699-4490-b53f-b836fb1ff1f9 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:31:09.815 4088 3038360565896 MainThread DEBUG nova.compute.manager [req-3f27080a-4699-4490-b53f-b836fb1ff1f9 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:31:09.830 4088 3038360565896 MainThread INFO nova.compute.manager [req-3f27080a-4699-4490-b53f-b836fb1ff1f9 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:31:10.471 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:31:10.471 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:31:10.712 4088 3038360566072 MainThread DEBUG os_win.utils.jobutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Waiting for WMI job: {'InstanceID': '222C149E-78AA-4425-B928-E74F101FE400', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14886), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:31:10.843 4088 3038360566072 MainThread ERROR os_win.utils.jobutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] WMI job failed: {'RawErrors': (('124\'instance-00000089\' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)instance-0000008929481B44-8CB0-47FD-B45A-ADF610FD709712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)instance-0000008929481B44-8CB0-47FD-B45A-ADF610FD709710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000089\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)instance-0000008929481B44-8CB0-47FD-B45A-ADF610FD7097%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '222C149E-78AA-4425-B928-E74F101FE400', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113116), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 31, 10), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 31, 10), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000089' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)\n\nNot enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)\n\n'instance-00000089' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)", 'ErrorSummaryDescription': "'instance-00000089' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000089.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:31:10.843 4088 3038360566072 MainThread DEBUG os_win._utils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000089' failed to start. Not enough memory in the system to start the virtual machine instance-00000089. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000089' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Not enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) 'instance-00000089' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.629535675048828 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:31:10.910 4088 3038360565896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:31:10.910 4088 3038360565896 MainThread INFO nova.compute.manager [-] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] VM Stopped (Lifecycle Event) 2021-09-10 17:31:10.910 4088 3038360566776 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000089" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:10.910 4088 3038360566776 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000089" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:10.940 4088 3038360565896 MainThread DEBUG nova.compute.manager [req-b460d5f8-4d0d-4dec-b198-06c2d7a95a19 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:31:10.940 4088 3038360565896 MainThread DEBUG nova.virt.hyperv.vmops [req-b460d5f8-4d0d-4dec-b198-06c2d7a95a19 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:31:10.984 4088 3038360565896 MainThread DEBUG nova.compute.manager [req-b460d5f8-4d0d-4dec-b198-06c2d7a95a19 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:31:11.002 4088 3038360565896 MainThread INFO nova.compute.manager [req-b460d5f8-4d0d-4dec-b198-06c2d7a95a19 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:31:11.466 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:31:11.873 4088 3038360566072 MainThread DEBUG os_win.utils.jobutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Waiting for WMI job: {'InstanceID': '70991B1D-19DC-46C5-A155-C9827C7B16B6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14484), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:31:12.018 4088 3038360566072 MainThread ERROR os_win.utils.jobutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] WMI job failed: {'RawErrors': (('124\'instance-00000089\' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)instance-0000008929481B44-8CB0-47FD-B45A-ADF610FD709712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)instance-0000008929481B44-8CB0-47FD-B45A-ADF610FD709710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000089\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)instance-0000008929481B44-8CB0-47FD-B45A-ADF610FD7097%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '70991B1D-19DC-46C5-A155-C9827C7B16B6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110300), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 31, 11), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 31, 11), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000089' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)\n\nNot enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)\n\n'instance-00000089' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)", 'ErrorSummaryDescription': "'instance-00000089' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000089.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:31:12.018 4088 3038360566072 MainThread DEBUG os_win._utils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000089' failed to start. Not enough memory in the system to start the virtual machine instance-00000089. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000089' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Not enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) 'instance-00000089' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.80445671081543 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:31:12.045 4088 3038360566776 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000089" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:12.045 4088 3038360566776 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000089" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:12.045 4088 3038360565896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:31:12.045 4088 3038360565896 MainThread INFO nova.compute.manager [-] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] VM Stopped (Lifecycle Event) 2021-09-10 17:31:12.067 4088 3038360565896 MainThread DEBUG nova.compute.manager [req-ffe892f0-7bdb-4c18-91cb-0fa3377247d3 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:31:12.067 4088 3038360565896 MainThread DEBUG nova.virt.hyperv.vmops [req-ffe892f0-7bdb-4c18-91cb-0fa3377247d3 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:31:12.111 4088 3038360565896 MainThread DEBUG nova.compute.manager [req-ffe892f0-7bdb-4c18-91cb-0fa3377247d3 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:31:12.137 4088 3038360565896 MainThread INFO nova.compute.manager [req-ffe892f0-7bdb-4c18-91cb-0fa3377247d3 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:31:13.051 4088 3038360566072 MainThread DEBUG os_win.utils.jobutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Waiting for WMI job: {'InstanceID': '7BACBC9B-8A37-4AA9-9987-FF58A8793471', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14416), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:31:13.176 4088 3038360566072 MainThread ERROR os_win.utils.jobutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] WMI job failed: {'RawErrors': (('124\'instance-00000089\' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)instance-0000008929481B44-8CB0-47FD-B45A-ADF610FD709712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)instance-0000008929481B44-8CB0-47FD-B45A-ADF610FD709710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000089\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)instance-0000008929481B44-8CB0-47FD-B45A-ADF610FD7097%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7BACBC9B-8A37-4AA9-9987-FF58A8793471', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111519), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 31, 13), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 31, 13), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000089' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)\n\nNot enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)\n\n'instance-00000089' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097)", 'ErrorSummaryDescription': "'instance-00000089' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000089.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:31:13.176 4088 3038360566072 MainThread ERROR nova.virt.hyperv.vmops [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Failed to change vm state of instance-00000089 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000089' failed to start. 2021-09-10 17:31:13.176 4088 3038360566072 MainThread INFO nova.virt.hyperv.vmops [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Got request to destroy instance 2021-09-10 17:31:13.222 4088 3038360565896 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:31:13.222 4088 3038360565896 MainThread INFO nova.compute.manager [-] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] VM Stopped (Lifecycle Event) 2021-09-10 17:31:13.252 4088 3038360566776 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000089" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:13.252 4088 3038360566776 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000089" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:13.266 4088 3038360565896 MainThread DEBUG nova.compute.manager [req-49ee59e8-7370-4c7b-b999-7743c5d92773 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:31:13.266 4088 3038360565896 MainThread DEBUG nova.virt.hyperv.vmops [req-49ee59e8-7370-4c7b-b999-7743c5d92773 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:31:13.309 4088 3038360565896 MainThread DEBUG nova.compute.manager [req-49ee59e8-7370-4c7b-b999-7743c5d92773 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:31:13.326 4088 3038360565896 MainThread INFO nova.compute.manager [req-49ee59e8-7370-4c7b-b999-7743c5d92773 - - - - -] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:31:13.467 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:31:14.485 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:31:14.988 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.vmops [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:31:14.988 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Lock "instance-00000089" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:14.988 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Lock "instance-00000089" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:15.020 4088 3038360566072 MainThread DEBUG os_win.utils.compute.vmutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Successfully changed vm state of instance-00000089 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:31:15.020 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.vmops [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Successfully changed state of VM instance-00000089 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:31:15.050 4088 3038360566072 MainThread DEBUG os_win.utils.jobutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Waiting for WMI job: {'InstanceID': 'FD250F33-2FE4-4538-8ABB-2C8DAF5916B9', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=13964), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:31:15.175 4088 3038360566072 MainThread DEBUG os_win.utils.jobutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] WMI job succeeded: {'InstanceID': 'FD250F33-2FE4-4538-8ABB-2C8DAF5916B9', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=106240), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:31:15.175 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Lock "instance-00000089" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:15.175 4088 3038360566072 MainThread DEBUG os_win.utils.pathutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Removing directory: C:\openstack\instances\instance-00000089 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:31:15.175 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Lock "instance-00000089" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:15.175 4088 3038360566072 MainThread ERROR nova.compute.manager [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000089' failed to start. Not enough memory in the system to start the virtual machine instance-00000089. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000089' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Not enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) 'instance-00000089' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Error code: 32778. 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Traceback (most recent call last): 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] return function(*args, **kwargs) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] admin_password, network_info, block_device_info) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] return function(self, *args, **kwds) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self.force_reraise() 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] raise self.value 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] should_plug_vifs=False) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 'req_state': req_state}) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self.force_reraise() 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] raise self.value 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] time.sleep(sleep_time) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self.force_reraise() 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] raise self.value 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] return f(*args, **kwargs) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] return self._wait_for_job(job_path) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] error_desc=err_desc) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000089' failed to start. 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Not enough memory in the system to start the virtual machine instance-00000089. 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000089' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Not enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 'instance-00000089' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Error code: 32778. 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] During handling of the above exception, another exception occurred: 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Traceback (most recent call last): 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] yield resources 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] accel_info=accel_info) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] return function(*args, **kwargs) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] admin_password, network_info, block_device_info) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] return function(self, *args, **kwds) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self.force_reraise() 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] raise self.value 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] should_plug_vifs=False) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 'req_state': req_state}) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self.force_reraise() 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] raise self.value 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] time.sleep(sleep_time) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self.force_reraise() 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] raise self.value 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] return f(*args, **kwargs) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] return self._wait_for_job(job_path) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] error_desc=err_desc) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000089' failed to start. 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Not enough memory in the system to start the virtual machine instance-00000089. 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000089' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Not enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 'instance-00000089' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Error code: 32778. 2021-09-10 17:31:15.175 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.175 4088 3038360566072 MainThread INFO nova.compute.manager [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Terminating instance 2021-09-10 17:31:15.175 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:31:15.175 4088 3038360566072 MainThread INFO nova.virt.hyperv.vmops [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Got request to destroy instance 2021-09-10 17:31:15.201 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.vmops [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:31:15.201 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Lock "instance-00000089" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:15.201 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Lock "instance-00000089" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:15.201 4088 3038360566072 MainThread INFO nova.compute.manager [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:31:15.201 4088 3038360566072 MainThread DEBUG nova.compute.claims [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:31:15.201 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:15.294 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.hostops [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:31:15.326 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.hostops [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:31:15.467 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:31:15.549 4088 3038360566072 MainThread DEBUG nova.compute.provider_tree [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:31:15.560 4088 3038360566072 MainThread DEBUG nova.scheduler.client.report [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:31:15.560 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.359s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:15.560 4088 3038360566072 MainThread ERROR nova.compute.manager [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000089' failed to start. Not enough memory in the system to start the virtual machine instance-00000089. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000089' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Not enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) 'instance-00000089' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Error code: 32778. 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Traceback (most recent call last): 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] return function(*args, **kwargs) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] admin_password, network_info, block_device_info) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] return function(self, *args, **kwds) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self.force_reraise() 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] raise self.value 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] should_plug_vifs=False) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 'req_state': req_state}) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self.force_reraise() 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] raise self.value 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] time.sleep(sleep_time) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self.force_reraise() 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] raise self.value 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] return f(*args, **kwargs) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] return self._wait_for_job(job_path) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] error_desc=err_desc) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000089' failed to start. 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Not enough memory in the system to start the virtual machine instance-00000089. 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000089' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Not enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 'instance-00000089' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Error code: 32778. 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] During handling of the above exception, another exception occurred: 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Traceback (most recent call last): 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] accel_info=accel_info) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] return function(*args, **kwargs) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] admin_password, network_info, block_device_info) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] return function(self, *args, **kwds) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self.force_reraise() 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] raise self.value 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] should_plug_vifs=False) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 'req_state': req_state}) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self.force_reraise() 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] raise self.value 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] time.sleep(sleep_time) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self.force_reraise() 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] raise self.value 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] return f(*args, **kwargs) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] return self._wait_for_job(job_path) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] error_desc=err_desc) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000089' failed to start. 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Not enough memory in the system to start the virtual machine instance-00000089. 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000089' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Not enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 'instance-00000089' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Error code: 32778. 2021-09-10 17:31:15.560 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: 27dff516-729a-44df-9cf5-583985f4ec93] 2021-09-10 17:31:15.560 4088 3038360566072 MainThread DEBUG nova.compute.utils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] WMI job failed with status 10. Error summary description: 'instance-00000089' failed to start. Not enough memory in the system to start the virtual machine instance-00000089. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:31:15.560 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Build of instance 27dff516-729a-44df-9cf5-583985f4ec93 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000089' failed to start. Not enough memory in the system to start the virtual machine instance-00000089. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000089' failed to start. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Not enough memory in the system to start the virtual machine instance-00000089 with ram size 1024 megabytes. (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) 'instance-00000089' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 29481B44-8CB0-47FD-B45A-ADF610FD7097) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:31:15.560 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:31:15.577 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:31:15.577 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:31:15.577 4088 3038360566072 MainThread DEBUG nova.network.neutron [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:31:15.577 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.094s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:15.577 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:15.577 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:31:15.577 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:31:15.588 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:31:15.799 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2223MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:31:15.799 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:15.926 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:31:15.926 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:31:15.926 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:31:15.926 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:31:15.926 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:31:15.926 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:31:15.926 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:31:15.926 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:31:15.926 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:31:15.926 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:31:15.926 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:31:15.926 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:31:15.926 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:31:15.951 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 27dff516-729a-44df-9cf5-583985f4ec93 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1591 2021-09-10 17:31:15.951 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:31:15.951 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:31:15.983 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:31:15.999 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:31:16.061 4088 3038360566072 MainThread DEBUG nova.network.neutron [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:31:16.084 4088 3038360566072 MainThread INFO nova.compute.manager [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] [instance: 27dff516-729a-44df-9cf5-583985f4ec93] Took 0.50 seconds to deallocate network for instance. 2021-09-10 17:31:16.205 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:31:16.205 4088 3038360566072 MainThread INFO nova.scheduler.client.report [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Deleted allocations for instance 27dff516-729a-44df-9cf5-583985f4ec93 2021-09-10 17:31:16.244 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:31:16.244 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:31:16.244 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.437s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:16.263 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-c20f4919-18e0-4c4c-8ca1-04e7a2bb4307 56b46e8aaf0e4c24ad2cbac5d029d70e c66a56bcea974021b9292220f9d4cade - default default] Lock "27dff516-729a-44df-9cf5-583985f4ec93" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.235s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:18.252 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:31:18.252 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:31:18.670 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-359fd482-69f5-4194-9466-f46ea31258d3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:31:18.670 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:31:19.436 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Updating instance_info_cache with network_info: [{"id": "43904798-2eab-4ec0-9b1b-f79a929eba99", "address": "fa:16:3e:9c:26:60", "network": {"id": "7434a41e-b78f-4cb9-8ffe-b2514d097201", "bridge": null, "label": "tempest-LiveAutoBlockMigrationV225Test-1499875764-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91237ebda1b54d2dbc761e48fdd93516", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap43904798-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:31:19.459 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-359fd482-69f5-4194-9466-f46ea31258d3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:31:19.459 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:31:20.468 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:31:31.736 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:31:41.423 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Lock "ff2a83fa-db74-482d-8757-342c81429d60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:41.442 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:31:41.526 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:41.526 4088 3038360566072 MainThread DEBUG nova.virt.hardware [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:31:41.526 4088 3038360566072 MainThread INFO nova.compute.claims [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Claim successful on node n-h2-808474-1 2021-09-10 17:31:41.628 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.hostops [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:31:41.646 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.hostops [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:31:41.847 4088 3038360566072 MainThread DEBUG nova.compute.provider_tree [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:31:41.847 4088 3038360566072 MainThread DEBUG nova.scheduler.client.report [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:31:41.847 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:41.847 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:31:41.920 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:31:41.920 4088 3038360567304 GreenThread-127 DEBUG nova.compute.manager [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:31:41.920 4088 3038360567304 GreenThread-127 DEBUG nova.network.neutron [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:31:42.025 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:31:42.045 4088 3038360567304 GreenThread-127 DEBUG nova.policy [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e710e3097754eeb8ad12e38ed281d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c09d982121a423cbfdf4d85175c464c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:31:42.045 4088 3038360566072 MainThread INFO nova.virt.hyperv.vmops [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Spawning new instance 2021-09-10 17:31:42.054 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Lock "instance-0000008a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:42.054 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Lock "instance-0000008a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:42.054 4088 3038360566072 MainThread DEBUG nova.block_device [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:31:42.054 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:42.054 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:42.068 4088 3038360566072 MainThread DEBUG os_win.utils.pathutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Creating directory: C:\openstack\instances\instance-0000008a check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:31:42.068 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.vmops [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000008a\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:31:42.301 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.vmops [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Resizing VHD C:\openstack\instances\instance-0000008a\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:31:42.598 4088 3038360567304 GreenThread-127 DEBUG nova.network.neutron [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Successfully created port: 53db6274-4058-4e4b-b756-0c77108f4e64 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:31:43.188 4088 3038360567304 GreenThread-127 DEBUG nova.network.neutron [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Successfully updated port: 53db6274-4058-4e4b-b756-0c77108f4e64 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:31:43.204 4088 3038360567304 GreenThread-127 DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Acquired lock "refresh_cache-ff2a83fa-db74-482d-8757-342c81429d60" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:31:43.204 4088 3038360567304 GreenThread-127 DEBUG nova.network.neutron [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:31:43.223 4088 3038364315720 MainThread DEBUG nova.compute.manager [req-1cfe9c30-0b2b-4d3e-b233-a85f1a94e8ea 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Received event network-changed-53db6274-4058-4e4b-b756-0c77108f4e64 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:31:43.223 4088 3038364315720 MainThread DEBUG nova.compute.manager [req-1cfe9c30-0b2b-4d3e-b233-a85f1a94e8ea 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Refreshing instance network info cache due to event network-changed-53db6274-4058-4e4b-b756-0c77108f4e64. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:31:43.264 4088 3038360567304 GreenThread-127 DEBUG nova.network.neutron [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:31:43.576 4088 3038360567304 GreenThread-127 DEBUG nova.network.neutron [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Updating instance_info_cache with network_info: [{"id": "53db6274-4058-4e4b-b756-0c77108f4e64", "address": "fa:16:3e:96:27:1b", "network": {"id": "1758ef0b-50dc-45c4-93d4-bc752e87b401", "bridge": null, "label": "tempest-ServersNegativeTestJSON-302151487-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8c09d982121a423cbfdf4d85175c464c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap53db6274-40", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:31:43.595 4088 3038360567304 GreenThread-127 DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Releasing lock "refresh_cache-ff2a83fa-db74-482d-8757-342c81429d60" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:31:43.595 4088 3038360567304 GreenThread-127 DEBUG nova.compute.manager [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Instance network_info: |[{"id": "53db6274-4058-4e4b-b756-0c77108f4e64", "address": "fa:16:3e:96:27:1b", "network": {"id": "1758ef0b-50dc-45c4-93d4-bc752e87b401", "bridge": null, "label": "tempest-ServersNegativeTestJSON-302151487-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8c09d982121a423cbfdf4d85175c464c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap53db6274-40", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:31:43.595 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Preparing to wait for external event network-vif-plugged-53db6274-4058-4e4b-b756-0c77108f4e64 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:31:43.595 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Lock "ff2a83fa-db74-482d-8757-342c81429d60-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:43.595 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Lock "ff2a83fa-db74-482d-8757-342c81429d60-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:43.595 4088 3038360566072 MainThread DEBUG os_win.utils.compute.vmutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Creating VM instance-0000008a create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:31:43.595 4088 3038364315720 MainThread DEBUG oslo_concurrency.lockutils [req-1cfe9c30-0b2b-4d3e-b233-a85f1a94e8ea 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-ff2a83fa-db74-482d-8757-342c81429d60" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:31:43.595 4088 3038364315720 MainThread DEBUG nova.network.neutron [req-1cfe9c30-0b2b-4d3e-b233-a85f1a94e8ea 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Refreshing network info cache for port 53db6274-4058-4e4b-b756-0c77108f4e64 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:31:44.061 4088 3038364315720 MainThread DEBUG nova.network.neutron [req-1cfe9c30-0b2b-4d3e-b233-a85f1a94e8ea 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Updated VIF entry in instance network info cache for port 53db6274-4058-4e4b-b756-0c77108f4e64. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:31:44.061 4088 3038364315720 MainThread DEBUG nova.network.neutron [req-1cfe9c30-0b2b-4d3e-b233-a85f1a94e8ea 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Updating instance_info_cache with network_info: [{"id": "53db6274-4058-4e4b-b756-0c77108f4e64", "address": "fa:16:3e:96:27:1b", "network": {"id": "1758ef0b-50dc-45c4-93d4-bc752e87b401", "bridge": null, "label": "tempest-ServersNegativeTestJSON-302151487-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8c09d982121a423cbfdf4d85175c464c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap53db6274-40", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:31:44.079 4088 3038364315720 MainThread DEBUG oslo_concurrency.lockutils [req-1cfe9c30-0b2b-4d3e-b233-a85f1a94e8ea 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-ff2a83fa-db74-482d-8757-342c81429d60" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:31:45.310 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.vmops [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:31:50.185 4088 3038360567656 MainThread DEBUG nova.compute.manager [req-73deaced-fd63-4708-9093-2861b05c460e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Received event network-vif-plugged-53db6274-4058-4e4b-b756-0c77108f4e64 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:31:50.185 4088 3038360567656 MainThread DEBUG oslo_concurrency.lockutils [req-73deaced-fd63-4708-9093-2861b05c460e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "ff2a83fa-db74-482d-8757-342c81429d60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:50.185 4088 3038360567656 MainThread DEBUG oslo_concurrency.lockutils [req-73deaced-fd63-4708-9093-2861b05c460e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "ff2a83fa-db74-482d-8757-342c81429d60-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:50.185 4088 3038360567656 MainThread DEBUG nova.compute.manager [req-73deaced-fd63-4708-9093-2861b05c460e 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Processing event network-vif-plugged-53db6274-4058-4e4b-b756-0c77108f4e64 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:31:50.224 4088 3038360566072 MainThread INFO nova.virt.hyperv.vmops [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Using config drive for instance 2021-09-10 17:31:50.313 4088 3038360566072 MainThread INFO nova.virt.hyperv.vmops [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Creating config drive at C:\openstack\instances\instance-0000008a\configdrive.iso 2021-09-10 17:31:50.417 4088 3038360566072 MainThread DEBUG oslo_concurrency.processutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000008a\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpfqq1i7yl execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:31:50.716 4088 3038360566072 MainThread DEBUG oslo_concurrency.processutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000008a\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpfqq1i7yl" returned: 0 in 0.297s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:31:51.224 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.vmops [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Setting boot order for instance: instance-0000008a: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:31:51.317 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.vmops [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:31:51.333 4088 3038360566072 MainThread DEBUG os_win.utils.jobutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Waiting for WMI job: {'InstanceID': '7E124A1D-6655-43D8-BE6C-27038AA0B094', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15711), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:31:51.470 4088 3038360566072 MainThread ERROR os_win.utils.jobutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008a\' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)instance-0000008aBD2F3DB4-0314-4292-9FAB-FD9E0A7E8B3012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)instance-0000008aBD2F3DB4-0314-4292-9FAB-FD9E0A7E8B3010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)instance-0000008aBD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '7E124A1D-6655-43D8-BE6C-27038AA0B094', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113273), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 31, 51), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 31, 51), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008a' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)\n\nNot enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)\n\n'instance-0000008a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)", 'ErrorSummaryDescription': "'instance-0000008a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:31:51.470 4088 3038360566072 MainThread DEBUG os_win._utils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008a' failed to start. Not enough memory in the system to start the virtual machine instance-0000008a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008a' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Not enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) 'instance-0000008a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.15273618698120117 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:31:51.520 4088 3038360567480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:31:51.520 4088 3038360567480 MainThread INFO nova.compute.manager [-] [instance: ff2a83fa-db74-482d-8757-342c81429d60] VM Stopped (Lifecycle Event) 2021-09-10 17:31:51.520 4088 3038360567656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:51.520 4088 3038360567656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:51.547 4088 3038360567480 MainThread DEBUG nova.compute.manager [req-d4a09d9d-86bb-4a44-affa-1dd0073ec60c - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:31:51.547 4088 3038360567480 MainThread DEBUG nova.virt.hyperv.vmops [req-d4a09d9d-86bb-4a44-affa-1dd0073ec60c - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:31:51.610 4088 3038360567480 MainThread DEBUG nova.compute.manager [req-d4a09d9d-86bb-4a44-affa-1dd0073ec60c - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:31:51.638 4088 3038360567480 MainThread INFO nova.compute.manager [req-d4a09d9d-86bb-4a44-affa-1dd0073ec60c - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:31:52.497 4088 3038360566072 MainThread DEBUG os_win.utils.jobutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Waiting for WMI job: {'InstanceID': '48C52BF3-D095-43DF-84F8-A15F3443E4CB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14825), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:31:52.660 4088 3038360566072 MainThread ERROR os_win.utils.jobutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008a\' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)instance-0000008aBD2F3DB4-0314-4292-9FAB-FD9E0A7E8B3012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)instance-0000008aBD2F3DB4-0314-4292-9FAB-FD9E0A7E8B3010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)instance-0000008aBD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '48C52BF3-D095-43DF-84F8-A15F3443E4CB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=109065), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 31, 52), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 31, 52), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008a' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)\n\nNot enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)\n\n'instance-0000008a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)", 'ErrorSummaryDescription': "'instance-0000008a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:31:52.660 4088 3038360566072 MainThread DEBUG os_win._utils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008a' failed to start. Not enough memory in the system to start the virtual machine instance-0000008a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008a' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Not enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) 'instance-0000008a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3424699306488037 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:31:52.660 4088 3038360567480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:31:52.660 4088 3038360567480 MainThread INFO nova.compute.manager [-] [instance: ff2a83fa-db74-482d-8757-342c81429d60] VM Stopped (Lifecycle Event) 2021-09-10 17:31:52.660 4088 3038360567656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:52.660 4088 3038360567656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:52.695 4088 3038360567480 MainThread DEBUG nova.compute.manager [req-a118a11b-725d-42f5-8336-527547221976 - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:31:52.695 4088 3038360567480 MainThread DEBUG nova.virt.hyperv.vmops [req-a118a11b-725d-42f5-8336-527547221976 - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:31:52.729 4088 3038360567480 MainThread DEBUG nova.compute.manager [req-a118a11b-725d-42f5-8336-527547221976 - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:31:52.765 4088 3038360567480 MainThread INFO nova.compute.manager [req-a118a11b-725d-42f5-8336-527547221976 - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:31:53.702 4088 3038360566072 MainThread DEBUG os_win.utils.jobutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Waiting for WMI job: {'InstanceID': 'FBE365B0-FF08-4686-A69B-85375F69D7AC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14574), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:31:53.860 4088 3038360566072 MainThread ERROR os_win.utils.jobutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008a\' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)instance-0000008aBD2F3DB4-0314-4292-9FAB-FD9E0A7E8B3012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)instance-0000008aBD2F3DB4-0314-4292-9FAB-FD9E0A7E8B3010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)instance-0000008aBD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'FBE365B0-FF08-4686-A69B-85375F69D7AC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=109393), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 31, 53), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 31, 53), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008a' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)\n\nNot enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)\n\n'instance-0000008a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)", 'ErrorSummaryDescription': "'instance-0000008a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:31:53.860 4088 3038360566072 MainThread DEBUG os_win._utils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008a' failed to start. Not enough memory in the system to start the virtual machine instance-0000008a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008a' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Not enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) 'instance-0000008a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.542668104171753 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:31:53.885 4088 3038360567480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:31:53.885 4088 3038360567480 MainThread INFO nova.compute.manager [-] [instance: ff2a83fa-db74-482d-8757-342c81429d60] VM Stopped (Lifecycle Event) 2021-09-10 17:31:53.885 4088 3038360567656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:53.885 4088 3038360567656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:53.907 4088 3038360567480 MainThread DEBUG nova.compute.manager [req-747b7150-5401-4a6e-aed5-884867b740ce - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:31:53.907 4088 3038360567480 MainThread DEBUG nova.virt.hyperv.vmops [req-747b7150-5401-4a6e-aed5-884867b740ce - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:31:53.947 4088 3038360567480 MainThread DEBUG nova.compute.manager [req-747b7150-5401-4a6e-aed5-884867b740ce - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:31:53.969 4088 3038360567480 MainThread INFO nova.compute.manager [req-747b7150-5401-4a6e-aed5-884867b740ce - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:31:54.926 4088 3038360566072 MainThread DEBUG os_win.utils.jobutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Waiting for WMI job: {'InstanceID': '93832439-8C68-477D-89E2-6EFB0A60D836', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16555), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:31:55.079 4088 3038360566072 MainThread ERROR os_win.utils.jobutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008a\' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)instance-0000008aBD2F3DB4-0314-4292-9FAB-FD9E0A7E8B3012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)instance-0000008aBD2F3DB4-0314-4292-9FAB-FD9E0A7E8B3010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)instance-0000008aBD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '93832439-8C68-477D-89E2-6EFB0A60D836', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112275), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 31, 54), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 31, 55), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008a' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)\n\nNot enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)\n\n'instance-0000008a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)", 'ErrorSummaryDescription': "'instance-0000008a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:31:55.079 4088 3038360566072 MainThread DEBUG os_win._utils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008a' failed to start. Not enough memory in the system to start the virtual machine instance-0000008a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008a' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Not enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) 'instance-0000008a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7620689868927 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:31:55.122 4088 3038360567656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:55.122 4088 3038360567656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:55.122 4088 3038360567480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:31:55.122 4088 3038360567480 MainThread INFO nova.compute.manager [-] [instance: ff2a83fa-db74-482d-8757-342c81429d60] VM Stopped (Lifecycle Event) 2021-09-10 17:31:55.139 4088 3038360567480 MainThread DEBUG nova.compute.manager [req-73f7a0a8-c722-4ad0-9d59-6ef166e24d6a - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:31:55.139 4088 3038360567480 MainThread DEBUG nova.virt.hyperv.vmops [req-73f7a0a8-c722-4ad0-9d59-6ef166e24d6a - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:31:55.187 4088 3038360567480 MainThread DEBUG nova.compute.manager [req-73f7a0a8-c722-4ad0-9d59-6ef166e24d6a - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:31:55.217 4088 3038360567480 MainThread INFO nova.compute.manager [req-73f7a0a8-c722-4ad0-9d59-6ef166e24d6a - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:31:56.114 4088 3038360566072 MainThread DEBUG os_win.utils.jobutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Waiting for WMI job: {'InstanceID': '62D44B81-E24C-47DE-AD22-F33E798DD26B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15008), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:31:56.249 4088 3038360566072 MainThread ERROR os_win.utils.jobutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008a\' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)instance-0000008aBD2F3DB4-0314-4292-9FAB-FD9E0A7E8B3012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)instance-0000008aBD2F3DB4-0314-4292-9FAB-FD9E0A7E8B3010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)instance-0000008aBD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '62D44B81-E24C-47DE-AD22-F33E798DD26B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110741), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 31, 56), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 31, 56), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008a' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)\n\nNot enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)\n\n'instance-0000008a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)", 'ErrorSummaryDescription': "'instance-0000008a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:31:56.249 4088 3038360566072 MainThread DEBUG os_win._utils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008a' failed to start. Not enough memory in the system to start the virtual machine instance-0000008a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008a' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Not enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) 'instance-0000008a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.931235074996948 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:31:56.296 4088 3038360567656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:56.296 4088 3038360567656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:56.296 4088 3038360567480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:31:56.296 4088 3038360567480 MainThread INFO nova.compute.manager [-] [instance: ff2a83fa-db74-482d-8757-342c81429d60] VM Stopped (Lifecycle Event) 2021-09-10 17:31:56.327 4088 3038360567480 MainThread DEBUG nova.compute.manager [req-4168fe86-2d1f-4188-a8b0-b1708cfb8d9b - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:31:56.327 4088 3038360567480 MainThread DEBUG nova.virt.hyperv.vmops [req-4168fe86-2d1f-4188-a8b0-b1708cfb8d9b - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:31:56.371 4088 3038360567480 MainThread DEBUG nova.compute.manager [req-4168fe86-2d1f-4188-a8b0-b1708cfb8d9b - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:31:56.389 4088 3038360567480 MainThread INFO nova.compute.manager [req-4168fe86-2d1f-4188-a8b0-b1708cfb8d9b - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:31:57.275 4088 3038360566072 MainThread DEBUG os_win.utils.jobutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Waiting for WMI job: {'InstanceID': 'C89C128B-DE75-424D-BBFB-72C692E15AAA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14456), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:31:57.420 4088 3038360566072 MainThread ERROR os_win.utils.jobutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008a\' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)instance-0000008aBD2F3DB4-0314-4292-9FAB-FD9E0A7E8B3012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)instance-0000008aBD2F3DB4-0314-4292-9FAB-FD9E0A7E8B3010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008a\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)instance-0000008aBD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C89C128B-DE75-424D-BBFB-72C692E15AAA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110984), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 31, 57), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 31, 57), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008a' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)\n\nNot enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)\n\n'instance-0000008a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30)", 'ErrorSummaryDescription': "'instance-0000008a' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008a.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:31:57.420 4088 3038360566072 MainThread ERROR nova.virt.hyperv.vmops [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Failed to change vm state of instance-0000008a to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000008a' failed to start. 2021-09-10 17:31:57.420 4088 3038360566072 MainThread INFO nova.virt.hyperv.vmops [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Got request to destroy instance 2021-09-10 17:31:57.456 4088 3038360567656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:57.456 4088 3038360567656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:57.456 4088 3038360567480 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:31:57.456 4088 3038360567480 MainThread INFO nova.compute.manager [-] [instance: ff2a83fa-db74-482d-8757-342c81429d60] VM Stopped (Lifecycle Event) 2021-09-10 17:31:57.483 4088 3038360567480 MainThread DEBUG nova.compute.manager [req-b0d7ba51-631a-4629-b0db-6c5411f3dabf - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:31:57.483 4088 3038360567480 MainThread DEBUG nova.virt.hyperv.vmops [req-b0d7ba51-631a-4629-b0db-6c5411f3dabf - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:31:57.536 4088 3038360567480 MainThread DEBUG nova.compute.manager [req-b0d7ba51-631a-4629-b0db-6c5411f3dabf - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:31:57.557 4088 3038360567480 MainThread INFO nova.compute.manager [req-b0d7ba51-631a-4629-b0db-6c5411f3dabf - - - - -] [instance: ff2a83fa-db74-482d-8757-342c81429d60] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:31:59.254 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.vmops [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:31:59.254 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Lock "instance-0000008a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:59.254 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Lock "instance-0000008a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:59.254 4088 3038360566072 MainThread DEBUG os_win.utils.compute.vmutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Successfully changed vm state of instance-0000008a to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:31:59.254 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.vmops [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Successfully changed state of VM instance-0000008a to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:31:59.320 4088 3038360566072 MainThread DEBUG os_win.utils.jobutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Waiting for WMI job: {'InstanceID': 'CCA886FA-3500-44C4-B523-A3EE66A08A55', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14247), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:31:59.438 4088 3038360566072 MainThread DEBUG os_win.utils.jobutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] WMI job succeeded: {'InstanceID': 'CCA886FA-3500-44C4-B523-A3EE66A08A55', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=106747), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:31:59.440 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Lock "instance-0000008a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:59.440 4088 3038360566072 MainThread DEBUG os_win.utils.pathutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Removing directory: C:\openstack\instances\instance-0000008a check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:31:59.440 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Lock "instance-0000008a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:59.440 4088 3038360566072 MainThread ERROR nova.compute.manager [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008a' failed to start. Not enough memory in the system to start the virtual machine instance-0000008a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008a' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Not enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) 'instance-0000008a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Error code: 32778. 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] Traceback (most recent call last): 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] return function(*args, **kwargs) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] admin_password, network_info, block_device_info) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] return function(self, *args, **kwds) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self.force_reraise() 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] raise self.value 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] should_plug_vifs=False) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 'req_state': req_state}) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self.force_reraise() 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] raise self.value 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] time.sleep(sleep_time) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self.force_reraise() 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] raise self.value 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] return f(*args, **kwargs) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] return self._wait_for_job(job_path) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] error_desc=err_desc) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000008a' failed to start. 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] Not enough memory in the system to start the virtual machine instance-0000008a. 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008a' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] Not enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 'instance-0000008a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Error code: 32778. 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] During handling of the above exception, another exception occurred: 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] Traceback (most recent call last): 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] yield resources 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] accel_info=accel_info) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] return function(*args, **kwargs) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] admin_password, network_info, block_device_info) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] return function(self, *args, **kwds) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self.force_reraise() 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] raise self.value 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] should_plug_vifs=False) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 'req_state': req_state}) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self.force_reraise() 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] raise self.value 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] time.sleep(sleep_time) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self.force_reraise() 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] raise self.value 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] return f(*args, **kwargs) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] return self._wait_for_job(job_path) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] error_desc=err_desc) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008a' failed to start. 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] Not enough memory in the system to start the virtual machine instance-0000008a. 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008a' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] Not enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 'instance-0000008a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Error code: 32778. 2021-09-10 17:31:59.440 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.440 4088 3038360566072 MainThread INFO nova.compute.manager [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Terminating instance 2021-09-10 17:31:59.440 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:31:59.440 4088 3038360566072 MainThread INFO nova.virt.hyperv.vmops [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Got request to destroy instance 2021-09-10 17:31:59.440 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.vmops [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:31:59.440 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Lock "instance-0000008a" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:59.440 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Lock "instance-0000008a" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:59.440 4088 3038360566072 MainThread INFO nova.compute.manager [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Took 0.00 seconds to destroy the instance on the hypervisor. 2021-09-10 17:31:59.469 4088 3038360566072 MainThread DEBUG nova.compute.claims [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:31:59.469 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:31:59.534 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.hostops [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:31:59.572 4088 3038360566072 MainThread DEBUG nova.virt.hyperv.hostops [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:31:59.784 4088 3038360566072 MainThread DEBUG nova.compute.provider_tree [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:31:59.784 4088 3038360566072 MainThread DEBUG nova.scheduler.client.report [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:31:59.784 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.312s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:31:59.784 4088 3038360566072 MainThread ERROR nova.compute.manager [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008a' failed to start. Not enough memory in the system to start the virtual machine instance-0000008a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008a' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Not enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) 'instance-0000008a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Error code: 32778. 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] Traceback (most recent call last): 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] return function(*args, **kwargs) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] admin_password, network_info, block_device_info) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] return function(self, *args, **kwds) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self.force_reraise() 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] raise self.value 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] should_plug_vifs=False) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 'req_state': req_state}) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self.force_reraise() 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] raise self.value 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] time.sleep(sleep_time) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self.force_reraise() 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] raise self.value 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] return f(*args, **kwargs) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] return self._wait_for_job(job_path) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] error_desc=err_desc) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000008a' failed to start. 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] Not enough memory in the system to start the virtual machine instance-0000008a. 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008a' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] Not enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 'instance-0000008a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Error code: 32778. 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] During handling of the above exception, another exception occurred: 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] Traceback (most recent call last): 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] accel_info=accel_info) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] return function(*args, **kwargs) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] admin_password, network_info, block_device_info) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] return function(self, *args, **kwds) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self.force_reraise() 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] raise self.value 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] should_plug_vifs=False) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 'req_state': req_state}) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self.force_reraise() 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] raise self.value 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] time.sleep(sleep_time) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self.force_reraise() 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] raise self.value 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] return f(*args, **kwargs) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] return self._wait_for_job(job_path) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] error_desc=err_desc) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008a' failed to start. 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] Not enough memory in the system to start the virtual machine instance-0000008a. 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008a' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] Not enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 'instance-0000008a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Error code: 32778. 2021-09-10 17:31:59.784 4088 3038360566072 MainThread TRACE nova.compute.manager [instance: ff2a83fa-db74-482d-8757-342c81429d60] 2021-09-10 17:31:59.784 4088 3038360566072 MainThread DEBUG nova.compute.utils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] WMI job failed with status 10. Error summary description: 'instance-0000008a' failed to start. Not enough memory in the system to start the virtual machine instance-0000008a. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:31:59.784 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Build of instance ff2a83fa-db74-482d-8757-342c81429d60 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000008a' failed to start. Not enough memory in the system to start the virtual machine instance-0000008a. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008a' failed to start. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Not enough memory in the system to start the virtual machine instance-0000008a with ram size 1024 megabytes. (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) 'instance-0000008a' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID BD2F3DB4-0314-4292-9FAB-FD9E0A7E8B30) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:31:59.784 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:31:59.784 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:31:59.813 4088 3038360566072 MainThread DEBUG nova.compute.manager [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:31:59.813 4088 3038360566072 MainThread DEBUG nova.network.neutron [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:32:00.285 4088 3038360566072 MainThread DEBUG nova.network.neutron [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:32:00.285 4088 3038360566072 MainThread INFO nova.compute.manager [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] [instance: ff2a83fa-db74-482d-8757-342c81429d60] Took 0.47 seconds to deallocate network for instance. 2021-09-10 17:32:00.422 4088 3038360566072 MainThread INFO nova.scheduler.client.report [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Deleted allocations for instance ff2a83fa-db74-482d-8757-342c81429d60 2021-09-10 17:32:00.459 4088 3038360566072 MainThread DEBUG oslo_concurrency.lockutils [req-2f91dbf8-648a-49aa-81f6-4d080e85f69d 8e710e3097754eeb8ad12e38ed281d7d 8c09d982121a423cbfdf4d85175c464c - default default] Lock "ff2a83fa-db74-482d-8757-342c81429d60" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:32:08.500 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:32:10.468 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:32:10.468 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:32:11.467 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:32:11.467 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:32:12.466 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:32:15.468 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:32:15.468 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:32:15.484 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:32:15.484 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:32:15.484 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:32:15.484 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:32:15.508 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:32:15.718 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2221MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:32:15.718 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:32:16.000 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:32:16.000 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:32:16.000 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:32:16.000 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:32:16.000 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:32:16.000 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:32:16.000 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:32:16.000 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:32:16.000 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:32:16.000 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:32:16.000 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:32:16.000 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:32:16.000 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:32:16.000 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:32:16.000 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:32:16.062 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing inventories for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:757 2021-09-10 17:32:16.093 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Updating ProviderTree inventory for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 from _refresh_and_get_inventory using data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} _refresh_and_get_inventory c:\openstack\build\nova\nova\scheduler\client\report.py:723 2021-09-10 17:32:16.093 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Updating inventory in ProviderTree for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 with inventory: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:176 2021-09-10 17:32:16.125 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing aggregate associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, aggregates: None _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:766 2021-09-10 17:32:16.148 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing trait associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_VHD,COMPUTE_IMAGE_TYPE_VHDX,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:778 2021-09-10 17:32:16.171 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:32:16.188 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:32:16.375 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:32:16.406 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:32:16.406 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:32:16.406 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.687s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:32:16.466 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_incomplete_migrations run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:32:16.466 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances with incomplete migration _cleanup_incomplete_migrations c:\openstack\build\nova\nova\compute\manager.py:10640 2021-09-10 17:32:19.469 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:32:19.469 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:32:19.546 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-6a33a253-c7b1-44b1-bdc0-eca64733ab55" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:32:19.546 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:32:20.078 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Updating instance_info_cache with network_info: [{"id": "d98b48f6-4cb1-44c3-9950-b42769c9d93e", "address": "fa:16:3e:44:cf:f9", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd98b48f6-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:32:20.094 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-6a33a253-c7b1-44b1-bdc0-eca64733ab55" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:32:20.094 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:32:20.482 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:32:21.468 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:32:34.483 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._run_pending_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:32:34.483 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10602 2021-09-10 17:32:34.500 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] There are 0 instances to clean _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10611 2021-09-10 17:32:47.535 4088 3038363525720 MainThread DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "27fe0257-cfa7-41ce-8543-5349d843a088" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:32:47.535 4088 3038363525720 MainThread DEBUG nova.compute.manager [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:32:47.640 4088 3038363525720 MainThread DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:32:47.640 4088 3038363525720 MainThread DEBUG nova.virt.hardware [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:32:47.640 4088 3038363525720 MainThread INFO nova.compute.claims [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Claim successful on node n-h2-808474-1 2021-09-10 17:32:47.733 4088 3038363525720 MainThread DEBUG nova.virt.hyperv.hostops [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:32:47.765 4088 3038363525720 MainThread DEBUG nova.virt.hyperv.hostops [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:32:47.967 4088 3038363525720 MainThread DEBUG nova.compute.provider_tree [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:32:47.983 4088 3038363525720 MainThread DEBUG nova.scheduler.client.report [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:32:47.983 4088 3038363525720 MainThread DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:32:47.983 4088 3038363525720 MainThread DEBUG nova.compute.manager [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:32:48.046 4088 3038363525720 MainThread DEBUG nova.compute.manager [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:32:48.046 4088 3038363525544 GreenThread-128 DEBUG nova.compute.manager [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:32:48.046 4088 3038363525544 GreenThread-128 DEBUG nova.network.neutron [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:32:48.170 4088 3038363525720 MainThread DEBUG nova.compute.manager [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:32:48.170 4088 3038363525544 GreenThread-128 DEBUG nova.policy [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0226fc9bb37e4645999ab1e146569f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a659c58dcc3425b8ccbfd6f1f95de43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:32:48.186 4088 3038363525720 MainThread INFO nova.virt.hyperv.vmops [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Spawning new instance 2021-09-10 17:32:48.201 4088 3038363525720 MainThread DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "instance-0000008b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:32:48.201 4088 3038363525720 MainThread DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "instance-0000008b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:32:48.201 4088 3038363525720 MainThread DEBUG nova.block_device [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:32:48.201 4088 3038363525720 MainThread DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:32:48.201 4088 3038363525720 MainThread DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:32:48.201 4088 3038363525720 MainThread DEBUG os_win.utils.pathutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Creating directory: C:\openstack\instances\instance-0000008b check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:32:48.201 4088 3038363525720 MainThread DEBUG nova.virt.hyperv.vmops [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000008b\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:32:48.452 4088 3038363525720 MainThread DEBUG nova.virt.hyperv.vmops [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Resizing VHD C:\openstack\instances\instance-0000008b\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:32:48.702 4088 3038363525544 GreenThread-128 DEBUG nova.network.neutron [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Successfully created port: 36eb95d3-29f1-46f8-8bd3-5f61bc3eb664 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:32:49.331 4088 3038363525544 GreenThread-128 DEBUG nova.network.neutron [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Successfully updated port: 36eb95d3-29f1-46f8-8bd3-5f61bc3eb664 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:32:49.358 4088 3038363525544 GreenThread-128 DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Acquired lock "refresh_cache-27fe0257-cfa7-41ce-8543-5349d843a088" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:32:49.358 4088 3038363525544 GreenThread-128 DEBUG nova.network.neutron [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:32:49.405 4088 3038363526248 MainThread DEBUG nova.compute.manager [req-6eb5a61d-2f35-4a06-98d7-48adfec34944 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Received event network-changed-36eb95d3-29f1-46f8-8bd3-5f61bc3eb664 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:32:49.405 4088 3038363526248 MainThread DEBUG nova.compute.manager [req-6eb5a61d-2f35-4a06-98d7-48adfec34944 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Refreshing instance network info cache due to event network-changed-36eb95d3-29f1-46f8-8bd3-5f61bc3eb664. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:32:49.734 4088 3038363525544 GreenThread-128 DEBUG nova.network.neutron [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:32:50.061 4088 3038363525544 GreenThread-128 DEBUG nova.network.neutron [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Updating instance_info_cache with network_info: [{"id": "36eb95d3-29f1-46f8-8bd3-5f61bc3eb664", "address": "fa:16:3e:db:2f:98", "network": {"id": "32eb283c-70ec-49c4-a64b-fe78dcc445e4", "bridge": null, "label": "tempest-TestEncryptedCinderVolumes-1170647147-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1a659c58dcc3425b8ccbfd6f1f95de43", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap36eb95d3-29", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:32:50.079 4088 3038363525544 GreenThread-128 DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Releasing lock "refresh_cache-27fe0257-cfa7-41ce-8543-5349d843a088" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:32:50.079 4088 3038363525544 GreenThread-128 DEBUG nova.compute.manager [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Instance network_info: |[{"id": "36eb95d3-29f1-46f8-8bd3-5f61bc3eb664", "address": "fa:16:3e:db:2f:98", "network": {"id": "32eb283c-70ec-49c4-a64b-fe78dcc445e4", "bridge": null, "label": "tempest-TestEncryptedCinderVolumes-1170647147-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1a659c58dcc3425b8ccbfd6f1f95de43", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap36eb95d3-29", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:32:50.079 4088 3038363526248 MainThread DEBUG oslo_concurrency.lockutils [req-6eb5a61d-2f35-4a06-98d7-48adfec34944 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-27fe0257-cfa7-41ce-8543-5349d843a088" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:32:50.079 4088 3038363526248 MainThread DEBUG nova.network.neutron [req-6eb5a61d-2f35-4a06-98d7-48adfec34944 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Refreshing network info cache for port 36eb95d3-29f1-46f8-8bd3-5f61bc3eb664 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:32:50.079 4088 3038363525720 MainThread DEBUG nova.compute.manager [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Preparing to wait for external event network-vif-plugged-36eb95d3-29f1-46f8-8bd3-5f61bc3eb664 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:32:50.079 4088 3038363525720 MainThread DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "27fe0257-cfa7-41ce-8543-5349d843a088-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:32:50.079 4088 3038363525720 MainThread DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "27fe0257-cfa7-41ce-8543-5349d843a088-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:32:50.079 4088 3038363525720 MainThread DEBUG os_win.utils.compute.vmutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Creating VM instance-0000008b create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:32:50.563 4088 3038363526248 MainThread DEBUG nova.network.neutron [req-6eb5a61d-2f35-4a06-98d7-48adfec34944 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Updated VIF entry in instance network info cache for port 36eb95d3-29f1-46f8-8bd3-5f61bc3eb664. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:32:50.563 4088 3038363526248 MainThread DEBUG nova.network.neutron [req-6eb5a61d-2f35-4a06-98d7-48adfec34944 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Updating instance_info_cache with network_info: [{"id": "36eb95d3-29f1-46f8-8bd3-5f61bc3eb664", "address": "fa:16:3e:db:2f:98", "network": {"id": "32eb283c-70ec-49c4-a64b-fe78dcc445e4", "bridge": null, "label": "tempest-TestEncryptedCinderVolumes-1170647147-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1a659c58dcc3425b8ccbfd6f1f95de43", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap36eb95d3-29", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:32:50.592 4088 3038363526248 MainThread DEBUG oslo_concurrency.lockutils [req-6eb5a61d-2f35-4a06-98d7-48adfec34944 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-27fe0257-cfa7-41ce-8543-5349d843a088" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:32:51.812 4088 3038363525720 MainThread DEBUG nova.virt.hyperv.vmops [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:32:58.579 4088 3038360567304 MainThread DEBUG nova.compute.manager [req-67b9fca9-5d12-4cb1-a814-f2eddd2f2be5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Received event network-vif-plugged-36eb95d3-29f1-46f8-8bd3-5f61bc3eb664 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:32:58.579 4088 3038360567304 MainThread DEBUG oslo_concurrency.lockutils [req-67b9fca9-5d12-4cb1-a814-f2eddd2f2be5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "27fe0257-cfa7-41ce-8543-5349d843a088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:32:58.579 4088 3038360567304 MainThread DEBUG oslo_concurrency.lockutils [req-67b9fca9-5d12-4cb1-a814-f2eddd2f2be5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "27fe0257-cfa7-41ce-8543-5349d843a088-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:32:58.579 4088 3038360567304 MainThread DEBUG nova.compute.manager [req-67b9fca9-5d12-4cb1-a814-f2eddd2f2be5 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Processing event network-vif-plugged-36eb95d3-29f1-46f8-8bd3-5f61bc3eb664 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:32:58.607 4088 3038363525720 MainThread INFO nova.virt.hyperv.vmops [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Using config drive for instance 2021-09-10 17:32:58.719 4088 3038363525720 MainThread INFO nova.virt.hyperv.vmops [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Creating config drive at C:\openstack\instances\instance-0000008b\configdrive.iso 2021-09-10 17:32:58.811 4088 3038363525720 MainThread DEBUG oslo_concurrency.processutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000008b\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmprxp9cron execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:32:59.188 4088 3038363525720 MainThread DEBUG oslo_concurrency.processutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000008b\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmprxp9cron" returned: 0 in 0.375s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:32:59.709 4088 3038363525720 MainThread DEBUG nova.virt.hyperv.vmops [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Setting boot order for instance: instance-0000008b: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:32:59.800 4088 3038363525720 MainThread DEBUG nova.virt.hyperv.vmops [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:32:59.829 4088 3038363525720 MainThread DEBUG os_win.utils.jobutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Waiting for WMI job: {'InstanceID': 'CB1C0545-CD80-4145-A5DF-C6156DA19C2D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=20007), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:32:59.954 4088 3038363525720 MainThread ERROR os_win.utils.jobutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008b\' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)instance-0000008b7E223CD6-6BE7-4E54-AB95-315683984CB212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)instance-0000008b7E223CD6-6BE7-4E54-AB95-315683984CB210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)instance-0000008b7E223CD6-6BE7-4E54-AB95-315683984CB2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'CB1C0545-CD80-4145-A5DF-C6156DA19C2D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118483), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 32, 59), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 32, 59), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008b' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)\n\nNot enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)\n\n'instance-0000008b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)", 'ErrorSummaryDescription': "'instance-0000008b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:32:59.954 4088 3038363525720 MainThread DEBUG os_win._utils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008b' failed to start. Not enough memory in the system to start the virtual machine instance-0000008b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008b' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Not enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) 'instance-0000008b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1541581153869629 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:33:00.016 4088 3038363525896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:00.016 4088 3038363525896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:00.016 4088 3038360567304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:33:00.016 4088 3038360567304 MainThread INFO nova.compute.manager [-] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] VM Stopped (Lifecycle Event) 2021-09-10 17:33:00.016 4088 3038360567304 MainThread DEBUG nova.compute.manager [req-4fcde2bb-3ad8-485a-9c55-9d38a09614e9 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:33:00.045 4088 3038360567304 MainThread DEBUG nova.virt.hyperv.vmops [req-4fcde2bb-3ad8-485a-9c55-9d38a09614e9 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:33:00.094 4088 3038360567304 MainThread DEBUG nova.compute.manager [req-4fcde2bb-3ad8-485a-9c55-9d38a09614e9 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:33:00.094 4088 3038360567304 MainThread INFO nova.compute.manager [req-4fcde2bb-3ad8-485a-9c55-9d38a09614e9 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:33:00.969 4088 3038363525720 MainThread DEBUG os_win.utils.jobutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Waiting for WMI job: {'InstanceID': '3403CD49-F065-4B8A-95EA-B11BD6833F6E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15477), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:33:01.100 4088 3038363525720 MainThread ERROR os_win.utils.jobutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008b\' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)instance-0000008b7E223CD6-6BE7-4E54-AB95-315683984CB212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)instance-0000008b7E223CD6-6BE7-4E54-AB95-315683984CB210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)instance-0000008b7E223CD6-6BE7-4E54-AB95-315683984CB2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '3403CD49-F065-4B8A-95EA-B11BD6833F6E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115348), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 33), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 33, 1), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008b' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)\n\nNot enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)\n\n'instance-0000008b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)", 'ErrorSummaryDescription': "'instance-0000008b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:33:01.100 4088 3038363525720 MainThread DEBUG os_win._utils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008b' failed to start. Not enough memory in the system to start the virtual machine instance-0000008b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008b' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Not enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) 'instance-0000008b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3004791736602783 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:33:01.159 4088 3038363525896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:01.159 4088 3038363525896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:01.159 4088 3038360567304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:33:01.159 4088 3038360567304 MainThread INFO nova.compute.manager [-] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] VM Stopped (Lifecycle Event) 2021-09-10 17:33:01.185 4088 3038360567304 MainThread DEBUG nova.compute.manager [req-425b0674-6cb9-4f7a-b2fd-d6a3cecc92ed - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:33:01.185 4088 3038360567304 MainThread DEBUG nova.virt.hyperv.vmops [req-425b0674-6cb9-4f7a-b2fd-d6a3cecc92ed - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:33:01.233 4088 3038360567304 MainThread DEBUG nova.compute.manager [req-425b0674-6cb9-4f7a-b2fd-d6a3cecc92ed - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:33:01.264 4088 3038360567304 MainThread INFO nova.compute.manager [req-425b0674-6cb9-4f7a-b2fd-d6a3cecc92ed - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:33:02.133 4088 3038363525720 MainThread DEBUG os_win.utils.jobutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Waiting for WMI job: {'InstanceID': 'BE0D2325-4AED-4ED3-A7D9-CDCC8B9BB9D4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15250), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:33:02.266 4088 3038363525720 MainThread ERROR os_win.utils.jobutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008b\' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)instance-0000008b7E223CD6-6BE7-4E54-AB95-315683984CB212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)instance-0000008b7E223CD6-6BE7-4E54-AB95-315683984CB210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)instance-0000008b7E223CD6-6BE7-4E54-AB95-315683984CB2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BE0D2325-4AED-4ED3-A7D9-CDCC8B9BB9D4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112027), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 33, 2), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 33, 2), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008b' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)\n\nNot enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)\n\n'instance-0000008b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)", 'ErrorSummaryDescription': "'instance-0000008b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:33:02.281 4088 3038363525720 MainThread DEBUG os_win._utils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008b' failed to start. Not enough memory in the system to start the virtual machine instance-0000008b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008b' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Not enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) 'instance-0000008b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.481590509414673 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:33:02.313 4088 3038363525896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:02.313 4088 3038363525896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:02.313 4088 3038360567304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:33:02.313 4088 3038360567304 MainThread INFO nova.compute.manager [-] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] VM Stopped (Lifecycle Event) 2021-09-10 17:33:02.344 4088 3038360567304 MainThread DEBUG nova.compute.manager [req-8e7abdfc-92b1-40ad-a2bd-eb91a9089797 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:33:02.344 4088 3038360567304 MainThread DEBUG nova.virt.hyperv.vmops [req-8e7abdfc-92b1-40ad-a2bd-eb91a9089797 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:33:02.377 4088 3038360567304 MainThread DEBUG nova.compute.manager [req-8e7abdfc-92b1-40ad-a2bd-eb91a9089797 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:33:02.404 4088 3038360567304 MainThread INFO nova.compute.manager [req-8e7abdfc-92b1-40ad-a2bd-eb91a9089797 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:33:03.312 4088 3038363525720 MainThread DEBUG os_win.utils.jobutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Waiting for WMI job: {'InstanceID': '2B2C3055-B7D0-4448-B072-813D8CC3BB89', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14749), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:33:03.456 4088 3038363525720 MainThread ERROR os_win.utils.jobutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008b\' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)instance-0000008b7E223CD6-6BE7-4E54-AB95-315683984CB212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)instance-0000008b7E223CD6-6BE7-4E54-AB95-315683984CB210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)instance-0000008b7E223CD6-6BE7-4E54-AB95-315683984CB2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '2B2C3055-B7D0-4448-B072-813D8CC3BB89', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110735), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 33, 3), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 33, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008b' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)\n\nNot enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)\n\n'instance-0000008b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)", 'ErrorSummaryDescription': "'instance-0000008b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:33:03.456 4088 3038363525720 MainThread DEBUG os_win._utils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008b' failed to start. Not enough memory in the system to start the virtual machine instance-0000008b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008b' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Not enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) 'instance-0000008b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.6564276218414307 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:33:03.496 4088 3038363525896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:03.496 4088 3038363525896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:03.496 4088 3038360567304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:33:03.496 4088 3038360567304 MainThread INFO nova.compute.manager [-] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] VM Stopped (Lifecycle Event) 2021-09-10 17:33:03.516 4088 3038360567304 MainThread DEBUG nova.compute.manager [req-61f92fdb-ea6f-4bd3-a577-13839e51ec79 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:33:03.516 4088 3038360567304 MainThread DEBUG nova.virt.hyperv.vmops [req-61f92fdb-ea6f-4bd3-a577-13839e51ec79 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:33:03.563 4088 3038360567304 MainThread DEBUG nova.compute.manager [req-61f92fdb-ea6f-4bd3-a577-13839e51ec79 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:33:03.579 4088 3038360567304 MainThread INFO nova.compute.manager [req-61f92fdb-ea6f-4bd3-a577-13839e51ec79 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:33:04.482 4088 3038363525720 MainThread DEBUG os_win.utils.jobutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Waiting for WMI job: {'InstanceID': 'BEE3C6A9-7645-4B6D-84A0-21BCEF110800', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15439), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:33:04.610 4088 3038363525720 MainThread ERROR os_win.utils.jobutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008b\' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)instance-0000008b7E223CD6-6BE7-4E54-AB95-315683984CB212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)instance-0000008b7E223CD6-6BE7-4E54-AB95-315683984CB210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)instance-0000008b7E223CD6-6BE7-4E54-AB95-315683984CB2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BEE3C6A9-7645-4B6D-84A0-21BCEF110800', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111595), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 33, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 33, 4), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008b' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)\n\nNot enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)\n\n'instance-0000008b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)", 'ErrorSummaryDescription': "'instance-0000008b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:33:04.610 4088 3038363525720 MainThread DEBUG os_win._utils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008b' failed to start. Not enough memory in the system to start the virtual machine instance-0000008b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008b' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Not enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) 'instance-0000008b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.810229301452637 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:33:04.639 4088 3038360567304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:33:04.639 4088 3038360567304 MainThread INFO nova.compute.manager [-] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] VM Stopped (Lifecycle Event) 2021-09-10 17:33:04.670 4088 3038363525896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:04.670 4088 3038363525896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:04.685 4088 3038360567304 MainThread DEBUG nova.compute.manager [req-6aef00ed-b831-4267-ac75-2ede5b973fc2 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:33:04.685 4088 3038360567304 MainThread DEBUG nova.virt.hyperv.vmops [req-6aef00ed-b831-4267-ac75-2ede5b973fc2 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:33:04.719 4088 3038360567304 MainThread DEBUG nova.compute.manager [req-6aef00ed-b831-4267-ac75-2ede5b973fc2 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:33:04.750 4088 3038360567304 MainThread INFO nova.compute.manager [req-6aef00ed-b831-4267-ac75-2ede5b973fc2 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:33:05.626 4088 3038363525720 MainThread DEBUG os_win.utils.jobutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Waiting for WMI job: {'InstanceID': 'DA5B5ED0-8194-43F8-A599-9CE63500EABD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15317), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:33:05.773 4088 3038363525720 MainThread ERROR os_win.utils.jobutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008b\' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)instance-0000008b7E223CD6-6BE7-4E54-AB95-315683984CB212030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)instance-0000008b7E223CD6-6BE7-4E54-AB95-315683984CB210243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008b\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)instance-0000008b7E223CD6-6BE7-4E54-AB95-315683984CB2%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'DA5B5ED0-8194-43F8-A599-9CE63500EABD', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112571), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 33, 5), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 33, 5), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008b' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)\n\nNot enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)\n\n'instance-0000008b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2)", 'ErrorSummaryDescription': "'instance-0000008b' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008b.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:33:05.773 4088 3038363525720 MainThread ERROR nova.virt.hyperv.vmops [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Failed to change vm state of instance-0000008b to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000008b' failed to start. 2021-09-10 17:33:05.773 4088 3038363525720 MainThread INFO nova.virt.hyperv.vmops [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Got request to destroy instance 2021-09-10 17:33:05.818 4088 3038363525896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:05.818 4088 3038363525896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:05.818 4088 3038360567304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:33:05.818 4088 3038360567304 MainThread INFO nova.compute.manager [-] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] VM Stopped (Lifecycle Event) 2021-09-10 17:33:05.832 4088 3038360567304 MainThread DEBUG nova.compute.manager [req-979599ca-9499-482a-a864-f7db73732fe5 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:33:05.832 4088 3038360567304 MainThread DEBUG nova.virt.hyperv.vmops [req-979599ca-9499-482a-a864-f7db73732fe5 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:33:05.888 4088 3038360567304 MainThread DEBUG nova.compute.manager [req-979599ca-9499-482a-a864-f7db73732fe5 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:33:05.895 4088 3038360567304 MainThread INFO nova.compute.manager [req-979599ca-9499-482a-a864-f7db73732fe5 - - - - -] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:33:07.576 4088 3038363525720 MainThread DEBUG nova.virt.hyperv.vmops [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:33:07.576 4088 3038363525720 MainThread DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "instance-0000008b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:07.576 4088 3038363525720 MainThread DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "instance-0000008b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:07.591 4088 3038363525720 MainThread DEBUG os_win.utils.compute.vmutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Successfully changed vm state of instance-0000008b to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:33:07.594 4088 3038363525720 MainThread DEBUG nova.virt.hyperv.vmops [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Successfully changed state of VM instance-0000008b to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:33:07.628 4088 3038363525720 MainThread DEBUG os_win.utils.jobutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Waiting for WMI job: {'InstanceID': '17CDE146-BDD7-459D-A09D-7ADCEBB40A7F', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14017), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:33:07.891 4088 3038363525720 MainThread DEBUG os_win.utils.jobutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] WMI job succeeded: {'InstanceID': '17CDE146-BDD7-459D-A09D-7ADCEBB40A7F', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=143549), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:33:07.907 4088 3038363525720 MainThread DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "instance-0000008b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:07.907 4088 3038363525720 MainThread DEBUG os_win.utils.pathutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Removing directory: C:\openstack\instances\instance-0000008b check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:33:07.907 4088 3038363525720 MainThread DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "instance-0000008b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:07.907 4088 3038363525720 MainThread ERROR nova.compute.manager [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008b' failed to start. Not enough memory in the system to start the virtual machine instance-0000008b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008b' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Not enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) 'instance-0000008b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Error code: 32778. 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Traceback (most recent call last): 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] return function(*args, **kwargs) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] admin_password, network_info, block_device_info) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] return function(self, *args, **kwds) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self.force_reraise() 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] raise self.value 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] should_plug_vifs=False) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 'req_state': req_state}) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self.force_reraise() 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] raise self.value 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] time.sleep(sleep_time) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self.force_reraise() 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] raise self.value 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] return f(*args, **kwargs) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] return self._wait_for_job(job_path) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] error_desc=err_desc) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000008b' failed to start. 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Not enough memory in the system to start the virtual machine instance-0000008b. 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008b' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Not enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 'instance-0000008b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Error code: 32778. 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] During handling of the above exception, another exception occurred: 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Traceback (most recent call last): 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] yield resources 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] accel_info=accel_info) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] return function(*args, **kwargs) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] admin_password, network_info, block_device_info) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] return function(self, *args, **kwds) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self.force_reraise() 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] raise self.value 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] should_plug_vifs=False) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 'req_state': req_state}) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self.force_reraise() 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] raise self.value 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] time.sleep(sleep_time) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self.force_reraise() 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] raise self.value 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] return f(*args, **kwargs) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] return self._wait_for_job(job_path) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] error_desc=err_desc) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008b' failed to start. 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Not enough memory in the system to start the virtual machine instance-0000008b. 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008b' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Not enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 'instance-0000008b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Error code: 32778. 2021-09-10 17:33:07.907 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:07.907 4088 3038363525720 MainThread INFO nova.compute.manager [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Terminating instance 2021-09-10 17:33:07.907 4088 3038363525720 MainThread DEBUG nova.compute.manager [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:33:07.907 4088 3038363525720 MainThread INFO nova.virt.hyperv.vmops [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Got request to destroy instance 2021-09-10 17:33:07.907 4088 3038363525720 MainThread DEBUG nova.virt.hyperv.vmops [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:33:07.907 4088 3038363525720 MainThread DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "instance-0000008b" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:07.934 4088 3038363525720 MainThread DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "instance-0000008b" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:07.934 4088 3038363525720 MainThread INFO nova.compute.manager [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:33:07.934 4088 3038363525720 MainThread DEBUG nova.compute.claims [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:33:07.934 4088 3038363525720 MainThread DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:08.003 4088 3038363525720 MainThread DEBUG nova.virt.hyperv.hostops [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:33:08.029 4088 3038363525720 MainThread DEBUG nova.virt.hyperv.hostops [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:33:08.235 4088 3038363525720 MainThread DEBUG nova.compute.provider_tree [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:33:08.265 4088 3038363525720 MainThread DEBUG nova.scheduler.client.report [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:33:08.265 4088 3038363525720 MainThread DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.329s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:08.265 4088 3038363525720 MainThread ERROR nova.compute.manager [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008b' failed to start. Not enough memory in the system to start the virtual machine instance-0000008b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008b' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Not enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) 'instance-0000008b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Error code: 32778. 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Traceback (most recent call last): 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] return function(*args, **kwargs) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] admin_password, network_info, block_device_info) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] return function(self, *args, **kwds) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self.force_reraise() 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] raise self.value 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] should_plug_vifs=False) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 'req_state': req_state}) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self.force_reraise() 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] raise self.value 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] time.sleep(sleep_time) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self.force_reraise() 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] raise self.value 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] return f(*args, **kwargs) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] return self._wait_for_job(job_path) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] error_desc=err_desc) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000008b' failed to start. 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Not enough memory in the system to start the virtual machine instance-0000008b. 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008b' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Not enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 'instance-0000008b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Error code: 32778. 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] During handling of the above exception, another exception occurred: 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Traceback (most recent call last): 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] accel_info=accel_info) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] return function(*args, **kwargs) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] admin_password, network_info, block_device_info) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] return function(self, *args, **kwds) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self.force_reraise() 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] raise self.value 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] should_plug_vifs=False) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 'req_state': req_state}) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self.force_reraise() 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] raise self.value 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] time.sleep(sleep_time) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self.force_reraise() 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] raise self.value 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] return f(*args, **kwargs) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] return self._wait_for_job(job_path) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] error_desc=err_desc) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008b' failed to start. 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Not enough memory in the system to start the virtual machine instance-0000008b. 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008b' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Not enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 'instance-0000008b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Error code: 32778. 2021-09-10 17:33:08.265 4088 3038363525720 MainThread TRACE nova.compute.manager [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] 2021-09-10 17:33:08.265 4088 3038363525720 MainThread DEBUG nova.compute.utils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] WMI job failed with status 10. Error summary description: 'instance-0000008b' failed to start. Not enough memory in the system to start the virtual machine instance-0000008b. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:33:08.265 4088 3038363525720 MainThread DEBUG nova.compute.manager [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Build of instance 27fe0257-cfa7-41ce-8543-5349d843a088 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000008b' failed to start. Not enough memory in the system to start the virtual machine instance-0000008b. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008b' failed to start. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Not enough memory in the system to start the virtual machine instance-0000008b with ram size 1024 megabytes. (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) 'instance-0000008b' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 7E223CD6-6BE7-4E54-AB95-315683984CB2) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:33:08.265 4088 3038363525720 MainThread DEBUG nova.compute.manager [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:33:08.265 4088 3038363525720 MainThread DEBUG nova.compute.manager [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:33:08.265 4088 3038363525720 MainThread DEBUG nova.compute.manager [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:33:08.265 4088 3038363525720 MainThread DEBUG nova.network.neutron [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:33:08.719 4088 3038363525720 MainThread DEBUG nova.network.neutron [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:33:08.766 4088 3038363525720 MainThread INFO nova.compute.manager [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: 27fe0257-cfa7-41ce-8543-5349d843a088] Took 0.50 seconds to deallocate network for instance. 2021-09-10 17:33:08.892 4088 3038363525720 MainThread INFO nova.scheduler.client.report [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Deleted allocations for instance 27fe0257-cfa7-41ce-8543-5349d843a088 2021-09-10 17:33:08.923 4088 3038363525720 MainThread DEBUG oslo_concurrency.lockutils [req-c99a6ab2-d349-4163-b60b-937e525a801a 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "27fe0257-cfa7-41ce-8543-5349d843a088" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 21.391s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:09.505 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:33:10.466 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:33:10.466 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:33:12.466 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:33:12.466 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:33:12.466 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:33:14.469 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:33:16.482 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:33:17.470 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:33:17.470 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:17.470 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:17.470 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:33:17.470 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:33:17.498 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:33:17.721 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2223MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:33:17.721 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:17.841 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:33:17.841 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:33:17.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:33:17.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:33:17.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:33:17.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:33:17.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:33:17.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:33:17.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:33:17.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:33:17.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:33:17.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:33:17.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:33:17.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:33:17.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:33:17.877 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:33:17.896 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:33:18.100 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:33:18.114 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:33:18.114 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:33:18.114 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:21.106 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:33:21.106 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:33:21.171 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-592bb39a-81cb-43f8-a643-b04092bd9e8a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:33:21.171 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:33:21.688 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Updating instance_info_cache with network_info: [{"id": "2ef6a3e6-e7a5-4da7-941d-89a1d5c697b7", "address": "fa:16:3e:eb:d0:49", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2ef6a3e6-e7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:33:21.704 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-592bb39a-81cb-43f8-a643-b04092bd9e8a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:33:21.704 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:33:21.704 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:33:29.919 4088 3038363526600 MainThread DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "d2676f87-5c64-40cc-b7e7-a75b36bfbe57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:29.938 4088 3038363526600 MainThread DEBUG nova.compute.manager [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:33:30.016 4088 3038363526600 MainThread DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:30.016 4088 3038363526600 MainThread DEBUG nova.virt.hardware [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:33:30.016 4088 3038363526600 MainThread INFO nova.compute.claims [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Claim successful on node n-h2-808474-1 2021-09-10 17:33:30.107 4088 3038363526600 MainThread DEBUG nova.virt.hyperv.hostops [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:33:30.107 4088 3038363526600 MainThread DEBUG nova.virt.hyperv.hostops [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:33:30.327 4088 3038363526600 MainThread DEBUG nova.compute.provider_tree [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:33:30.344 4088 3038363526600 MainThread DEBUG nova.scheduler.client.report [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:33:30.344 4088 3038363526600 MainThread DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:30.344 4088 3038363526600 MainThread DEBUG nova.compute.manager [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:33:30.407 4088 3038363526600 MainThread DEBUG nova.compute.manager [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:33:30.407 4088 3038363525720 GreenThread-129 DEBUG nova.compute.manager [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:33:30.422 4088 3038363525720 GreenThread-129 DEBUG nova.network.neutron [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:33:30.532 4088 3038363525720 GreenThread-129 DEBUG nova.policy [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0226fc9bb37e4645999ab1e146569f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a659c58dcc3425b8ccbfd6f1f95de43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:33:30.532 4088 3038363526600 MainThread DEBUG nova.compute.manager [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:33:30.547 4088 3038363526600 MainThread INFO nova.virt.hyperv.vmops [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Spawning new instance 2021-09-10 17:33:30.547 4088 3038363526600 MainThread DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "instance-0000008c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:30.547 4088 3038363526600 MainThread DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "instance-0000008c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:30.547 4088 3038363526600 MainThread DEBUG nova.block_device [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:33:30.547 4088 3038363526600 MainThread DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:30.547 4088 3038363526600 MainThread DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:30.575 4088 3038363526600 MainThread DEBUG os_win.utils.pathutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Creating directory: C:\openstack\instances\instance-0000008c check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:33:30.575 4088 3038363526600 MainThread DEBUG nova.virt.hyperv.vmops [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000008c\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:33:30.797 4088 3038363526600 MainThread DEBUG nova.virt.hyperv.vmops [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Resizing VHD C:\openstack\instances\instance-0000008c\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:33:31.109 4088 3038363525720 GreenThread-129 DEBUG nova.network.neutron [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Successfully created port: bddbb702-a040-490c-901b-fc79beca37e8 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:33:31.733 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:33:31.733 4088 3038363525720 GreenThread-129 DEBUG nova.network.neutron [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Successfully updated port: bddbb702-a040-490c-901b-fc79beca37e8 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:33:31.763 4088 3038363525720 GreenThread-129 DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Acquired lock "refresh_cache-d2676f87-5c64-40cc-b7e7-a75b36bfbe57" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:33:31.763 4088 3038363525720 GreenThread-129 DEBUG nova.network.neutron [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:33:31.813 4088 3038363527304 MainThread DEBUG nova.compute.manager [req-95e8f722-88c1-48d2-bfe5-7e19fa39eda6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Received event network-changed-bddbb702-a040-490c-901b-fc79beca37e8 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:33:31.813 4088 3038363527304 MainThread DEBUG nova.compute.manager [req-95e8f722-88c1-48d2-bfe5-7e19fa39eda6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Refreshing instance network info cache due to event network-changed-bddbb702-a040-490c-901b-fc79beca37e8. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:33:31.841 4088 3038363525720 GreenThread-129 DEBUG nova.network.neutron [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:33:32.172 4088 3038363525720 GreenThread-129 DEBUG nova.network.neutron [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Updating instance_info_cache with network_info: [{"id": "bddbb702-a040-490c-901b-fc79beca37e8", "address": "fa:16:3e:4e:80:7b", "network": {"id": "32eb283c-70ec-49c4-a64b-fe78dcc445e4", "bridge": null, "label": "tempest-TestEncryptedCinderVolumes-1170647147-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1a659c58dcc3425b8ccbfd6f1f95de43", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapbddbb702-a0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:33:32.172 4088 3038363525720 GreenThread-129 DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Releasing lock "refresh_cache-d2676f87-5c64-40cc-b7e7-a75b36bfbe57" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:33:32.172 4088 3038363525720 GreenThread-129 DEBUG nova.compute.manager [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Instance network_info: |[{"id": "bddbb702-a040-490c-901b-fc79beca37e8", "address": "fa:16:3e:4e:80:7b", "network": {"id": "32eb283c-70ec-49c4-a64b-fe78dcc445e4", "bridge": null, "label": "tempest-TestEncryptedCinderVolumes-1170647147-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1a659c58dcc3425b8ccbfd6f1f95de43", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapbddbb702-a0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:33:32.172 4088 3038363527304 MainThread DEBUG oslo_concurrency.lockutils [req-95e8f722-88c1-48d2-bfe5-7e19fa39eda6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-d2676f87-5c64-40cc-b7e7-a75b36bfbe57" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:33:32.172 4088 3038363527304 MainThread DEBUG nova.network.neutron [req-95e8f722-88c1-48d2-bfe5-7e19fa39eda6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Refreshing network info cache for port bddbb702-a040-490c-901b-fc79beca37e8 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:33:32.172 4088 3038363526600 MainThread DEBUG nova.compute.manager [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Preparing to wait for external event network-vif-plugged-bddbb702-a040-490c-901b-fc79beca37e8 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:33:32.172 4088 3038363526600 MainThread DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "d2676f87-5c64-40cc-b7e7-a75b36bfbe57-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:32.172 4088 3038363526600 MainThread DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "d2676f87-5c64-40cc-b7e7-a75b36bfbe57-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:32.172 4088 3038363526600 MainThread DEBUG os_win.utils.compute.vmutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Creating VM instance-0000008c create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:33:32.672 4088 3038363527304 MainThread DEBUG nova.network.neutron [req-95e8f722-88c1-48d2-bfe5-7e19fa39eda6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Updated VIF entry in instance network info cache for port bddbb702-a040-490c-901b-fc79beca37e8. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:33:32.672 4088 3038363527304 MainThread DEBUG nova.network.neutron [req-95e8f722-88c1-48d2-bfe5-7e19fa39eda6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Updating instance_info_cache with network_info: [{"id": "bddbb702-a040-490c-901b-fc79beca37e8", "address": "fa:16:3e:4e:80:7b", "network": {"id": "32eb283c-70ec-49c4-a64b-fe78dcc445e4", "bridge": null, "label": "tempest-TestEncryptedCinderVolumes-1170647147-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1a659c58dcc3425b8ccbfd6f1f95de43", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapbddbb702-a0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:33:32.672 4088 3038363527304 MainThread DEBUG oslo_concurrency.lockutils [req-95e8f722-88c1-48d2-bfe5-7e19fa39eda6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-d2676f87-5c64-40cc-b7e7-a75b36bfbe57" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:33:33.907 4088 3038363526600 MainThread DEBUG nova.virt.hyperv.vmops [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:33:36.735 4088 3038363526952 MainThread DEBUG nova.compute.manager [req-839640b6-b492-49c5-8c55-b73db9240133 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Received event network-vif-plugged-bddbb702-a040-490c-901b-fc79beca37e8 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:33:36.735 4088 3038363526952 MainThread DEBUG oslo_concurrency.lockutils [req-839640b6-b492-49c5-8c55-b73db9240133 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d2676f87-5c64-40cc-b7e7-a75b36bfbe57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:36.735 4088 3038363526952 MainThread DEBUG oslo_concurrency.lockutils [req-839640b6-b492-49c5-8c55-b73db9240133 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d2676f87-5c64-40cc-b7e7-a75b36bfbe57-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:36.735 4088 3038363526952 MainThread DEBUG nova.compute.manager [req-839640b6-b492-49c5-8c55-b73db9240133 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Processing event network-vif-plugged-bddbb702-a040-490c-901b-fc79beca37e8 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:33:36.750 4088 3038363526600 MainThread INFO nova.virt.hyperv.vmops [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Using config drive for instance 2021-09-10 17:33:36.879 4088 3038363526600 MainThread INFO nova.virt.hyperv.vmops [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Creating config drive at C:\openstack\instances\instance-0000008c\configdrive.iso 2021-09-10 17:33:36.986 4088 3038363526600 MainThread DEBUG oslo_concurrency.processutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000008c\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpoja5u031 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:33:37.294 4088 3038363526600 MainThread DEBUG oslo_concurrency.processutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000008c\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpoja5u031" returned: 0 in 0.313s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:33:37.795 4088 3038363526600 MainThread DEBUG nova.virt.hyperv.vmops [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Setting boot order for instance: instance-0000008c: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:33:37.881 4088 3038363526600 MainThread DEBUG nova.virt.hyperv.vmops [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:33:37.922 4088 3038363526600 MainThread DEBUG os_win.utils.jobutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Waiting for WMI job: {'InstanceID': '75A3EBA7-B9E3-421A-B61C-BE4433BEA701', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15542), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:33:38.062 4088 3038363526600 MainThread ERROR os_win.utils.jobutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008c\' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)instance-0000008c2EDABC06-8785-4928-97B6-1ED27C4A10FC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)instance-0000008c2EDABC06-8785-4928-97B6-1ED27C4A10FC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)instance-0000008c2EDABC06-8785-4928-97B6-1ED27C4A10FC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '75A3EBA7-B9E3-421A-B61C-BE4433BEA701', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118709), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 33, 37), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 33, 38), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008c' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)\n\nNot enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)\n\n'instance-0000008c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)", 'ErrorSummaryDescription': "'instance-0000008c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:33:38.062 4088 3038363526600 MainThread DEBUG os_win._utils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008c' failed to start. Not enough memory in the system to start the virtual machine instance-0000008c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008c' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Not enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) 'instance-0000008c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18105673789978027 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:33:38.109 4088 3038363527304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:33:38.109 4088 3038363527304 MainThread INFO nova.compute.manager [-] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] VM Stopped (Lifecycle Event) 2021-09-10 17:33:38.109 4088 3038363527128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:38.109 4088 3038363527128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:38.125 4088 3038363527304 MainThread DEBUG nova.compute.manager [req-57ecf646-8a5d-4fc3-844e-cee234e5ffee - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:33:38.125 4088 3038363527304 MainThread DEBUG nova.virt.hyperv.vmops [req-57ecf646-8a5d-4fc3-844e-cee234e5ffee - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:33:38.171 4088 3038363527304 MainThread DEBUG nova.compute.manager [req-57ecf646-8a5d-4fc3-844e-cee234e5ffee - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:33:38.188 4088 3038363527304 MainThread INFO nova.compute.manager [req-57ecf646-8a5d-4fc3-844e-cee234e5ffee - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:33:39.093 4088 3038363526600 MainThread DEBUG os_win.utils.jobutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Waiting for WMI job: {'InstanceID': '693178C0-DA92-4B97-93C7-7A9A1A162962', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14447), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:33:39.232 4088 3038363526600 MainThread ERROR os_win.utils.jobutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008c\' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)instance-0000008c2EDABC06-8785-4928-97B6-1ED27C4A10FC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)instance-0000008c2EDABC06-8785-4928-97B6-1ED27C4A10FC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)instance-0000008c2EDABC06-8785-4928-97B6-1ED27C4A10FC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '693178C0-DA92-4B97-93C7-7A9A1A162962', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112790), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 33, 39), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 33, 39), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008c' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)\n\nNot enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)\n\n'instance-0000008c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)", 'ErrorSummaryDescription': "'instance-0000008c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:33:39.232 4088 3038363526600 MainThread DEBUG os_win._utils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008c' failed to start. Not enough memory in the system to start the virtual machine instance-0000008c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008c' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Not enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) 'instance-0000008c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3509387969970703 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:33:39.249 4088 3038363527304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:33:39.278 4088 3038363527304 MainThread INFO nova.compute.manager [-] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] VM Stopped (Lifecycle Event) 2021-09-10 17:33:39.278 4088 3038363527128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:39.281 4088 3038363527128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:39.296 4088 3038363527304 MainThread DEBUG nova.compute.manager [req-3b0891cc-a7eb-4c72-9f5e-9b0774b2ac9d - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:33:39.296 4088 3038363527304 MainThread DEBUG nova.virt.hyperv.vmops [req-3b0891cc-a7eb-4c72-9f5e-9b0774b2ac9d - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:33:39.344 4088 3038363527304 MainThread DEBUG nova.compute.manager [req-3b0891cc-a7eb-4c72-9f5e-9b0774b2ac9d - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:33:39.359 4088 3038363527304 MainThread INFO nova.compute.manager [req-3b0891cc-a7eb-4c72-9f5e-9b0774b2ac9d - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:33:40.248 4088 3038363526600 MainThread DEBUG os_win.utils.jobutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Waiting for WMI job: {'InstanceID': 'B6BBBD5C-5EC4-4AFC-9268-395BD6DD4F80', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15457), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:33:40.390 4088 3038363526600 MainThread ERROR os_win.utils.jobutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008c\' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)instance-0000008c2EDABC06-8785-4928-97B6-1ED27C4A10FC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)instance-0000008c2EDABC06-8785-4928-97B6-1ED27C4A10FC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)instance-0000008c2EDABC06-8785-4928-97B6-1ED27C4A10FC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B6BBBD5C-5EC4-4AFC-9268-395BD6DD4F80', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113715), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 33, 40), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 33, 40), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008c' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)\n\nNot enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)\n\n'instance-0000008c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)", 'ErrorSummaryDescription': "'instance-0000008c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:33:40.390 4088 3038363526600 MainThread DEBUG os_win._utils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008c' failed to start. Not enough memory in the system to start the virtual machine instance-0000008c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008c' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Not enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) 'instance-0000008c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5090575218200684 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:33:40.438 4088 3038363527128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:40.438 4088 3038363527128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:40.438 4088 3038363527304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:33:40.438 4088 3038363527304 MainThread INFO nova.compute.manager [-] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] VM Stopped (Lifecycle Event) 2021-09-10 17:33:40.468 4088 3038363527304 MainThread DEBUG nova.compute.manager [req-57485037-19a2-44fa-884e-131af3460af8 - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:33:40.468 4088 3038363527304 MainThread DEBUG nova.virt.hyperv.vmops [req-57485037-19a2-44fa-884e-131af3460af8 - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:33:40.511 4088 3038363527304 MainThread DEBUG nova.compute.manager [req-57485037-19a2-44fa-884e-131af3460af8 - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:33:40.519 4088 3038363527304 MainThread INFO nova.compute.manager [req-57485037-19a2-44fa-884e-131af3460af8 - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:33:41.421 4088 3038363526600 MainThread DEBUG os_win.utils.jobutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Waiting for WMI job: {'InstanceID': '6CE71DEA-7769-4836-8783-6C011C2DD40D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15539), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:33:41.551 4088 3038363526600 MainThread ERROR os_win.utils.jobutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008c\' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)instance-0000008c2EDABC06-8785-4928-97B6-1ED27C4A10FC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)instance-0000008c2EDABC06-8785-4928-97B6-1ED27C4A10FC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)instance-0000008c2EDABC06-8785-4928-97B6-1ED27C4A10FC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6CE71DEA-7769-4836-8783-6C011C2DD40D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111829), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 33, 41), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 33, 41), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008c' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)\n\nNot enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)\n\n'instance-0000008c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)", 'ErrorSummaryDescription': "'instance-0000008c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:33:41.551 4088 3038363526600 MainThread DEBUG os_win._utils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008c' failed to start. Not enough memory in the system to start the virtual machine instance-0000008c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008c' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Not enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) 'instance-0000008c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.6700944900512695 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:33:41.594 4088 3038363527128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:41.594 4088 3038363527128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:41.594 4088 3038363527304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:33:41.594 4088 3038363527304 MainThread INFO nova.compute.manager [-] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] VM Stopped (Lifecycle Event) 2021-09-10 17:33:41.609 4088 3038363527304 MainThread DEBUG nova.compute.manager [req-2b8662d2-7460-4ae5-aa16-fde2feb93e76 - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:33:41.609 4088 3038363527304 MainThread DEBUG nova.virt.hyperv.vmops [req-2b8662d2-7460-4ae5-aa16-fde2feb93e76 - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:33:41.651 4088 3038363527304 MainThread DEBUG nova.compute.manager [req-2b8662d2-7460-4ae5-aa16-fde2feb93e76 - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:33:41.672 4088 3038363527304 MainThread INFO nova.compute.manager [req-2b8662d2-7460-4ae5-aa16-fde2feb93e76 - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:33:42.563 4088 3038363526600 MainThread DEBUG os_win.utils.jobutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Waiting for WMI job: {'InstanceID': '799BF567-9E24-4A2E-AF4A-66445C5DF340', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15092), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:33:42.703 4088 3038363526600 MainThread ERROR os_win.utils.jobutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008c\' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)instance-0000008c2EDABC06-8785-4928-97B6-1ED27C4A10FC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)instance-0000008c2EDABC06-8785-4928-97B6-1ED27C4A10FC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)instance-0000008c2EDABC06-8785-4928-97B6-1ED27C4A10FC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '799BF567-9E24-4A2E-AF4A-66445C5DF340', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112136), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 33, 42), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 33, 42), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008c' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)\n\nNot enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)\n\n'instance-0000008c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)", 'ErrorSummaryDescription': "'instance-0000008c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:33:42.703 4088 3038363526600 MainThread DEBUG os_win._utils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008c' failed to start. Not enough memory in the system to start the virtual machine instance-0000008c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008c' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Not enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) 'instance-0000008c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.821783542633057 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:33:42.724 4088 3038363527128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:42.746 4088 3038363527128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:42.746 4088 3038363527304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:33:42.746 4088 3038363527304 MainThread INFO nova.compute.manager [-] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] VM Stopped (Lifecycle Event) 2021-09-10 17:33:42.750 4088 3038363527304 MainThread DEBUG nova.compute.manager [req-5c1f21f9-6a57-4e59-aab1-14f4040da9b7 - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:33:42.750 4088 3038363527304 MainThread DEBUG nova.virt.hyperv.vmops [req-5c1f21f9-6a57-4e59-aab1-14f4040da9b7 - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:33:42.813 4088 3038363527304 MainThread DEBUG nova.compute.manager [req-5c1f21f9-6a57-4e59-aab1-14f4040da9b7 - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:33:42.813 4088 3038363527304 MainThread INFO nova.compute.manager [req-5c1f21f9-6a57-4e59-aab1-14f4040da9b7 - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:33:43.731 4088 3038363526600 MainThread DEBUG os_win.utils.jobutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Waiting for WMI job: {'InstanceID': '97F708C4-70AD-4E2D-BBC9-CD7D74C697C3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15646), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:33:43.873 4088 3038363526600 MainThread ERROR os_win.utils.jobutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008c\' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)instance-0000008c2EDABC06-8785-4928-97B6-1ED27C4A10FC12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)instance-0000008c2EDABC06-8785-4928-97B6-1ED27C4A10FC10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008c\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)instance-0000008c2EDABC06-8785-4928-97B6-1ED27C4A10FC%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '97F708C4-70AD-4E2D-BBC9-CD7D74C697C3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=109942), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 33, 43), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 33, 43), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008c' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)\n\nNot enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)\n\n'instance-0000008c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC)", 'ErrorSummaryDescription': "'instance-0000008c' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008c.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:33:43.873 4088 3038363526600 MainThread ERROR nova.virt.hyperv.vmops [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Failed to change vm state of instance-0000008c to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000008c' failed to start. 2021-09-10 17:33:43.873 4088 3038363526600 MainThread INFO nova.virt.hyperv.vmops [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Got request to destroy instance 2021-09-10 17:33:43.888 4088 3038363527128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:43.888 4088 3038363527128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:43.920 4088 3038363527304 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:33:43.920 4088 3038363527304 MainThread INFO nova.compute.manager [-] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] VM Stopped (Lifecycle Event) 2021-09-10 17:33:43.929 4088 3038363527304 MainThread DEBUG nova.compute.manager [req-1c4145c8-5d4a-421c-90f5-8dae68884ea6 - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:33:43.929 4088 3038363527304 MainThread DEBUG nova.virt.hyperv.vmops [req-1c4145c8-5d4a-421c-90f5-8dae68884ea6 - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:33:43.997 4088 3038363527304 MainThread DEBUG nova.compute.manager [req-1c4145c8-5d4a-421c-90f5-8dae68884ea6 - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:33:43.997 4088 3038363527304 MainThread INFO nova.compute.manager [req-1c4145c8-5d4a-421c-90f5-8dae68884ea6 - - - - -] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:33:45.689 4088 3038363526600 MainThread DEBUG nova.virt.hyperv.vmops [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:33:45.689 4088 3038363526600 MainThread DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "instance-0000008c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:45.689 4088 3038363526600 MainThread DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "instance-0000008c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:45.703 4088 3038363526600 MainThread DEBUG os_win.utils.compute.vmutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Successfully changed vm state of instance-0000008c to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:33:45.703 4088 3038363526600 MainThread DEBUG nova.virt.hyperv.vmops [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Successfully changed state of VM instance-0000008c to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:33:45.746 4088 3038363526600 MainThread DEBUG os_win.utils.jobutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Waiting for WMI job: {'InstanceID': 'B7AFEC67-D0D4-405E-8545-63BDBA264928', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14863), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:33:45.860 4088 3038363526600 MainThread DEBUG os_win.utils.jobutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] WMI job succeeded: {'InstanceID': 'B7AFEC67-D0D4-405E-8545-63BDBA264928', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=102351), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:33:45.860 4088 3038363526600 MainThread DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "instance-0000008c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:45.860 4088 3038363526600 MainThread DEBUG os_win.utils.pathutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Removing directory: C:\openstack\instances\instance-0000008c check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:33:45.860 4088 3038363526600 MainThread DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "instance-0000008c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:45.877 4088 3038363526600 MainThread ERROR nova.compute.manager [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008c' failed to start. Not enough memory in the system to start the virtual machine instance-0000008c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008c' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Not enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) 'instance-0000008c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Error code: 32778. 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Traceback (most recent call last): 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] return function(*args, **kwargs) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] admin_password, network_info, block_device_info) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] return function(self, *args, **kwds) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self.force_reraise() 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] raise self.value 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] should_plug_vifs=False) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 'req_state': req_state}) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self.force_reraise() 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] raise self.value 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] time.sleep(sleep_time) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self.force_reraise() 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] raise self.value 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] return f(*args, **kwargs) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] return self._wait_for_job(job_path) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] error_desc=err_desc) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000008c' failed to start. 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Not enough memory in the system to start the virtual machine instance-0000008c. 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008c' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Not enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 'instance-0000008c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Error code: 32778. 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] During handling of the above exception, another exception occurred: 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Traceback (most recent call last): 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] yield resources 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] accel_info=accel_info) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] return function(*args, **kwargs) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] admin_password, network_info, block_device_info) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] return function(self, *args, **kwds) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self.force_reraise() 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] raise self.value 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] should_plug_vifs=False) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 'req_state': req_state}) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self.force_reraise() 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] raise self.value 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] time.sleep(sleep_time) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self.force_reraise() 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] raise self.value 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] return f(*args, **kwargs) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] return self._wait_for_job(job_path) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] error_desc=err_desc) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008c' failed to start. 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Not enough memory in the system to start the virtual machine instance-0000008c. 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008c' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Not enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 'instance-0000008c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Error code: 32778. 2021-09-10 17:33:45.877 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:45.877 4088 3038363526600 MainThread INFO nova.compute.manager [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Terminating instance 2021-09-10 17:33:45.877 4088 3038363526600 MainThread DEBUG nova.compute.manager [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:33:45.877 4088 3038363526600 MainThread INFO nova.virt.hyperv.vmops [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Got request to destroy instance 2021-09-10 17:33:45.877 4088 3038363526600 MainThread DEBUG nova.virt.hyperv.vmops [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:33:45.877 4088 3038363526600 MainThread DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "instance-0000008c" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:45.877 4088 3038363526600 MainThread DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "instance-0000008c" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:45.877 4088 3038363526600 MainThread INFO nova.compute.manager [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Took 0.00 seconds to destroy the instance on the hypervisor. 2021-09-10 17:33:45.902 4088 3038363526600 MainThread DEBUG nova.compute.claims [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:33:45.902 4088 3038363526600 MainThread DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:33:45.982 4088 3038363526600 MainThread DEBUG nova.virt.hyperv.hostops [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:33:46.005 4088 3038363526600 MainThread DEBUG nova.virt.hyperv.hostops [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:33:46.219 4088 3038363526600 MainThread DEBUG nova.compute.provider_tree [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:33:46.234 4088 3038363526600 MainThread DEBUG nova.scheduler.client.report [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:33:46.234 4088 3038363526600 MainThread DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:33:46.234 4088 3038363526600 MainThread ERROR nova.compute.manager [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008c' failed to start. Not enough memory in the system to start the virtual machine instance-0000008c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008c' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Not enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) 'instance-0000008c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Error code: 32778. 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Traceback (most recent call last): 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] return function(*args, **kwargs) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] admin_password, network_info, block_device_info) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] return function(self, *args, **kwds) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self.force_reraise() 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] raise self.value 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] should_plug_vifs=False) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 'req_state': req_state}) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self.force_reraise() 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] raise self.value 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] time.sleep(sleep_time) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self.force_reraise() 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] raise self.value 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] return f(*args, **kwargs) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] return self._wait_for_job(job_path) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] error_desc=err_desc) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000008c' failed to start. 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Not enough memory in the system to start the virtual machine instance-0000008c. 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008c' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Not enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 'instance-0000008c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Error code: 32778. 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] During handling of the above exception, another exception occurred: 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Traceback (most recent call last): 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] accel_info=accel_info) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] return function(*args, **kwargs) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] admin_password, network_info, block_device_info) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] return function(self, *args, **kwds) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self.force_reraise() 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] raise self.value 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] should_plug_vifs=False) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 'req_state': req_state}) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self.force_reraise() 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] raise self.value 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] time.sleep(sleep_time) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self.force_reraise() 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] raise self.value 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] return f(*args, **kwargs) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] return self._wait_for_job(job_path) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] error_desc=err_desc) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008c' failed to start. 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Not enough memory in the system to start the virtual machine instance-0000008c. 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008c' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Not enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 'instance-0000008c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Error code: 32778. 2021-09-10 17:33:46.234 4088 3038363526600 MainThread TRACE nova.compute.manager [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] 2021-09-10 17:33:46.234 4088 3038363526600 MainThread DEBUG nova.compute.utils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] WMI job failed with status 10. Error summary description: 'instance-0000008c' failed to start. Not enough memory in the system to start the virtual machine instance-0000008c. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:33:46.234 4088 3038363526600 MainThread DEBUG nova.compute.manager [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Build of instance d2676f87-5c64-40cc-b7e7-a75b36bfbe57 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000008c' failed to start. Not enough memory in the system to start the virtual machine instance-0000008c. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008c' failed to start. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Not enough memory in the system to start the virtual machine instance-0000008c with ram size 1024 megabytes. (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) 'instance-0000008c' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 2EDABC06-8785-4928-97B6-1ED27C4A10FC) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:33:46.234 4088 3038363526600 MainThread DEBUG nova.compute.manager [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:33:46.234 4088 3038363526600 MainThread DEBUG nova.compute.manager [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:33:46.234 4088 3038363526600 MainThread DEBUG nova.compute.manager [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:33:46.234 4088 3038363526600 MainThread DEBUG nova.network.neutron [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:33:46.715 4088 3038363526600 MainThread DEBUG nova.network.neutron [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:33:46.734 4088 3038363526600 MainThread INFO nova.compute.manager [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] [instance: d2676f87-5c64-40cc-b7e7-a75b36bfbe57] Took 0.50 seconds to deallocate network for instance. 2021-09-10 17:33:46.872 4088 3038363526600 MainThread INFO nova.scheduler.client.report [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Deleted allocations for instance d2676f87-5c64-40cc-b7e7-a75b36bfbe57 2021-09-10 17:33:46.894 4088 3038363526600 MainThread DEBUG oslo_concurrency.lockutils [req-8b135ca7-015d-41d8-beb2-c1e081e08a0d 0226fc9bb37e4645999ab1e146569f72 1a659c58dcc3425b8ccbfd6f1f95de43 - default default] Lock "d2676f87-5c64-40cc-b7e7-a75b36bfbe57" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.969s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:34:10.517 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:34:11.472 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:34:11.495 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:34:12.526 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:34:14.471 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:34:14.471 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:34:18.464 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:34:18.464 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:34:18.471 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:34:18.471 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:34:18.471 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:34:18.471 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:34:18.487 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:34:18.717 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2222MB free_disk=50GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:34:18.717 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:34:18.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:34:18.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:34:18.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:34:18.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:34:18.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:34:18.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:34:18.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:34:18.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:34:18.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:34:18.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:34:18.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:34:18.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:34:18.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:34:18.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:34:18.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:34:18.909 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:34:18.925 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:34:19.127 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:34:19.143 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:34:19.143 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:34:19.143 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:34:21.136 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:34:21.136 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:34:21.206 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-9446e666-4364-4dcd-b041-405653a856bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:34:21.206 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:34:22.026 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Updating instance_info_cache with network_info: [{"id": "f581c585-39ab-4120-a040-5d92bb401a6c", "address": "fa:16:3e:da:9a:80", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf581c585-39", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:34:22.050 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-9446e666-4364-4dcd-b041-405653a856bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:34:22.050 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:34:22.464 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:34:46.095 4088 3038363528712 MainThread DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Lock "6233922c-7a39-4d26-a5b3-44889c3647c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:34:46.130 4088 3038363528712 MainThread DEBUG nova.compute.manager [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:34:46.213 4088 3038363528712 MainThread DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:34:46.213 4088 3038363528712 MainThread DEBUG nova.virt.hardware [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:34:46.213 4088 3038363528712 MainThread INFO nova.compute.claims [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Claim successful on node n-h2-808474-1 2021-09-10 17:34:46.307 4088 3038363528712 MainThread DEBUG nova.virt.hyperv.hostops [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:34:46.317 4088 3038363528712 MainThread DEBUG nova.virt.hyperv.hostops [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:34:46.525 4088 3038363528712 MainThread DEBUG nova.compute.provider_tree [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:34:46.541 4088 3038363528712 MainThread DEBUG nova.scheduler.client.report [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:34:46.541 4088 3038363528712 MainThread DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:34:46.541 4088 3038363528712 MainThread DEBUG nova.compute.manager [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:34:46.604 4088 3038363528712 MainThread DEBUG nova.compute.manager [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:34:46.604 4088 3038363528536 GreenThread-130 DEBUG nova.compute.manager [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:34:46.604 4088 3038363528536 GreenThread-130 DEBUG nova.network.neutron [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:34:46.728 4088 3038363528712 MainThread DEBUG nova.compute.manager [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:34:46.736 4088 3038363528536 GreenThread-130 DEBUG nova.policy [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffb5dbb2ad6e47068976b3e937dc4322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f601013bf0c474aac57e1ac136b5136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:34:46.746 4088 3038363528712 MainThread INFO nova.virt.hyperv.vmops [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Spawning new instance 2021-09-10 17:34:46.746 4088 3038363528712 MainThread DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Lock "instance-0000008d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:34:46.746 4088 3038363528712 MainThread DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Lock "instance-0000008d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:34:46.746 4088 3038363528712 MainThread DEBUG nova.block_device [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:34:46.746 4088 3038363528712 MainThread DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Lock "f2cce4b1-ac64-485e-8426-63b59c59ab51-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:34:57.900 4088 3038363528712 MainThread DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Lock "f2cce4b1-ac64-485e-8426-63b59c59ab51-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 11.156s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:34:57.900 4088 3038363528536 GreenThread-130 DEBUG nova.network.neutron [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Successfully created port: 1160e3c7-ca98-435d-bb62-d28b69c97e2c _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:34:57.931 4088 3038363528712 MainThread DEBUG os_win.utils.pathutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Creating directory: C:\openstack\instances\instance-0000008d check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:34:57.931 4088 3038363528712 MainThread DEBUG nova.virt.hyperv.vmops [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Creating differencing VHD. Parent: C:\openstack\instances\_base\f2cce4b1-ac64-485e-8426-63b59c59ab51.vhdx, Target: C:\openstack\instances\instance-0000008d\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:34:58.370 4088 3038363528712 MainThread DEBUG nova.virt.hyperv.vmops [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Resizing VHD C:\openstack\instances\instance-0000008d\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:34:58.557 4088 3038363528536 GreenThread-130 DEBUG nova.network.neutron [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Successfully updated port: 1160e3c7-ca98-435d-bb62-d28b69c97e2c _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:34:58.557 4088 3038363528536 GreenThread-130 DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Acquired lock "refresh_cache-6233922c-7a39-4d26-a5b3-44889c3647c3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:34:58.557 4088 3038363528536 GreenThread-130 DEBUG nova.network.neutron [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:34:58.601 4088 3038364991736 MainThread DEBUG nova.compute.manager [req-68e7d194-7dd0-4e95-b784-91b34551bfbc 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Received event network-changed-1160e3c7-ca98-435d-bb62-d28b69c97e2c external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:34:58.610 4088 3038364991736 MainThread DEBUG nova.compute.manager [req-68e7d194-7dd0-4e95-b784-91b34551bfbc 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Refreshing instance network info cache due to event network-changed-1160e3c7-ca98-435d-bb62-d28b69c97e2c. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:34:58.650 4088 3038363528536 GreenThread-130 DEBUG nova.network.neutron [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:34:58.976 4088 3038363528536 GreenThread-130 DEBUG nova.network.neutron [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Updating instance_info_cache with network_info: [{"id": "1160e3c7-ca98-435d-bb62-d28b69c97e2c", "address": "fa:16:3e:a8:78:d6", "network": {"id": "1b7bf981-f3de-4768-a09e-78fe8ea37484", "bridge": null, "label": "tempest-TestMinimumBasicScenario-1484923914-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9f601013bf0c474aac57e1ac136b5136", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap1160e3c7-ca", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:34:58.992 4088 3038363528536 GreenThread-130 DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Releasing lock "refresh_cache-6233922c-7a39-4d26-a5b3-44889c3647c3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:34:58.992 4088 3038363528536 GreenThread-130 DEBUG nova.compute.manager [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Instance network_info: |[{"id": "1160e3c7-ca98-435d-bb62-d28b69c97e2c", "address": "fa:16:3e:a8:78:d6", "network": {"id": "1b7bf981-f3de-4768-a09e-78fe8ea37484", "bridge": null, "label": "tempest-TestMinimumBasicScenario-1484923914-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9f601013bf0c474aac57e1ac136b5136", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap1160e3c7-ca", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:34:58.992 4088 3038363528712 MainThread DEBUG nova.compute.manager [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Preparing to wait for external event network-vif-plugged-1160e3c7-ca98-435d-bb62-d28b69c97e2c prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:34:58.999 4088 3038363528712 MainThread DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Lock "6233922c-7a39-4d26-a5b3-44889c3647c3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:34:58.999 4088 3038363528712 MainThread DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Lock "6233922c-7a39-4d26-a5b3-44889c3647c3-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:34:58.999 4088 3038363528712 MainThread DEBUG os_win.utils.compute.vmutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Creating VM instance-0000008d create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:34:58.999 4088 3038364991736 MainThread DEBUG oslo_concurrency.lockutils [req-68e7d194-7dd0-4e95-b784-91b34551bfbc 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-6233922c-7a39-4d26-a5b3-44889c3647c3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:34:58.999 4088 3038364991736 MainThread DEBUG nova.network.neutron [req-68e7d194-7dd0-4e95-b784-91b34551bfbc 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Refreshing network info cache for port 1160e3c7-ca98-435d-bb62-d28b69c97e2c _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:34:59.492 4088 3038364991736 MainThread DEBUG nova.network.neutron [req-68e7d194-7dd0-4e95-b784-91b34551bfbc 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Updated VIF entry in instance network info cache for port 1160e3c7-ca98-435d-bb62-d28b69c97e2c. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:34:59.492 4088 3038364991736 MainThread DEBUG nova.network.neutron [req-68e7d194-7dd0-4e95-b784-91b34551bfbc 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Updating instance_info_cache with network_info: [{"id": "1160e3c7-ca98-435d-bb62-d28b69c97e2c", "address": "fa:16:3e:a8:78:d6", "network": {"id": "1b7bf981-f3de-4768-a09e-78fe8ea37484", "bridge": null, "label": "tempest-TestMinimumBasicScenario-1484923914-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9f601013bf0c474aac57e1ac136b5136", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap1160e3c7-ca", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:34:59.500 4088 3038364991736 MainThread DEBUG oslo_concurrency.lockutils [req-68e7d194-7dd0-4e95-b784-91b34551bfbc 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-6233922c-7a39-4d26-a5b3-44889c3647c3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:35:00.838 4088 3038363528712 MainThread DEBUG nova.virt.hyperv.vmops [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:35:05.170 4088 3038363528536 MainThread DEBUG nova.compute.manager [req-b6f697c2-f204-433c-89b6-59c77619c64b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Received event network-vif-plugged-1160e3c7-ca98-435d-bb62-d28b69c97e2c external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:35:05.170 4088 3038363528536 MainThread DEBUG oslo_concurrency.lockutils [req-b6f697c2-f204-433c-89b6-59c77619c64b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "6233922c-7a39-4d26-a5b3-44889c3647c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:35:05.170 4088 3038363528536 MainThread DEBUG oslo_concurrency.lockutils [req-b6f697c2-f204-433c-89b6-59c77619c64b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "6233922c-7a39-4d26-a5b3-44889c3647c3-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:35:05.170 4088 3038363528536 MainThread DEBUG nova.compute.manager [req-b6f697c2-f204-433c-89b6-59c77619c64b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Processing event network-vif-plugged-1160e3c7-ca98-435d-bb62-d28b69c97e2c _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:35:05.196 4088 3038363528712 MainThread INFO nova.virt.hyperv.vmops [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Using config drive for instance 2021-09-10 17:35:05.306 4088 3038363528712 MainThread INFO nova.virt.hyperv.vmops [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Creating config drive at C:\openstack\instances\instance-0000008d\configdrive.iso 2021-09-10 17:35:05.415 4088 3038363528712 MainThread DEBUG oslo_concurrency.processutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000008d\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpacptpwbe execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:35:05.728 4088 3038363528712 MainThread DEBUG oslo_concurrency.processutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000008d\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpacptpwbe" returned: 0 in 0.312s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:35:06.250 4088 3038363528712 MainThread DEBUG nova.virt.hyperv.vmops [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Setting boot order for instance: instance-0000008d: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:35:06.337 4088 3038363528712 MainThread DEBUG nova.virt.hyperv.vmops [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:35:06.362 4088 3038363528712 MainThread DEBUG os_win.utils.jobutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Waiting for WMI job: {'InstanceID': 'B81A789B-AD2C-4AAC-A7DD-503359C704BA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=18528), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:35:06.512 4088 3038363528712 MainThread ERROR os_win.utils.jobutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008d\' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)instance-0000008dEC8250B6-1632-4496-B361-1A7ACB743C0712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)instance-0000008dEC8250B6-1632-4496-B361-1A7ACB743C0710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)instance-0000008dEC8250B6-1632-4496-B361-1A7ACB743C07%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'B81A789B-AD2C-4AAC-A7DD-503359C704BA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116933), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 35, 6), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 35, 6), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008d' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)\n\nNot enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)\n\n'instance-0000008d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)", 'ErrorSummaryDescription': "'instance-0000008d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:35:06.512 4088 3038363528712 MainThread DEBUG os_win._utils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008d' failed to start. Not enough memory in the system to start the virtual machine instance-0000008d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008d' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Not enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) 'instance-0000008d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.17525792121887207 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:35:06.542 4088 3038363528888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:35:06.542 4088 3038363528888 MainThread INFO nova.compute.manager [-] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] VM Stopped (Lifecycle Event) 2021-09-10 17:35:06.542 4088 3038363528536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:35:06.542 4088 3038363528536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:35:06.571 4088 3038363528888 MainThread DEBUG nova.compute.manager [req-6fda7639-5ea8-42bf-9992-f8c799b9cc13 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:35:06.571 4088 3038363528888 MainThread DEBUG nova.virt.hyperv.vmops [req-6fda7639-5ea8-42bf-9992-f8c799b9cc13 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:35:06.603 4088 3038363528888 MainThread DEBUG nova.compute.manager [req-6fda7639-5ea8-42bf-9992-f8c799b9cc13 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:35:06.634 4088 3038363528888 MainThread INFO nova.compute.manager [req-6fda7639-5ea8-42bf-9992-f8c799b9cc13 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:35:07.531 4088 3038363528712 MainThread DEBUG os_win.utils.jobutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Waiting for WMI job: {'InstanceID': '002D2CEC-48D1-4A27-8CFC-13CA5220E787', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15611), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:35:07.681 4088 3038363528712 MainThread ERROR os_win.utils.jobutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008d\' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)instance-0000008dEC8250B6-1632-4496-B361-1A7ACB743C0712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)instance-0000008dEC8250B6-1632-4496-B361-1A7ACB743C0710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)instance-0000008dEC8250B6-1632-4496-B361-1A7ACB743C07%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '002D2CEC-48D1-4A27-8CFC-13CA5220E787', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112389), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 35, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 35, 7), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008d' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)\n\nNot enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)\n\n'instance-0000008d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)", 'ErrorSummaryDescription': "'instance-0000008d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:35:07.681 4088 3038363528712 MainThread DEBUG os_win._utils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008d' failed to start. Not enough memory in the system to start the virtual machine instance-0000008d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008d' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Not enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) 'instance-0000008d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3439064025878906 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:35:07.728 4088 3038363528536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:35:07.728 4088 3038363528536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:35:07.728 4088 3038363528888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:35:07.728 4088 3038363528888 MainThread INFO nova.compute.manager [-] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] VM Stopped (Lifecycle Event) 2021-09-10 17:35:07.743 4088 3038363528888 MainThread DEBUG nova.compute.manager [req-5227922b-f2ec-4e8a-8604-90322c6efde0 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:35:07.743 4088 3038363528888 MainThread DEBUG nova.virt.hyperv.vmops [req-5227922b-f2ec-4e8a-8604-90322c6efde0 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:35:07.791 4088 3038363528888 MainThread DEBUG nova.compute.manager [req-5227922b-f2ec-4e8a-8604-90322c6efde0 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:35:07.791 4088 3038363528888 MainThread INFO nova.compute.manager [req-5227922b-f2ec-4e8a-8604-90322c6efde0 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:35:08.698 4088 3038363528712 MainThread DEBUG os_win.utils.jobutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Waiting for WMI job: {'InstanceID': 'E3B3BB68-CE55-4AC3-B6C7-429C8AA7BF32', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14414), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:35:08.853 4088 3038363528712 MainThread ERROR os_win.utils.jobutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008d\' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)instance-0000008dEC8250B6-1632-4496-B361-1A7ACB743C0712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)instance-0000008dEC8250B6-1632-4496-B361-1A7ACB743C0710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)instance-0000008dEC8250B6-1632-4496-B361-1A7ACB743C07%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'E3B3BB68-CE55-4AC3-B6C7-429C8AA7BF32', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112859), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 35, 8), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 35, 8), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008d' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)\n\nNot enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)\n\n'instance-0000008d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)", 'ErrorSummaryDescription': "'instance-0000008d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:35:08.853 4088 3038363528712 MainThread DEBUG os_win._utils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008d' failed to start. Not enough memory in the system to start the virtual machine instance-0000008d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008d' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Not enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) 'instance-0000008d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.516554594039917 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:35:08.902 4088 3038363528536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:35:08.902 4088 3038363528536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:35:08.902 4088 3038363528888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:35:08.902 4088 3038363528888 MainThread INFO nova.compute.manager [-] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] VM Stopped (Lifecycle Event) 2021-09-10 17:35:08.931 4088 3038363528888 MainThread DEBUG nova.compute.manager [req-bbd76252-94c6-4aae-b67a-bc7ba3cb0d1f - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:35:08.931 4088 3038363528888 MainThread DEBUG nova.virt.hyperv.vmops [req-bbd76252-94c6-4aae-b67a-bc7ba3cb0d1f - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:35:08.969 4088 3038363528888 MainThread DEBUG nova.compute.manager [req-bbd76252-94c6-4aae-b67a-bc7ba3cb0d1f - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:35:08.993 4088 3038363528888 MainThread INFO nova.compute.manager [req-bbd76252-94c6-4aae-b67a-bc7ba3cb0d1f - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:35:09.885 4088 3038363528712 MainThread DEBUG os_win.utils.jobutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Waiting for WMI job: {'InstanceID': 'CA3AA79B-7532-4A75-A97D-62CDD91B0EEB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14828), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:35:10.024 4088 3038363528712 MainThread ERROR os_win.utils.jobutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008d\' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)instance-0000008dEC8250B6-1632-4496-B361-1A7ACB743C0712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)instance-0000008dEC8250B6-1632-4496-B361-1A7ACB743C0710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)instance-0000008dEC8250B6-1632-4496-B361-1A7ACB743C07%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'CA3AA79B-7532-4A75-A97D-62CDD91B0EEB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111421), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 35, 9), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 35, 9), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008d' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)\n\nNot enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)\n\n'instance-0000008d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)", 'ErrorSummaryDescription': "'instance-0000008d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:35:10.024 4088 3038363528712 MainThread DEBUG os_win._utils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008d' failed to start. Not enough memory in the system to start the virtual machine instance-0000008d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008d' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Not enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) 'instance-0000008d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.6875076293945312 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:35:10.059 4088 3038363528536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:35:10.059 4088 3038363528536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:35:10.059 4088 3038363528888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:35:10.059 4088 3038363528888 MainThread INFO nova.compute.manager [-] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] VM Stopped (Lifecycle Event) 2021-09-10 17:35:10.074 4088 3038363528888 MainThread DEBUG nova.compute.manager [req-c25ab95e-8b92-435e-a0c3-b0ae9300cc35 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:35:10.074 4088 3038363528888 MainThread DEBUG nova.virt.hyperv.vmops [req-c25ab95e-8b92-435e-a0c3-b0ae9300cc35 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:35:10.126 4088 3038363528888 MainThread DEBUG nova.compute.manager [req-c25ab95e-8b92-435e-a0c3-b0ae9300cc35 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:35:10.149 4088 3038363528888 MainThread INFO nova.compute.manager [req-c25ab95e-8b92-435e-a0c3-b0ae9300cc35 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:35:11.058 4088 3038363528712 MainThread DEBUG os_win.utils.jobutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Waiting for WMI job: {'InstanceID': '8018E66F-3745-477C-A4E1-B1EC267D82B1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15379), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:35:11.223 4088 3038363528712 MainThread ERROR os_win.utils.jobutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008d\' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)instance-0000008dEC8250B6-1632-4496-B361-1A7ACB743C0712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)instance-0000008dEC8250B6-1632-4496-B361-1A7ACB743C0710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)instance-0000008dEC8250B6-1632-4496-B361-1A7ACB743C07%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '8018E66F-3745-477C-A4E1-B1EC267D82B1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=144057), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 35, 11), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 35, 11), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008d' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)\n\nNot enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)\n\n'instance-0000008d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)", 'ErrorSummaryDescription': "'instance-0000008d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:35:11.223 4088 3038363528712 MainThread DEBUG os_win._utils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008d' failed to start. Not enough memory in the system to start the virtual machine instance-0000008d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008d' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Not enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) 'instance-0000008d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.886375665664673 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:35:11.266 4088 3038363528536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:35:11.266 4088 3038363528536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:35:11.266 4088 3038363528888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:35:11.266 4088 3038363528888 MainThread INFO nova.compute.manager [-] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] VM Stopped (Lifecycle Event) 2021-09-10 17:35:11.287 4088 3038363528888 MainThread DEBUG nova.compute.manager [req-30df6d44-dba0-4dbb-9b5b-daaa6234c6c2 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:35:11.287 4088 3038363528888 MainThread DEBUG nova.virt.hyperv.vmops [req-30df6d44-dba0-4dbb-9b5b-daaa6234c6c2 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:35:11.340 4088 3038363528888 MainThread DEBUG nova.compute.manager [req-30df6d44-dba0-4dbb-9b5b-daaa6234c6c2 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:35:11.340 4088 3038363528888 MainThread INFO nova.compute.manager [req-30df6d44-dba0-4dbb-9b5b-daaa6234c6c2 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:35:12.266 4088 3038363528712 MainThread DEBUG os_win.utils.jobutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Waiting for WMI job: {'InstanceID': 'FB4B0FF6-2E3A-4173-A4FA-EE52F930681D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15355), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:35:12.401 4088 3038363528712 MainThread ERROR os_win.utils.jobutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008d\' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)instance-0000008dEC8250B6-1632-4496-B361-1A7ACB743C0712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)instance-0000008dEC8250B6-1632-4496-B361-1A7ACB743C0710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008d\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)instance-0000008dEC8250B6-1632-4496-B361-1A7ACB743C07%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'FB4B0FF6-2E3A-4173-A4FA-EE52F930681D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=110924), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 35, 12), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 35, 12), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008d' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)\n\nNot enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)\n\n'instance-0000008d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07)", 'ErrorSummaryDescription': "'instance-0000008d' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008d.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:35:12.401 4088 3038363528712 MainThread ERROR nova.virt.hyperv.vmops [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Failed to change vm state of instance-0000008d to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000008d' failed to start. 2021-09-10 17:35:12.401 4088 3038363528712 MainThread INFO nova.virt.hyperv.vmops [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Got request to destroy instance 2021-09-10 17:35:12.431 4088 3038363528536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:35:12.431 4088 3038363528536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:35:12.431 4088 3038363528888 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:35:12.431 4088 3038363528888 MainThread INFO nova.compute.manager [-] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] VM Stopped (Lifecycle Event) 2021-09-10 17:35:12.462 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:35:12.462 4088 3038363528888 MainThread DEBUG nova.compute.manager [req-b1585fc5-bfc9-4d6d-a842-6e25af6b97a7 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:35:12.462 4088 3038363528888 MainThread DEBUG nova.virt.hyperv.vmops [req-b1585fc5-bfc9-4d6d-a842-6e25af6b97a7 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:35:12.511 4088 3038363528888 MainThread DEBUG nova.compute.manager [req-b1585fc5-bfc9-4d6d-a842-6e25af6b97a7 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:35:12.540 4088 3038363528888 MainThread INFO nova.compute.manager [req-b1585fc5-bfc9-4d6d-a842-6e25af6b97a7 - - - - -] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:35:13.477 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:35:13.486 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:35:14.212 4088 3038363528712 MainThread DEBUG nova.virt.hyperv.vmops [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:35:14.212 4088 3038363528712 MainThread DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Lock "instance-0000008d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:35:14.212 4088 3038363528712 MainThread DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Lock "instance-0000008d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:35:14.243 4088 3038363528712 MainThread DEBUG os_win.utils.compute.vmutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Successfully changed vm state of instance-0000008d to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:35:14.243 4088 3038363528712 MainThread DEBUG nova.virt.hyperv.vmops [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Successfully changed state of VM instance-0000008d to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:35:14.279 4088 3038363528712 MainThread DEBUG os_win.utils.jobutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Waiting for WMI job: {'InstanceID': 'B9C3EF3A-4BDE-4E8A-B291-648AA09EF8C2', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14582), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:35:14.386 4088 3038363528712 MainThread DEBUG os_win.utils.jobutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] WMI job succeeded: {'InstanceID': 'B9C3EF3A-4BDE-4E8A-B291-648AA09EF8C2', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=106318), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:35:14.386 4088 3038363528712 MainThread DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Lock "instance-0000008d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:35:14.386 4088 3038363528712 MainThread DEBUG os_win.utils.pathutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Removing directory: C:\openstack\instances\instance-0000008d check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:35:14.386 4088 3038363528712 MainThread DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Lock "instance-0000008d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:35:14.386 4088 3038363528712 MainThread ERROR nova.compute.manager [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008d' failed to start. Not enough memory in the system to start the virtual machine instance-0000008d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008d' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Not enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) 'instance-0000008d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Error code: 32778. 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Traceback (most recent call last): 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] return function(*args, **kwargs) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] admin_password, network_info, block_device_info) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] return function(self, *args, **kwds) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self.force_reraise() 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] raise self.value 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] should_plug_vifs=False) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 'req_state': req_state}) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self.force_reraise() 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] raise self.value 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] time.sleep(sleep_time) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self.force_reraise() 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] raise self.value 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] return f(*args, **kwargs) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] return self._wait_for_job(job_path) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] error_desc=err_desc) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000008d' failed to start. 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Not enough memory in the system to start the virtual machine instance-0000008d. 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008d' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Not enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 'instance-0000008d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Error code: 32778. 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] During handling of the above exception, another exception occurred: 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Traceback (most recent call last): 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] yield resources 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] accel_info=accel_info) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] return function(*args, **kwargs) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] admin_password, network_info, block_device_info) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] return function(self, *args, **kwds) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self.force_reraise() 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] raise self.value 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] should_plug_vifs=False) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 'req_state': req_state}) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self.force_reraise() 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] raise self.value 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] time.sleep(sleep_time) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self.force_reraise() 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] raise self.value 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] return f(*args, **kwargs) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] return self._wait_for_job(job_path) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] error_desc=err_desc) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008d' failed to start. 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Not enough memory in the system to start the virtual machine instance-0000008d. 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008d' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Not enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 'instance-0000008d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Error code: 32778. 2021-09-10 17:35:14.386 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.403 4088 3038363528712 MainThread INFO nova.compute.manager [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Terminating instance 2021-09-10 17:35:14.403 4088 3038363528712 MainThread DEBUG nova.compute.manager [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:35:14.403 4088 3038363528712 MainThread INFO nova.virt.hyperv.vmops [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Got request to destroy instance 2021-09-10 17:35:14.419 4088 3038363528712 MainThread DEBUG nova.virt.hyperv.vmops [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:35:14.419 4088 3038363528712 MainThread DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Lock "instance-0000008d" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:35:14.419 4088 3038363528712 MainThread DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Lock "instance-0000008d" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:35:14.419 4088 3038363528712 MainThread INFO nova.compute.manager [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Took 0.02 seconds to destroy the instance on the hypervisor. 2021-09-10 17:35:14.419 4088 3038363528712 MainThread DEBUG nova.compute.claims [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:35:14.419 4088 3038363528712 MainThread DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:35:14.462 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:35:14.462 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:35:14.462 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:35:14.510 4088 3038363528712 MainThread DEBUG nova.virt.hyperv.hostops [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:35:14.510 4088 3038363528712 MainThread DEBUG nova.virt.hyperv.hostops [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:35:14.734 4088 3038363528712 MainThread DEBUG nova.compute.provider_tree [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:35:14.746 4088 3038363528712 MainThread DEBUG nova.scheduler.client.report [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:35:14.746 4088 3038363528712 MainThread DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:35:14.746 4088 3038363528712 MainThread ERROR nova.compute.manager [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008d' failed to start. Not enough memory in the system to start the virtual machine instance-0000008d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008d' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Not enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) 'instance-0000008d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Error code: 32778. 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Traceback (most recent call last): 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] return function(*args, **kwargs) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] admin_password, network_info, block_device_info) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] return function(self, *args, **kwds) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self.force_reraise() 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] raise self.value 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] should_plug_vifs=False) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 'req_state': req_state}) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self.force_reraise() 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] raise self.value 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] time.sleep(sleep_time) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self.force_reraise() 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] raise self.value 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] return f(*args, **kwargs) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] return self._wait_for_job(job_path) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] error_desc=err_desc) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000008d' failed to start. 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Not enough memory in the system to start the virtual machine instance-0000008d. 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008d' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Not enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 'instance-0000008d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Error code: 32778. 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] During handling of the above exception, another exception occurred: 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Traceback (most recent call last): 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] accel_info=accel_info) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] return function(*args, **kwargs) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] admin_password, network_info, block_device_info) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] return function(self, *args, **kwds) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self.force_reraise() 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] raise self.value 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] should_plug_vifs=False) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 'req_state': req_state}) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self.force_reraise() 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] raise self.value 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] time.sleep(sleep_time) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self.force_reraise() 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] raise self.value 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] return f(*args, **kwargs) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] return self._wait_for_job(job_path) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] error_desc=err_desc) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008d' failed to start. 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Not enough memory in the system to start the virtual machine instance-0000008d. 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008d' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Not enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 'instance-0000008d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Error code: 32778. 2021-09-10 17:35:14.746 4088 3038363528712 MainThread TRACE nova.compute.manager [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] 2021-09-10 17:35:14.746 4088 3038363528712 MainThread DEBUG nova.compute.utils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] WMI job failed with status 10. Error summary description: 'instance-0000008d' failed to start. Not enough memory in the system to start the virtual machine instance-0000008d. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:35:14.746 4088 3038363528712 MainThread DEBUG nova.compute.manager [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Build of instance 6233922c-7a39-4d26-a5b3-44889c3647c3 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000008d' failed to start. Not enough memory in the system to start the virtual machine instance-0000008d. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008d' failed to start. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Not enough memory in the system to start the virtual machine instance-0000008d with ram size 1024 megabytes. (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) 'instance-0000008d' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID EC8250B6-1632-4496-B361-1A7ACB743C07) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:35:14.746 4088 3038363528712 MainThread DEBUG nova.compute.manager [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:35:14.746 4088 3038363528712 MainThread DEBUG nova.compute.manager [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:35:14.746 4088 3038363528712 MainThread DEBUG nova.compute.manager [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:35:14.746 4088 3038363528712 MainThread DEBUG nova.network.neutron [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:35:15.226 4088 3038363528712 MainThread DEBUG nova.network.neutron [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:35:15.263 4088 3038363528712 MainThread INFO nova.compute.manager [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] [instance: 6233922c-7a39-4d26-a5b3-44889c3647c3] Took 0.52 seconds to deallocate network for instance. 2021-09-10 17:35:15.384 4088 3038363528712 MainThread INFO nova.scheduler.client.report [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Deleted allocations for instance 6233922c-7a39-4d26-a5b3-44889c3647c3 2021-09-10 17:35:15.435 4088 3038363528712 MainThread DEBUG oslo_concurrency.lockutils [req-95ae4e2f-1b10-40f4-953e-02ae240bd838 ffb5dbb2ad6e47068976b3e937dc4322 9f601013bf0c474aac57e1ac136b5136 - default default] Lock "6233922c-7a39-4d26-a5b3-44889c3647c3" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 29.343s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:35:18.461 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:35:18.477 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:35:18.483 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:35:18.483 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:35:18.483 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:35:18.483 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:35:18.711 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2219MB free_disk=49GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:35:18.711 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:35:18.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:35:18.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:35:18.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:35:18.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:35:18.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:35:18.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:35:18.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:35:18.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:35:18.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:35:18.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:35:18.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:35:18.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:35:18.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:35:18.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:35:18.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:35:18.883 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:35:18.911 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:35:19.118 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:35:19.133 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:35:19.133 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:35:19.133 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:35:20.149 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:35:20.192 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:35:20.461 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:35:20.461 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:35:20.649 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-9bb2d354-2d76-40ea-8b9c-b18a21edefbb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:35:20.649 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:35:21.494 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Updating instance_info_cache with network_info: [{"id": "cffb92ec-4239-478b-a7e3-533da175c554", "address": "fa:16:3e:61:8a:33", "network": {"id": "6762dff9-0e3f-42c6-a0d6-ae3571e9fc82", "bridge": null, "label": "tempest-AttachSCSIVolumeTestJSON-1567357011-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "10c929df49a24fb798e1b2d3f7414211", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcffb92ec-42", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:35:21.523 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-9bb2d354-2d76-40ea-8b9c-b18a21edefbb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:35:21.523 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:35:23.477 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:35:34.742 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:35:50.507 4088 3038365087352 MainThread DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "d96429b4-66c9-4d52-8c01-f9c377be61ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:35:50.523 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:35:50.617 4088 3038365087352 MainThread DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:35:50.617 4088 3038365087352 MainThread DEBUG nova.virt.hardware [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:35:50.617 4088 3038365087352 MainThread INFO nova.compute.claims [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Claim successful on node n-h2-808474-1 2021-09-10 17:35:50.732 4088 3038365087352 MainThread DEBUG nova.virt.hyperv.hostops [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:35:50.732 4088 3038365087352 MainThread DEBUG nova.virt.hyperv.hostops [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:35:50.945 4088 3038365087352 MainThread DEBUG nova.compute.provider_tree [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:35:50.960 4088 3038365087352 MainThread DEBUG nova.scheduler.client.report [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:35:50.960 4088 3038365087352 MainThread DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:35:50.960 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:35:51.023 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:35:51.039 4088 3038365087176 GreenThread-131 DEBUG nova.compute.manager [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:35:51.039 4088 3038365087176 GreenThread-131 DEBUG nova.network.neutron [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:35:51.148 4088 3038365087176 GreenThread-131 DEBUG nova.policy [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '580888399edc4d7c97b4a1bce73db000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '351b14c1ba6b4a35aa1c79568c8e5c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:35:51.148 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:35:51.163 4088 3038365087352 MainThread INFO nova.virt.hyperv.vmops [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Spawning new instance 2021-09-10 17:35:51.179 4088 3038365087352 MainThread DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-0000008e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:35:51.179 4088 3038365087352 MainThread DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-0000008e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:35:51.179 4088 3038365087352 MainThread DEBUG nova.block_device [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:35:51.179 4088 3038365087352 MainThread DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:35:51.179 4088 3038365087352 MainThread DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:35:51.195 4088 3038365087352 MainThread DEBUG os_win.utils.pathutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Creating directory: C:\openstack\instances\instance-0000008e check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:35:51.195 4088 3038365087352 MainThread DEBUG nova.virt.hyperv.vmops [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000008e\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:35:51.429 4088 3038365087352 MainThread DEBUG nova.virt.hyperv.vmops [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Resizing VHD C:\openstack\instances\instance-0000008e\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:35:51.757 4088 3038365087176 GreenThread-131 DEBUG nova.network.neutron [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Successfully created port: 6123d59e-0e70-46a4-abdd-2621ab16ba1e _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:35:52.382 4088 3038365087176 GreenThread-131 DEBUG nova.network.neutron [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Successfully updated port: 6123d59e-0e70-46a4-abdd-2621ab16ba1e _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:35:52.398 4088 3038365087176 GreenThread-131 DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Acquired lock "refresh_cache-d96429b4-66c9-4d52-8c01-f9c377be61ff" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:35:52.398 4088 3038365087176 GreenThread-131 DEBUG nova.network.neutron [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:35:52.418 4088 3038365088056 MainThread DEBUG nova.compute.manager [req-8749b169-edf0-40aa-8c1d-2e6bdcf39a4a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Received event network-changed-6123d59e-0e70-46a4-abdd-2621ab16ba1e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:35:52.418 4088 3038365088056 MainThread DEBUG nova.compute.manager [req-8749b169-edf0-40aa-8c1d-2e6bdcf39a4a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Refreshing instance network info cache due to event network-changed-6123d59e-0e70-46a4-abdd-2621ab16ba1e. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:35:52.492 4088 3038365087176 GreenThread-131 DEBUG nova.network.neutron [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:35:52.819 4088 3038365087176 GreenThread-131 DEBUG nova.network.neutron [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Updating instance_info_cache with network_info: [{"id": "6123d59e-0e70-46a4-abdd-2621ab16ba1e", "address": "fa:16:3e:1c:99:79", "network": {"id": "a74f7a61-699f-45dd-8e25-3e73b17b8d87", "bridge": null, "label": "tempest-network-smoke--847854339", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "351b14c1ba6b4a35aa1c79568c8e5c30", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap6123d59e-0e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:35:52.828 4088 3038365087176 GreenThread-131 DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Releasing lock "refresh_cache-d96429b4-66c9-4d52-8c01-f9c377be61ff" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:35:52.828 4088 3038365087176 GreenThread-131 DEBUG nova.compute.manager [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Instance network_info: |[{"id": "6123d59e-0e70-46a4-abdd-2621ab16ba1e", "address": "fa:16:3e:1c:99:79", "network": {"id": "a74f7a61-699f-45dd-8e25-3e73b17b8d87", "bridge": null, "label": "tempest-network-smoke--847854339", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "351b14c1ba6b4a35aa1c79568c8e5c30", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap6123d59e-0e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:35:52.828 4088 3038365088056 MainThread DEBUG oslo_concurrency.lockutils [req-8749b169-edf0-40aa-8c1d-2e6bdcf39a4a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-d96429b4-66c9-4d52-8c01-f9c377be61ff" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:35:52.828 4088 3038365088056 MainThread DEBUG nova.network.neutron [req-8749b169-edf0-40aa-8c1d-2e6bdcf39a4a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Refreshing network info cache for port 6123d59e-0e70-46a4-abdd-2621ab16ba1e _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:35:52.828 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Preparing to wait for external event network-vif-plugged-6123d59e-0e70-46a4-abdd-2621ab16ba1e prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:35:52.828 4088 3038365087352 MainThread DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "d96429b4-66c9-4d52-8c01-f9c377be61ff-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:35:52.851 4088 3038365087352 MainThread DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "d96429b4-66c9-4d52-8c01-f9c377be61ff-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:35:52.851 4088 3038365087352 MainThread DEBUG os_win.utils.compute.vmutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Creating VM instance-0000008e create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:35:53.321 4088 3038365088056 MainThread DEBUG nova.network.neutron [req-8749b169-edf0-40aa-8c1d-2e6bdcf39a4a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Updated VIF entry in instance network info cache for port 6123d59e-0e70-46a4-abdd-2621ab16ba1e. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:35:53.321 4088 3038365088056 MainThread DEBUG nova.network.neutron [req-8749b169-edf0-40aa-8c1d-2e6bdcf39a4a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Updating instance_info_cache with network_info: [{"id": "6123d59e-0e70-46a4-abdd-2621ab16ba1e", "address": "fa:16:3e:1c:99:79", "network": {"id": "a74f7a61-699f-45dd-8e25-3e73b17b8d87", "bridge": null, "label": "tempest-network-smoke--847854339", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "351b14c1ba6b4a35aa1c79568c8e5c30", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap6123d59e-0e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:35:53.321 4088 3038365088056 MainThread DEBUG oslo_concurrency.lockutils [req-8749b169-edf0-40aa-8c1d-2e6bdcf39a4a 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-d96429b4-66c9-4d52-8c01-f9c377be61ff" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:35:54.509 4088 3038365087352 MainThread DEBUG nova.virt.hyperv.vmops [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:36:01.464 4088 3038365087176 MainThread DEBUG nova.compute.manager [req-84ea7e94-a20f-4f2d-a254-23ba3e740273 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Received event network-vif-plugged-6123d59e-0e70-46a4-abdd-2621ab16ba1e external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:36:01.464 4088 3038365087176 MainThread DEBUG oslo_concurrency.lockutils [req-84ea7e94-a20f-4f2d-a254-23ba3e740273 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d96429b4-66c9-4d52-8c01-f9c377be61ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:01.464 4088 3038365087176 MainThread DEBUG oslo_concurrency.lockutils [req-84ea7e94-a20f-4f2d-a254-23ba3e740273 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "d96429b4-66c9-4d52-8c01-f9c377be61ff-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:01.491 4088 3038365087176 MainThread DEBUG nova.compute.manager [req-84ea7e94-a20f-4f2d-a254-23ba3e740273 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Processing event network-vif-plugged-6123d59e-0e70-46a4-abdd-2621ab16ba1e _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:36:01.502 4088 3038365087352 MainThread INFO nova.virt.hyperv.vmops [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Using config drive for instance 2021-09-10 17:36:01.900 4088 3038365087352 MainThread INFO nova.virt.hyperv.vmops [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Creating config drive at C:\openstack\instances\instance-0000008e\configdrive.iso 2021-09-10 17:36:01.998 4088 3038365087352 MainThread DEBUG oslo_concurrency.processutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000008e\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp_kclc_qc execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:36:02.327 4088 3038365087352 MainThread DEBUG oslo_concurrency.processutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000008e\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp_kclc_qc" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:36:02.860 4088 3038365087352 MainThread DEBUG nova.virt.hyperv.vmops [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Setting boot order for instance: instance-0000008e: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:36:02.944 4088 3038365087352 MainThread DEBUG nova.virt.hyperv.vmops [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:36:02.978 4088 3038365087352 MainThread DEBUG os_win.utils.jobutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': 'F4D344AD-119B-44CC-A487-516A3E5EFFD6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14866), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:36:03.119 4088 3038365087352 MainThread ERROR os_win.utils.jobutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008e\' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)instance-0000008e966605D0-BA46-4D95-B675-BBFED750F5A012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)instance-0000008e966605D0-BA46-4D95-B675-BBFED750F5A010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)instance-0000008e966605D0-BA46-4D95-B675-BBFED750F5A0%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'F4D344AD-119B-44CC-A487-516A3E5EFFD6', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114103), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 36, 2), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 36, 3), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008e' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)\n\nNot enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)\n\n'instance-0000008e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)", 'ErrorSummaryDescription': "'instance-0000008e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:36:03.119 4088 3038365087352 MainThread DEBUG os_win._utils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008e' failed to start. Not enough memory in the system to start the virtual machine instance-0000008e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008e' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Not enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) 'instance-0000008e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.17518925666809082 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:36:03.139 4088 3038365087880 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:36:03.139 4088 3038365087880 MainThread INFO nova.compute.manager [-] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] VM Stopped (Lifecycle Event) 2021-09-10 17:36:03.139 4088 3038365087176 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:03.139 4088 3038365087176 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:03.163 4088 3038365087880 MainThread DEBUG nova.compute.manager [req-1448df17-1ac8-47df-9a36-9b0ce0446829 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:36:03.163 4088 3038365087880 MainThread DEBUG nova.virt.hyperv.vmops [req-1448df17-1ac8-47df-9a36-9b0ce0446829 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:36:03.213 4088 3038365087880 MainThread DEBUG nova.compute.manager [req-1448df17-1ac8-47df-9a36-9b0ce0446829 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:36:03.241 4088 3038365087880 MainThread INFO nova.compute.manager [req-1448df17-1ac8-47df-9a36-9b0ce0446829 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:36:04.143 4088 3038365087352 MainThread DEBUG os_win.utils.jobutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '4FA063E9-C9E3-473D-9BE4-2CF1359B5EA3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14716), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:36:04.275 4088 3038365087352 MainThread ERROR os_win.utils.jobutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008e\' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)instance-0000008e966605D0-BA46-4D95-B675-BBFED750F5A012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)instance-0000008e966605D0-BA46-4D95-B675-BBFED750F5A010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)instance-0000008e966605D0-BA46-4D95-B675-BBFED750F5A0%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '4FA063E9-C9E3-473D-9BE4-2CF1359B5EA3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112203), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 36, 4), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 36, 4), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008e' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)\n\nNot enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)\n\n'instance-0000008e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)", 'ErrorSummaryDescription': "'instance-0000008e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:36:04.275 4088 3038365087352 MainThread DEBUG os_win._utils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008e' failed to start. Not enough memory in the system to start the virtual machine instance-0000008e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008e' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Not enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) 'instance-0000008e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3310437202453613 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:36:04.307 4088 3038365087880 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:36:04.307 4088 3038365087880 MainThread INFO nova.compute.manager [-] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] VM Stopped (Lifecycle Event) 2021-09-10 17:36:04.307 4088 3038365087176 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:04.307 4088 3038365087176 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:04.345 4088 3038365087880 MainThread DEBUG nova.compute.manager [req-684567de-c2ef-41ac-acad-2ea745bcb79b - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:36:04.345 4088 3038365087880 MainThread DEBUG nova.virt.hyperv.vmops [req-684567de-c2ef-41ac-acad-2ea745bcb79b - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:36:04.388 4088 3038365087880 MainThread DEBUG nova.compute.manager [req-684567de-c2ef-41ac-acad-2ea745bcb79b - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:36:04.402 4088 3038365087880 MainThread INFO nova.compute.manager [req-684567de-c2ef-41ac-acad-2ea745bcb79b - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:36:05.292 4088 3038365087352 MainThread DEBUG os_win.utils.jobutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '9F60477A-ECE7-4C2D-907F-0EBD54D683EE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14691), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:36:05.441 4088 3038365087352 MainThread ERROR os_win.utils.jobutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008e\' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)instance-0000008e966605D0-BA46-4D95-B675-BBFED750F5A012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)instance-0000008e966605D0-BA46-4D95-B675-BBFED750F5A010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)instance-0000008e966605D0-BA46-4D95-B675-BBFED750F5A0%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '9F60477A-ECE7-4C2D-907F-0EBD54D683EE', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114969), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 36, 5), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 36, 5), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008e' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)\n\nNot enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)\n\n'instance-0000008e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)", 'ErrorSummaryDescription': "'instance-0000008e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:36:05.441 4088 3038365087352 MainThread DEBUG os_win._utils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008e' failed to start. Not enough memory in the system to start the virtual machine instance-0000008e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008e' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Not enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) 'instance-0000008e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.497105360031128 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:36:05.479 4088 3038365087880 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:36:05.479 4088 3038365087880 MainThread INFO nova.compute.manager [-] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] VM Stopped (Lifecycle Event) 2021-09-10 17:36:05.479 4088 3038365087176 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:05.479 4088 3038365087176 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:05.507 4088 3038365087880 MainThread DEBUG nova.compute.manager [req-5ffe04d5-0437-4410-86c6-b14b32d660d2 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:36:05.507 4088 3038365087880 MainThread DEBUG nova.virt.hyperv.vmops [req-5ffe04d5-0437-4410-86c6-b14b32d660d2 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:36:05.558 4088 3038365087880 MainThread DEBUG nova.compute.manager [req-5ffe04d5-0437-4410-86c6-b14b32d660d2 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:36:05.582 4088 3038365087880 MainThread INFO nova.compute.manager [req-5ffe04d5-0437-4410-86c6-b14b32d660d2 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:36:06.480 4088 3038365087352 MainThread DEBUG os_win.utils.jobutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '0B029D01-BA09-4758-A8D3-04A250A85DB7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=22605), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:36:06.632 4088 3038365087352 MainThread ERROR os_win.utils.jobutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008e\' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)instance-0000008e966605D0-BA46-4D95-B675-BBFED750F5A012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)instance-0000008e966605D0-BA46-4D95-B675-BBFED750F5A010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)instance-0000008e966605D0-BA46-4D95-B675-BBFED750F5A0%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '0B029D01-BA09-4758-A8D3-04A250A85DB7', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113956), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 36, 6), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 36, 6), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008e' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)\n\nNot enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)\n\n'instance-0000008e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)", 'ErrorSummaryDescription': "'instance-0000008e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:36:06.632 4088 3038365087352 MainThread DEBUG os_win._utils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008e' failed to start. Not enough memory in the system to start the virtual machine instance-0000008e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008e' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Not enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) 'instance-0000008e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.687431812286377 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:36:06.652 4088 3038365087880 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:36:06.652 4088 3038365087880 MainThread INFO nova.compute.manager [-] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] VM Stopped (Lifecycle Event) 2021-09-10 17:36:06.652 4088 3038365087176 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:06.652 4088 3038365087176 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:06.678 4088 3038365087880 MainThread DEBUG nova.compute.manager [req-c7597e66-53c4-472d-bc2f-747495cc5eb0 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:36:06.678 4088 3038365087880 MainThread DEBUG nova.virt.hyperv.vmops [req-c7597e66-53c4-472d-bc2f-747495cc5eb0 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:36:06.714 4088 3038365087880 MainThread DEBUG nova.compute.manager [req-c7597e66-53c4-472d-bc2f-747495cc5eb0 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:36:06.755 4088 3038365087880 MainThread INFO nova.compute.manager [req-c7597e66-53c4-472d-bc2f-747495cc5eb0 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:36:07.667 4088 3038365087352 MainThread DEBUG os_win.utils.jobutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '1A2255BF-9888-48B7-AC74-8898386A0015', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15592), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:36:07.805 4088 3038365087352 MainThread ERROR os_win.utils.jobutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008e\' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)instance-0000008e966605D0-BA46-4D95-B675-BBFED750F5A012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)instance-0000008e966605D0-BA46-4D95-B675-BBFED750F5A010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)instance-0000008e966605D0-BA46-4D95-B675-BBFED750F5A0%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1A2255BF-9888-48B7-AC74-8898386A0015', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113122), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 36, 7), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 36, 7), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008e' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)\n\nNot enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)\n\n'instance-0000008e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)", 'ErrorSummaryDescription': "'instance-0000008e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:36:07.805 4088 3038365087352 MainThread DEBUG os_win._utils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008e' failed to start. Not enough memory in the system to start the virtual machine instance-0000008e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008e' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Not enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) 'instance-0000008e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.860429286956787 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:36:07.851 4088 3038365087176 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:07.851 4088 3038365087176 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:07.851 4088 3038365087880 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:36:07.851 4088 3038365087880 MainThread INFO nova.compute.manager [-] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] VM Stopped (Lifecycle Event) 2021-09-10 17:36:07.851 4088 3038365087880 MainThread DEBUG nova.compute.manager [req-3795b973-1730-4ad9-940d-680d014635a2 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:36:07.851 4088 3038365087880 MainThread DEBUG nova.virt.hyperv.vmops [req-3795b973-1730-4ad9-940d-680d014635a2 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:36:07.928 4088 3038365087880 MainThread DEBUG nova.compute.manager [req-3795b973-1730-4ad9-940d-680d014635a2 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:36:07.940 4088 3038365087880 MainThread INFO nova.compute.manager [req-3795b973-1730-4ad9-940d-680d014635a2 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:36:08.820 4088 3038365087352 MainThread DEBUG os_win.utils.jobutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': 'BD0CDFF1-F98C-49D7-B40F-F601AFA4711C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16090), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:36:08.961 4088 3038365087352 MainThread ERROR os_win.utils.jobutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008e\' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)instance-0000008e966605D0-BA46-4D95-B675-BBFED750F5A012030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)instance-0000008e966605D0-BA46-4D95-B675-BBFED750F5A010243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008e\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)instance-0000008e966605D0-BA46-4D95-B675-BBFED750F5A0%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BD0CDFF1-F98C-49D7-B40F-F601AFA4711C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=117170), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 36, 8), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 36, 8), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008e' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)\n\nNot enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)\n\n'instance-0000008e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0)", 'ErrorSummaryDescription': "'instance-0000008e' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008e.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:36:08.961 4088 3038365087352 MainThread ERROR nova.virt.hyperv.vmops [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Failed to change vm state of instance-0000008e to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000008e' failed to start. 2021-09-10 17:36:08.961 4088 3038365087352 MainThread INFO nova.virt.hyperv.vmops [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Got request to destroy instance 2021-09-10 17:36:09.022 4088 3038365087880 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:36:09.022 4088 3038365087880 MainThread INFO nova.compute.manager [-] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] VM Stopped (Lifecycle Event) 2021-09-10 17:36:09.022 4088 3038365087176 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:09.022 4088 3038365087176 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:09.034 4088 3038365087880 MainThread DEBUG nova.compute.manager [req-7d6f14c0-22c5-4499-9eba-2fd7c91ef1f8 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:36:09.034 4088 3038365087880 MainThread DEBUG nova.virt.hyperv.vmops [req-7d6f14c0-22c5-4499-9eba-2fd7c91ef1f8 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:36:09.096 4088 3038365087880 MainThread DEBUG nova.compute.manager [req-7d6f14c0-22c5-4499-9eba-2fd7c91ef1f8 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:36:09.103 4088 3038365087880 MainThread INFO nova.compute.manager [req-7d6f14c0-22c5-4499-9eba-2fd7c91ef1f8 - - - - -] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:36:10.788 4088 3038365087352 MainThread DEBUG nova.virt.hyperv.vmops [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:36:10.788 4088 3038365087352 MainThread DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-0000008e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:10.788 4088 3038365087352 MainThread DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-0000008e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:10.819 4088 3038365087352 MainThread DEBUG os_win.utils.compute.vmutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Successfully changed vm state of instance-0000008e to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:36:10.824 4088 3038365087352 MainThread DEBUG nova.virt.hyperv.vmops [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Successfully changed state of VM instance-0000008e to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:36:10.866 4088 3038365087352 MainThread DEBUG os_win.utils.jobutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '9EE71386-349F-486A-8C29-B0ACF6224BF4', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=13987), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:36:11.090 4088 3038365087352 MainThread DEBUG os_win.utils.jobutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job succeeded: {'InstanceID': '9EE71386-349F-486A-8C29-B0ACF6224BF4', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=175571), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:36:11.090 4088 3038365087352 MainThread DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-0000008e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:11.090 4088 3038365087352 MainThread DEBUG os_win.utils.pathutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Removing directory: C:\openstack\instances\instance-0000008e check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:36:11.090 4088 3038365087352 MainThread DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-0000008e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:11.090 4088 3038365087352 MainThread ERROR nova.compute.manager [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008e' failed to start. Not enough memory in the system to start the virtual machine instance-0000008e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008e' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Not enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) 'instance-0000008e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Error code: 32778. 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Traceback (most recent call last): 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] return function(*args, **kwargs) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] admin_password, network_info, block_device_info) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] return function(self, *args, **kwds) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self.force_reraise() 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] raise self.value 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] should_plug_vifs=False) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 'req_state': req_state}) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self.force_reraise() 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] raise self.value 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] time.sleep(sleep_time) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self.force_reraise() 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] raise self.value 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] return f(*args, **kwargs) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] return self._wait_for_job(job_path) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] error_desc=err_desc) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000008e' failed to start. 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Not enough memory in the system to start the virtual machine instance-0000008e. 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008e' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Not enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 'instance-0000008e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Error code: 32778. 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] During handling of the above exception, another exception occurred: 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Traceback (most recent call last): 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] yield resources 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] accel_info=accel_info) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] return function(*args, **kwargs) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] admin_password, network_info, block_device_info) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] return function(self, *args, **kwds) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self.force_reraise() 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] raise self.value 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] should_plug_vifs=False) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 'req_state': req_state}) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self.force_reraise() 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] raise self.value 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] time.sleep(sleep_time) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self.force_reraise() 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] raise self.value 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] return f(*args, **kwargs) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] return self._wait_for_job(job_path) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] error_desc=err_desc) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008e' failed to start. 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Not enough memory in the system to start the virtual machine instance-0000008e. 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008e' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Not enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 'instance-0000008e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Error code: 32778. 2021-09-10 17:36:11.090 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.113 4088 3038365087352 MainThread INFO nova.compute.manager [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Terminating instance 2021-09-10 17:36:11.113 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:36:11.113 4088 3038365087352 MainThread INFO nova.virt.hyperv.vmops [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Got request to destroy instance 2021-09-10 17:36:11.121 4088 3038365087352 MainThread DEBUG nova.virt.hyperv.vmops [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:36:11.121 4088 3038365087352 MainThread DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-0000008e" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:11.121 4088 3038365087352 MainThread DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-0000008e" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:11.121 4088 3038365087352 MainThread INFO nova.compute.manager [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Took 0.00 seconds to destroy the instance on the hypervisor. 2021-09-10 17:36:11.121 4088 3038365087352 MainThread DEBUG nova.compute.claims [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:36:11.121 4088 3038365087352 MainThread DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:11.215 4088 3038365087352 MainThread DEBUG nova.virt.hyperv.hostops [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:36:11.230 4088 3038365087352 MainThread DEBUG nova.virt.hyperv.hostops [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:36:11.445 4088 3038365087352 MainThread DEBUG nova.compute.provider_tree [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:36:11.466 4088 3038365087352 MainThread DEBUG nova.scheduler.client.report [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:36:11.466 4088 3038365087352 MainThread DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.344s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:11.466 4088 3038365087352 MainThread ERROR nova.compute.manager [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008e' failed to start. Not enough memory in the system to start the virtual machine instance-0000008e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008e' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Not enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) 'instance-0000008e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Error code: 32778. 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Traceback (most recent call last): 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] return function(*args, **kwargs) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] admin_password, network_info, block_device_info) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] return function(self, *args, **kwds) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self.force_reraise() 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] raise self.value 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] should_plug_vifs=False) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 'req_state': req_state}) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self.force_reraise() 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] raise self.value 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] time.sleep(sleep_time) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self.force_reraise() 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] raise self.value 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] return f(*args, **kwargs) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] return self._wait_for_job(job_path) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] error_desc=err_desc) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000008e' failed to start. 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Not enough memory in the system to start the virtual machine instance-0000008e. 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008e' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Not enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 'instance-0000008e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Error code: 32778. 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] During handling of the above exception, another exception occurred: 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Traceback (most recent call last): 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] accel_info=accel_info) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] return function(*args, **kwargs) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] admin_password, network_info, block_device_info) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] return function(self, *args, **kwds) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self.force_reraise() 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] raise self.value 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] should_plug_vifs=False) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 'req_state': req_state}) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self.force_reraise() 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] raise self.value 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] time.sleep(sleep_time) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self.force_reraise() 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] raise self.value 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] return f(*args, **kwargs) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] return self._wait_for_job(job_path) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] error_desc=err_desc) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008e' failed to start. 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Not enough memory in the system to start the virtual machine instance-0000008e. 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008e' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Not enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 'instance-0000008e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Error code: 32778. 2021-09-10 17:36:11.466 4088 3038365087352 MainThread TRACE nova.compute.manager [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] 2021-09-10 17:36:11.466 4088 3038365087352 MainThread DEBUG nova.compute.utils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] WMI job failed with status 10. Error summary description: 'instance-0000008e' failed to start. Not enough memory in the system to start the virtual machine instance-0000008e. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:36:11.466 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Build of instance d96429b4-66c9-4d52-8c01-f9c377be61ff was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000008e' failed to start. Not enough memory in the system to start the virtual machine instance-0000008e. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008e' failed to start. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Not enough memory in the system to start the virtual machine instance-0000008e with ram size 1024 megabytes. (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) 'instance-0000008e' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 966605D0-BA46-4D95-B675-BBFED750F5A0) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:36:11.466 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:36:11.466 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:36:11.466 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:36:11.466 4088 3038365087352 MainThread DEBUG nova.network.neutron [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:36:11.935 4088 3038365087352 MainThread DEBUG nova.network.neutron [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:36:11.960 4088 3038365087352 MainThread INFO nova.compute.manager [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: d96429b4-66c9-4d52-8c01-f9c377be61ff] Took 0.50 seconds to deallocate network for instance. 2021-09-10 17:36:12.108 4088 3038365087352 MainThread INFO nova.scheduler.client.report [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Deleted allocations for instance d96429b4-66c9-4d52-8c01-f9c377be61ff 2021-09-10 17:36:12.139 4088 3038365087352 MainThread DEBUG oslo_concurrency.lockutils [req-1c126ff5-518e-4dc6-b2b3-073483c62c5c 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "d96429b4-66c9-4d52-8c01-f9c377be61ff" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 21.625s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:13.491 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:36:14.459 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:36:14.459 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:36:15.464 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:36:16.465 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:36:16.465 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:36:18.463 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:36:18.463 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:18.463 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:18.463 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:36:18.463 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:36:18.494 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:36:18.680 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2220MB free_disk=49GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:36:18.680 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:18.841 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:36:18.841 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:36:18.864 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:36:18.864 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:36:18.864 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:36:18.864 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:36:18.864 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:36:18.864 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:36:18.864 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:36:18.864 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:36:18.864 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:36:18.864 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:36:18.872 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:36:18.872 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:36:18.872 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:36:18.889 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:36:18.907 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:36:19.131 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:36:19.131 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:36:19.131 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:36:19.147 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:20.147 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:36:20.459 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:36:20.459 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:36:20.459 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9342 2021-09-10 17:36:20.538 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-18930e09-cd62-4d3e-b27f-e9541dfa3efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:36:20.538 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:36:20.538 4088 3038296676664 GreenThread-2 DEBUG nova.objects.instance [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lazy-loading 'info_cache' on Instance uuid 18930e09-cd62-4d3e-b27f-e9541dfa3efc obj_load_attr c:\openstack\build\nova\nova\objects\instance.py:1101 2021-09-10 17:36:21.185 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Updating instance_info_cache with network_info: [{"id": "829c891f-1877-4967-a719-113170bb7add", "address": "fa:16:3e:5d:ef:74", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap829c891f-18", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:36:21.209 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-18930e09-cd62-4d3e-b27f-e9541dfa3efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:36:21.209 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:36:23.459 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:36:40.724 4088 3038365087528 MainThread DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "749d3e34-a2bc-4962-a645-dbcbfc91b72f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:40.746 4088 3038365087528 MainThread DEBUG nova.compute.manager [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:36:40.844 4088 3038365087528 MainThread DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:40.844 4088 3038365087528 MainThread DEBUG nova.virt.hardware [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:36:40.844 4088 3038365087528 MainThread INFO nova.compute.claims [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Claim successful on node n-h2-808474-1 2021-09-10 17:36:40.944 4088 3038365087528 MainThread DEBUG nova.virt.hyperv.hostops [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:36:40.962 4088 3038365087528 MainThread DEBUG nova.virt.hyperv.hostops [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:36:41.162 4088 3038365087528 MainThread DEBUG nova.compute.provider_tree [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:36:41.177 4088 3038365087528 MainThread DEBUG nova.scheduler.client.report [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:36:41.177 4088 3038365087528 MainThread DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:41.177 4088 3038365087528 MainThread DEBUG nova.compute.manager [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:36:41.232 4088 3038365087528 MainThread DEBUG nova.compute.manager [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:36:41.232 4088 3038365087352 GreenThread-132 DEBUG nova.compute.manager [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:36:41.248 4088 3038365087352 GreenThread-132 DEBUG nova.network.neutron [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:36:41.351 4088 3038365087528 MainThread DEBUG nova.compute.manager [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:36:41.351 4088 3038365087352 GreenThread-132 DEBUG nova.policy [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '580888399edc4d7c97b4a1bce73db000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '351b14c1ba6b4a35aa1c79568c8e5c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:36:41.351 4088 3038365087528 MainThread INFO nova.virt.hyperv.vmops [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Spawning new instance 2021-09-10 17:36:41.351 4088 3038365087528 MainThread DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-0000008f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:41.351 4088 3038365087528 MainThread DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-0000008f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:41.351 4088 3038365087528 MainThread DEBUG nova.block_device [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:36:41.380 4088 3038365087528 MainThread DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:41.380 4088 3038365087528 MainThread DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:41.388 4088 3038365087528 MainThread DEBUG os_win.utils.pathutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Creating directory: C:\openstack\instances\instance-0000008f check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:36:41.388 4088 3038365087528 MainThread DEBUG nova.virt.hyperv.vmops [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-0000008f\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:36:41.618 4088 3038365087528 MainThread DEBUG nova.virt.hyperv.vmops [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Resizing VHD C:\openstack\instances\instance-0000008f\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:36:41.943 4088 3038365087352 GreenThread-132 DEBUG nova.network.neutron [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Successfully created port: fb430264-b3f5-4692-99d1-137ce953a0b5 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:36:42.560 4088 3038365087352 GreenThread-132 DEBUG nova.network.neutron [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Successfully updated port: fb430264-b3f5-4692-99d1-137ce953a0b5 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:36:42.573 4088 3038365087352 GreenThread-132 DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Acquired lock "refresh_cache-749d3e34-a2bc-4962-a645-dbcbfc91b72f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:36:42.573 4088 3038365087352 GreenThread-132 DEBUG nova.network.neutron [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:36:42.630 4088 3038365089112 MainThread DEBUG nova.compute.manager [req-e0b014b4-5191-42c6-91ab-cf3f942c8bd3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Received event network-changed-fb430264-b3f5-4692-99d1-137ce953a0b5 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:36:42.630 4088 3038365089112 MainThread DEBUG nova.compute.manager [req-e0b014b4-5191-42c6-91ab-cf3f942c8bd3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Refreshing instance network info cache due to event network-changed-fb430264-b3f5-4692-99d1-137ce953a0b5. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:36:42.654 4088 3038365087352 GreenThread-132 DEBUG nova.network.neutron [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:36:42.998 4088 3038365087352 GreenThread-132 DEBUG nova.network.neutron [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Updating instance_info_cache with network_info: [{"id": "fb430264-b3f5-4692-99d1-137ce953a0b5", "address": "fa:16:3e:65:aa:7a", "network": {"id": "6ca31cfc-0c60-4a2d-896c-cbb85a27e909", "bridge": null, "label": "tempest-network-smoke--450514377", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "351b14c1ba6b4a35aa1c79568c8e5c30", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfb430264-b3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:36:43.013 4088 3038365087352 GreenThread-132 DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Releasing lock "refresh_cache-749d3e34-a2bc-4962-a645-dbcbfc91b72f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:36:43.013 4088 3038365087352 GreenThread-132 DEBUG nova.compute.manager [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Instance network_info: |[{"id": "fb430264-b3f5-4692-99d1-137ce953a0b5", "address": "fa:16:3e:65:aa:7a", "network": {"id": "6ca31cfc-0c60-4a2d-896c-cbb85a27e909", "bridge": null, "label": "tempest-network-smoke--450514377", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "351b14c1ba6b4a35aa1c79568c8e5c30", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfb430264-b3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:36:43.013 4088 3038365089112 MainThread DEBUG oslo_concurrency.lockutils [req-e0b014b4-5191-42c6-91ab-cf3f942c8bd3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-749d3e34-a2bc-4962-a645-dbcbfc91b72f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:36:43.013 4088 3038365089112 MainThread DEBUG nova.network.neutron [req-e0b014b4-5191-42c6-91ab-cf3f942c8bd3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Refreshing network info cache for port fb430264-b3f5-4692-99d1-137ce953a0b5 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:36:43.013 4088 3038365087528 MainThread DEBUG nova.compute.manager [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Preparing to wait for external event network-vif-plugged-fb430264-b3f5-4692-99d1-137ce953a0b5 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:36:43.013 4088 3038365087528 MainThread DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "749d3e34-a2bc-4962-a645-dbcbfc91b72f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:43.013 4088 3038365087528 MainThread DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "749d3e34-a2bc-4962-a645-dbcbfc91b72f-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:43.013 4088 3038365087528 MainThread DEBUG os_win.utils.compute.vmutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Creating VM instance-0000008f create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:36:43.763 4088 3038365089112 MainThread DEBUG nova.network.neutron [req-e0b014b4-5191-42c6-91ab-cf3f942c8bd3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Updated VIF entry in instance network info cache for port fb430264-b3f5-4692-99d1-137ce953a0b5. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:36:43.763 4088 3038365089112 MainThread DEBUG nova.network.neutron [req-e0b014b4-5191-42c6-91ab-cf3f942c8bd3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Updating instance_info_cache with network_info: [{"id": "fb430264-b3f5-4692-99d1-137ce953a0b5", "address": "fa:16:3e:65:aa:7a", "network": {"id": "6ca31cfc-0c60-4a2d-896c-cbb85a27e909", "bridge": null, "label": "tempest-network-smoke--450514377", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "351b14c1ba6b4a35aa1c79568c8e5c30", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfb430264-b3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:36:43.786 4088 3038365089112 MainThread DEBUG oslo_concurrency.lockutils [req-e0b014b4-5191-42c6-91ab-cf3f942c8bd3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-749d3e34-a2bc-4962-a645-dbcbfc91b72f" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:36:44.710 4088 3038365087528 MainThread DEBUG nova.virt.hyperv.vmops [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:36:51.692 4088 3038365088760 MainThread DEBUG nova.compute.manager [req-0c70a586-9f49-4e78-9e84-1db1e138fe35 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Received event network-vif-plugged-fb430264-b3f5-4692-99d1-137ce953a0b5 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:36:51.692 4088 3038365088760 MainThread DEBUG oslo_concurrency.lockutils [req-0c70a586-9f49-4e78-9e84-1db1e138fe35 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "749d3e34-a2bc-4962-a645-dbcbfc91b72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:51.692 4088 3038365088760 MainThread DEBUG oslo_concurrency.lockutils [req-0c70a586-9f49-4e78-9e84-1db1e138fe35 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "749d3e34-a2bc-4962-a645-dbcbfc91b72f-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:51.692 4088 3038365088760 MainThread DEBUG nova.compute.manager [req-0c70a586-9f49-4e78-9e84-1db1e138fe35 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Processing event network-vif-plugged-fb430264-b3f5-4692-99d1-137ce953a0b5 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:36:51.716 4088 3038365087528 MainThread INFO nova.virt.hyperv.vmops [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Using config drive for instance 2021-09-10 17:36:51.823 4088 3038365087528 MainThread INFO nova.virt.hyperv.vmops [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Creating config drive at C:\openstack\instances\instance-0000008f\configdrive.iso 2021-09-10 17:36:51.918 4088 3038365087528 MainThread DEBUG oslo_concurrency.processutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000008f\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp7oapqh4g execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:36:52.264 4088 3038365087528 MainThread DEBUG oslo_concurrency.processutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-0000008f\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp7oapqh4g" returned: 0 in 0.344s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:36:52.758 4088 3038365087528 MainThread DEBUG nova.virt.hyperv.vmops [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Setting boot order for instance: instance-0000008f: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:36:52.849 4088 3038365087528 MainThread DEBUG nova.virt.hyperv.vmops [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:36:52.881 4088 3038365087528 MainThread DEBUG os_win.utils.jobutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '1B68D813-B765-4441-9FED-EB3FD04231F2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14638), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:36:53.026 4088 3038365087528 MainThread ERROR os_win.utils.jobutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008f\' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)instance-0000008fC7F81D5D-F591-4611-AA9F-720631E5DA3112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)instance-0000008fC7F81D5D-F591-4611-AA9F-720631E5DA3110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)instance-0000008fC7F81D5D-F591-4611-AA9F-720631E5DA31%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1B68D813-B765-4441-9FED-EB3FD04231F2', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119512), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 36, 52), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 36, 52), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008f' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)\n\nNot enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)\n\n'instance-0000008f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)", 'ErrorSummaryDescription': "'instance-0000008f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:36:53.026 4088 3038365087528 MainThread DEBUG os_win._utils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008f' failed to start. Not enough memory in the system to start the virtual machine instance-0000008f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008f' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Not enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) 'instance-0000008f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1768484115600586 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:36:53.052 4088 3038365088760 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:53.052 4088 3038365088760 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:53.052 4088 3038365087352 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:36:53.052 4088 3038365087352 MainThread INFO nova.compute.manager [-] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] VM Stopped (Lifecycle Event) 2021-09-10 17:36:53.056 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-938f9daa-1d99-43d4-a102-18ceb1195c4e - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:36:53.056 4088 3038365087352 MainThread DEBUG nova.virt.hyperv.vmops [req-938f9daa-1d99-43d4-a102-18ceb1195c4e - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:36:53.113 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-938f9daa-1d99-43d4-a102-18ceb1195c4e - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:36:53.131 4088 3038365087352 MainThread INFO nova.compute.manager [req-938f9daa-1d99-43d4-a102-18ceb1195c4e - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:36:54.055 4088 3038365087528 MainThread DEBUG os_win.utils.jobutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': 'D5D9ED00-97BF-46F7-AFB1-18AB9D867D9A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16480), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:36:54.200 4088 3038365087528 MainThread ERROR os_win.utils.jobutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008f\' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)instance-0000008fC7F81D5D-F591-4611-AA9F-720631E5DA3112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)instance-0000008fC7F81D5D-F591-4611-AA9F-720631E5DA3110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)instance-0000008fC7F81D5D-F591-4611-AA9F-720631E5DA31%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D5D9ED00-97BF-46F7-AFB1-18AB9D867D9A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114775), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 36, 54), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 36, 54), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008f' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)\n\nNot enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)\n\n'instance-0000008f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)", 'ErrorSummaryDescription': "'instance-0000008f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:36:54.200 4088 3038365087528 MainThread DEBUG os_win._utils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008f' failed to start. Not enough memory in the system to start the virtual machine instance-0000008f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008f' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Not enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) 'instance-0000008f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3510615825653076 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:36:54.215 4088 3038365087352 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:36:54.215 4088 3038365087352 MainThread INFO nova.compute.manager [-] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] VM Stopped (Lifecycle Event) 2021-09-10 17:36:54.215 4088 3038365088760 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:54.239 4088 3038365088760 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.031s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:54.247 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-afe6cdd1-d259-45dc-a3e8-505a19663d39 - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:36:54.247 4088 3038365087352 MainThread DEBUG nova.virt.hyperv.vmops [req-afe6cdd1-d259-45dc-a3e8-505a19663d39 - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:36:54.294 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-afe6cdd1-d259-45dc-a3e8-505a19663d39 - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:36:54.303 4088 3038365087352 MainThread INFO nova.compute.manager [req-afe6cdd1-d259-45dc-a3e8-505a19663d39 - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:36:55.239 4088 3038365087528 MainThread DEBUG os_win.utils.jobutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': 'CCDAC53E-FFAE-406C-AF52-8ABBF0E4C23D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15575), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:36:55.386 4088 3038365087528 MainThread ERROR os_win.utils.jobutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008f\' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)instance-0000008fC7F81D5D-F591-4611-AA9F-720631E5DA3112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)instance-0000008fC7F81D5D-F591-4611-AA9F-720631E5DA3110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)instance-0000008fC7F81D5D-F591-4611-AA9F-720631E5DA31%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'CCDAC53E-FFAE-406C-AF52-8ABBF0E4C23D', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113896), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 36, 55), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 36, 55), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008f' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)\n\nNot enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)\n\n'instance-0000008f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)", 'ErrorSummaryDescription': "'instance-0000008f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:36:55.386 4088 3038365087528 MainThread DEBUG os_win._utils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008f' failed to start. Not enough memory in the system to start the virtual machine instance-0000008f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008f' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Not enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) 'instance-0000008f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.536818027496338 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:36:55.419 4088 3038365087352 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:36:55.419 4088 3038365087352 MainThread INFO nova.compute.manager [-] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] VM Stopped (Lifecycle Event) 2021-09-10 17:36:55.419 4088 3038365088760 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:55.419 4088 3038365088760 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:55.442 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-4c31b15c-1003-4d3a-91ba-6194fad13764 - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:36:55.442 4088 3038365087352 MainThread DEBUG nova.virt.hyperv.vmops [req-4c31b15c-1003-4d3a-91ba-6194fad13764 - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:36:55.481 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-4c31b15c-1003-4d3a-91ba-6194fad13764 - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:36:55.520 4088 3038365087352 MainThread INFO nova.compute.manager [req-4c31b15c-1003-4d3a-91ba-6194fad13764 - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:36:56.398 4088 3038365087528 MainThread DEBUG os_win.utils.jobutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '25885E89-A0B1-4295-9E8D-FD7AD5C131F1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15585), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:36:56.556 4088 3038365087528 MainThread ERROR os_win.utils.jobutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008f\' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)instance-0000008fC7F81D5D-F591-4611-AA9F-720631E5DA3112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)instance-0000008fC7F81D5D-F591-4611-AA9F-720631E5DA3110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)instance-0000008fC7F81D5D-F591-4611-AA9F-720631E5DA31%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '25885E89-A0B1-4295-9E8D-FD7AD5C131F1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114272), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 36, 56), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 36, 56), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008f' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)\n\nNot enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)\n\n'instance-0000008f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)", 'ErrorSummaryDescription': "'instance-0000008f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:36:56.556 4088 3038365087528 MainThread DEBUG os_win._utils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008f' failed to start. Not enough memory in the system to start the virtual machine instance-0000008f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008f' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Not enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) 'instance-0000008f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.7072203159332275 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:36:56.556 4088 3038365088760 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:56.556 4088 3038365088760 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:56.556 4088 3038365087352 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:36:56.556 4088 3038365087352 MainThread INFO nova.compute.manager [-] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] VM Stopped (Lifecycle Event) 2021-09-10 17:36:56.591 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-63ad1f30-8937-4cd8-993c-90143b8f775f - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:36:56.591 4088 3038365087352 MainThread DEBUG nova.virt.hyperv.vmops [req-63ad1f30-8937-4cd8-993c-90143b8f775f - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:36:56.645 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-63ad1f30-8937-4cd8-993c-90143b8f775f - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:36:56.661 4088 3038365087352 MainThread INFO nova.compute.manager [req-63ad1f30-8937-4cd8-993c-90143b8f775f - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:36:57.583 4088 3038365087528 MainThread DEBUG os_win.utils.jobutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '2B48CEC4-1C3C-4008-AFD9-E0623FE28794', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14450), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:36:57.731 4088 3038365087528 MainThread ERROR os_win.utils.jobutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008f\' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)instance-0000008fC7F81D5D-F591-4611-AA9F-720631E5DA3112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)instance-0000008fC7F81D5D-F591-4611-AA9F-720631E5DA3110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)instance-0000008fC7F81D5D-F591-4611-AA9F-720631E5DA31%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '2B48CEC4-1C3C-4008-AFD9-E0623FE28794', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111917), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 36, 57), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 36, 57), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008f' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)\n\nNot enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)\n\n'instance-0000008f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)", 'ErrorSummaryDescription': "'instance-0000008f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:36:57.731 4088 3038365087528 MainThread DEBUG os_win._utils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-0000008f' failed to start. Not enough memory in the system to start the virtual machine instance-0000008f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008f' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Not enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) 'instance-0000008f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.882343530654907 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:36:57.766 4088 3038365088760 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:57.766 4088 3038365088760 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:57.766 4088 3038365087352 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:36:57.766 4088 3038365087352 MainThread INFO nova.compute.manager [-] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] VM Stopped (Lifecycle Event) 2021-09-10 17:36:57.778 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-022ab28b-d21d-40dd-b060-b55fd07e7de7 - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:36:57.794 4088 3038365087352 MainThread DEBUG nova.virt.hyperv.vmops [req-022ab28b-d21d-40dd-b060-b55fd07e7de7 - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:36:57.834 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-022ab28b-d21d-40dd-b060-b55fd07e7de7 - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:36:57.856 4088 3038365087352 MainThread INFO nova.compute.manager [req-022ab28b-d21d-40dd-b060-b55fd07e7de7 - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:36:58.764 4088 3038365087528 MainThread DEBUG os_win.utils.jobutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '537DBBCD-6421-4BD7-A287-5E17DB011D9A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15952), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:36:58.911 4088 3038365087528 MainThread ERROR os_win.utils.jobutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-0000008f\' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)instance-0000008fC7F81D5D-F591-4611-AA9F-720631E5DA3112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)instance-0000008fC7F81D5D-F591-4611-AA9F-720631E5DA3110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-0000008f\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)instance-0000008fC7F81D5D-F591-4611-AA9F-720631E5DA31%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '537DBBCD-6421-4BD7-A287-5E17DB011D9A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113803), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 36, 58), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 36, 58), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-0000008f' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)\n\nNot enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)\n\n'instance-0000008f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31)", 'ErrorSummaryDescription': "'instance-0000008f' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-0000008f.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:36:58.911 4088 3038365087528 MainThread ERROR nova.virt.hyperv.vmops [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Failed to change vm state of instance-0000008f to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000008f' failed to start. 2021-09-10 17:36:58.911 4088 3038365087528 MainThread INFO nova.virt.hyperv.vmops [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Got request to destroy instance 2021-09-10 17:36:58.934 4088 3038365087352 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:36:58.934 4088 3038365087352 MainThread INFO nova.compute.manager [-] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] VM Stopped (Lifecycle Event) 2021-09-10 17:36:58.934 4088 3038365088760 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:36:58.934 4088 3038365088760 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-0000008f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:36:58.954 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-a4f54158-ea5a-4254-8694-999a3dd6da5b - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:36:58.954 4088 3038365087352 MainThread DEBUG nova.virt.hyperv.vmops [req-a4f54158-ea5a-4254-8694-999a3dd6da5b - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:36:59.013 4088 3038365087352 MainThread DEBUG nova.compute.manager [req-a4f54158-ea5a-4254-8694-999a3dd6da5b - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:36:59.036 4088 3038365087352 MainThread INFO nova.compute.manager [req-a4f54158-ea5a-4254-8694-999a3dd6da5b - - - - -] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:37:00.856 4088 3038365087528 MainThread DEBUG nova.virt.hyperv.vmops [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:37:00.856 4088 3038365087528 MainThread DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-0000008f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:00.856 4088 3038365087528 MainThread DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-0000008f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:00.888 4088 3038365087528 MainThread DEBUG os_win.utils.compute.vmutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Successfully changed vm state of instance-0000008f to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:37:00.888 4088 3038365087528 MainThread DEBUG nova.virt.hyperv.vmops [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Successfully changed state of VM instance-0000008f to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:37:00.918 4088 3038365087528 MainThread DEBUG os_win.utils.jobutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': 'EA70201D-006B-4EF9-9731-3D79C2C7DA46', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=13771), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:37:01.021 4088 3038365087528 MainThread DEBUG os_win.utils.jobutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job succeeded: {'InstanceID': 'EA70201D-006B-4EF9-9731-3D79C2C7DA46', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=111990), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:37:01.021 4088 3038365087528 MainThread DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-0000008f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:01.021 4088 3038365087528 MainThread DEBUG os_win.utils.pathutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Removing directory: C:\openstack\instances\instance-0000008f check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:37:01.021 4088 3038365087528 MainThread DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-0000008f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:01.021 4088 3038365087528 MainThread ERROR nova.compute.manager [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008f' failed to start. Not enough memory in the system to start the virtual machine instance-0000008f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008f' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Not enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) 'instance-0000008f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Error code: 32778. 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Traceback (most recent call last): 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] return function(*args, **kwargs) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] admin_password, network_info, block_device_info) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] return function(self, *args, **kwds) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self.force_reraise() 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] raise self.value 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] should_plug_vifs=False) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 'req_state': req_state}) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self.force_reraise() 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] raise self.value 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] time.sleep(sleep_time) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self.force_reraise() 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] raise self.value 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] return f(*args, **kwargs) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] return self._wait_for_job(job_path) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] error_desc=err_desc) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000008f' failed to start. 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Not enough memory in the system to start the virtual machine instance-0000008f. 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008f' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Not enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 'instance-0000008f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Error code: 32778. 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] During handling of the above exception, another exception occurred: 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Traceback (most recent call last): 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] yield resources 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] accel_info=accel_info) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] return function(*args, **kwargs) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] admin_password, network_info, block_device_info) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] return function(self, *args, **kwds) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self.force_reraise() 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] raise self.value 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] should_plug_vifs=False) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 'req_state': req_state}) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self.force_reraise() 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] raise self.value 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] time.sleep(sleep_time) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self.force_reraise() 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] raise self.value 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] return f(*args, **kwargs) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] return self._wait_for_job(job_path) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] error_desc=err_desc) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008f' failed to start. 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Not enough memory in the system to start the virtual machine instance-0000008f. 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008f' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Not enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 'instance-0000008f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Error code: 32778. 2021-09-10 17:37:01.021 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.021 4088 3038365087528 MainThread INFO nova.compute.manager [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Terminating instance 2021-09-10 17:37:01.021 4088 3038365087528 MainThread DEBUG nova.compute.manager [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:37:01.021 4088 3038365087528 MainThread INFO nova.virt.hyperv.vmops [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Got request to destroy instance 2021-09-10 17:37:01.054 4088 3038365087528 MainThread DEBUG nova.virt.hyperv.vmops [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:37:01.054 4088 3038365087528 MainThread DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-0000008f" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:01.054 4088 3038365087528 MainThread DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-0000008f" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:01.054 4088 3038365087528 MainThread INFO nova.compute.manager [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:37:01.054 4088 3038365087528 MainThread DEBUG nova.compute.claims [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:37:01.054 4088 3038365087528 MainThread DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:01.145 4088 3038365087528 MainThread DEBUG nova.virt.hyperv.hostops [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:37:01.173 4088 3038365087528 MainThread DEBUG nova.virt.hyperv.hostops [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:37:01.374 4088 3038365087528 MainThread DEBUG nova.compute.provider_tree [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:37:01.387 4088 3038365087528 MainThread DEBUG nova.scheduler.client.report [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:37:01.387 4088 3038365087528 MainThread DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.329s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:01.387 4088 3038365087528 MainThread ERROR nova.compute.manager [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008f' failed to start. Not enough memory in the system to start the virtual machine instance-0000008f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008f' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Not enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) 'instance-0000008f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Error code: 32778. 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Traceback (most recent call last): 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] return function(*args, **kwargs) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] admin_password, network_info, block_device_info) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] return function(self, *args, **kwds) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self.force_reraise() 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] raise self.value 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] should_plug_vifs=False) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 'req_state': req_state}) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self.force_reraise() 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] raise self.value 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] time.sleep(sleep_time) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self.force_reraise() 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] raise self.value 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] return f(*args, **kwargs) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] return self._wait_for_job(job_path) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] error_desc=err_desc) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-0000008f' failed to start. 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Not enough memory in the system to start the virtual machine instance-0000008f. 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008f' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Not enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 'instance-0000008f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Error code: 32778. 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] During handling of the above exception, another exception occurred: 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Traceback (most recent call last): 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] accel_info=accel_info) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] return function(*args, **kwargs) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] admin_password, network_info, block_device_info) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] return function(self, *args, **kwds) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self.force_reraise() 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] raise self.value 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] should_plug_vifs=False) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 'req_state': req_state}) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self.force_reraise() 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] raise self.value 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] time.sleep(sleep_time) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self.force_reraise() 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] raise self.value 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] return f(*args, **kwargs) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] return self._wait_for_job(job_path) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] error_desc=err_desc) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-0000008f' failed to start. 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Not enough memory in the system to start the virtual machine instance-0000008f. 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008f' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Not enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 'instance-0000008f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Error code: 32778. 2021-09-10 17:37:01.387 4088 3038365087528 MainThread TRACE nova.compute.manager [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] 2021-09-10 17:37:01.387 4088 3038365087528 MainThread DEBUG nova.compute.utils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] WMI job failed with status 10. Error summary description: 'instance-0000008f' failed to start. Not enough memory in the system to start the virtual machine instance-0000008f. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:37:01.387 4088 3038365087528 MainThread DEBUG nova.compute.manager [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Build of instance 749d3e34-a2bc-4962-a645-dbcbfc91b72f was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-0000008f' failed to start. Not enough memory in the system to start the virtual machine instance-0000008f. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-0000008f' failed to start. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Not enough memory in the system to start the virtual machine instance-0000008f with ram size 1024 megabytes. (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) 'instance-0000008f' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID C7F81D5D-F591-4611-AA9F-720631E5DA31) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:37:01.387 4088 3038365087528 MainThread DEBUG nova.compute.manager [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:37:01.387 4088 3038365087528 MainThread DEBUG nova.compute.manager [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:37:01.402 4088 3038365087528 MainThread DEBUG nova.compute.manager [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:37:01.402 4088 3038365087528 MainThread DEBUG nova.network.neutron [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:37:01.879 4088 3038365087528 MainThread DEBUG nova.network.neutron [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:37:01.895 4088 3038365087528 MainThread INFO nova.compute.manager [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 749d3e34-a2bc-4962-a645-dbcbfc91b72f] Took 0.50 seconds to deallocate network for instance. 2021-09-10 17:37:02.028 4088 3038365087528 MainThread INFO nova.scheduler.client.report [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Deleted allocations for instance 749d3e34-a2bc-4962-a645-dbcbfc91b72f 2021-09-10 17:37:02.055 4088 3038365087528 MainThread DEBUG oslo_concurrency.lockutils [req-7437064c-c2b9-41c3-8587-4fb423d4398f 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "749d3e34-a2bc-4962-a645-dbcbfc91b72f" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 21.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:13.473 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:37:14.466 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:37:15.473 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:37:16.462 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:37:17.452 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:37:17.452 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:37:19.455 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:37:19.490 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:37:20.457 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:37:20.472 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:20.472 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:20.472 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:37:20.472 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:37:20.498 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:37:20.707 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2225MB free_disk=49GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:37:20.707 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:20.894 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:37:20.894 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:37:20.894 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:37:20.894 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:37:20.894 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:37:20.894 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:37:20.894 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:37:20.894 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:37:20.894 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:37:20.894 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:37:20.894 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:37:20.894 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:37:20.894 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:37:20.894 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:37:20.894 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:37:20.958 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing inventories for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:757 2021-09-10 17:37:20.989 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Updating ProviderTree inventory for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 from _refresh_and_get_inventory using data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} _refresh_and_get_inventory c:\openstack\build\nova\nova\scheduler\client\report.py:723 2021-09-10 17:37:20.989 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Updating inventory in ProviderTree for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 with inventory: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:176 2021-09-10 17:37:21.026 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing aggregate associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, aggregates: None _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:766 2021-09-10 17:37:21.066 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing trait associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_VHD,COMPUTE_IMAGE_TYPE_VHDX,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:778 2021-09-10 17:37:21.066 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:37:21.082 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:37:21.296 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:37:21.296 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:37:21.296 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:37:21.296 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:22.535 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:37:22.535 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:37:22.608 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:37:22.608 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:37:23.104 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Updating instance_info_cache with network_info: [{"id": "e94d3f34-4aa5-46a2-9cf3-221c28446067", "address": "fa:16:3e:bd:9b:a0", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape94d3f34-4a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:37:23.118 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:37:23.118 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:37:23.118 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_power_states run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:37:23.187 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 18930e09-cd62-4d3e-b27f-e9541dfa3efc _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:37:23.187 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:37:23.187 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 66c5445c-c347-4833-8af8-58ba8ff6d95e _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:37:23.187 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:37:23.187 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9db39d70-5120-4de4-bb87-480a6efb8a3a _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:37:23.187 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 0e77fafa-3f8a-4513-bb64-518c77e99029 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:37:23.187 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 50586591-86ba-41be-b4e1-5004ea0d76dd _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:37:23.187 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 98da4c02-e4db-4a02-a807-c737f9038672 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:37:23.187 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 359fd482-69f5-4194-9466-f46ea31258d3 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:37:23.187 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 6a33a253-c7b1-44b1-bdc0-eca64733ab55 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:37:23.187 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 592bb39a-81cb-43f8-a643-b04092bd9e8a _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:37:23.202 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9446e666-4364-4dcd-b041-405653a856bd _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:37:23.202 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9bb2d354-2d76-40ea-8b9c-b18a21edefbb _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:37:23.202 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:23.202 4088 3038338906600 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:23.202 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:23.202 4088 3038338907832 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:23.202 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:23.202 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:23.202 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:23.202 4088 3038338905368 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:23.202 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:23.202 4088 3038338907480 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:23.211 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:23.211 4088 3038342255192 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:23.211 4088 3038342257128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:23.211 4088 3038342257128 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:23.211 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "98da4c02-e4db-4a02-a807-c737f9038672" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:23.211 4088 3038338907128 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:23.211 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:23.211 4088 3038338906952 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:23.211 4088 3038338905016 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:23.211 4088 3038338905016 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:23.211 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "359fd482-69f5-4194-9466-f46ea31258d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:23.211 4088 3038342255896 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:23.211 4088 3038342257656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9446e666-4364-4dcd-b041-405653a856bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:23.211 4088 3038342257656 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 9446e666-4364-4dcd-b041-405653a856bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:23.211 4088 3038342256776 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:23.211 4088 3038342256776 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:23.363 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.156s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:23.363 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.156s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:23.368 4088 3038342255192 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.156s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:23.368 4088 3038338907128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "98da4c02-e4db-4a02-a807-c737f9038672" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.156s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:23.368 4088 3038338906600 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.156s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:23.394 4088 3038338907832 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.187s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:23.394 4088 3038342257128 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.187s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:23.394 4088 3038338906952 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.187s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:23.409 4088 3038338905016 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.203s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:23.411 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "359fd482-69f5-4194-9466-f46ea31258d3" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.203s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:23.411 4088 3038338907480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.203s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:23.411 4088 3038342257656 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9446e666-4364-4dcd-b041-405653a856bd" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.203s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:23.411 4088 3038342256776 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.203s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:24.452 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:37:24.462 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_incomplete_migrations run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:37:24.462 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances with incomplete migration _cleanup_incomplete_migrations c:\openstack\build\nova\nova\compute\manager.py:10640 2021-09-10 17:37:26.468 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:37:30.800 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "0e545b2c-ea5d-4c5f-a9fd-35267850e2ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:30.818 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:37:30.894 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:30.905 4088 3038338908008 MainThread DEBUG nova.virt.hardware [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:37:30.905 4088 3038338908008 MainThread INFO nova.compute.claims [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Claim successful on node n-h2-808474-1 2021-09-10 17:37:31.003 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.hostops [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:37:31.021 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.hostops [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:37:31.216 4088 3038338908008 MainThread DEBUG nova.compute.provider_tree [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:37:31.238 4088 3038338908008 MainThread DEBUG nova.scheduler.client.report [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:37:31.238 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:31.238 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:37:31.288 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:37:31.288 4088 3038338905368 GreenThread-133 DEBUG nova.compute.manager [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:37:31.288 4088 3038338905368 GreenThread-133 DEBUG nova.network.neutron [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:37:31.409 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:37:31.425 4088 3038338905368 GreenThread-133 DEBUG nova.policy [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '580888399edc4d7c97b4a1bce73db000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '351b14c1ba6b4a35aa1c79568c8e5c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:37:31.440 4088 3038338908008 MainThread INFO nova.virt.hyperv.vmops [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Spawning new instance 2021-09-10 17:37:31.440 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000090" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:31.440 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000090" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:31.440 4088 3038338908008 MainThread DEBUG nova.block_device [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:37:31.440 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:31.440 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:31.456 4088 3038338908008 MainThread DEBUG os_win.utils.pathutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Creating directory: C:\openstack\instances\instance-00000090 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:37:31.456 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000090\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:37:31.690 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Resizing VHD C:\openstack\instances\instance-00000090\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:37:32.030 4088 3038338905368 GreenThread-133 DEBUG nova.network.neutron [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Successfully created port: 251fd929-d3e6-4392-aa36-e11454716c60 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:37:32.631 4088 3038338905368 GreenThread-133 DEBUG nova.network.neutron [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Successfully updated port: 251fd929-d3e6-4392-aa36-e11454716c60 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:37:32.644 4088 3038338905368 GreenThread-133 DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Acquired lock "refresh_cache-0e545b2c-ea5d-4c5f-a9fd-35267850e2ae" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:37:32.644 4088 3038338905368 GreenThread-133 DEBUG nova.network.neutron [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:37:32.702 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-a0b45487-61b5-4d00-bb8c-663d1a51fa74 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Received event network-changed-251fd929-d3e6-4392-aa36-e11454716c60 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:37:32.702 4088 3038342255896 MainThread DEBUG nova.compute.manager [req-a0b45487-61b5-4d00-bb8c-663d1a51fa74 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Refreshing instance network info cache due to event network-changed-251fd929-d3e6-4392-aa36-e11454716c60. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:37:32.724 4088 3038338905368 GreenThread-133 DEBUG nova.network.neutron [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:37:33.066 4088 3038338905368 GreenThread-133 DEBUG nova.network.neutron [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Updating instance_info_cache with network_info: [{"id": "251fd929-d3e6-4392-aa36-e11454716c60", "address": "fa:16:3e:15:7a:5c", "network": {"id": "46a10a17-af3d-45de-99a2-250cdcb041b2", "bridge": null, "label": "tempest-network-smoke--396985115", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "351b14c1ba6b4a35aa1c79568c8e5c30", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap251fd929-d3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:37:33.099 4088 3038338905368 GreenThread-133 DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Releasing lock "refresh_cache-0e545b2c-ea5d-4c5f-a9fd-35267850e2ae" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:37:33.099 4088 3038338905368 GreenThread-133 DEBUG nova.compute.manager [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Instance network_info: |[{"id": "251fd929-d3e6-4392-aa36-e11454716c60", "address": "fa:16:3e:15:7a:5c", "network": {"id": "46a10a17-af3d-45de-99a2-250cdcb041b2", "bridge": null, "label": "tempest-network-smoke--396985115", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "351b14c1ba6b4a35aa1c79568c8e5c30", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap251fd929-d3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:37:33.099 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Preparing to wait for external event network-vif-plugged-251fd929-d3e6-4392-aa36-e11454716c60 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:37:33.099 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "0e545b2c-ea5d-4c5f-a9fd-35267850e2ae-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:33.099 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "0e545b2c-ea5d-4c5f-a9fd-35267850e2ae-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:33.099 4088 3038338908008 MainThread DEBUG os_win.utils.compute.vmutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Creating VM instance-00000090 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:37:33.099 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-a0b45487-61b5-4d00-bb8c-663d1a51fa74 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-0e545b2c-ea5d-4c5f-a9fd-35267850e2ae" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:37:33.099 4088 3038342255896 MainThread DEBUG nova.network.neutron [req-a0b45487-61b5-4d00-bb8c-663d1a51fa74 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Refreshing network info cache for port 251fd929-d3e6-4392-aa36-e11454716c60 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:37:33.593 4088 3038342255896 MainThread DEBUG nova.network.neutron [req-a0b45487-61b5-4d00-bb8c-663d1a51fa74 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Updated VIF entry in instance network info cache for port 251fd929-d3e6-4392-aa36-e11454716c60. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:37:33.593 4088 3038342255896 MainThread DEBUG nova.network.neutron [req-a0b45487-61b5-4d00-bb8c-663d1a51fa74 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Updating instance_info_cache with network_info: [{"id": "251fd929-d3e6-4392-aa36-e11454716c60", "address": "fa:16:3e:15:7a:5c", "network": {"id": "46a10a17-af3d-45de-99a2-250cdcb041b2", "bridge": null, "label": "tempest-network-smoke--396985115", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "351b14c1ba6b4a35aa1c79568c8e5c30", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap251fd929-d3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:37:33.608 4088 3038342255896 MainThread DEBUG oslo_concurrency.lockutils [req-a0b45487-61b5-4d00-bb8c-663d1a51fa74 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-0e545b2c-ea5d-4c5f-a9fd-35267850e2ae" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:37:34.898 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:37:37.722 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:37:39.909 4088 3038338906776 MainThread DEBUG nova.compute.manager [req-bc39157e-b2af-4463-9d37-4bbff3709682 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Received event network-vif-plugged-251fd929-d3e6-4392-aa36-e11454716c60 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:37:39.909 4088 3038338906776 MainThread DEBUG oslo_concurrency.lockutils [req-bc39157e-b2af-4463-9d37-4bbff3709682 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "0e545b2c-ea5d-4c5f-a9fd-35267850e2ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:39.909 4088 3038338906776 MainThread DEBUG oslo_concurrency.lockutils [req-bc39157e-b2af-4463-9d37-4bbff3709682 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "0e545b2c-ea5d-4c5f-a9fd-35267850e2ae-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:39.925 4088 3038338906776 MainThread DEBUG nova.compute.manager [req-bc39157e-b2af-4463-9d37-4bbff3709682 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Processing event network-vif-plugged-251fd929-d3e6-4392-aa36-e11454716c60 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:37:39.952 4088 3038338908008 MainThread INFO nova.virt.hyperv.vmops [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Using config drive for instance 2021-09-10 17:37:40.035 4088 3038338908008 MainThread INFO nova.virt.hyperv.vmops [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Creating config drive at C:\openstack\instances\instance-00000090\configdrive.iso 2021-09-10 17:37:40.138 4088 3038338908008 MainThread DEBUG oslo_concurrency.processutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000090\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpn5hxs5p7 execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:37:40.467 4088 3038338908008 MainThread DEBUG oslo_concurrency.processutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000090\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpn5hxs5p7" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:37:41.000 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Setting boot order for instance: instance-00000090: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:37:41.073 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:37:41.118 4088 3038338908008 MainThread DEBUG os_win.utils.jobutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '687C3E69-F855-425C-BA05-FE27F021D188', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19039), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:37:41.258 4088 3038338908008 MainThread ERROR os_win.utils.jobutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000090\' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)instance-00000090D2716C9A-C402-4CF7-A52A-84FC00E2628112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)instance-00000090D2716C9A-C402-4CF7-A52A-84FC00E2628110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000090\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)instance-00000090D2716C9A-C402-4CF7-A52A-84FC00E26281%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '687C3E69-F855-425C-BA05-FE27F021D188', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=121132), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 37, 41), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 37, 41), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000090' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)\n\nNot enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)\n\n'instance-00000090' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)", 'ErrorSummaryDescription': "'instance-00000090' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000090.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:37:41.258 4088 3038338908008 MainThread DEBUG os_win._utils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000090' failed to start. Not enough memory in the system to start the virtual machine instance-00000090. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000090' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Not enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) 'instance-00000090' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18437957763671875 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:37:41.297 4088 3038338906776 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:37:41.297 4088 3038338906776 MainThread INFO nova.compute.manager [-] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] VM Stopped (Lifecycle Event) 2021-09-10 17:37:41.297 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000090" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:41.297 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000090" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:41.302 4088 3038338906776 MainThread DEBUG nova.compute.manager [req-e9114d9a-ba37-4999-9b16-3970328de62e - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:37:41.320 4088 3038338906776 MainThread DEBUG nova.virt.hyperv.vmops [req-e9114d9a-ba37-4999-9b16-3970328de62e - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:41.369 4088 3038338906776 MainThread DEBUG nova.compute.manager [req-e9114d9a-ba37-4999-9b16-3970328de62e - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:37:41.390 4088 3038338906776 MainThread INFO nova.compute.manager [req-e9114d9a-ba37-4999-9b16-3970328de62e - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:37:42.269 4088 3038338908008 MainThread DEBUG os_win.utils.jobutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '66D218F9-BC54-4D63-AA1C-B49EB4A9B937', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15564), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:37:42.400 4088 3038338908008 MainThread ERROR os_win.utils.jobutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000090\' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)instance-00000090D2716C9A-C402-4CF7-A52A-84FC00E2628112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)instance-00000090D2716C9A-C402-4CF7-A52A-84FC00E2628110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000090\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)instance-00000090D2716C9A-C402-4CF7-A52A-84FC00E26281%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '66D218F9-BC54-4D63-AA1C-B49EB4A9B937', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115328), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 37, 42), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 37, 42), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000090' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)\n\nNot enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)\n\n'instance-00000090' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)", 'ErrorSummaryDescription': "'instance-00000090' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000090.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:37:42.400 4088 3038338908008 MainThread DEBUG os_win._utils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000090' failed to start. Not enough memory in the system to start the virtual machine instance-00000090. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000090' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Not enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) 'instance-00000090' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.3263146877288818 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:37:42.456 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._run_pending_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:37:42.456 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10602 2021-09-10 17:37:42.456 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000090" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:42.456 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000090" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:42.472 4088 3038338906776 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:37:42.472 4088 3038338906776 MainThread INFO nova.compute.manager [-] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] VM Stopped (Lifecycle Event) 2021-09-10 17:37:42.472 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] There are 0 instances to clean _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10611 2021-09-10 17:37:42.472 4088 3038338906776 MainThread DEBUG nova.compute.manager [req-ffad9425-72d9-4d07-83ba-8afb3920101f - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:37:42.472 4088 3038338906776 MainThread DEBUG nova.virt.hyperv.vmops [req-ffad9425-72d9-4d07-83ba-8afb3920101f - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:42.519 4088 3038338906776 MainThread DEBUG nova.compute.manager [req-ffad9425-72d9-4d07-83ba-8afb3920101f - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:37:42.561 4088 3038338906776 MainThread INFO nova.compute.manager [req-ffad9425-72d9-4d07-83ba-8afb3920101f - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:37:43.419 4088 3038338908008 MainThread DEBUG os_win.utils.jobutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '01233B9B-A7CA-48A4-8712-4B51CFE4445E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14813), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:37:43.555 4088 3038338908008 MainThread ERROR os_win.utils.jobutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000090\' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)instance-00000090D2716C9A-C402-4CF7-A52A-84FC00E2628112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)instance-00000090D2716C9A-C402-4CF7-A52A-84FC00E2628110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000090\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)instance-00000090D2716C9A-C402-4CF7-A52A-84FC00E26281%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '01233B9B-A7CA-48A4-8712-4B51CFE4445E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115098), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 37, 43), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 37, 43), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000090' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)\n\nNot enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)\n\n'instance-00000090' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)", 'ErrorSummaryDescription': "'instance-00000090' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000090.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:37:43.555 4088 3038338908008 MainThread DEBUG os_win._utils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000090' failed to start. Not enough memory in the system to start the virtual machine instance-00000090. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000090' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Not enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) 'instance-00000090' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.481686592102051 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:37:43.598 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000090" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:43.598 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000090" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:43.598 4088 3038338906776 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:37:43.598 4088 3038338906776 MainThread INFO nova.compute.manager [-] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] VM Stopped (Lifecycle Event) 2021-09-10 17:37:43.628 4088 3038338906776 MainThread DEBUG nova.compute.manager [req-decc75c6-6f98-4791-954a-15e316eb74f8 - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:37:43.628 4088 3038338906776 MainThread DEBUG nova.virt.hyperv.vmops [req-decc75c6-6f98-4791-954a-15e316eb74f8 - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:43.669 4088 3038338906776 MainThread DEBUG nova.compute.manager [req-decc75c6-6f98-4791-954a-15e316eb74f8 - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:37:43.687 4088 3038338906776 MainThread INFO nova.compute.manager [req-decc75c6-6f98-4791-954a-15e316eb74f8 - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:37:44.567 4088 3038338908008 MainThread DEBUG os_win.utils.jobutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '686A5B98-11AB-4587-AEA9-38A5369FAD34', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=17099), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:37:44.722 4088 3038338908008 MainThread ERROR os_win.utils.jobutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000090\' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)instance-00000090D2716C9A-C402-4CF7-A52A-84FC00E2628112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)instance-00000090D2716C9A-C402-4CF7-A52A-84FC00E2628110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000090\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)instance-00000090D2716C9A-C402-4CF7-A52A-84FC00E26281%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '686A5B98-11AB-4587-AEA9-38A5369FAD34', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112981), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 37, 44), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 37, 44), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000090' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)\n\nNot enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)\n\n'instance-00000090' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)", 'ErrorSummaryDescription': "'instance-00000090' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000090.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:37:44.722 4088 3038338908008 MainThread DEBUG os_win._utils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000090' failed to start. Not enough memory in the system to start the virtual machine instance-00000090. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000090' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Not enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) 'instance-00000090' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.648374557495117 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:37:44.739 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000090" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:44.739 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000090" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:44.739 4088 3038338906776 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:37:44.739 4088 3038338906776 MainThread INFO nova.compute.manager [-] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] VM Stopped (Lifecycle Event) 2021-09-10 17:37:44.765 4088 3038338906776 MainThread DEBUG nova.compute.manager [req-83fa6136-fc62-4a25-a32d-af64019bc1ce - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:37:44.765 4088 3038338906776 MainThread DEBUG nova.virt.hyperv.vmops [req-83fa6136-fc62-4a25-a32d-af64019bc1ce - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:44.800 4088 3038338906776 MainThread DEBUG nova.compute.manager [req-83fa6136-fc62-4a25-a32d-af64019bc1ce - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:37:44.847 4088 3038338906776 MainThread INFO nova.compute.manager [req-83fa6136-fc62-4a25-a32d-af64019bc1ce - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:37:45.739 4088 3038338908008 MainThread DEBUG os_win.utils.jobutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '17C4BAFC-2254-4E83-A301-078725D511EA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16183), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:37:45.868 4088 3038338908008 MainThread ERROR os_win.utils.jobutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000090\' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)instance-00000090D2716C9A-C402-4CF7-A52A-84FC00E2628112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)instance-00000090D2716C9A-C402-4CF7-A52A-84FC00E2628110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000090\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)instance-00000090D2716C9A-C402-4CF7-A52A-84FC00E26281%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '17C4BAFC-2254-4E83-A301-078725D511EA', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111994), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 37, 45), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 37, 45), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000090' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)\n\nNot enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)\n\n'instance-00000090' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)", 'ErrorSummaryDescription': "'instance-00000090' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000090.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:37:45.868 4088 3038338908008 MainThread DEBUG os_win._utils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000090' failed to start. Not enough memory in the system to start the virtual machine instance-00000090. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000090' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Not enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) 'instance-00000090' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.794726610183716 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:37:45.930 4088 3038338906776 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:37:45.930 4088 3038338906776 MainThread INFO nova.compute.manager [-] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] VM Stopped (Lifecycle Event) 2021-09-10 17:37:45.930 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000090" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:45.930 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000090" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:45.950 4088 3038338906776 MainThread DEBUG nova.compute.manager [req-db050f10-795d-4730-a953-dfb881a54afe - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:37:45.950 4088 3038338906776 MainThread DEBUG nova.virt.hyperv.vmops [req-db050f10-795d-4730-a953-dfb881a54afe - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:45.991 4088 3038338906776 MainThread DEBUG nova.compute.manager [req-db050f10-795d-4730-a953-dfb881a54afe - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:37:46.015 4088 3038338906776 MainThread INFO nova.compute.manager [req-db050f10-795d-4730-a953-dfb881a54afe - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:37:46.933 4088 3038338908008 MainThread DEBUG os_win.utils.jobutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '255BF668-FCB2-4699-8792-8B7EFE1455A5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14590), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:37:47.051 4088 3038338908008 MainThread ERROR os_win.utils.jobutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000090\' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)instance-00000090D2716C9A-C402-4CF7-A52A-84FC00E2628112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)instance-00000090D2716C9A-C402-4CF7-A52A-84FC00E2628110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000090\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)instance-00000090D2716C9A-C402-4CF7-A52A-84FC00E26281%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '255BF668-FCB2-4699-8792-8B7EFE1455A5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116038), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 37, 46), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 37, 47), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000090' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)\n\nNot enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)\n\n'instance-00000090' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281)", 'ErrorSummaryDescription': "'instance-00000090' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000090.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:37:47.051 4088 3038338908008 MainThread ERROR nova.virt.hyperv.vmops [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Failed to change vm state of instance-00000090 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000090' failed to start. 2021-09-10 17:37:47.051 4088 3038338908008 MainThread INFO nova.virt.hyperv.vmops [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Got request to destroy instance 2021-09-10 17:37:47.103 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000090" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:47.103 4088 3038338905368 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000090" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:47.103 4088 3038338906776 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:37:47.103 4088 3038338906776 MainThread INFO nova.compute.manager [-] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] VM Stopped (Lifecycle Event) 2021-09-10 17:37:47.128 4088 3038338906776 MainThread DEBUG nova.compute.manager [req-18f3f9ef-540d-485f-ace7-eebbb4f76566 - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:37:47.128 4088 3038338906776 MainThread DEBUG nova.virt.hyperv.vmops [req-18f3f9ef-540d-485f-ace7-eebbb4f76566 - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:37:47.180 4088 3038338906776 MainThread DEBUG nova.compute.manager [req-18f3f9ef-540d-485f-ace7-eebbb4f76566 - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:37:47.200 4088 3038338906776 MainThread INFO nova.compute.manager [req-18f3f9ef-540d-485f-ace7-eebbb4f76566 - - - - -] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:37:48.878 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:37:48.878 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000090" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:48.878 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000090" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:48.890 4088 3038338908008 MainThread DEBUG os_win.utils.compute.vmutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Successfully changed vm state of instance-00000090 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:37:48.890 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Successfully changed state of VM instance-00000090 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:37:48.940 4088 3038338908008 MainThread DEBUG os_win.utils.jobutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': 'C3AC9920-4F20-4AA1-926F-F2E95B20A2EE', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14880), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:37:49.061 4088 3038338908008 MainThread DEBUG os_win.utils.jobutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job succeeded: {'InstanceID': 'C3AC9920-4F20-4AA1-926F-F2E95B20A2EE', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=109219), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:37:49.061 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000090" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:49.061 4088 3038338908008 MainThread DEBUG os_win.utils.pathutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Removing directory: C:\openstack\instances\instance-00000090 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:37:49.081 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000090" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:49.081 4088 3038338908008 MainThread ERROR nova.compute.manager [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000090' failed to start. Not enough memory in the system to start the virtual machine instance-00000090. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000090' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Not enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) 'instance-00000090' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Error code: 32778. 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Traceback (most recent call last): 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] return function(*args, **kwargs) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] admin_password, network_info, block_device_info) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] return function(self, *args, **kwds) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self.force_reraise() 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] raise self.value 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] should_plug_vifs=False) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 'req_state': req_state}) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self.force_reraise() 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] raise self.value 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] time.sleep(sleep_time) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self.force_reraise() 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] raise self.value 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] return f(*args, **kwargs) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] return self._wait_for_job(job_path) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] error_desc=err_desc) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000090' failed to start. 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Not enough memory in the system to start the virtual machine instance-00000090. 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000090' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Not enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 'instance-00000090' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Error code: 32778. 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] During handling of the above exception, another exception occurred: 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Traceback (most recent call last): 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] yield resources 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] accel_info=accel_info) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] return function(*args, **kwargs) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] admin_password, network_info, block_device_info) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] return function(self, *args, **kwds) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self.force_reraise() 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] raise self.value 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] should_plug_vifs=False) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 'req_state': req_state}) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self.force_reraise() 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] raise self.value 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] time.sleep(sleep_time) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self.force_reraise() 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] raise self.value 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] return f(*args, **kwargs) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] return self._wait_for_job(job_path) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] error_desc=err_desc) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000090' failed to start. 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Not enough memory in the system to start the virtual machine instance-00000090. 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000090' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Not enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 'instance-00000090' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Error code: 32778. 2021-09-10 17:37:49.081 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.081 4088 3038338908008 MainThread INFO nova.compute.manager [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Terminating instance 2021-09-10 17:37:49.081 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:37:49.081 4088 3038338908008 MainThread INFO nova.virt.hyperv.vmops [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Got request to destroy instance 2021-09-10 17:37:49.093 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.vmops [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:37:49.112 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000090" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:49.112 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000090" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:49.112 4088 3038338908008 MainThread INFO nova.compute.manager [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:37:49.112 4088 3038338908008 MainThread DEBUG nova.compute.claims [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:37:49.112 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:37:49.177 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.hostops [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:37:49.207 4088 3038338908008 MainThread DEBUG nova.virt.hyperv.hostops [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:37:49.425 4088 3038338908008 MainThread DEBUG nova.compute.provider_tree [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:37:49.425 4088 3038338908008 MainThread DEBUG nova.scheduler.client.report [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:37:49.442 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:37:49.442 4088 3038338908008 MainThread ERROR nova.compute.manager [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000090' failed to start. Not enough memory in the system to start the virtual machine instance-00000090. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000090' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Not enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) 'instance-00000090' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Error code: 32778. 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Traceback (most recent call last): 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] return function(*args, **kwargs) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] admin_password, network_info, block_device_info) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] return function(self, *args, **kwds) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self.force_reraise() 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] raise self.value 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] should_plug_vifs=False) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 'req_state': req_state}) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self.force_reraise() 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] raise self.value 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] time.sleep(sleep_time) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self.force_reraise() 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] raise self.value 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] return f(*args, **kwargs) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] return self._wait_for_job(job_path) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] error_desc=err_desc) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000090' failed to start. 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Not enough memory in the system to start the virtual machine instance-00000090. 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000090' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Not enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 'instance-00000090' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Error code: 32778. 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] During handling of the above exception, another exception occurred: 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Traceback (most recent call last): 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] accel_info=accel_info) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] return function(*args, **kwargs) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] admin_password, network_info, block_device_info) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] return function(self, *args, **kwds) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self.force_reraise() 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] raise self.value 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] should_plug_vifs=False) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 'req_state': req_state}) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self.force_reraise() 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] raise self.value 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] time.sleep(sleep_time) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self.force_reraise() 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] raise self.value 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] return f(*args, **kwargs) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] return self._wait_for_job(job_path) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] error_desc=err_desc) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000090' failed to start. 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Not enough memory in the system to start the virtual machine instance-00000090. 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000090' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Not enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 'instance-00000090' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Error code: 32778. 2021-09-10 17:37:49.442 4088 3038338908008 MainThread TRACE nova.compute.manager [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] 2021-09-10 17:37:49.442 4088 3038338908008 MainThread DEBUG nova.compute.utils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] WMI job failed with status 10. Error summary description: 'instance-00000090' failed to start. Not enough memory in the system to start the virtual machine instance-00000090. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:37:49.442 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Build of instance 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000090' failed to start. Not enough memory in the system to start the virtual machine instance-00000090. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000090' failed to start. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Not enough memory in the system to start the virtual machine instance-00000090 with ram size 1024 megabytes. (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) 'instance-00000090' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID D2716C9A-C402-4CF7-A52A-84FC00E26281) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:37:49.442 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:37:49.442 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:37:49.442 4088 3038338908008 MainThread DEBUG nova.compute.manager [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:37:49.442 4088 3038338908008 MainThread DEBUG nova.network.neutron [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:37:49.922 4088 3038338908008 MainThread DEBUG nova.network.neutron [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:37:49.929 4088 3038338908008 MainThread INFO nova.compute.manager [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae] Took 0.48 seconds to deallocate network for instance. 2021-09-10 17:37:50.068 4088 3038338908008 MainThread INFO nova.scheduler.client.report [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Deleted allocations for instance 0e545b2c-ea5d-4c5f-a9fd-35267850e2ae 2021-09-10 17:37:50.109 4088 3038338908008 MainThread DEBUG oslo_concurrency.lockutils [req-ed9a90b6-b473-4cd2-8ca0-bb172ef43b94 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "0e545b2c-ea5d-4c5f-a9fd-35267850e2ae" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.313s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:38:15.486 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:38:15.486 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:38:17.466 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:38:17.466 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:38:17.466 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:38:17.466 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:38:19.083 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "607bf05f-387c-4106-872a-1b453d094222" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:38:19.083 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:38:19.174 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:38:19.174 4088 3038296623592 MainThread DEBUG nova.virt.hardware [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:38:19.174 4088 3038296623592 MainThread INFO nova.compute.claims [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Claim successful on node n-h2-808474-1 2021-09-10 17:38:19.280 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.hostops [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:38:19.291 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.hostops [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:38:19.507 4088 3038296623592 MainThread DEBUG nova.compute.provider_tree [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:38:19.507 4088 3038296623592 MainThread DEBUG nova.scheduler.client.report [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:38:19.507 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:38:19.507 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:38:19.572 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:38:19.595 4088 3038296677544 GreenThread-134 DEBUG nova.compute.manager [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:38:19.595 4088 3038296677544 GreenThread-134 DEBUG nova.network.neutron [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:38:19.701 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:38:19.701 4088 3038296677544 GreenThread-134 DEBUG nova.policy [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '580888399edc4d7c97b4a1bce73db000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '351b14c1ba6b4a35aa1c79568c8e5c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:38:19.720 4088 3038296623592 MainThread INFO nova.virt.hyperv.vmops [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Spawning new instance 2021-09-10 17:38:19.724 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000091" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:38:19.724 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000091" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:38:19.724 4088 3038296623592 MainThread DEBUG nova.block_device [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:38:19.724 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:38:19.724 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:38:19.724 4088 3038296623592 MainThread DEBUG os_win.utils.pathutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Creating directory: C:\openstack\instances\instance-00000091 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:38:19.724 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000091\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:38:19.960 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Resizing VHD C:\openstack\instances\instance-00000091\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:38:20.284 4088 3038296677544 GreenThread-134 DEBUG nova.network.neutron [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Successfully created port: b9d14c19-0860-4b11-9a4b-1c13dc285397 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:38:20.453 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:38:20.453 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:38:20.468 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:38:20.468 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:38:20.468 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:38:20.468 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:38:20.484 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:38:20.696 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2221MB free_disk=49GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:38:20.696 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:38:20.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:38:20.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:38:20.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:38:20.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:38:20.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:38:20.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:38:20.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:38:20.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:38:20.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:38:20.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:38:20.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:38:20.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:38:20.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:38:20.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 607bf05f-387c-4106-872a-1b453d094222 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:38:20.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:38:20.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=14GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:38:20.892 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:38:20.906 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:38:20.906 4088 3038296677544 GreenThread-134 DEBUG nova.network.neutron [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Successfully updated port: b9d14c19-0860-4b11-9a4b-1c13dc285397 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:38:20.923 4088 3038296677544 GreenThread-134 DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Acquired lock "refresh_cache-607bf05f-387c-4106-872a-1b453d094222" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:38:20.923 4088 3038296677544 GreenThread-134 DEBUG nova.network.neutron [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:38:20.953 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-52854b77-b137-43ec-b948-b04e60a0e570 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Received event network-changed-b9d14c19-0860-4b11-9a4b-1c13dc285397 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:38:20.953 4088 3038342146888 MainThread DEBUG nova.compute.manager [req-52854b77-b137-43ec-b948-b04e60a0e570 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Refreshing instance network info cache due to event network-changed-b9d14c19-0860-4b11-9a4b-1c13dc285397. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:38:21.124 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:38:21.140 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:38:21.140 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:38:21.140 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:38:21.298 4088 3038296677544 GreenThread-134 DEBUG nova.network.neutron [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:38:21.612 4088 3038296677544 GreenThread-134 DEBUG nova.network.neutron [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Updating instance_info_cache with network_info: [{"id": "b9d14c19-0860-4b11-9a4b-1c13dc285397", "address": "fa:16:3e:de:7e:06", "network": {"id": "8ff1723c-2a3d-4249-8dcc-dd7eb3de6601", "bridge": null, "label": "tempest-network-smoke--1013058763", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "351b14c1ba6b4a35aa1c79568c8e5c30", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapb9d14c19-08", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:38:21.642 4088 3038296677544 GreenThread-134 DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Releasing lock "refresh_cache-607bf05f-387c-4106-872a-1b453d094222" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:38:21.642 4088 3038296677544 GreenThread-134 DEBUG nova.compute.manager [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Instance network_info: |[{"id": "b9d14c19-0860-4b11-9a4b-1c13dc285397", "address": "fa:16:3e:de:7e:06", "network": {"id": "8ff1723c-2a3d-4249-8dcc-dd7eb3de6601", "bridge": null, "label": "tempest-network-smoke--1013058763", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "351b14c1ba6b4a35aa1c79568c8e5c30", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapb9d14c19-08", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:38:21.642 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Preparing to wait for external event network-vif-plugged-b9d14c19-0860-4b11-9a4b-1c13dc285397 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:38:21.642 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "607bf05f-387c-4106-872a-1b453d094222-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:38:21.642 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "607bf05f-387c-4106-872a-1b453d094222-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:38:21.642 4088 3038296623592 MainThread DEBUG os_win.utils.compute.vmutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Creating VM instance-00000091 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:38:21.642 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-52854b77-b137-43ec-b948-b04e60a0e570 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-607bf05f-387c-4106-872a-1b453d094222" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:38:21.642 4088 3038342146888 MainThread DEBUG nova.network.neutron [req-52854b77-b137-43ec-b948-b04e60a0e570 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Refreshing network info cache for port b9d14c19-0860-4b11-9a4b-1c13dc285397 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:38:22.111 4088 3038342146888 MainThread DEBUG nova.network.neutron [req-52854b77-b137-43ec-b948-b04e60a0e570 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Updated VIF entry in instance network info cache for port b9d14c19-0860-4b11-9a4b-1c13dc285397. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:38:22.111 4088 3038342146888 MainThread DEBUG nova.network.neutron [req-52854b77-b137-43ec-b948-b04e60a0e570 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Updating instance_info_cache with network_info: [{"id": "b9d14c19-0860-4b11-9a4b-1c13dc285397", "address": "fa:16:3e:de:7e:06", "network": {"id": "8ff1723c-2a3d-4249-8dcc-dd7eb3de6601", "bridge": null, "label": "tempest-network-smoke--1013058763", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "351b14c1ba6b4a35aa1c79568c8e5c30", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapb9d14c19-08", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:38:22.111 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [req-52854b77-b137-43ec-b948-b04e60a0e570 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-607bf05f-387c-4106-872a-1b453d094222" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:38:23.156 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:38:23.156 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:38:23.233 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-66c5445c-c347-4833-8af8-58ba8ff6d95e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:38:23.233 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:38:23.361 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:38:23.736 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Updating instance_info_cache with network_info: [{"id": "fecb5a04-48f6-4c8b-bb0f-748b812daefa", "address": "fa:16:3e:2d:da:04", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfecb5a04-48", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:38:23.752 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-66c5445c-c347-4833-8af8-58ba8ff6d95e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:38:23.752 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:38:24.454 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:38:28.157 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-c3a6d208-59bf-4942-bc77-1f7ded8616e7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Received event network-vif-plugged-b9d14c19-0860-4b11-9a4b-1c13dc285397 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:38:28.157 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-c3a6d208-59bf-4942-bc77-1f7ded8616e7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "607bf05f-387c-4106-872a-1b453d094222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:38:28.157 4088 3038296677544 MainThread DEBUG oslo_concurrency.lockutils [req-c3a6d208-59bf-4942-bc77-1f7ded8616e7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "607bf05f-387c-4106-872a-1b453d094222-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:38:28.157 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-c3a6d208-59bf-4942-bc77-1f7ded8616e7 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Processing event network-vif-plugged-b9d14c19-0860-4b11-9a4b-1c13dc285397 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:38:28.219 4088 3038296623592 MainThread INFO nova.virt.hyperv.vmops [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Using config drive for instance 2021-09-10 17:38:28.303 4088 3038296623592 MainThread INFO nova.virt.hyperv.vmops [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Creating config drive at C:\openstack\instances\instance-00000091\configdrive.iso 2021-09-10 17:38:28.407 4088 3038296623592 MainThread DEBUG oslo_concurrency.processutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000091\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpoytkso4k execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:38:28.729 4088 3038296623592 MainThread DEBUG oslo_concurrency.processutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000091\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpoytkso4k" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:38:29.235 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Setting boot order for instance: instance-00000091: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:38:29.305 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:38:29.345 4088 3038296623592 MainThread DEBUG os_win.utils.jobutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '06F8C5C1-A669-48A9-ACA7-2A3E26B50CCB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14858), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:38:29.489 4088 3038296623592 MainThread ERROR os_win.utils.jobutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000091\' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)instance-000000916DFFC521-3A92-4EAD-B666-54DB0CAD446612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)instance-000000916DFFC521-3A92-4EAD-B666-54DB0CAD446610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000091\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)instance-000000916DFFC521-3A92-4EAD-B666-54DB0CAD4466%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '06F8C5C1-A669-48A9-ACA7-2A3E26B50CCB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114331), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 38, 29), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 38, 29), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000091' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)\n\nNot enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)\n\n'instance-00000091' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)", 'ErrorSummaryDescription': "'instance-00000091' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000091.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:38:29.489 4088 3038296623592 MainThread DEBUG os_win._utils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000091' failed to start. Not enough memory in the system to start the virtual machine instance-00000091. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000091' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Not enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) 'instance-00000091' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.18404889106750488 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:38:29.525 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000091" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:38:29.525 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000091" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:38:29.525 4088 3038296677544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:38:29.525 4088 3038296677544 MainThread INFO nova.compute.manager [-] [instance: 607bf05f-387c-4106-872a-1b453d094222] VM Stopped (Lifecycle Event) 2021-09-10 17:38:29.556 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-c61b468e-632b-44fd-86d8-5b6b08fa9a0f - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:38:29.556 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-c61b468e-632b-44fd-86d8-5b6b08fa9a0f - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:38:29.595 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-c61b468e-632b-44fd-86d8-5b6b08fa9a0f - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:38:29.630 4088 3038296677544 MainThread INFO nova.compute.manager [req-c61b468e-632b-44fd-86d8-5b6b08fa9a0f - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:38:30.505 4088 3038296623592 MainThread DEBUG os_win.utils.jobutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': 'BC1E0E65-EA0E-4E5D-8BD5-10851647C3CB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15381), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:38:30.650 4088 3038296623592 MainThread ERROR os_win.utils.jobutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000091\' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)instance-000000916DFFC521-3A92-4EAD-B666-54DB0CAD446612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)instance-000000916DFFC521-3A92-4EAD-B666-54DB0CAD446610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000091\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)instance-000000916DFFC521-3A92-4EAD-B666-54DB0CAD4466%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BC1E0E65-EA0E-4E5D-8BD5-10851647C3CB', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113150), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 38, 30), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 38, 30), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000091' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)\n\nNot enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)\n\n'instance-00000091' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)", 'ErrorSummaryDescription': "'instance-00000091' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000091.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:38:30.650 4088 3038296623592 MainThread DEBUG os_win._utils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000091' failed to start. Not enough memory in the system to start the virtual machine instance-00000091. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000091' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Not enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) 'instance-00000091' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.34490966796875 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:38:30.680 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000091" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:38:30.680 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000091" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:38:30.680 4088 3038296677544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:38:30.680 4088 3038296677544 MainThread INFO nova.compute.manager [-] [instance: 607bf05f-387c-4106-872a-1b453d094222] VM Stopped (Lifecycle Event) 2021-09-10 17:38:30.704 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-6cd8aef7-f427-42db-817c-b2879eff13e4 - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:38:30.704 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-6cd8aef7-f427-42db-817c-b2879eff13e4 - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:38:30.751 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-6cd8aef7-f427-42db-817c-b2879eff13e4 - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:38:30.783 4088 3038296677544 MainThread INFO nova.compute.manager [req-6cd8aef7-f427-42db-817c-b2879eff13e4 - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:38:31.670 4088 3038296623592 MainThread DEBUG os_win.utils.jobutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': 'C8EE516D-73BD-4D39-A166-D3E7489339C4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15073), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:38:31.806 4088 3038296623592 MainThread ERROR os_win.utils.jobutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000091\' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)instance-000000916DFFC521-3A92-4EAD-B666-54DB0CAD446612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)instance-000000916DFFC521-3A92-4EAD-B666-54DB0CAD446610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000091\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)instance-000000916DFFC521-3A92-4EAD-B666-54DB0CAD4466%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C8EE516D-73BD-4D39-A166-D3E7489339C4', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111854), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 38, 31), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 38, 31), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000091' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)\n\nNot enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)\n\n'instance-00000091' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)", 'ErrorSummaryDescription': "'instance-00000091' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000091.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:38:31.806 4088 3038296623592 MainThread DEBUG os_win._utils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000091' failed to start. Not enough memory in the system to start the virtual machine instance-00000091. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000091' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Not enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) 'instance-00000091' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5009191036224365 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:38:31.845 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000091" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:38:31.845 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000091" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:38:31.845 4088 3038296677544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:38:31.845 4088 3038296677544 MainThread INFO nova.compute.manager [-] [instance: 607bf05f-387c-4106-872a-1b453d094222] VM Stopped (Lifecycle Event) 2021-09-10 17:38:31.845 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-e1570ac7-8145-4f8a-b34f-e0bf001fb0a3 - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:38:31.845 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-e1570ac7-8145-4f8a-b34f-e0bf001fb0a3 - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:38:31.907 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-e1570ac7-8145-4f8a-b34f-e0bf001fb0a3 - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:38:31.923 4088 3038296677544 MainThread INFO nova.compute.manager [req-e1570ac7-8145-4f8a-b34f-e0bf001fb0a3 - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:38:32.832 4088 3038296623592 MainThread DEBUG os_win.utils.jobutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': 'D2F19CE2-CB78-4E74-A5B7-DF53E164A36F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15276), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:38:32.971 4088 3038296623592 MainThread ERROR os_win.utils.jobutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000091\' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)instance-000000916DFFC521-3A92-4EAD-B666-54DB0CAD446612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)instance-000000916DFFC521-3A92-4EAD-B666-54DB0CAD446610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000091\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)instance-000000916DFFC521-3A92-4EAD-B666-54DB0CAD4466%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D2F19CE2-CB78-4E74-A5B7-DF53E164A36F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113292), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 38, 32), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 38, 32), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000091' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)\n\nNot enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)\n\n'instance-00000091' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)", 'ErrorSummaryDescription': "'instance-00000091' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000091.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:38:32.971 4088 3038296623592 MainThread DEBUG os_win._utils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000091' failed to start. Not enough memory in the system to start the virtual machine instance-00000091. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000091' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Not enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) 'instance-00000091' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.665875196456909 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:38:33.012 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000091" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:38:33.012 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000091" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:38:33.012 4088 3038296677544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:38:33.012 4088 3038296677544 MainThread INFO nova.compute.manager [-] [instance: 607bf05f-387c-4106-872a-1b453d094222] VM Stopped (Lifecycle Event) 2021-09-10 17:38:33.036 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-911709b9-eb25-41b5-a685-c802fddbf5a4 - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:38:33.036 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-911709b9-eb25-41b5-a685-c802fddbf5a4 - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:38:33.092 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-911709b9-eb25-41b5-a685-c802fddbf5a4 - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:38:33.112 4088 3038296677544 MainThread INFO nova.compute.manager [req-911709b9-eb25-41b5-a685-c802fddbf5a4 - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:38:34.011 4088 3038296623592 MainThread DEBUG os_win.utils.jobutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '60776829-A558-4228-878C-B904DBCBDA96', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15302), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:38:34.158 4088 3038296623592 MainThread ERROR os_win.utils.jobutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000091\' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)instance-000000916DFFC521-3A92-4EAD-B666-54DB0CAD446612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)instance-000000916DFFC521-3A92-4EAD-B666-54DB0CAD446610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000091\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)instance-000000916DFFC521-3A92-4EAD-B666-54DB0CAD4466%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '60776829-A558-4228-878C-B904DBCBDA96', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=111959), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 38, 33), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 38, 34), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000091' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)\n\nNot enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)\n\n'instance-00000091' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)", 'ErrorSummaryDescription': "'instance-00000091' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000091.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:38:34.158 4088 3038296623592 MainThread DEBUG os_win._utils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000091' failed to start. Not enough memory in the system to start the virtual machine instance-00000091. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000091' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Not enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) 'instance-00000091' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.852893590927124 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:38:34.188 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000091" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:38:34.188 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000091" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:38:34.188 4088 3038296677544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:38:34.195 4088 3038296677544 MainThread INFO nova.compute.manager [-] [instance: 607bf05f-387c-4106-872a-1b453d094222] VM Stopped (Lifecycle Event) 2021-09-10 17:38:34.206 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-284677e7-bc5d-4e9b-b6ab-5c6a8e110e63 - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:38:34.206 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-284677e7-bc5d-4e9b-b6ab-5c6a8e110e63 - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:38:34.241 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-284677e7-bc5d-4e9b-b6ab-5c6a8e110e63 - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:38:34.282 4088 3038296677544 MainThread INFO nova.compute.manager [req-284677e7-bc5d-4e9b-b6ab-5c6a8e110e63 - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:38:35.189 4088 3038296623592 MainThread DEBUG os_win.utils.jobutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '54A91C15-D549-4227-9DB5-7210CAB48E09', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16067), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:38:35.346 4088 3038296623592 MainThread ERROR os_win.utils.jobutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000091\' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)instance-000000916DFFC521-3A92-4EAD-B666-54DB0CAD446612030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)instance-000000916DFFC521-3A92-4EAD-B666-54DB0CAD446610243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000091\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)instance-000000916DFFC521-3A92-4EAD-B666-54DB0CAD4466%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '54A91C15-D549-4227-9DB5-7210CAB48E09', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=133347), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 38, 35), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 38, 35), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000091' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)\n\nNot enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)\n\n'instance-00000091' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466)", 'ErrorSummaryDescription': "'instance-00000091' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000091.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:38:35.346 4088 3038296623592 MainThread ERROR nova.virt.hyperv.vmops [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Failed to change vm state of instance-00000091 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000091' failed to start. 2021-09-10 17:38:35.346 4088 3038296623592 MainThread INFO nova.virt.hyperv.vmops [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Got request to destroy instance 2021-09-10 17:38:35.396 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000091" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:38:35.396 4088 3038342146888 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000091" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:38:35.396 4088 3038296677544 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:38:35.396 4088 3038296677544 MainThread INFO nova.compute.manager [-] [instance: 607bf05f-387c-4106-872a-1b453d094222] VM Stopped (Lifecycle Event) 2021-09-10 17:38:35.409 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-216b989b-e6a7-4e71-8dce-e69b2363f5ad - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:38:35.409 4088 3038296677544 MainThread DEBUG nova.virt.hyperv.vmops [req-216b989b-e6a7-4e71-8dce-e69b2363f5ad - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:38:35.470 4088 3038296677544 MainThread DEBUG nova.compute.manager [req-216b989b-e6a7-4e71-8dce-e69b2363f5ad - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:38:35.501 4088 3038296677544 MainThread INFO nova.compute.manager [req-216b989b-e6a7-4e71-8dce-e69b2363f5ad - - - - -] [instance: 607bf05f-387c-4106-872a-1b453d094222] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:38:37.251 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:38:37.266 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000091" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:38:37.266 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000091" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:38:37.282 4088 3038296623592 MainThread DEBUG os_win.utils.compute.vmutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Successfully changed vm state of instance-00000091 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:38:37.285 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Successfully changed state of VM instance-00000091 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:38:37.319 4088 3038296623592 MainThread DEBUG os_win.utils.jobutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': 'EAE1FE2D-E9C7-410E-9910-B516A98B05BE', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14264), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:38:37.454 4088 3038296623592 MainThread DEBUG os_win.utils.jobutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job succeeded: {'InstanceID': 'EAE1FE2D-E9C7-410E-9910-B516A98B05BE', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=97159), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:38:37.456 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000091" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:38:37.456 4088 3038296623592 MainThread DEBUG os_win.utils.pathutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Removing directory: C:\openstack\instances\instance-00000091 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:38:37.456 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000091" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:38:37.456 4088 3038296623592 MainThread ERROR nova.compute.manager [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000091' failed to start. Not enough memory in the system to start the virtual machine instance-00000091. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000091' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Not enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) 'instance-00000091' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Error code: 32778. 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] Traceback (most recent call last): 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] return function(*args, **kwargs) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] admin_password, network_info, block_device_info) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] return function(self, *args, **kwds) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self.force_reraise() 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] raise self.value 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] should_plug_vifs=False) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 'req_state': req_state}) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self.force_reraise() 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] raise self.value 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] time.sleep(sleep_time) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self.force_reraise() 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] raise self.value 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] return f(*args, **kwargs) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] return self._wait_for_job(job_path) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] error_desc=err_desc) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000091' failed to start. 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] Not enough memory in the system to start the virtual machine instance-00000091. 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000091' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] Not enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 'instance-00000091' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Error code: 32778. 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] During handling of the above exception, another exception occurred: 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] Traceback (most recent call last): 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] yield resources 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] accel_info=accel_info) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] return function(*args, **kwargs) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] admin_password, network_info, block_device_info) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] return function(self, *args, **kwds) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self.force_reraise() 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] raise self.value 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] should_plug_vifs=False) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 'req_state': req_state}) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self.force_reraise() 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] raise self.value 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] time.sleep(sleep_time) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self.force_reraise() 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] raise self.value 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] return f(*args, **kwargs) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] return self._wait_for_job(job_path) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] error_desc=err_desc) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000091' failed to start. 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] Not enough memory in the system to start the virtual machine instance-00000091. 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000091' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] Not enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 'instance-00000091' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Error code: 32778. 2021-09-10 17:38:37.456 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.456 4088 3038296623592 MainThread INFO nova.compute.manager [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Terminating instance 2021-09-10 17:38:37.456 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:38:37.456 4088 3038296623592 MainThread INFO nova.virt.hyperv.vmops [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Got request to destroy instance 2021-09-10 17:38:37.475 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.vmops [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:38:37.475 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000091" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:38:37.475 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000091" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:38:37.475 4088 3038296623592 MainThread INFO nova.compute.manager [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Took 0.01 seconds to destroy the instance on the hypervisor. 2021-09-10 17:38:37.475 4088 3038296623592 MainThread DEBUG nova.compute.claims [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:38:37.475 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:38:37.568 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.hostops [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:38:37.581 4088 3038296623592 MainThread DEBUG nova.virt.hyperv.hostops [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:38:37.784 4088 3038296623592 MainThread DEBUG nova.compute.provider_tree [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:38:37.784 4088 3038296623592 MainThread DEBUG nova.scheduler.client.report [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:38:37.784 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.313s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:38:37.784 4088 3038296623592 MainThread ERROR nova.compute.manager [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000091' failed to start. Not enough memory in the system to start the virtual machine instance-00000091. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000091' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Not enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) 'instance-00000091' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Error code: 32778. 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] Traceback (most recent call last): 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] return function(*args, **kwargs) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] admin_password, network_info, block_device_info) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] return function(self, *args, **kwds) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self.force_reraise() 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] raise self.value 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] should_plug_vifs=False) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 'req_state': req_state}) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self.force_reraise() 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] raise self.value 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] time.sleep(sleep_time) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self.force_reraise() 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] raise self.value 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] return f(*args, **kwargs) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] return self._wait_for_job(job_path) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] error_desc=err_desc) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000091' failed to start. 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] Not enough memory in the system to start the virtual machine instance-00000091. 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000091' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] Not enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 'instance-00000091' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Error code: 32778. 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] During handling of the above exception, another exception occurred: 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] Traceback (most recent call last): 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] accel_info=accel_info) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] return function(*args, **kwargs) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] admin_password, network_info, block_device_info) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] return function(self, *args, **kwds) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self.force_reraise() 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] raise self.value 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] should_plug_vifs=False) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 'req_state': req_state}) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self.force_reraise() 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] raise self.value 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] time.sleep(sleep_time) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self.force_reraise() 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] raise self.value 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] return f(*args, **kwargs) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] return self._wait_for_job(job_path) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] error_desc=err_desc) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000091' failed to start. 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] Not enough memory in the system to start the virtual machine instance-00000091. 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000091' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] Not enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 'instance-00000091' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Error code: 32778. 2021-09-10 17:38:37.784 4088 3038296623592 MainThread TRACE nova.compute.manager [instance: 607bf05f-387c-4106-872a-1b453d094222] 2021-09-10 17:38:37.813 4088 3038296623592 MainThread DEBUG nova.compute.utils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] WMI job failed with status 10. Error summary description: 'instance-00000091' failed to start. Not enough memory in the system to start the virtual machine instance-00000091. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:38:37.813 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Build of instance 607bf05f-387c-4106-872a-1b453d094222 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000091' failed to start. Not enough memory in the system to start the virtual machine instance-00000091. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000091' failed to start. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Not enough memory in the system to start the virtual machine instance-00000091 with ram size 1024 megabytes. (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) 'instance-00000091' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 6DFFC521-3A92-4EAD-B666-54DB0CAD4466) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:38:37.818 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:38:37.818 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:38:37.818 4088 3038296623592 MainThread DEBUG nova.compute.manager [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:38:37.818 4088 3038296623592 MainThread DEBUG nova.network.neutron [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:38:38.300 4088 3038296623592 MainThread DEBUG nova.network.neutron [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:38:38.319 4088 3038296623592 MainThread INFO nova.compute.manager [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 607bf05f-387c-4106-872a-1b453d094222] Took 0.50 seconds to deallocate network for instance. 2021-09-10 17:38:38.441 4088 3038296623592 MainThread INFO nova.scheduler.client.report [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Deleted allocations for instance 607bf05f-387c-4106-872a-1b453d094222 2021-09-10 17:38:38.472 4088 3038296623592 MainThread DEBUG oslo_concurrency.lockutils [req-c79823fc-2720-4001-baf5-254ee329aa98 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "607bf05f-387c-4106-872a-1b453d094222" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.390s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:09.205 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "436b11e9-988c-46a7-a14a-9b5f6aa2bf2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:39:09.234 4088 3038342145304 MainThread DEBUG nova.compute.manager [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:39:09.328 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:39:09.328 4088 3038342145304 MainThread DEBUG nova.virt.hardware [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:39:09.328 4088 3038342145304 MainThread INFO nova.compute.claims [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Claim successful on node n-h2-808474-1 2021-09-10 17:39:09.408 4088 3038342145304 MainThread DEBUG nova.virt.hyperv.hostops [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:39:09.437 4088 3038342145304 MainThread DEBUG nova.virt.hyperv.hostops [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:39:09.640 4088 3038342145304 MainThread DEBUG nova.compute.provider_tree [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:39:09.656 4088 3038342145304 MainThread DEBUG nova.scheduler.client.report [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:39:09.656 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:09.656 4088 3038342145304 MainThread DEBUG nova.compute.manager [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:39:09.719 4088 3038342145304 MainThread DEBUG nova.compute.manager [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:39:09.734 4088 3038342146536 GreenThread-135 DEBUG nova.compute.manager [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:39:09.734 4088 3038342146536 GreenThread-135 DEBUG nova.network.neutron [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:39:09.844 4088 3038342145304 MainThread DEBUG nova.compute.manager [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:39:09.858 4088 3038342146536 GreenThread-135 DEBUG nova.policy [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '580888399edc4d7c97b4a1bce73db000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '351b14c1ba6b4a35aa1c79568c8e5c30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:39:09.858 4088 3038342145304 MainThread INFO nova.virt.hyperv.vmops [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Spawning new instance 2021-09-10 17:39:09.874 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000092" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:39:09.874 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000092" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:09.874 4088 3038342145304 MainThread DEBUG nova.block_device [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:39:09.874 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:39:09.874 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:09.893 4088 3038342145304 MainThread DEBUG os_win.utils.pathutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Creating directory: C:\openstack\instances\instance-00000092 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:39:09.893 4088 3038342145304 MainThread DEBUG nova.virt.hyperv.vmops [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000092\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:39:10.125 4088 3038342145304 MainThread DEBUG nova.virt.hyperv.vmops [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Resizing VHD C:\openstack\instances\instance-00000092\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:39:10.468 4088 3038342146536 GreenThread-135 DEBUG nova.network.neutron [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Successfully created port: 6a4949e9-5ac7-4fde-893e-3ee77f66ffc9 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:39:11.063 4088 3038342146536 GreenThread-135 DEBUG nova.network.neutron [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Successfully updated port: 6a4949e9-5ac7-4fde-893e-3ee77f66ffc9 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:39:11.063 4088 3038342146536 GreenThread-135 DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Acquired lock "refresh_cache-436b11e9-988c-46a7-a14a-9b5f6aa2bf2d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:39:11.063 4088 3038342146536 GreenThread-135 DEBUG nova.network.neutron [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:39:11.117 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-6d74ccdf-d5a1-4a14-9660-7f858d52b110 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Received event network-changed-6a4949e9-5ac7-4fde-893e-3ee77f66ffc9 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:39:11.117 4088 3038342147064 MainThread DEBUG nova.compute.manager [req-6d74ccdf-d5a1-4a14-9660-7f858d52b110 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Refreshing instance network info cache due to event network-changed-6a4949e9-5ac7-4fde-893e-3ee77f66ffc9. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:39:11.140 4088 3038342146536 GreenThread-135 DEBUG nova.network.neutron [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:39:11.484 4088 3038342146536 GreenThread-135 DEBUG nova.network.neutron [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Updating instance_info_cache with network_info: [{"id": "6a4949e9-5ac7-4fde-893e-3ee77f66ffc9", "address": "fa:16:3e:a3:e8:bc", "network": {"id": "d66ed97b-17c5-4a50-aa11-82413968de7e", "bridge": null, "label": "tempest-network-smoke--272333549", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "351b14c1ba6b4a35aa1c79568c8e5c30", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap6a4949e9-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:39:11.513 4088 3038342146536 GreenThread-135 DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Releasing lock "refresh_cache-436b11e9-988c-46a7-a14a-9b5f6aa2bf2d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:39:11.513 4088 3038342146536 GreenThread-135 DEBUG nova.compute.manager [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Instance network_info: |[{"id": "6a4949e9-5ac7-4fde-893e-3ee77f66ffc9", "address": "fa:16:3e:a3:e8:bc", "network": {"id": "d66ed97b-17c5-4a50-aa11-82413968de7e", "bridge": null, "label": "tempest-network-smoke--272333549", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "351b14c1ba6b4a35aa1c79568c8e5c30", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap6a4949e9-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:39:11.513 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-6d74ccdf-d5a1-4a14-9660-7f858d52b110 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-436b11e9-988c-46a7-a14a-9b5f6aa2bf2d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:39:11.513 4088 3038342147064 MainThread DEBUG nova.network.neutron [req-6d74ccdf-d5a1-4a14-9660-7f858d52b110 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Refreshing network info cache for port 6a4949e9-5ac7-4fde-893e-3ee77f66ffc9 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:39:11.513 4088 3038342145304 MainThread DEBUG nova.compute.manager [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Preparing to wait for external event network-vif-plugged-6a4949e9-5ac7-4fde-893e-3ee77f66ffc9 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:39:11.513 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "436b11e9-988c-46a7-a14a-9b5f6aa2bf2d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:39:11.513 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "436b11e9-988c-46a7-a14a-9b5f6aa2bf2d-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:11.513 4088 3038342145304 MainThread DEBUG os_win.utils.compute.vmutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Creating VM instance-00000092 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:39:12.000 4088 3038342147064 MainThread DEBUG nova.network.neutron [req-6d74ccdf-d5a1-4a14-9660-7f858d52b110 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Updated VIF entry in instance network info cache for port 6a4949e9-5ac7-4fde-893e-3ee77f66ffc9. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:39:12.000 4088 3038342147064 MainThread DEBUG nova.network.neutron [req-6d74ccdf-d5a1-4a14-9660-7f858d52b110 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Updating instance_info_cache with network_info: [{"id": "6a4949e9-5ac7-4fde-893e-3ee77f66ffc9", "address": "fa:16:3e:a3:e8:bc", "network": {"id": "d66ed97b-17c5-4a50-aa11-82413968de7e", "bridge": null, "label": "tempest-network-smoke--272333549", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "351b14c1ba6b4a35aa1c79568c8e5c30", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap6a4949e9-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:39:12.016 4088 3038342147064 MainThread DEBUG oslo_concurrency.lockutils [req-6d74ccdf-d5a1-4a14-9660-7f858d52b110 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-436b11e9-988c-46a7-a14a-9b5f6aa2bf2d" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:39:13.258 4088 3038342145304 MainThread DEBUG nova.virt.hyperv.vmops [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:39:15.460 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:39:16.453 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:39:17.458 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:39:17.458 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:39:17.458 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:39:18.453 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:39:19.452 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:39:20.390 4088 3038342146536 MainThread DEBUG nova.compute.manager [req-cd857aa6-1410-40d2-ab13-04e065d34c9f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Received event network-vif-plugged-6a4949e9-5ac7-4fde-893e-3ee77f66ffc9 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:39:20.390 4088 3038342146536 MainThread DEBUG oslo_concurrency.lockutils [req-cd857aa6-1410-40d2-ab13-04e065d34c9f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "436b11e9-988c-46a7-a14a-9b5f6aa2bf2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:39:20.390 4088 3038342146536 MainThread DEBUG oslo_concurrency.lockutils [req-cd857aa6-1410-40d2-ab13-04e065d34c9f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "436b11e9-988c-46a7-a14a-9b5f6aa2bf2d-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:20.390 4088 3038342146536 MainThread DEBUG nova.compute.manager [req-cd857aa6-1410-40d2-ab13-04e065d34c9f 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Processing event network-vif-plugged-6a4949e9-5ac7-4fde-893e-3ee77f66ffc9 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:39:20.424 4088 3038342145304 MainThread INFO nova.virt.hyperv.vmops [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Using config drive for instance 2021-09-10 17:39:20.468 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:39:20.468 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:39:20.468 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:20.468 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:39:20.468 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:39:20.500 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:39:20.537 4088 3038342145304 MainThread INFO nova.virt.hyperv.vmops [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Creating config drive at C:\openstack\instances\instance-00000092\configdrive.iso 2021-09-10 17:39:20.628 4088 3038342145304 MainThread DEBUG oslo_concurrency.processutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000092\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpfvy119go execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:39:20.968 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2220MB free_disk=49GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:39:20.968 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:39:20.974 4088 3038342145304 MainThread DEBUG oslo_concurrency.processutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000092\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpfvy119go" returned: 0 in 0.343s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:39:21.109 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:39:21.109 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:39:21.109 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:39:21.109 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:39:21.109 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:39:21.109 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:39:21.109 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:39:21.109 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:39:21.109 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:39:21.109 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:39:21.109 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:39:21.109 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:39:21.109 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:39:21.109 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:39:21.109 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:39:21.109 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=14GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:39:21.132 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:39:21.162 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:39:21.374 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:39:21.374 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:39:21.374 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:39:21.374 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:21.483 4088 3038342145304 MainThread DEBUG nova.virt.hyperv.vmops [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Setting boot order for instance: instance-00000092: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:39:21.578 4088 3038342145304 MainThread DEBUG nova.virt.hyperv.vmops [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:39:21.606 4088 3038342145304 MainThread DEBUG os_win.utils.jobutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '58E23999-E563-40B6-80A9-2811F10AD252', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19026), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:39:21.750 4088 3038342145304 MainThread ERROR os_win.utils.jobutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000092\' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)instance-0000009222CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)instance-0000009222CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000092\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)instance-0000009222CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '58E23999-E563-40B6-80A9-2811F10AD252', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115053), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 39, 21), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 39, 21), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000092' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)\n\nNot enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)\n\n'instance-00000092' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)", 'ErrorSummaryDescription': "'instance-00000092' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000092.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:39:21.750 4088 3038342145304 MainThread DEBUG os_win._utils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000092' failed to start. Not enough memory in the system to start the virtual machine instance-00000092. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000092' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Not enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) 'instance-00000092' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1719048023223877 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:39:21.790 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000092" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:39:21.790 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000092" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:21.790 4088 3038342144424 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:39:21.796 4088 3038342144424 MainThread INFO nova.compute.manager [-] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] VM Stopped (Lifecycle Event) 2021-09-10 17:39:21.796 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-99d06dc2-f48e-4846-b1c7-a6c462a5f576 - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:39:21.796 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.vmops [req-99d06dc2-f48e-4846-b1c7-a6c462a5f576 - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:39:21.858 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-99d06dc2-f48e-4846-b1c7-a6c462a5f576 - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:39:21.883 4088 3038342144424 MainThread INFO nova.compute.manager [req-99d06dc2-f48e-4846-b1c7-a6c462a5f576 - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:39:22.374 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:39:22.781 4088 3038342145304 MainThread DEBUG os_win.utils.jobutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '14DE16B3-11B4-4A9E-8162-E7C2A42893CC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15012), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:39:22.906 4088 3038342145304 MainThread ERROR os_win.utils.jobutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000092\' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)instance-0000009222CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)instance-0000009222CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000092\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)instance-0000009222CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '14DE16B3-11B4-4A9E-8162-E7C2A42893CC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113372), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 39, 22), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 39, 22), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000092' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)\n\nNot enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)\n\n'instance-00000092' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)", 'ErrorSummaryDescription': "'instance-00000092' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000092.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:39:22.906 4088 3038342145304 MainThread DEBUG os_win._utils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000092' failed to start. Not enough memory in the system to start the virtual machine instance-00000092. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000092' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Not enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) 'instance-00000092' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.328277587890625 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:39:22.939 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000092" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:39:22.939 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000092" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:22.939 4088 3038342144424 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:39:22.939 4088 3038342144424 MainThread INFO nova.compute.manager [-] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] VM Stopped (Lifecycle Event) 2021-09-10 17:39:22.968 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-a45f85fc-1d40-470f-96a3-3853601b0ae3 - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:39:22.968 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.vmops [req-a45f85fc-1d40-470f-96a3-3853601b0ae3 - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:39:23.015 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-a45f85fc-1d40-470f-96a3-3853601b0ae3 - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:39:23.046 4088 3038342144424 MainThread INFO nova.compute.manager [req-a45f85fc-1d40-470f-96a3-3853601b0ae3 - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:39:23.921 4088 3038342145304 MainThread DEBUG os_win.utils.jobutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': 'C163AC4F-C475-435A-A028-F20EEC7C4C16', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14437), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:39:24.077 4088 3038342145304 MainThread ERROR os_win.utils.jobutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000092\' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)instance-0000009222CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)instance-0000009222CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000092\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)instance-0000009222CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'C163AC4F-C475-435A-A028-F20EEC7C4C16', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114139), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 39, 23), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 39, 24), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000092' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)\n\nNot enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)\n\n'instance-00000092' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)", 'ErrorSummaryDescription': "'instance-00000092' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000092.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:39:24.077 4088 3038342145304 MainThread DEBUG os_win._utils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000092' failed to start. Not enough memory in the system to start the virtual machine instance-00000092. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000092' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Not enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) 'instance-00000092' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.4997644424438477 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:39:24.109 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000092" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:39:24.109 4088 3038342145480 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000092" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:24.109 4088 3038342144424 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:39:24.109 4088 3038342144424 MainThread INFO nova.compute.manager [-] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] VM Stopped (Lifecycle Event) 2021-09-10 17:39:24.136 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-52da72f1-e93d-472a-83dd-196035bce72a - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:39:24.136 4088 3038342144424 MainThread DEBUG nova.virt.hyperv.vmops [req-52da72f1-e93d-472a-83dd-196035bce72a - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:39:24.171 4088 3038342144424 MainThread DEBUG nova.compute.manager [req-52da72f1-e93d-472a-83dd-196035bce72a - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:39:24.192 4088 3038342144424 MainThread INFO nova.compute.manager [req-52da72f1-e93d-472a-83dd-196035bce72a - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:39:24.468 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:39:24.469 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:39:24.546 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:39:24.546 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:39:25.044 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Updating instance_info_cache with network_info: [{"id": "83b451dc-a198-4ccd-9f65-c8fe6343aea3", "address": "fa:16:3e:44:7f:92", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap83b451dc-a1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:39:25.054 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:39:25.054 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:39:25.054 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:39:25.096 4088 3038342145304 MainThread DEBUG os_win.utils.jobutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '654F34CF-091B-4A5E-BB53-FF4E1327AB9E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15344), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:39:25.249 4088 3038342145304 MainThread ERROR os_win.utils.jobutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000092\' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)instance-0000009222CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)instance-0000009222CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000092\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)instance-0000009222CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '654F34CF-091B-4A5E-BB53-FF4E1327AB9E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113099), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 39, 25), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 39, 25), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000092' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)\n\nNot enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)\n\n'instance-00000092' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)", 'ErrorSummaryDescription': "'instance-00000092' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000092.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:39:25.249 4088 3038342145304 MainThread DEBUG os_win._utils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000092' failed to start. Not enough memory in the system to start the virtual machine instance-00000092. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000092' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Not enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) 'instance-00000092' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.671881914138794 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:39:25.283 4088 3038342146536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000092" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:39:25.283 4088 3038342146536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000092" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:25.283 4088 3038342258008 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:39:25.283 4088 3038342258008 MainThread INFO nova.compute.manager [-] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] VM Stopped (Lifecycle Event) 2021-09-10 17:39:25.312 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-7f29eaf6-730f-4fcd-b63e-c42f1f960af2 - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:39:25.312 4088 3038342258008 MainThread DEBUG nova.virt.hyperv.vmops [req-7f29eaf6-730f-4fcd-b63e-c42f1f960af2 - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:39:25.359 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-7f29eaf6-730f-4fcd-b63e-c42f1f960af2 - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:39:25.374 4088 3038342258008 MainThread INFO nova.compute.manager [req-7f29eaf6-730f-4fcd-b63e-c42f1f960af2 - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:39:26.279 4088 3038342145304 MainThread DEBUG os_win.utils.jobutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '42815A0D-BBA7-4F93-895A-0694E02D9F10', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15313), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:39:26.438 4088 3038342145304 MainThread ERROR os_win.utils.jobutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000092\' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)instance-0000009222CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)instance-0000009222CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000092\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)instance-0000009222CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '42815A0D-BBA7-4F93-895A-0694E02D9F10', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113451), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 39, 26), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 39, 26), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000092' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)\n\nNot enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)\n\n'instance-00000092' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)", 'ErrorSummaryDescription': "'instance-00000092' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000092.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:39:26.438 4088 3038342145304 MainThread DEBUG os_win._utils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000092' failed to start. Not enough memory in the system to start the virtual machine instance-00000092. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000092' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Not enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) 'instance-00000092' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.860401630401611 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:39:26.438 4088 3038342258008 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:39:26.438 4088 3038342258008 MainThread INFO nova.compute.manager [-] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] VM Stopped (Lifecycle Event) 2021-09-10 17:39:26.438 4088 3038342146536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000092" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:39:26.438 4088 3038342146536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000092" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:26.468 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-7e305657-627f-440f-875f-afb50a5fd8bb - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:39:26.468 4088 3038342258008 MainThread DEBUG nova.virt.hyperv.vmops [req-7e305657-627f-440f-875f-afb50a5fd8bb - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:39:26.515 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-7e305657-627f-440f-875f-afb50a5fd8bb - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:39:26.546 4088 3038342258008 MainThread INFO nova.compute.manager [req-7e305657-627f-440f-875f-afb50a5fd8bb - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:39:27.453 4088 3038342145304 MainThread DEBUG os_win.utils.jobutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '73BD2146-2706-4B2F-ADD1-F0A5BCE51BED', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15200), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:39:27.594 4088 3038342145304 MainThread ERROR os_win.utils.jobutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000092\' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)instance-0000009222CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D412030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)instance-0000009222CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D410243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000092\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)instance-0000009222CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '73BD2146-2706-4B2F-ADD1-F0A5BCE51BED', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114583), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 39, 27), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 39, 27), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000092' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)\n\nNot enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)\n\n'instance-00000092' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4)", 'ErrorSummaryDescription': "'instance-00000092' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000092.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:39:27.594 4088 3038342145304 MainThread ERROR nova.virt.hyperv.vmops [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Failed to change vm state of instance-00000092 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000092' failed to start. 2021-09-10 17:39:27.609 4088 3038342145304 MainThread INFO nova.virt.hyperv.vmops [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Got request to destroy instance 2021-09-10 17:39:27.624 4088 3038342146536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000092" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:39:27.624 4088 3038342146536 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000092" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:27.624 4088 3038342258008 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:39:27.624 4088 3038342258008 MainThread INFO nova.compute.manager [-] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] VM Stopped (Lifecycle Event) 2021-09-10 17:39:27.652 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-a2788d66-d78c-41cf-893c-858cb0ef6ec5 - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:39:27.652 4088 3038342258008 MainThread DEBUG nova.virt.hyperv.vmops [req-a2788d66-d78c-41cf-893c-858cb0ef6ec5 - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:39:27.705 4088 3038342258008 MainThread DEBUG nova.compute.manager [req-a2788d66-d78c-41cf-893c-858cb0ef6ec5 - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:39:27.719 4088 3038342258008 MainThread INFO nova.compute.manager [req-a2788d66-d78c-41cf-893c-858cb0ef6ec5 - - - - -] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:39:29.421 4088 3038342145304 MainThread DEBUG nova.virt.hyperv.vmops [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:39:29.421 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000092" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:39:29.421 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000092" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:29.421 4088 3038342145304 MainThread DEBUG os_win.utils.compute.vmutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Successfully changed vm state of instance-00000092 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:39:29.421 4088 3038342145304 MainThread DEBUG nova.virt.hyperv.vmops [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Successfully changed state of VM instance-00000092 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:39:29.477 4088 3038342145304 MainThread DEBUG os_win.utils.jobutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Waiting for WMI job: {'InstanceID': '1AECAC75-879A-475D-8ADE-B8959E9A4C8E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=13877), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:39:29.598 4088 3038342145304 MainThread DEBUG os_win.utils.jobutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] WMI job succeeded: {'InstanceID': '1AECAC75-879A-475D-8ADE-B8959E9A4C8E', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=101076), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:39:29.598 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000092" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:39:29.598 4088 3038342145304 MainThread DEBUG os_win.utils.pathutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Removing directory: C:\openstack\instances\instance-00000092 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:39:29.598 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000092" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:29.598 4088 3038342145304 MainThread ERROR nova.compute.manager [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000092' failed to start. Not enough memory in the system to start the virtual machine instance-00000092. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000092' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Not enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) 'instance-00000092' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Error code: 32778. 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Traceback (most recent call last): 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] return function(*args, **kwargs) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] admin_password, network_info, block_device_info) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] return function(self, *args, **kwds) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self.force_reraise() 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] raise self.value 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] should_plug_vifs=False) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 'req_state': req_state}) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self.force_reraise() 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] raise self.value 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] time.sleep(sleep_time) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self.force_reraise() 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] raise self.value 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] return f(*args, **kwargs) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] return self._wait_for_job(job_path) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] error_desc=err_desc) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000092' failed to start. 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Not enough memory in the system to start the virtual machine instance-00000092. 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000092' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Not enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 'instance-00000092' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Error code: 32778. 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] During handling of the above exception, another exception occurred: 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Traceback (most recent call last): 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] yield resources 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] accel_info=accel_info) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] return function(*args, **kwargs) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] admin_password, network_info, block_device_info) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] return function(self, *args, **kwds) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self.force_reraise() 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] raise self.value 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] should_plug_vifs=False) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 'req_state': req_state}) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self.force_reraise() 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] raise self.value 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] time.sleep(sleep_time) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self.force_reraise() 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] raise self.value 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] return f(*args, **kwargs) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] return self._wait_for_job(job_path) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] error_desc=err_desc) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000092' failed to start. 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Not enough memory in the system to start the virtual machine instance-00000092. 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000092' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Not enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 'instance-00000092' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Error code: 32778. 2021-09-10 17:39:29.598 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.598 4088 3038342145304 MainThread INFO nova.compute.manager [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Terminating instance 2021-09-10 17:39:29.598 4088 3038342145304 MainThread DEBUG nova.compute.manager [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:39:29.624 4088 3038342145304 MainThread INFO nova.virt.hyperv.vmops [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Got request to destroy instance 2021-09-10 17:39:29.624 4088 3038342145304 MainThread DEBUG nova.virt.hyperv.vmops [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:39:29.640 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000092" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:39:29.640 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "instance-00000092" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:29.640 4088 3038342145304 MainThread INFO nova.compute.manager [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Took 0.05 seconds to destroy the instance on the hypervisor. 2021-09-10 17:39:29.640 4088 3038342145304 MainThread DEBUG nova.compute.claims [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:39:29.640 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:39:29.717 4088 3038342145304 MainThread DEBUG nova.virt.hyperv.hostops [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:39:29.736 4088 3038342145304 MainThread DEBUG nova.virt.hyperv.hostops [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:39:29.921 4088 3038342145304 MainThread DEBUG nova.compute.provider_tree [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:39:29.958 4088 3038342145304 MainThread DEBUG nova.scheduler.client.report [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:39:29.958 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.313s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:29.958 4088 3038342145304 MainThread ERROR nova.compute.manager [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000092' failed to start. Not enough memory in the system to start the virtual machine instance-00000092. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000092' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Not enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) 'instance-00000092' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Error code: 32778. 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Traceback (most recent call last): 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] return function(*args, **kwargs) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] admin_password, network_info, block_device_info) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] return function(self, *args, **kwds) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self.force_reraise() 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] raise self.value 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] should_plug_vifs=False) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 'req_state': req_state}) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self.force_reraise() 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] raise self.value 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] time.sleep(sleep_time) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self.force_reraise() 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] raise self.value 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] return f(*args, **kwargs) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] return self._wait_for_job(job_path) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] error_desc=err_desc) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000092' failed to start. 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Not enough memory in the system to start the virtual machine instance-00000092. 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000092' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Not enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 'instance-00000092' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Error code: 32778. 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] During handling of the above exception, another exception occurred: 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Traceback (most recent call last): 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] accel_info=accel_info) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] return function(*args, **kwargs) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] admin_password, network_info, block_device_info) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] return function(self, *args, **kwds) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self.force_reraise() 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] raise self.value 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] should_plug_vifs=False) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 'req_state': req_state}) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self.force_reraise() 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] raise self.value 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] time.sleep(sleep_time) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self.force_reraise() 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] raise self.value 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] return f(*args, **kwargs) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] return self._wait_for_job(job_path) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] error_desc=err_desc) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000092' failed to start. 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Not enough memory in the system to start the virtual machine instance-00000092. 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000092' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Not enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 'instance-00000092' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Error code: 32778. 2021-09-10 17:39:29.958 4088 3038342145304 MainThread TRACE nova.compute.manager [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] 2021-09-10 17:39:29.968 4088 3038342145304 MainThread DEBUG nova.compute.utils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] WMI job failed with status 10. Error summary description: 'instance-00000092' failed to start. Not enough memory in the system to start the virtual machine instance-00000092. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:39:29.968 4088 3038342145304 MainThread DEBUG nova.compute.manager [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Build of instance 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000092' failed to start. Not enough memory in the system to start the virtual machine instance-00000092. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000092' failed to start. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Not enough memory in the system to start the virtual machine instance-00000092 with ram size 1024 megabytes. (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) 'instance-00000092' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 22CBF3DF-CFE3-45C2-BE9D-A9F66FEAF3D4) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:39:29.968 4088 3038342145304 MainThread DEBUG nova.compute.manager [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:39:29.968 4088 3038342145304 MainThread DEBUG nova.compute.manager [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:39:29.968 4088 3038342145304 MainThread DEBUG nova.compute.manager [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:39:29.968 4088 3038342145304 MainThread DEBUG nova.network.neutron [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:39:30.437 4088 3038342145304 MainThread DEBUG nova.network.neutron [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:39:30.468 4088 3038342145304 MainThread INFO nova.compute.manager [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] [instance: 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d] Took 0.50 seconds to deallocate network for instance. 2021-09-10 17:39:30.608 4088 3038342145304 MainThread INFO nova.scheduler.client.report [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Deleted allocations for instance 436b11e9-988c-46a7-a14a-9b5f6aa2bf2d 2021-09-10 17:39:30.624 4088 3038342145304 MainThread DEBUG oslo_concurrency.lockutils [req-5119bff7-94e6-4c68-b63d-ade8817dba00 580888399edc4d7c97b4a1bce73db000 351b14c1ba6b4a35aa1c79568c8e5c30 - default default] Lock "436b11e9-988c-46a7-a14a-9b5f6aa2bf2d" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 21.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:39:39.718 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:40:07.750 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "791f6785-0942-4130-b2e4-c5238398c1c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:40:07.750 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:40:07.874 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:40:07.874 4088 3038342147592 MainThread DEBUG nova.virt.hardware [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:40:07.874 4088 3038342147592 MainThread INFO nova.compute.claims [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Claim successful on node n-h2-808474-1 2021-09-10 17:40:07.985 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.hostops [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:40:08.017 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.hostops [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:40:08.218 4088 3038342147592 MainThread DEBUG nova.compute.provider_tree [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:40:08.218 4088 3038342147592 MainThread DEBUG nova.scheduler.client.report [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:40:08.218 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:40:08.218 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:40:08.300 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:40:08.300 4088 3038342145304 GreenThread-136 DEBUG nova.compute.manager [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:40:08.300 4088 3038342145304 GreenThread-136 DEBUG nova.network.neutron [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:40:08.423 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:40:08.439 4088 3038342147592 MainThread INFO nova.virt.hyperv.vmops [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Spawning new instance 2021-09-10 17:40:08.450 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "instance-00000093" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:40:08.450 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "instance-00000093" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:40:08.450 4088 3038342147592 MainThread DEBUG nova.block_device [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:40:08.450 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:40:08.450 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:40:08.450 4088 3038342147592 MainThread DEBUG os_win.utils.pathutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Creating directory: C:\openstack\instances\instance-00000093 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:40:08.450 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.vmops [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000093\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:40:08.482 4088 3038342145304 GreenThread-136 DEBUG nova.policy [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca5b31b9b47e4f338e12c70f0c03a712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2edbd40ad476fb7f6b1f64070fee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:40:08.686 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.vmops [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Resizing VHD C:\openstack\instances\instance-00000093\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:40:09.126 4088 3038342145304 GreenThread-136 DEBUG nova.network.neutron [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Successfully created port: 606bdaef-cc37-4ef0-97aa-ac2c1fe6e271 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:40:09.732 4088 3038342145304 GreenThread-136 DEBUG nova.network.neutron [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Successfully updated port: 606bdaef-cc37-4ef0-97aa-ac2c1fe6e271 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:40:09.732 4088 3038342145304 GreenThread-136 DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Acquired lock "refresh_cache-791f6785-0942-4130-b2e4-c5238398c1c8" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:40:09.732 4088 3038342145304 GreenThread-136 DEBUG nova.network.neutron [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:40:09.765 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-f2819517-dc6e-4f12-bc00-9f88d30aa4f6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Received event network-changed-606bdaef-cc37-4ef0-97aa-ac2c1fe6e271 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:40:09.787 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-f2819517-dc6e-4f12-bc00-9f88d30aa4f6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Refreshing instance network info cache due to event network-changed-606bdaef-cc37-4ef0-97aa-ac2c1fe6e271. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:40:09.829 4088 3038342145304 GreenThread-136 DEBUG nova.network.neutron [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:40:10.141 4088 3038342145304 GreenThread-136 DEBUG nova.network.neutron [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Updating instance_info_cache with network_info: [{"id": "606bdaef-cc37-4ef0-97aa-ac2c1fe6e271", "address": "fa:16:3e:d4:0b:83", "network": {"id": "88182bf3-791a-48fd-ad45-bb3de5fa5f37", "bridge": null, "label": "tempest-TestShelveInstance-977255127-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "01d2edbd40ad476fb7f6b1f64070fee3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap606bdaef-cc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:40:10.173 4088 3038342145304 GreenThread-136 DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Releasing lock "refresh_cache-791f6785-0942-4130-b2e4-c5238398c1c8" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:40:10.173 4088 3038342145304 GreenThread-136 DEBUG nova.compute.manager [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Instance network_info: |[{"id": "606bdaef-cc37-4ef0-97aa-ac2c1fe6e271", "address": "fa:16:3e:d4:0b:83", "network": {"id": "88182bf3-791a-48fd-ad45-bb3de5fa5f37", "bridge": null, "label": "tempest-TestShelveInstance-977255127-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "01d2edbd40ad476fb7f6b1f64070fee3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap606bdaef-cc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:40:10.173 4088 3038342145128 MainThread DEBUG oslo_concurrency.lockutils [req-f2819517-dc6e-4f12-bc00-9f88d30aa4f6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-791f6785-0942-4130-b2e4-c5238398c1c8" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:40:10.173 4088 3038342145128 MainThread DEBUG nova.network.neutron [req-f2819517-dc6e-4f12-bc00-9f88d30aa4f6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Refreshing network info cache for port 606bdaef-cc37-4ef0-97aa-ac2c1fe6e271 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:40:10.173 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Preparing to wait for external event network-vif-plugged-606bdaef-cc37-4ef0-97aa-ac2c1fe6e271 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:40:10.173 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "791f6785-0942-4130-b2e4-c5238398c1c8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:40:10.173 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "791f6785-0942-4130-b2e4-c5238398c1c8-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:40:10.173 4088 3038342147592 MainThread DEBUG os_win.utils.compute.vmutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Creating VM instance-00000093 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:40:10.657 4088 3038342145128 MainThread DEBUG nova.network.neutron [req-f2819517-dc6e-4f12-bc00-9f88d30aa4f6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Updated VIF entry in instance network info cache for port 606bdaef-cc37-4ef0-97aa-ac2c1fe6e271. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:40:10.657 4088 3038342145128 MainThread DEBUG nova.network.neutron [req-f2819517-dc6e-4f12-bc00-9f88d30aa4f6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Updating instance_info_cache with network_info: [{"id": "606bdaef-cc37-4ef0-97aa-ac2c1fe6e271", "address": "fa:16:3e:d4:0b:83", "network": {"id": "88182bf3-791a-48fd-ad45-bb3de5fa5f37", "bridge": null, "label": "tempest-TestShelveInstance-977255127-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "01d2edbd40ad476fb7f6b1f64070fee3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap606bdaef-cc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:40:10.657 4088 3038342145128 MainThread DEBUG oslo_concurrency.lockutils [req-f2819517-dc6e-4f12-bc00-9f88d30aa4f6 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-791f6785-0942-4130-b2e4-c5238398c1c8" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:40:11.830 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.vmops [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:40:15.485 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:40:16.450 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:40:17.446 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:40:17.446 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:40:18.458 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:40:18.716 4088 3038342144072 MainThread DEBUG nova.compute.manager [req-498ce019-0080-487a-a4c3-4165623588e4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Received event network-vif-plugged-606bdaef-cc37-4ef0-97aa-ac2c1fe6e271 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:40:18.716 4088 3038342144072 MainThread DEBUG oslo_concurrency.lockutils [req-498ce019-0080-487a-a4c3-4165623588e4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "791f6785-0942-4130-b2e4-c5238398c1c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:40:18.716 4088 3038342144072 MainThread DEBUG oslo_concurrency.lockutils [req-498ce019-0080-487a-a4c3-4165623588e4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "791f6785-0942-4130-b2e4-c5238398c1c8-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:40:18.716 4088 3038342144072 MainThread DEBUG nova.compute.manager [req-498ce019-0080-487a-a4c3-4165623588e4 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Processing event network-vif-plugged-606bdaef-cc37-4ef0-97aa-ac2c1fe6e271 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:40:18.762 4088 3038342147592 MainThread INFO nova.virt.hyperv.vmops [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Using config drive for instance 2021-09-10 17:40:18.879 4088 3038342147592 MainThread INFO nova.virt.hyperv.vmops [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Creating config drive at C:\openstack\instances\instance-00000093\configdrive.iso 2021-09-10 17:40:18.966 4088 3038342147592 MainThread DEBUG oslo_concurrency.processutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000093\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp8wswfwwt execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:40:19.267 4088 3038342147592 MainThread DEBUG oslo_concurrency.processutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000093\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmp8wswfwwt" returned: 0 in 0.297s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:40:19.800 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.vmops [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Setting boot order for instance: instance-00000093: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:40:19.874 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.vmops [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:40:19.919 4088 3038342147592 MainThread DEBUG os_win.utils.jobutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Waiting for WMI job: {'InstanceID': 'F740D402-C0FD-4E50-BE43-8BC0FF91BED9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14950), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:40:20.064 4088 3038342147592 MainThread ERROR os_win.utils.jobutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000093\' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)instance-000000931E56D8BD-4DB6-44BC-8977-D3091844A13D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)instance-000000931E56D8BD-4DB6-44BC-8977-D3091844A13D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000093\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)instance-000000931E56D8BD-4DB6-44BC-8977-D3091844A13D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'F740D402-C0FD-4E50-BE43-8BC0FF91BED9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=119055), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 40, 19), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 40, 20), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000093' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)\n\nNot enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)\n\n'instance-00000093' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)", 'ErrorSummaryDescription': "'instance-00000093' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000093.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:40:20.064 4088 3038342147592 MainThread DEBUG os_win._utils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000093' failed to start. Not enough memory in the system to start the virtual machine instance-00000093. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000093' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Not enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) 'instance-00000093' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.19031047821044922 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:40:20.090 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000093" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:40:20.090 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000093" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:40:20.090 4088 3038342145128 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:40:20.090 4088 3038342145128 MainThread INFO nova.compute.manager [-] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] VM Stopped (Lifecycle Event) 2021-09-10 17:40:20.098 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-b92c43f6-d231-42a2-80d8-61e1f599b94f - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:40:20.098 4088 3038342145128 MainThread DEBUG nova.virt.hyperv.vmops [req-b92c43f6-d231-42a2-80d8-61e1f599b94f - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:40:20.142 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-b92c43f6-d231-42a2-80d8-61e1f599b94f - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:40:20.184 4088 3038342145128 MainThread INFO nova.compute.manager [req-b92c43f6-d231-42a2-80d8-61e1f599b94f - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:40:20.460 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:40:21.106 4088 3038342147592 MainThread DEBUG os_win.utils.jobutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Waiting for WMI job: {'InstanceID': '6DC40DAA-D54B-4696-AD32-53C20F9D9B14', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15285), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:40:21.253 4088 3038342147592 MainThread ERROR os_win.utils.jobutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000093\' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)instance-000000931E56D8BD-4DB6-44BC-8977-D3091844A13D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)instance-000000931E56D8BD-4DB6-44BC-8977-D3091844A13D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000093\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)instance-000000931E56D8BD-4DB6-44BC-8977-D3091844A13D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '6DC40DAA-D54B-4696-AD32-53C20F9D9B14', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112130), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 40, 21), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 40, 21), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000093' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)\n\nNot enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)\n\n'instance-00000093' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)", 'ErrorSummaryDescription': "'instance-00000093' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000093.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:40:21.253 4088 3038342147592 MainThread DEBUG os_win._utils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000093' failed to start. Not enough memory in the system to start the virtual machine instance-00000093. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000093' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Not enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) 'instance-00000093' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.379554271697998 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:40:21.278 4088 3038342145128 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:40:21.278 4088 3038342145128 MainThread INFO nova.compute.manager [-] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] VM Stopped (Lifecycle Event) 2021-09-10 17:40:21.278 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000093" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:40:21.278 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000093" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:40:21.298 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-fc198438-9293-4d85-8d1e-f2c444fc8a13 - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:40:21.298 4088 3038342145128 MainThread DEBUG nova.virt.hyperv.vmops [req-fc198438-9293-4d85-8d1e-f2c444fc8a13 - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:40:21.344 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-fc198438-9293-4d85-8d1e-f2c444fc8a13 - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:40:21.344 4088 3038342145128 MainThread INFO nova.compute.manager [req-fc198438-9293-4d85-8d1e-f2c444fc8a13 - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:40:22.298 4088 3038342147592 MainThread DEBUG os_win.utils.jobutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Waiting for WMI job: {'InstanceID': '84D37754-8A85-4FEB-8E55-A4953C52D17A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21830), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:40:22.422 4088 3038342147592 MainThread ERROR os_win.utils.jobutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000093\' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)instance-000000931E56D8BD-4DB6-44BC-8977-D3091844A13D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)instance-000000931E56D8BD-4DB6-44BC-8977-D3091844A13D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000093\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)instance-000000931E56D8BD-4DB6-44BC-8977-D3091844A13D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '84D37754-8A85-4FEB-8E55-A4953C52D17A', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112816), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 40, 22), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 40, 22), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000093' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)\n\nNot enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)\n\n'instance-00000093' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)", 'ErrorSummaryDescription': "'instance-00000093' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000093.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:40:22.438 4088 3038342147592 MainThread DEBUG os_win._utils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000093' failed to start. Not enough memory in the system to start the virtual machine instance-00000093. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000093' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Not enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) 'instance-00000093' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.5646049976348877 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:40:22.454 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:40:22.469 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:40:22.469 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:40:22.469 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:40:22.469 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:40:22.469 4088 3038342145128 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:40:22.469 4088 3038342145128 MainThread INFO nova.compute.manager [-] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] VM Stopped (Lifecycle Event) 2021-09-10 17:40:22.469 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000093" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:40:22.469 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000093" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:40:22.469 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:40:22.497 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-a610f4aa-032d-43cc-95b4-60bdf2b89b28 - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:40:22.497 4088 3038342145128 MainThread DEBUG nova.virt.hyperv.vmops [req-a610f4aa-032d-43cc-95b4-60bdf2b89b28 - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:40:22.544 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-a610f4aa-032d-43cc-95b4-60bdf2b89b28 - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:40:22.564 4088 3038342145128 MainThread INFO nova.compute.manager [req-a610f4aa-032d-43cc-95b4-60bdf2b89b28 - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:40:22.715 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2219MB free_disk=49GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:40:22.715 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:40:22.845 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:40:22.845 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:40:22.845 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:40:22.845 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:40:22.845 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:40:22.845 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:40:22.845 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:40:22.845 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:40:22.845 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:40:22.845 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:40:22.845 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:40:22.845 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:40:22.845 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:40:22.861 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 791f6785-0942-4130-b2e4-c5238398c1c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:40:22.861 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:40:22.861 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=14GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:40:22.887 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:40:22.892 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:40:23.110 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:40:23.110 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:40:23.128 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:40:23.128 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:40:23.458 4088 3038342147592 MainThread DEBUG os_win.utils.jobutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Waiting for WMI job: {'InstanceID': 'BAA023A4-697D-4F8F-8085-B7EEA92826DC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19740), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:40:23.599 4088 3038342147592 MainThread ERROR os_win.utils.jobutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000093\' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)instance-000000931E56D8BD-4DB6-44BC-8977-D3091844A13D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)instance-000000931E56D8BD-4DB6-44BC-8977-D3091844A13D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000093\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)instance-000000931E56D8BD-4DB6-44BC-8977-D3091844A13D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'BAA023A4-697D-4F8F-8085-B7EEA92826DC', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118339), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 40, 23), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 40, 23), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000093' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)\n\nNot enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)\n\n'instance-00000093' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)", 'ErrorSummaryDescription': "'instance-00000093' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000093.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:40:23.599 4088 3038342147592 MainThread DEBUG os_win._utils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000093' failed to start. Not enough memory in the system to start the virtual machine instance-00000093. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000093' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Not enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) 'instance-00000093' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.725374698638916 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:40:23.662 4088 3038342145128 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:40:23.662 4088 3038342145128 MainThread INFO nova.compute.manager [-] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] VM Stopped (Lifecycle Event) 2021-09-10 17:40:23.662 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000093" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:40:23.662 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000093" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:40:23.672 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-1295c3f2-80de-4cc6-b120-cedde21e23b7 - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:40:23.688 4088 3038342145128 MainThread DEBUG nova.virt.hyperv.vmops [req-1295c3f2-80de-4cc6-b120-cedde21e23b7 - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:40:23.720 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-1295c3f2-80de-4cc6-b120-cedde21e23b7 - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:40:23.752 4088 3038342145128 MainThread INFO nova.compute.manager [req-1295c3f2-80de-4cc6-b120-cedde21e23b7 - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:40:24.122 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:40:24.454 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:40:24.625 4088 3038342147592 MainThread DEBUG os_win.utils.jobutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Waiting for WMI job: {'InstanceID': 'F5097ECC-F8E6-421C-9539-CA523F733E16', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14607), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:40:24.766 4088 3038342147592 MainThread ERROR os_win.utils.jobutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000093\' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)instance-000000931E56D8BD-4DB6-44BC-8977-D3091844A13D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)instance-000000931E56D8BD-4DB6-44BC-8977-D3091844A13D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000093\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)instance-000000931E56D8BD-4DB6-44BC-8977-D3091844A13D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'F5097ECC-F8E6-421C-9539-CA523F733E16', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113590), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 40, 24), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 40, 24), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000093' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)\n\nNot enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)\n\n'instance-00000093' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)", 'ErrorSummaryDescription': "'instance-00000093' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000093.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:40:24.766 4088 3038342147592 MainThread DEBUG os_win._utils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000093' failed to start. Not enough memory in the system to start the virtual machine instance-00000093. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000093' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Not enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) 'instance-00000093' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.892457723617554 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:40:24.814 4088 3038342145128 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:40:24.814 4088 3038342145128 MainThread INFO nova.compute.manager [-] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] VM Stopped (Lifecycle Event) 2021-09-10 17:40:24.814 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000093" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:40:24.814 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000093" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:40:24.840 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-46d009bd-3205-487c-831d-b4ec48f251af - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:40:24.840 4088 3038342145128 MainThread DEBUG nova.virt.hyperv.vmops [req-46d009bd-3205-487c-831d-b4ec48f251af - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:40:24.892 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-46d009bd-3205-487c-831d-b4ec48f251af - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:40:24.907 4088 3038342145128 MainThread INFO nova.compute.manager [req-46d009bd-3205-487c-831d-b4ec48f251af - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:40:25.794 4088 3038342147592 MainThread DEBUG os_win.utils.jobutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Waiting for WMI job: {'InstanceID': 'CA45B34B-C7B7-41FA-9928-2F0BC8D4E2B1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15831), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:40:25.940 4088 3038342147592 MainThread ERROR os_win.utils.jobutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000093\' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)instance-000000931E56D8BD-4DB6-44BC-8977-D3091844A13D12030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)instance-000000931E56D8BD-4DB6-44BC-8977-D3091844A13D10243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000093\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)instance-000000931E56D8BD-4DB6-44BC-8977-D3091844A13D%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'CA45B34B-C7B7-41FA-9928-2F0BC8D4E2B1', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113657), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 40, 25), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 40, 25), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000093' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)\n\nNot enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)\n\n'instance-00000093' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D)", 'ErrorSummaryDescription': "'instance-00000093' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000093.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:40:25.940 4088 3038342147592 MainThread ERROR nova.virt.hyperv.vmops [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Failed to change vm state of instance-00000093 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000093' failed to start. 2021-09-10 17:40:25.940 4088 3038342147592 MainThread INFO nova.virt.hyperv.vmops [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Got request to destroy instance 2021-09-10 17:40:25.966 4088 3038342145128 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:40:25.966 4088 3038342145128 MainThread INFO nova.compute.manager [-] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] VM Stopped (Lifecycle Event) 2021-09-10 17:40:25.997 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000093" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:40:25.997 4088 3038342146712 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000093" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:40:25.997 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-a145ba37-954f-43cf-96d8-a5a7ba5d21f9 - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:40:25.997 4088 3038342145128 MainThread DEBUG nova.virt.hyperv.vmops [req-a145ba37-954f-43cf-96d8-a5a7ba5d21f9 - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:40:26.061 4088 3038342145128 MainThread DEBUG nova.compute.manager [req-a145ba37-954f-43cf-96d8-a5a7ba5d21f9 - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:40:26.061 4088 3038342145128 MainThread INFO nova.compute.manager [req-a145ba37-954f-43cf-96d8-a5a7ba5d21f9 - - - - -] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:40:26.454 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:40:26.454 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:40:26.575 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-9db39d70-5120-4de4-bb87-480a6efb8a3a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:40:26.575 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:40:27.067 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Updating instance_info_cache with network_info: [{"id": "66953b8a-00d2-4045-8dae-abe4c015822d", "address": "fa:16:3e:7a:90:37", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap66953b8a-00", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:40:27.067 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-9db39d70-5120-4de4-bb87-480a6efb8a3a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:40:27.090 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:40:27.793 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.vmops [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:40:27.793 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "instance-00000093" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:40:27.793 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "instance-00000093" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:40:27.813 4088 3038342147592 MainThread DEBUG os_win.utils.compute.vmutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Successfully changed vm state of instance-00000093 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:40:27.813 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.vmops [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Successfully changed state of VM instance-00000093 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:40:27.856 4088 3038342147592 MainThread DEBUG os_win.utils.jobutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Waiting for WMI job: {'InstanceID': '9DB63557-F549-45E8-BC90-197188F462D6', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14681), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:40:28.095 4088 3038342147592 MainThread DEBUG os_win.utils.jobutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] WMI job succeeded: {'InstanceID': '9DB63557-F549-45E8-BC90-197188F462D6', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=141197), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:40:28.095 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "instance-00000093" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:40:28.095 4088 3038342147592 MainThread DEBUG os_win.utils.pathutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Removing directory: C:\openstack\instances\instance-00000093 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:40:28.095 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "instance-00000093" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:40:28.095 4088 3038342147592 MainThread ERROR nova.compute.manager [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000093' failed to start. Not enough memory in the system to start the virtual machine instance-00000093. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000093' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Not enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) 'instance-00000093' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Error code: 32778. 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Traceback (most recent call last): 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] return function(*args, **kwargs) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] admin_password, network_info, block_device_info) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] return function(self, *args, **kwds) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self.force_reraise() 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] raise self.value 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] should_plug_vifs=False) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 'req_state': req_state}) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self.force_reraise() 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] raise self.value 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] time.sleep(sleep_time) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self.force_reraise() 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] raise self.value 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] return f(*args, **kwargs) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] return self._wait_for_job(job_path) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] error_desc=err_desc) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000093' failed to start. 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Not enough memory in the system to start the virtual machine instance-00000093. 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000093' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Not enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 'instance-00000093' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Error code: 32778. 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] During handling of the above exception, another exception occurred: 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Traceback (most recent call last): 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] yield resources 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] accel_info=accel_info) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] return function(*args, **kwargs) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] admin_password, network_info, block_device_info) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] return function(self, *args, **kwds) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self.force_reraise() 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] raise self.value 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] should_plug_vifs=False) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 'req_state': req_state}) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self.force_reraise() 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] raise self.value 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] time.sleep(sleep_time) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self.force_reraise() 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] raise self.value 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] return f(*args, **kwargs) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] return self._wait_for_job(job_path) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] error_desc=err_desc) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000093' failed to start. 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Not enough memory in the system to start the virtual machine instance-00000093. 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000093' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Not enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 'instance-00000093' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Error code: 32778. 2021-09-10 17:40:28.095 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.095 4088 3038342147592 MainThread INFO nova.compute.manager [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Terminating instance 2021-09-10 17:40:28.095 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:40:28.095 4088 3038342147592 MainThread INFO nova.virt.hyperv.vmops [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Got request to destroy instance 2021-09-10 17:40:28.121 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.vmops [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:40:28.121 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "instance-00000093" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:40:28.121 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "instance-00000093" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:40:28.121 4088 3038342147592 MainThread INFO nova.compute.manager [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Took 0.03 seconds to destroy the instance on the hypervisor. 2021-09-10 17:40:28.135 4088 3038342147592 MainThread DEBUG nova.compute.claims [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:40:28.135 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:40:28.220 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.hostops [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:40:28.235 4088 3038342147592 MainThread DEBUG nova.virt.hyperv.hostops [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:40:28.421 4088 3038342147592 MainThread DEBUG nova.compute.provider_tree [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:40:28.451 4088 3038342147592 MainThread DEBUG nova.scheduler.client.report [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:40:28.451 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.313s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:40:28.451 4088 3038342147592 MainThread ERROR nova.compute.manager [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000093' failed to start. Not enough memory in the system to start the virtual machine instance-00000093. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000093' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Not enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) 'instance-00000093' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Error code: 32778. 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Traceback (most recent call last): 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] return function(*args, **kwargs) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] admin_password, network_info, block_device_info) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] return function(self, *args, **kwds) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self.force_reraise() 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] raise self.value 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] should_plug_vifs=False) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 'req_state': req_state}) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self.force_reraise() 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] raise self.value 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] time.sleep(sleep_time) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self.force_reraise() 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] raise self.value 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] return f(*args, **kwargs) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] return self._wait_for_job(job_path) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] error_desc=err_desc) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000093' failed to start. 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Not enough memory in the system to start the virtual machine instance-00000093. 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000093' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Not enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 'instance-00000093' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Error code: 32778. 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] During handling of the above exception, another exception occurred: 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Traceback (most recent call last): 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] accel_info=accel_info) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] return function(*args, **kwargs) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] admin_password, network_info, block_device_info) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] return function(self, *args, **kwds) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self.force_reraise() 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] raise self.value 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] should_plug_vifs=False) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 'req_state': req_state}) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self.force_reraise() 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] raise self.value 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] time.sleep(sleep_time) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self.force_reraise() 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] raise self.value 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] return f(*args, **kwargs) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] return self._wait_for_job(job_path) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] error_desc=err_desc) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000093' failed to start. 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Not enough memory in the system to start the virtual machine instance-00000093. 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000093' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Not enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 'instance-00000093' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Error code: 32778. 2021-09-10 17:40:28.451 4088 3038342147592 MainThread TRACE nova.compute.manager [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] 2021-09-10 17:40:28.451 4088 3038342147592 MainThread DEBUG nova.compute.utils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] WMI job failed with status 10. Error summary description: 'instance-00000093' failed to start. Not enough memory in the system to start the virtual machine instance-00000093. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:40:28.451 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Build of instance 791f6785-0942-4130-b2e4-c5238398c1c8 was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000093' failed to start. Not enough memory in the system to start the virtual machine instance-00000093. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000093' failed to start. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Not enough memory in the system to start the virtual machine instance-00000093 with ram size 1024 megabytes. (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) 'instance-00000093' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 1E56D8BD-4DB6-44BC-8977-D3091844A13D) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:40:28.451 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:40:28.451 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:40:28.451 4088 3038342147592 MainThread DEBUG nova.compute.manager [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:40:28.451 4088 3038342147592 MainThread DEBUG nova.network.neutron [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:40:28.934 4088 3038342147592 MainThread DEBUG nova.network.neutron [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:40:28.949 4088 3038342147592 MainThread INFO nova.compute.manager [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: 791f6785-0942-4130-b2e4-c5238398c1c8] Took 0.50 seconds to deallocate network for instance. 2021-09-10 17:40:29.089 4088 3038342147592 MainThread INFO nova.scheduler.client.report [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Deleted allocations for instance 791f6785-0942-4130-b2e4-c5238398c1c8 2021-09-10 17:40:29.110 4088 3038342147592 MainThread DEBUG oslo_concurrency.lockutils [req-cb51134a-d223-4c13-b746-b80b9836905a ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "791f6785-0942-4130-b2e4-c5238398c1c8" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 21.359s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:41:15.295 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "e373fdf1-1fae-4b31-9dd1-30a4529ed1ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:41:15.312 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:41:15.401 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:41:15.401 4088 3038300761080 MainThread DEBUG nova.virt.hardware [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:41:15.413 4088 3038300761080 MainThread INFO nova.compute.claims [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Claim successful on node n-h2-808474-1 2021-09-10 17:41:15.510 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.hostops [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:41:15.528 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.hostops [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:41:15.745 4088 3038300761080 MainThread DEBUG nova.compute.provider_tree [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:41:15.752 4088 3038300761080 MainThread DEBUG nova.scheduler.client.report [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:41:15.752 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:41:15.752 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:41:15.821 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:41:15.821 4088 3038300760904 GreenThread-137 DEBUG nova.compute.manager [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:41:15.821 4088 3038300760904 GreenThread-137 DEBUG nova.network.neutron [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:41:15.877 4088 3038300761080 MainThread INFO nova.virt.block_device [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Booting with volume 26a22bd2-cb94-4736-8838-312896b8255c at /dev/sda 2021-09-10 17:41:15.945 4088 3038300760904 GreenThread-137 DEBUG nova.policy [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca5b31b9b47e4f338e12c70f0c03a712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d2edbd40ad476fb7f6b1f64070fee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:41:15.963 4088 3038300761080 MainThread DEBUG os_brick.utils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] ==> get_connector_properties: call "{'root_helper': None, 'my_ip': '10.222.0.47', 'multipath': False, 'enforce_multipath': True, 'host': 'n-h2-808474-1', 'execute': None}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:41:15.963 4088 3038300761080 MainThread DEBUG os_brick.utils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] <== get_connector_properties: return (0ms) {'platform': 'AMD64', 'os_type': 'win32', 'ip': '10.222.0.47', 'host': 'n-h2-808474-1', 'multipath': False, 'initiator': 'iqn.1991-05.com.microsoft:n-h2-808474-1.cbci-808474-1.local'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:41:15.969 4088 3038300761080 MainThread DEBUG nova.virt.block_device [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Updating existing volume attachment record: a68d167b-7916-41aa-ab6d-90ac0961f24d _volume_attach c:\openstack\build\nova\nova\virt\block_device.py:556 2021-09-10 17:41:16.454 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:41:16.454 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:41:16.578 4088 3038300760904 GreenThread-137 DEBUG nova.network.neutron [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Successfully created port: eaf84346-2633-4949-a5b7-15f5afe8a761 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:41:17.215 4088 3038300760904 GreenThread-137 DEBUG nova.network.neutron [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Successfully updated port: eaf84346-2633-4949-a5b7-15f5afe8a761 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:41:17.249 4088 3038300760904 GreenThread-137 DEBUG oslo_concurrency.lockutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Acquired lock "refresh_cache-e373fdf1-1fae-4b31-9dd1-30a4529ed1ca" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:41:17.249 4088 3038300760904 GreenThread-137 DEBUG nova.network.neutron [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:41:17.298 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-4b510972-3d89-464f-89d7-92ba11c130aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Received event network-changed-eaf84346-2633-4949-a5b7-15f5afe8a761 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:41:17.298 4088 3038340492280 MainThread DEBUG nova.compute.manager [req-4b510972-3d89-464f-89d7-92ba11c130aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Refreshing instance network info cache due to event network-changed-eaf84346-2633-4949-a5b7-15f5afe8a761. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:41:17.324 4088 3038300760904 GreenThread-137 DEBUG nova.network.neutron [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:41:17.679 4088 3038300760904 GreenThread-137 DEBUG nova.network.neutron [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Updating instance_info_cache with network_info: [{"id": "eaf84346-2633-4949-a5b7-15f5afe8a761", "address": "fa:16:3e:6b:42:47", "network": {"id": "88182bf3-791a-48fd-ad45-bb3de5fa5f37", "bridge": null, "label": "tempest-TestShelveInstance-977255127-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "01d2edbd40ad476fb7f6b1f64070fee3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapeaf84346-26", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:41:17.704 4088 3038300760904 GreenThread-137 DEBUG oslo_concurrency.lockutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Releasing lock "refresh_cache-e373fdf1-1fae-4b31-9dd1-30a4529ed1ca" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:41:17.704 4088 3038300760904 GreenThread-137 DEBUG nova.compute.manager [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Instance network_info: |[{"id": "eaf84346-2633-4949-a5b7-15f5afe8a761", "address": "fa:16:3e:6b:42:47", "network": {"id": "88182bf3-791a-48fd-ad45-bb3de5fa5f37", "bridge": null, "label": "tempest-TestShelveInstance-977255127-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "01d2edbd40ad476fb7f6b1f64070fee3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapeaf84346-26", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:41:17.704 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-4b510972-3d89-464f-89d7-92ba11c130aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-e373fdf1-1fae-4b31-9dd1-30a4529ed1ca" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:41:17.704 4088 3038340492280 MainThread DEBUG nova.network.neutron [req-4b510972-3d89-464f-89d7-92ba11c130aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Refreshing network info cache for port eaf84346-2633-4949-a5b7-15f5afe8a761 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:41:18.198 4088 3038340492280 MainThread DEBUG nova.network.neutron [req-4b510972-3d89-464f-89d7-92ba11c130aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Updated VIF entry in instance network info cache for port eaf84346-2633-4949-a5b7-15f5afe8a761. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:41:18.198 4088 3038340492280 MainThread DEBUG nova.network.neutron [req-4b510972-3d89-464f-89d7-92ba11c130aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Updating instance_info_cache with network_info: [{"id": "eaf84346-2633-4949-a5b7-15f5afe8a761", "address": "fa:16:3e:6b:42:47", "network": {"id": "88182bf3-791a-48fd-ad45-bb3de5fa5f37", "bridge": null, "label": "tempest-TestShelveInstance-977255127-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "01d2edbd40ad476fb7f6b1f64070fee3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapeaf84346-26", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:41:18.220 4088 3038340492280 MainThread DEBUG oslo_concurrency.lockutils [req-4b510972-3d89-464f-89d7-92ba11c130aa 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-e373fdf1-1fae-4b31-9dd1-30a4529ed1ca" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:41:18.456 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:41:18.456 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:41:18.456 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:41:19.877 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:41:19.891 4088 3038300761080 MainThread INFO nova.virt.hyperv.vmops [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Spawning new instance 2021-09-10 17:41:19.891 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "instance-00000094" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:41:19.891 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "instance-00000094" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:41:19.891 4088 3038300761080 MainThread DEBUG nova.block_device [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] block_device_list ['sda'] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:41:19.891 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Preparing to wait for external event network-vif-plugged-eaf84346-2633-4949-a5b7-15f5afe8a761 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:41:19.891 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "e373fdf1-1fae-4b31-9dd1-30a4529ed1ca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:41:19.891 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "e373fdf1-1fae-4b31-9dd1-30a4529ed1ca-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:41:19.891 4088 3038300761080 MainThread DEBUG os_win.utils.compute.vmutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Creating VM instance-00000094 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:41:20.956 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.volumeops [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Attaching volume: {'driver_volume_type': 'iscsi', 'data': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-26a22bd2-cb94-4736-8838-312896b8255c', 'target_lun': 0, 'volume_id': '26a22bd2-cb94-4736-8838-312896b8255c', 'auth_method': 'CHAP', 'auth_username': 'Dy2Qf7XCEFUbu6eKJt2D', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'status': 'reserved', 'instance': 'e373fdf1-1fae-4b31-9dd1-30a4529ed1ca', 'attached_at': '', 'detached_at': '', 'volume_id': '26a22bd2-cb94-4736-8838-312896b8255c', 'serial': '26a22bd2-cb94-4736-8838-312896b8255c'} to instance-00000094 _attach_volume c:\openstack\build\nova\nova\virt\hyperv\volumeops.py:108 2021-09-10 17:41:20.956 4088 3038300761080 MainThread DEBUG os_brick.initiator.windows.iscsi [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-26a22bd2-cb94-4736-8838-312896b8255c', 'target_lun': 0, 'volume_id': '26a22bd2-cb94-4736-8838-312896b8255c', 'auth_method': 'CHAP', 'auth_username': 'Dy2Qf7XCEFUbu6eKJt2D', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:41:20.956 4088 3038300761080 MainThread INFO os_brick.initiator.windows.iscsi [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Attempting to establish an iSCSI session to target iqn.2010-10.org.openstack:volume-26a22bd2-cb94-4736-8838-312896b8255c on portal 10.222.0.55:3260 accessing LUN 0 using initiator None. 2021-09-10 17:41:20.956 4088 3038300761080 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Logging in iSCSI target iqn.2010-10.org.openstack:volume-26a22bd2-cb94-4736-8838-312896b8255c login_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:401 2021-09-10 17:41:21.461 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:41:23.447 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:41:23.447 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:41:23.464 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:41:23.464 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:41:23.464 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:41:23.464 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:41:23.486 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:41:23.700 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2220MB free_disk=49GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:41:23.700 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:41:23.839 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:41:23.839 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:41:23.839 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:41:23.839 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:41:23.839 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:41:23.839 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:41:23.839 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:41:23.839 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:41:23.839 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:41:23.839 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:41:23.839 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:41:23.839 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:41:23.861 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:41:23.861 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance e373fdf1-1fae-4b31-9dd1-30a4529ed1ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:41:23.861 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:41:23.861 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:41:23.877 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:41:23.892 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:41:24.111 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:41:24.111 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:41:24.111 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:41:24.111 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:41:25.119 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:41:25.151 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:41:25.986 4088 3038300761080 MainThread DEBUG os_win.utils.storage.diskutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:41:26.119 4088 3038300761080 MainThread DEBUG os_win.utils.storage.diskutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:41:26.173 4088 3038300761080 MainThread DEBUG os_brick.initiator.windows.iscsi [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] <== connect_volume: return (5217ms) {'type': 'block', 'path': '\\\\.\\PhysicalDrive1', 'number': 1, 'scsi_wwn': '36001405622A01F5EDB54CE598E8F6FCA'} trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:41:26.491 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:41:26.491 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:41:26.561 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-0e77fafa-3f8a-4513-bb64-518c77e99029" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:41:26.561 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:41:26.736 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:41:27.062 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Updating instance_info_cache with network_info: [{"id": "a8d3d6fd-c535-4f42-b11d-348191f22a38", "address": "fa:16:3e:61:e8:c4", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa8d3d6fd-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:41:27.073 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-0e77fafa-3f8a-4513-bb64-518c77e99029" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:41:27.073 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:41:31.150 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-84571bd8-7e1c-44d5-a2d7-3ba0a6ed2d6b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Received event network-vif-plugged-eaf84346-2633-4949-a5b7-15f5afe8a761 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:41:31.150 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-84571bd8-7e1c-44d5-a2d7-3ba0a6ed2d6b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "e373fdf1-1fae-4b31-9dd1-30a4529ed1ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:41:31.150 4088 3038300758440 MainThread DEBUG oslo_concurrency.lockutils [req-84571bd8-7e1c-44d5-a2d7-3ba0a6ed2d6b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "e373fdf1-1fae-4b31-9dd1-30a4529ed1ca-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:41:31.150 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-84571bd8-7e1c-44d5-a2d7-3ba0a6ed2d6b 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Processing event network-vif-plugged-eaf84346-2633-4949-a5b7-15f5afe8a761 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:41:31.181 4088 3038300761080 MainThread INFO nova.virt.hyperv.vmops [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Using config drive for instance 2021-09-10 17:41:31.283 4088 3038300761080 MainThread INFO nova.virt.hyperv.vmops [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Creating config drive at C:\openstack\instances\instance-00000094\configdrive.iso 2021-09-10 17:41:31.376 4088 3038300761080 MainThread DEBUG oslo_concurrency.processutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000094\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpxf12rhww execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:41:31.699 4088 3038300761080 MainThread DEBUG oslo_concurrency.processutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000094\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpxf12rhww" returned: 0 in 0.328s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:41:32.215 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Setting boot order for instance: instance-00000094: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:41:32.307 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:41:32.345 4088 3038300761080 MainThread DEBUG os_win.utils.jobutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Waiting for WMI job: {'InstanceID': '63798F30-1BC2-462F-A03F-2B65484F28E9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=21332), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:41:32.480 4088 3038300761080 MainThread ERROR os_win.utils.jobutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000094\' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)instance-000000944783590D-7BB3-4CC2-BDF4-08FAC4EB3C3712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)instance-000000944783590D-7BB3-4CC2-BDF4-08FAC4EB3C3710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000094\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)instance-000000944783590D-7BB3-4CC2-BDF4-08FAC4EB3C37%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '63798F30-1BC2-462F-A03F-2B65484F28E9', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=116376), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 41, 32), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 41, 32), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000094' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)\n\nNot enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)\n\n'instance-00000094' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)", 'ErrorSummaryDescription': "'instance-00000094' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000094.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:41:32.501 4088 3038300761080 MainThread DEBUG os_win._utils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000094' failed to start. Not enough memory in the system to start the virtual machine instance-00000094. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000094' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Not enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) 'instance-00000094' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1939246654510498 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:41:32.525 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000094" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:41:32.525 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000094" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:41:32.525 4088 3038300758440 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:41:32.525 4088 3038300758440 MainThread INFO nova.compute.manager [-] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] VM Stopped (Lifecycle Event) 2021-09-10 17:41:32.548 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-ce0bd639-bc87-4564-8f1f-e25a4f510875 - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:41:32.548 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.vmops [req-ce0bd639-bc87-4564-8f1f-e25a4f510875 - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:41:32.595 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-ce0bd639-bc87-4564-8f1f-e25a4f510875 - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:41:32.619 4088 3038300758440 MainThread INFO nova.compute.manager [req-ce0bd639-bc87-4564-8f1f-e25a4f510875 - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:41:33.541 4088 3038300761080 MainThread DEBUG os_win.utils.jobutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Waiting for WMI job: {'InstanceID': '5E3E6663-AE1C-4C62-881A-EAE2C9B1ECF3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15410), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:41:33.673 4088 3038300761080 MainThread ERROR os_win.utils.jobutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000094\' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)instance-000000944783590D-7BB3-4CC2-BDF4-08FAC4EB3C3712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)instance-000000944783590D-7BB3-4CC2-BDF4-08FAC4EB3C3710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000094\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)instance-000000944783590D-7BB3-4CC2-BDF4-08FAC4EB3C37%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5E3E6663-AE1C-4C62-881A-EAE2C9B1ECF3', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=112651), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 41, 33), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 41, 33), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000094' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)\n\nNot enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)\n\n'instance-00000094' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)", 'ErrorSummaryDescription': "'instance-00000094' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000094.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:41:33.673 4088 3038300761080 MainThread DEBUG os_win._utils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000094' failed to start. Not enough memory in the system to start the virtual machine instance-00000094. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000094' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Not enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) 'instance-00000094' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.366424798965454 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:41:33.732 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000094" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:41:33.732 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000094" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:41:33.732 4088 3038300758440 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:41:33.732 4088 3038300758440 MainThread INFO nova.compute.manager [-] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] VM Stopped (Lifecycle Event) 2021-09-10 17:41:33.756 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-c95d9d92-ac26-4cfa-a478-165ac828648c - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:41:33.756 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.vmops [req-c95d9d92-ac26-4cfa-a478-165ac828648c - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:41:33.798 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-c95d9d92-ac26-4cfa-a478-165ac828648c - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:41:33.828 4088 3038300758440 MainThread INFO nova.compute.manager [req-c95d9d92-ac26-4cfa-a478-165ac828648c - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:41:34.683 4088 3038300761080 MainThread DEBUG os_win.utils.jobutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Waiting for WMI job: {'InstanceID': '2B8068D3-D7DA-4A83-BB79-921B1CB0FD0C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16080), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:41:34.830 4088 3038300761080 MainThread ERROR os_win.utils.jobutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000094\' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)instance-000000944783590D-7BB3-4CC2-BDF4-08FAC4EB3C3712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)instance-000000944783590D-7BB3-4CC2-BDF4-08FAC4EB3C3710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000094\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)instance-000000944783590D-7BB3-4CC2-BDF4-08FAC4EB3C37%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '2B8068D3-D7DA-4A83-BB79-921B1CB0FD0C', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114054), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 41, 34), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 41, 34), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000094' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)\n\nNot enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)\n\n'instance-00000094' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)", 'ErrorSummaryDescription': "'instance-00000094' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000094.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:41:34.830 4088 3038300761080 MainThread DEBUG os_win._utils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000094' failed to start. Not enough memory in the system to start the virtual machine instance-00000094. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000094' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Not enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) 'instance-00000094' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.523292303085327 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:41:34.855 4088 3038300758440 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:41:34.855 4088 3038300758440 MainThread INFO nova.compute.manager [-] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] VM Stopped (Lifecycle Event) 2021-09-10 17:41:34.855 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000094" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:41:34.855 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000094" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:41:34.892 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-6ce412a5-5749-498e-b086-19755cc1cf17 - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:41:34.892 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.vmops [req-6ce412a5-5749-498e-b086-19755cc1cf17 - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:41:34.939 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-6ce412a5-5749-498e-b086-19755cc1cf17 - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:41:34.939 4088 3038300758440 MainThread INFO nova.compute.manager [req-6ce412a5-5749-498e-b086-19755cc1cf17 - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:41:35.861 4088 3038300761080 MainThread DEBUG os_win.utils.jobutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Waiting for WMI job: {'InstanceID': '18818D3C-E9AD-4F01-9CFC-572B34A9E770', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15447), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:41:36.005 4088 3038300761080 MainThread ERROR os_win.utils.jobutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000094\' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)instance-000000944783590D-7BB3-4CC2-BDF4-08FAC4EB3C3712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)instance-000000944783590D-7BB3-4CC2-BDF4-08FAC4EB3C3710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000094\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)instance-000000944783590D-7BB3-4CC2-BDF4-08FAC4EB3C37%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '18818D3C-E9AD-4F01-9CFC-572B34A9E770', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113878), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 41, 35), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 41, 35), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000094' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)\n\nNot enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)\n\n'instance-00000094' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)", 'ErrorSummaryDescription': "'instance-00000094' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000094.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:41:36.005 4088 3038300761080 MainThread DEBUG os_win._utils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000094' failed to start. Not enough memory in the system to start the virtual machine instance-00000094. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000094' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Not enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) 'instance-00000094' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.69781494140625 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:41:36.013 4088 3038300758440 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:41:36.013 4088 3038300758440 MainThread INFO nova.compute.manager [-] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] VM Stopped (Lifecycle Event) 2021-09-10 17:41:36.013 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000094" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:41:36.013 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000094" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:41:36.041 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-c2470dd6-d21f-4714-a1b1-2c30cc6650ba - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:41:36.041 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.vmops [req-c2470dd6-d21f-4714-a1b1-2c30cc6650ba - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:41:36.072 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-c2470dd6-d21f-4714-a1b1-2c30cc6650ba - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:41:36.110 4088 3038300758440 MainThread INFO nova.compute.manager [req-c2470dd6-d21f-4714-a1b1-2c30cc6650ba - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:41:37.029 4088 3038300761080 MainThread DEBUG os_win.utils.jobutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Waiting for WMI job: {'InstanceID': '5205FD4A-D05E-454A-BCBC-F6145EC47144', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15368), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:41:37.173 4088 3038300761080 MainThread ERROR os_win.utils.jobutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000094\' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)instance-000000944783590D-7BB3-4CC2-BDF4-08FAC4EB3C3712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)instance-000000944783590D-7BB3-4CC2-BDF4-08FAC4EB3C3710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000094\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)instance-000000944783590D-7BB3-4CC2-BDF4-08FAC4EB3C37%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '5205FD4A-D05E-454A-BCBC-F6145EC47144', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115089), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 41, 37), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 41, 37), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000094' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)\n\nNot enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)\n\n'instance-00000094' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)", 'ErrorSummaryDescription': "'instance-00000094' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000094.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:41:37.173 4088 3038300761080 MainThread DEBUG os_win._utils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000094' failed to start. Not enough memory in the system to start the virtual machine instance-00000094. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000094' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Not enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) 'instance-00000094' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.86659049987793 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:41:37.215 4088 3038300758440 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:41:37.215 4088 3038300758440 MainThread INFO nova.compute.manager [-] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] VM Stopped (Lifecycle Event) 2021-09-10 17:41:37.215 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000094" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:41:37.235 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000094" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.016s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:41:37.235 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-b7d24322-92b3-4e45-843c-99f314a97859 - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:41:37.235 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.vmops [req-b7d24322-92b3-4e45-843c-99f314a97859 - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:41:37.296 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-b7d24322-92b3-4e45-843c-99f314a97859 - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:41:37.307 4088 3038300758440 MainThread INFO nova.compute.manager [req-b7d24322-92b3-4e45-843c-99f314a97859 - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:41:38.190 4088 3038300761080 MainThread DEBUG os_win.utils.jobutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Waiting for WMI job: {'InstanceID': '977582EE-CF72-4071-932A-A7AA631B159B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16684), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:41:38.322 4088 3038300761080 MainThread ERROR os_win.utils.jobutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000094\' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)instance-000000944783590D-7BB3-4CC2-BDF4-08FAC4EB3C3712030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)instance-000000944783590D-7BB3-4CC2-BDF4-08FAC4EB3C3710243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000094\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)instance-000000944783590D-7BB3-4CC2-BDF4-08FAC4EB3C37%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '977582EE-CF72-4071-932A-A7AA631B159B', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=123115), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 41, 38), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 41, 38), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000094' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)\n\nNot enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)\n\n'instance-00000094' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37)", 'ErrorSummaryDescription': "'instance-00000094' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000094.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:41:38.338 4088 3038300761080 MainThread ERROR nova.virt.hyperv.vmops [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Failed to change vm state of instance-00000094 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000094' failed to start. 2021-09-10 17:41:38.338 4088 3038300761080 MainThread INFO nova.virt.hyperv.vmops [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Got request to destroy instance 2021-09-10 17:41:38.386 4088 3038300758440 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:41:38.386 4088 3038300758440 MainThread INFO nova.compute.manager [-] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] VM Stopped (Lifecycle Event) 2021-09-10 17:41:38.404 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000094" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:41:38.404 4088 3038300760904 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000094" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:41:38.404 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-340fb5a1-7018-48ff-89c4-c8f46f884362 - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:41:38.404 4088 3038300758440 MainThread DEBUG nova.virt.hyperv.vmops [req-340fb5a1-7018-48ff-89c4-c8f46f884362 - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:41:38.464 4088 3038300758440 MainThread DEBUG nova.compute.manager [req-340fb5a1-7018-48ff-89c4-c8f46f884362 - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:41:38.498 4088 3038300758440 MainThread INFO nova.compute.manager [req-340fb5a1-7018-48ff-89c4-c8f46f884362 - - - - -] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:41:40.244 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:41:40.244 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "instance-00000094" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:41:40.244 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "instance-00000094" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:41:40.268 4088 3038300761080 MainThread DEBUG os_win.utils.compute.vmutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Successfully changed vm state of instance-00000094 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:41:40.268 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Successfully changed state of VM instance-00000094 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:41:40.315 4088 3038300761080 MainThread DEBUG os_win.utils.jobutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Waiting for WMI job: {'InstanceID': '89923A7B-CE00-40C6-9A73-274210B44469', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14768), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:41:40.447 4088 3038300761080 MainThread DEBUG os_win.utils.jobutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] WMI job succeeded: {'InstanceID': '89923A7B-CE00-40C6-9A73-274210B44469', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=109782), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:41:40.447 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "instance-00000094" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:41:40.447 4088 3038300761080 MainThread DEBUG os_win.utils.pathutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Removing directory: C:\openstack\instances\instance-00000094 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:41:40.447 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "instance-00000094" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:41:40.447 4088 3038300761080 MainThread ERROR nova.compute.manager [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000094' failed to start. Not enough memory in the system to start the virtual machine instance-00000094. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000094' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Not enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) 'instance-00000094' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Error code: 32778. 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Traceback (most recent call last): 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] return function(*args, **kwargs) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] admin_password, network_info, block_device_info) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] return function(self, *args, **kwds) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self.force_reraise() 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] raise self.value 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] should_plug_vifs=False) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 'req_state': req_state}) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self.force_reraise() 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] raise self.value 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] time.sleep(sleep_time) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self.force_reraise() 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] raise self.value 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] return f(*args, **kwargs) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] return self._wait_for_job(job_path) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] error_desc=err_desc) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000094' failed to start. 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Not enough memory in the system to start the virtual machine instance-00000094. 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000094' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Not enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 'instance-00000094' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Error code: 32778. 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] During handling of the above exception, another exception occurred: 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Traceback (most recent call last): 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] yield resources 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] accel_info=accel_info) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] return function(*args, **kwargs) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] admin_password, network_info, block_device_info) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] return function(self, *args, **kwds) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self.force_reraise() 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] raise self.value 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] should_plug_vifs=False) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 'req_state': req_state}) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self.force_reraise() 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] raise self.value 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] time.sleep(sleep_time) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self.force_reraise() 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] raise self.value 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] return f(*args, **kwargs) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] return self._wait_for_job(job_path) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] error_desc=err_desc) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000094' failed to start. 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Not enough memory in the system to start the virtual machine instance-00000094. 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000094' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Not enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 'instance-00000094' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Error code: 32778. 2021-09-10 17:41:40.447 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:40.455 4088 3038300761080 MainThread INFO nova.compute.manager [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Terminating instance 2021-09-10 17:41:40.455 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:41:40.455 4088 3038300761080 MainThread INFO nova.virt.hyperv.vmops [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Got request to destroy instance 2021-09-10 17:41:40.470 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.vmops [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:41:40.470 4088 3038300761080 MainThread DEBUG os_brick.initiator.windows.iscsi [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] ==> disconnect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '10.222.0.55:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-26a22bd2-cb94-4736-8838-312896b8255c', 'target_lun': 0, 'volume_id': '26a22bd2-cb94-4736-8838-312896b8255c', 'auth_method': 'CHAP', 'auth_username': 'Dy2Qf7XCEFUbu6eKJt2D', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}, 'device_info': None, 'force': False, 'ignore_errors': False}" trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:163 2021-09-10 17:41:40.470 4088 3038300761080 MainThread DEBUG os_win.utils.storage.diskutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:199 2021-09-10 17:41:40.573 4088 3038300761080 MainThread DEBUG os_win.utils.storage.diskutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Finished rescanning disks. _rescan_disks c:\openstack\build\os-win\os_win\utils\storage\diskutils.py:210 2021-09-10 17:41:40.573 4088 3038300761080 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Logging out iSCSI target iqn.2010-10.org.openstack:volume-26a22bd2-cb94-4736-8838-312896b8255c logout_storage_target c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:480 2021-09-10 17:41:40.635 4088 3038300761080 MainThread DEBUG os_win.utils.storage.initiator.iscsi_utils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Removing iSCSI target persistent login: iqn.2010-10.org.openstack:volume-26a22bd2-cb94-4736-8838-312896b8255c _remove_target_persistent_logins c:\openstack\build\os-win\os_win\utils\storage\initiator\iscsi_utils.py:495 2021-09-10 17:41:40.661 4088 3038300761080 MainThread DEBUG os_brick.initiator.windows.iscsi [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] <== disconnect_volume: return (190ms) None trace_logging_wrapper c:\python37\lib\site-packages\os_brick\utils.py:187 2021-09-10 17:41:40.661 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "instance-00000094" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:41:40.661 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "instance-00000094" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:41:40.661 4088 3038300761080 MainThread INFO nova.compute.manager [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Took 0.22 seconds to destroy the instance on the hypervisor. 2021-09-10 17:41:43.863 4088 3038300761080 MainThread INFO nova.compute.manager [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Took 3.20 seconds to detach 1 volumes for instance. 2021-09-10 17:41:43.863 4088 3038300761080 MainThread DEBUG nova.compute.claims [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:41:43.876 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:41:43.962 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.hostops [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:41:43.969 4088 3038300761080 MainThread DEBUG nova.virt.hyperv.hostops [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:41:44.175 4088 3038300761080 MainThread DEBUG nova.compute.provider_tree [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:41:44.192 4088 3038300761080 MainThread DEBUG nova.scheduler.client.report [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:41:44.192 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.328s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:41:44.192 4088 3038300761080 MainThread ERROR nova.compute.manager [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000094' failed to start. Not enough memory in the system to start the virtual machine instance-00000094. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000094' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Not enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) 'instance-00000094' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Error code: 32778. 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Traceback (most recent call last): 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] return function(*args, **kwargs) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] admin_password, network_info, block_device_info) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] return function(self, *args, **kwds) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self.force_reraise() 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] raise self.value 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] should_plug_vifs=False) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 'req_state': req_state}) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self.force_reraise() 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] raise self.value 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] time.sleep(sleep_time) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self.force_reraise() 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] raise self.value 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] return f(*args, **kwargs) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] return self._wait_for_job(job_path) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] error_desc=err_desc) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000094' failed to start. 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Not enough memory in the system to start the virtual machine instance-00000094. 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000094' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Not enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 'instance-00000094' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Error code: 32778. 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] During handling of the above exception, another exception occurred: 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Traceback (most recent call last): 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] accel_info=accel_info) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] return function(*args, **kwargs) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] admin_password, network_info, block_device_info) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] return function(self, *args, **kwds) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self.force_reraise() 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] raise self.value 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] should_plug_vifs=False) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 'req_state': req_state}) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self.force_reraise() 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] raise self.value 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] time.sleep(sleep_time) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self.force_reraise() 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] raise self.value 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] return f(*args, **kwargs) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] return self._wait_for_job(job_path) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] error_desc=err_desc) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000094' failed to start. 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Not enough memory in the system to start the virtual machine instance-00000094. 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000094' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Not enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 'instance-00000094' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Error code: 32778. 2021-09-10 17:41:44.192 4088 3038300761080 MainThread TRACE nova.compute.manager [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] 2021-09-10 17:41:44.207 4088 3038300761080 MainThread DEBUG nova.compute.utils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] WMI job failed with status 10. Error summary description: 'instance-00000094' failed to start. Not enough memory in the system to start the virtual machine instance-00000094. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:41:44.207 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Build of instance e373fdf1-1fae-4b31-9dd1-30a4529ed1ca was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000094' failed to start. Not enough memory in the system to start the virtual machine instance-00000094. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000094' failed to start. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Not enough memory in the system to start the virtual machine instance-00000094 with ram size 1024 megabytes. (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) 'instance-00000094' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 4783590D-7BB3-4CC2-BDF4-08FAC4EB3C37) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:41:44.207 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:41:44.207 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:41:44.207 4088 3038300761080 MainThread DEBUG nova.compute.manager [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:41:44.207 4088 3038300761080 MainThread DEBUG nova.network.neutron [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:41:44.697 4088 3038300761080 MainThread DEBUG nova.network.neutron [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:41:44.707 4088 3038300761080 MainThread INFO nova.compute.manager [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] [instance: e373fdf1-1fae-4b31-9dd1-30a4529ed1ca] Took 0.50 seconds to deallocate network for instance. 2021-09-10 17:41:44.707 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:41:44.868 4088 3038300761080 MainThread INFO nova.scheduler.client.report [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Deleted allocations for instance e373fdf1-1fae-4b31-9dd1-30a4529ed1ca 2021-09-10 17:41:44.910 4088 3038300761080 MainThread DEBUG oslo_concurrency.lockutils [req-74865e52-9050-4af9-a3f0-668bdc0ebe67 ca5b31b9b47e4f338e12c70f0c03a712 01d2edbd40ad476fb7f6b1f64070fee3 - default default] Lock "e373fdf1-1fae-4b31-9dd1-30a4529ed1ca" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 29.625s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:42:16.489 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:42:18.441 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:42:18.441 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:42:18.441 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:42:20.441 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:42:21.445 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:42:24.113 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Lock "2423d019-a7f7-433a-9baf-c071866eaccd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:42:24.128 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Starting instance... _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2197 2021-09-10 17:42:24.273 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:42:24.273 4088 3038340489992 MainThread DEBUG nova.virt.hardware [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Require both a host and instance NUMA topology to fit instance on host. numa_fit_instance_to_host c:\openstack\build\nova\nova\virt\hardware.py:2177 2021-09-10 17:42:24.273 4088 3038340489992 MainThread INFO nova.compute.claims [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Claim successful on node n-h2-808474-1 2021-09-10 17:42:24.395 4088 3038340489992 MainThread DEBUG nova.scheduler.client.report [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Refreshing inventories for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:757 2021-09-10 17:42:24.425 4088 3038340489992 MainThread DEBUG nova.scheduler.client.report [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Updating ProviderTree inventory for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 from _refresh_and_get_inventory using data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} _refresh_and_get_inventory c:\openstack\build\nova\nova\scheduler\client\report.py:723 2021-09-10 17:42:24.425 4088 3038340489992 MainThread DEBUG nova.compute.provider_tree [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Updating inventory in ProviderTree for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 with inventory: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:176 2021-09-10 17:42:24.445 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:42:24.445 4088 3038340489992 MainThread DEBUG nova.scheduler.client.report [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Refreshing aggregate associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, aggregates: None _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:766 2021-09-10 17:42:24.463 4088 3038340489992 MainThread DEBUG nova.scheduler.client.report [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Refreshing trait associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_VHD,COMPUTE_IMAGE_TYPE_VHDX,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:778 2021-09-10 17:42:24.492 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.hostops [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:42:24.507 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.hostops [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:42:24.726 4088 3038340489992 MainThread DEBUG nova.compute.provider_tree [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:42:24.742 4088 3038340489992 MainThread DEBUG nova.scheduler.client.report [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:42:24.742 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:42:24.742 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Start building networks asynchronously for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2576 2021-09-10 17:42:24.742 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.282s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:42:24.742 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:42:24.742 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:42:24.742 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:42:24.758 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:42:24.797 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Start building block device mappings for instance. _build_resources c:\openstack\build\nova\nova\compute\manager.py:2611 2021-09-10 17:42:24.816 4088 3038340491752 GreenThread-138 DEBUG nova.compute.manager [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Allocating IP information in the background. _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1756 2021-09-10 17:42:24.816 4088 3038340491752 GreenThread-138 DEBUG nova.network.neutron [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] allocate_for_instance() allocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1116 2021-09-10 17:42:24.941 4088 3038340491752 GreenThread-138 DEBUG nova.policy [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10226e0397b7435499d0680801742547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efd33abd6ee4c68bcbc61a4464c4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} authorize c:\openstack\build\nova\nova\policy.py:202 2021-09-10 17:42:24.941 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Start spawning the instance on the hypervisor. _build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2396 2021-09-10 17:42:24.973 4088 3038340489992 MainThread INFO nova.virt.hyperv.vmops [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Spawning new instance 2021-09-10 17:42:24.973 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Lock "instance-00000095" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:42:24.973 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Lock "instance-00000095" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:42:24.988 4088 3038340489992 MainThread DEBUG nova.block_device [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] block_device_list [] volume_in_mapping c:\openstack\build\nova\nova\block_device.py:593 2021-09-10 17:42:24.988 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" acquired by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:42:24.988 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Lock "2db44274-f9cc-4e8a-a37d-2b6502ddf47d-cache.lock" released by "nova.virt.hyperv.imagecache.ImageCache.get_cached_image..fetch_image_if_not_existing" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:42:24.988 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2213MB free_disk=49GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:42:24.988 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:42:24.988 4088 3038340489992 MainThread DEBUG os_win.utils.pathutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Creating directory: C:\openstack\instances\instance-00000095 check_create_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:146 2021-09-10 17:42:24.988 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Creating differencing VHD. Parent: C:\openstack\instances\_base\2db44274-f9cc-4e8a-a37d-2b6502ddf47d.vhdx, Target: C:\openstack\instances\instance-00000095\root.vhdx _create_root_vhd c:\openstack\build\nova\nova\virt\hyperv\vmops.py:158 2021-09-10 17:42:25.129 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:42:25.129 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:42:25.129 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:42:25.129 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:42:25.129 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:42:25.129 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:42:25.129 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:42:25.129 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:42:25.129 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:42:25.129 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:42:25.146 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:42:25.146 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:42:25.146 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:42:25.146 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 2423d019-a7f7-433a-9baf-c071866eaccd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:42:25.146 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 14 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:42:25.146 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=14848MB phys_disk=79GB used_disk=14GB total_vcpus=6 used_vcpus=14 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:42:25.164 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:42:25.184 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:42:25.241 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Resizing VHD C:\openstack\instances\instance-00000095\root.vhdx to new size 1065353216 _is_resize_needed c:\openstack\build\nova\nova\virt\hyperv\vmops.py:201 2021-09-10 17:42:25.429 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:42:25.445 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:42:25.445 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:42:25.445 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:42:25.554 4088 3038340491752 GreenThread-138 DEBUG nova.network.neutron [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Successfully created port: ae52cad2-ab4d-49f1-af56-da3aa09e6f72 _create_port_minimal c:\openstack\build\nova\nova\network\neutron.py:533 2021-09-10 17:42:26.179 4088 3038340491752 GreenThread-138 DEBUG nova.network.neutron [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Successfully updated port: ae52cad2-ab4d-49f1-af56-da3aa09e6f72 _update_port c:\openstack\build\nova\nova\network\neutron.py:571 2021-09-10 17:42:26.179 4088 3038340491752 GreenThread-138 DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Acquired lock "refresh_cache-2423d019-a7f7-433a-9baf-c071866eaccd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:42:26.179 4088 3038340491752 GreenThread-138 DEBUG nova.network.neutron [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Building network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1877 2021-09-10 17:42:26.239 4088 3038340489640 MainThread DEBUG nova.compute.manager [req-4109e3c7-bc25-403a-9b3c-dba4c37a6809 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Received event network-changed-ae52cad2-ab4d-49f1-af56-da3aa09e6f72 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:42:26.239 4088 3038340489640 MainThread DEBUG nova.compute.manager [req-4109e3c7-bc25-403a-9b3c-dba4c37a6809 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Refreshing instance network info cache due to event network-changed-ae52cad2-ab4d-49f1-af56-da3aa09e6f72. external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10511 2021-09-10 17:42:26.261 4088 3038340491752 GreenThread-138 DEBUG nova.network.neutron [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Instance cache missing network info. _get_preexisting_port_ids c:\openstack\build\nova\nova\network\neutron.py:3153 2021-09-10 17:42:26.445 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:42:26.445 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:42:26.508 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-50586591-86ba-41be-b4e1-5004ea0d76dd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:42:26.508 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:42:26.601 4088 3038340491752 GreenThread-138 DEBUG nova.network.neutron [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Updating instance_info_cache with network_info: [{"id": "ae52cad2-ab4d-49f1-af56-da3aa09e6f72", "address": "fa:16:3e:da:09:de", "network": {"id": "9c9ec601-183d-4fbc-9575-40c57d66c504", "bridge": null, "label": "tempest-TestSnapshotPattern-1357695525-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3efd33abd6ee4c68bcbc61a4464c4134", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapae52cad2-ab", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:42:26.630 4088 3038340491752 GreenThread-138 DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Releasing lock "refresh_cache-2423d019-a7f7-433a-9baf-c071866eaccd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:42:26.630 4088 3038340491752 GreenThread-138 DEBUG nova.compute.manager [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Instance network_info: |[{"id": "ae52cad2-ab4d-49f1-af56-da3aa09e6f72", "address": "fa:16:3e:da:09:de", "network": {"id": "9c9ec601-183d-4fbc-9575-40c57d66c504", "bridge": null, "label": "tempest-TestSnapshotPattern-1357695525-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3efd33abd6ee4c68bcbc61a4464c4134", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapae52cad2-ab", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| _allocate_network_async c:\openstack\build\nova\nova\compute\manager.py:1771 2021-09-10 17:42:26.630 4088 3038340489640 MainThread DEBUG oslo_concurrency.lockutils [req-4109e3c7-bc25-403a-9b3c-dba4c37a6809 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Acquired lock "refresh_cache-2423d019-a7f7-433a-9baf-c071866eaccd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:42:26.630 4088 3038340489640 MainThread DEBUG nova.network.neutron [req-4109e3c7-bc25-403a-9b3c-dba4c37a6809 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Refreshing network info cache for port ae52cad2-ab4d-49f1-af56-da3aa09e6f72 _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1874 2021-09-10 17:42:26.630 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Preparing to wait for external event network-vif-plugged-ae52cad2-ab4d-49f1-af56-da3aa09e6f72 prepare_for_instance_event c:\openstack\build\nova\nova\compute\manager.py:281 2021-09-10 17:42:26.630 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Lock "2423d019-a7f7-433a-9baf-c071866eaccd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:42:26.630 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Lock "2423d019-a7f7-433a-9baf-c071866eaccd-events" released by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:42:26.630 4088 3038340489992 MainThread DEBUG os_win.utils.compute.vmutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Creating VM instance-00000095 create_vm c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:353 2021-09-10 17:42:27.039 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Updating instance_info_cache with network_info: [{"id": "ad57189e-6845-4bd3-a7d1-681004b754a9", "address": "fa:16:3e:7f:ee:91", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapad57189e-68", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:42:27.057 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-50586591-86ba-41be-b4e1-5004ea0d76dd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:42:27.057 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:42:27.057 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:42:27.057 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:42:27.057 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_incomplete_migrations run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:42:27.057 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances with incomplete migration _cleanup_incomplete_migrations c:\openstack\build\nova\nova\compute\manager.py:10640 2021-09-10 17:42:27.132 4088 3038340489640 MainThread DEBUG nova.network.neutron [req-4109e3c7-bc25-403a-9b3c-dba4c37a6809 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Updated VIF entry in instance network info cache for port ae52cad2-ab4d-49f1-af56-da3aa09e6f72. _build_network_info_model c:\openstack\build\nova\nova\network\neutron.py:3288 2021-09-10 17:42:27.132 4088 3038340489640 MainThread DEBUG nova.network.neutron [req-4109e3c7-bc25-403a-9b3c-dba4c37a6809 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Updating instance_info_cache with network_info: [{"id": "ae52cad2-ab4d-49f1-af56-da3aa09e6f72", "address": "fa:16:3e:da:09:de", "network": {"id": "9c9ec601-183d-4fbc-9575-40c57d66c504", "bridge": null, "label": "tempest-TestSnapshotPattern-1357695525-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3efd33abd6ee4c68bcbc61a4464c4134", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapae52cad2-ab", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:42:27.149 4088 3038340489640 MainThread DEBUG oslo_concurrency.lockutils [req-4109e3c7-bc25-403a-9b3c-dba4c37a6809 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Releasing lock "refresh_cache-2423d019-a7f7-433a-9baf-c071866eaccd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:42:28.387 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Creating nic for instance create_instance c:\openstack\build\nova\nova\virt\hyperv\vmops.py:421 2021-09-10 17:42:32.460 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:42:35.429 4088 3038340491576 MainThread DEBUG nova.compute.manager [req-830cabcc-5c64-4562-b307-a2e1c4ace2c3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Received event network-vif-plugged-ae52cad2-ab4d-49f1-af56-da3aa09e6f72 external_instance_event c:\openstack\build\nova\nova\compute\manager.py:10507 2021-09-10 17:42:35.429 4088 3038340491576 MainThread DEBUG oslo_concurrency.lockutils [req-830cabcc-5c64-4562-b307-a2e1c4ace2c3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "2423d019-a7f7-433a-9baf-c071866eaccd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:42:35.429 4088 3038340491576 MainThread DEBUG oslo_concurrency.lockutils [req-830cabcc-5c64-4562-b307-a2e1c4ace2c3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] Lock "2423d019-a7f7-433a-9baf-c071866eaccd-events" released by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:42:35.429 4088 3038340491576 MainThread DEBUG nova.compute.manager [req-830cabcc-5c64-4562-b307-a2e1c4ace2c3 066bb0a533264941b909702b76848d2e 5fb6e4652c6846e2b642a48e1ed4ccae - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Processing event network-vif-plugged-ae52cad2-ab4d-49f1-af56-da3aa09e6f72 _process_instance_event c:\openstack\build\nova\nova\compute\manager.py:10266 2021-09-10 17:42:35.457 4088 3038340489992 MainThread INFO nova.virt.hyperv.vmops [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Using config drive for instance 2021-09-10 17:42:35.569 4088 3038340489992 MainThread INFO nova.virt.hyperv.vmops [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Creating config drive at C:\openstack\instances\instance-00000095\configdrive.iso 2021-09-10 17:42:35.644 4088 3038340489992 MainThread DEBUG oslo_concurrency.processutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Running cmd (subprocess): c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000095\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpk5o3hdsr execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:384 2021-09-10 17:42:36.007 4088 3038340489992 MainThread DEBUG oslo_concurrency.processutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] CMD "c:\openstack\bin\mkisofs.exe -o C:\openstack\instances\instance-00000095\configdrive.iso -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 23.1.0 -quiet -J -r -V config-2 C:\Users\ADMINI~1\AppData\Local\Temp\tmpk5o3hdsr" returned: 0 in 0.359s execute c:\python37\lib\site-packages\oslo_concurrency\processutils.py:423 2021-09-10 17:42:36.520 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Setting boot order for instance: instance-00000095: [2, 1, 3, 0] set_boot_order c:\openstack\build\nova\nova\virt\hyperv\vmops.py:252 2021-09-10 17:42:36.602 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Power on instance power_on c:\openstack\build\nova\nova\virt\hyperv\vmops.py:860 2021-09-10 17:42:36.647 4088 3038340489992 MainThread DEBUG os_win.utils.jobutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Waiting for WMI job: {'InstanceID': 'D04D3DCD-2FC5-43F1-BC70-55FF3E0AA705', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=19204), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:42:36.788 4088 3038340489992 MainThread ERROR os_win.utils.jobutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000095\' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)instance-000000953CAA6BFB-0CC5-4366-A431-30902C757B9112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)instance-000000953CAA6BFB-0CC5-4366-A431-30902C757B9110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000095\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)instance-000000953CAA6BFB-0CC5-4366-A431-30902C757B91%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'D04D3DCD-2FC5-43F1-BC70-55FF3E0AA705', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=115951), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 42, 36), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 42, 36), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000095' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)\n\nNot enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)\n\n'instance-00000095' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)", 'ErrorSummaryDescription': "'instance-00000095' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000095.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:42:36.788 4088 3038340489992 MainThread DEBUG os_win._utils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000095' failed to start. Not enough memory in the system to start the virtual machine instance-00000095. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000095' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Not enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) 'instance-00000095' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 5. Time left: undefined. Time elapsed: 0.1865217685699463 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:42:36.805 4088 3038340491576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000095" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:42:36.805 4088 3038340491576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000095" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:42:36.805 4088 3038340491752 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:42:36.805 4088 3038340491752 MainThread INFO nova.compute.manager [-] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] VM Stopped (Lifecycle Event) 2021-09-10 17:42:36.832 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-4ff9aeea-2a2e-42d1-a146-0db19a5a975d - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:42:36.847 4088 3038340491752 MainThread DEBUG nova.virt.hyperv.vmops [req-4ff9aeea-2a2e-42d1-a146-0db19a5a975d - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:42:36.897 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-4ff9aeea-2a2e-42d1-a146-0db19a5a975d - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:42:36.900 4088 3038340491752 MainThread INFO nova.compute.manager [req-4ff9aeea-2a2e-42d1-a146-0db19a5a975d - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:42:37.822 4088 3038340489992 MainThread DEBUG os_win.utils.jobutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Waiting for WMI job: {'InstanceID': 'F643F90D-05B9-4AF6-8DA5-34FC628EEFC5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16298), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:42:37.979 4088 3038340489992 MainThread ERROR os_win.utils.jobutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000095\' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)instance-000000953CAA6BFB-0CC5-4366-A431-30902C757B9112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)instance-000000953CAA6BFB-0CC5-4366-A431-30902C757B9110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000095\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)instance-000000953CAA6BFB-0CC5-4366-A431-30902C757B91%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': 'F643F90D-05B9-4AF6-8DA5-34FC628EEFC5', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114243), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 42, 37), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 42, 37), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000095' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)\n\nNot enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)\n\n'instance-00000095' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)", 'ErrorSummaryDescription': "'instance-00000095' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000095.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:42:37.979 4088 3038340489992 MainThread DEBUG os_win._utils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000095' failed to start. Not enough memory in the system to start the virtual machine instance-00000095. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000095' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Not enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) 'instance-00000095' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 4. Time left: undefined. Time elapsed: 1.377129316329956 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:42:38.007 4088 3038340491576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000095" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:42:38.007 4088 3038340491576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000095" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:42:38.007 4088 3038340491752 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:42:38.017 4088 3038340491752 MainThread INFO nova.compute.manager [-] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] VM Stopped (Lifecycle Event) 2021-09-10 17:42:38.030 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-2b205f36-cb86-4846-89b1-51bc75079525 - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:42:38.030 4088 3038340491752 MainThread DEBUG nova.virt.hyperv.vmops [req-2b205f36-cb86-4846-89b1-51bc75079525 - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:42:38.092 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-2b205f36-cb86-4846-89b1-51bc75079525 - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:42:38.108 4088 3038340491752 MainThread INFO nova.compute.manager [req-2b205f36-cb86-4846-89b1-51bc75079525 - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:42:38.980 4088 3038340489992 MainThread DEBUG os_win.utils.jobutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Waiting for WMI job: {'InstanceID': '65A27377-21E2-4413-8C81-D25FB517915F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=14891), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:42:39.194 4088 3038340491752 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:42:39.194 4088 3038340491752 MainThread INFO nova.compute.manager [-] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] VM Stopped (Lifecycle Event) 2021-09-10 17:42:39.194 4088 3038340491576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000095" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:42:39.194 4088 3038340491576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000095" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:42:39.214 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-47404a41-789e-4833-a1f5-5e7553d61e7b - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:42:39.214 4088 3038340491752 MainThread DEBUG nova.virt.hyperv.vmops [req-47404a41-789e-4833-a1f5-5e7553d61e7b - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:42:39.244 4088 3038340489992 MainThread ERROR os_win.utils.jobutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000095\' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)instance-000000953CAA6BFB-0CC5-4366-A431-30902C757B9112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)instance-000000953CAA6BFB-0CC5-4366-A431-30902C757B9110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000095\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)instance-000000953CAA6BFB-0CC5-4366-A431-30902C757B91%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '65A27377-21E2-4413-8C81-D25FB517915F', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=120344), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 42, 38), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 42, 39), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000095' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)\n\nNot enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)\n\n'instance-00000095' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)", 'ErrorSummaryDescription': "'instance-00000095' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000095.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:42:39.244 4088 3038340489992 MainThread DEBUG os_win._utils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000095' failed to start. Not enough memory in the system to start the virtual machine instance-00000095. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000095' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Not enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) 'instance-00000095' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 3. Time left: undefined. Time elapsed: 2.642559289932251 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:42:39.244 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-47404a41-789e-4833-a1f5-5e7553d61e7b - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:42:39.286 4088 3038340491752 MainThread INFO nova.compute.manager [req-47404a41-789e-4833-a1f5-5e7553d61e7b - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:42:40.280 4088 3038340489992 MainThread DEBUG os_win.utils.jobutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Waiting for WMI job: {'InstanceID': '1C9EBD4A-DE6F-4A94-8835-09BD62B54638', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=16203), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:42:40.419 4088 3038340489992 MainThread ERROR os_win.utils.jobutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000095\' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)instance-000000953CAA6BFB-0CC5-4366-A431-30902C757B9112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)instance-000000953CAA6BFB-0CC5-4366-A431-30902C757B9110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000095\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)instance-000000953CAA6BFB-0CC5-4366-A431-30902C757B91%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '1C9EBD4A-DE6F-4A94-8835-09BD62B54638', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=118114), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 42, 40), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 42, 40), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000095' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)\n\nNot enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)\n\n'instance-00000095' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)", 'ErrorSummaryDescription': "'instance-00000095' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000095.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:42:40.419 4088 3038340489992 MainThread DEBUG os_win._utils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000095' failed to start. Not enough memory in the system to start the virtual machine instance-00000095. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000095' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Not enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) 'instance-00000095' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 2. Time left: undefined. Time elapsed: 3.8175504207611084 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:42:40.478 4088 3038340491752 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:42:40.478 4088 3038340491752 MainThread INFO nova.compute.manager [-] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] VM Stopped (Lifecycle Event) 2021-09-10 17:42:40.478 4088 3038340491576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000095" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:42:40.478 4088 3038340491576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000095" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:42:40.478 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-96e57471-0714-4ff8-bb6b-6d20d6686fc3 - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:42:40.478 4088 3038340491752 MainThread DEBUG nova.virt.hyperv.vmops [req-96e57471-0714-4ff8-bb6b-6d20d6686fc3 - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:42:40.538 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-96e57471-0714-4ff8-bb6b-6d20d6686fc3 - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:42:40.567 4088 3038340491752 MainThread INFO nova.compute.manager [req-96e57471-0714-4ff8-bb6b-6d20d6686fc3 - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:42:41.440 4088 3038340489992 MainThread DEBUG os_win.utils.jobutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Waiting for WMI job: {'InstanceID': '90CC45DC-1919-4C72-8103-C4B8806A5D9E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15283), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:42:41.577 4088 3038340489992 MainThread ERROR os_win.utils.jobutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000095\' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)instance-000000953CAA6BFB-0CC5-4366-A431-30902C757B9112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)instance-000000953CAA6BFB-0CC5-4366-A431-30902C757B9110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000095\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)instance-000000953CAA6BFB-0CC5-4366-A431-30902C757B91%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '90CC45DC-1919-4C72-8103-C4B8806A5D9E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=113271), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 42, 41), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 42, 41), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000095' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)\n\nNot enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)\n\n'instance-00000095' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)", 'ErrorSummaryDescription': "'instance-00000095' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000095.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:42:41.577 4088 3038340489992 MainThread DEBUG os_win._utils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Got expected exception WMI job failed with status 10. Error summary description: 'instance-00000095' failed to start. Not enough memory in the system to start the virtual machine instance-00000095. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000095' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Not enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) 'instance-00000095' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Error code: 32778. while calling function os_win.utils.compute.vmutils.VMUtils.set_vm_state. Retries left: 1. Time left: undefined. Time elapsed: 4.975898504257202 Retrying in 1 seconds. inner c:\openstack\build\os-win\os_win\_utils.py:195 2021-09-10 17:42:41.621 4088 3038340491576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000095" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:42:41.621 4088 3038340491576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000095" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:42:41.621 4088 3038340491752 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:42:41.621 4088 3038340491752 MainThread INFO nova.compute.manager [-] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] VM Stopped (Lifecycle Event) 2021-09-10 17:42:41.621 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-8d46d7f4-a741-4899-93d7-59e204255025 - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:42:41.621 4088 3038340491752 MainThread DEBUG nova.virt.hyperv.vmops [req-8d46d7f4-a741-4899-93d7-59e204255025 - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:42:41.681 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-8d46d7f4-a741-4899-93d7-59e204255025 - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:42:41.702 4088 3038340491752 MainThread INFO nova.compute.manager [req-8d46d7f4-a741-4899-93d7-59e204255025 - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:42:42.593 4088 3038340489992 MainThread DEBUG os_win.utils.jobutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Waiting for WMI job: {'InstanceID': '76A8BD27-2C36-4B95-8E7F-42ABF07B7E5E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=15417), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:42:42.738 4088 3038340489992 MainThread ERROR os_win.utils.jobutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] WMI job failed: {'RawErrors': (('124\'instance-00000095\' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)instance-000000953CAA6BFB-0CC5-4366-A431-30902C757B9112030Microsoft-Windows-Hyper-V-Worker50', '124Not enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)instance-000000953CAA6BFB-0CC5-4366-A431-30902C757B9110243122Microsoft-Windows-Hyper-V-Worker50', '124\'instance-00000095\' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)instance-000000953CAA6BFB-0CC5-4366-A431-30902C757B91%%21479424140x8007000E3050Microsoft-Windows-Hyper-V-Worker50'), 0), 'InstanceID': '76A8BD27-2C36-4B95-8E7F-42ABF07B7E5E', 'Description': 'Initializing and Starting Virtual Machine', 'ElementName': 'Starting', 'JobStatus': 'Job is completed with error', 'ElapsedTime': datetime.timedelta(microseconds=114300), 'Cancellable': True, 'JobType': 12, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 10, 'JobState': 10, 'StatusDescriptions': ('Job is completed', 'Job is completed with error'), 'OperationalStatus': (17, 6), 'TimeSubmitted': datetime.datetime(2021, 9, 10, 17, 42, 42), 'UntilTime': None, 'TimeOfLastStateChange': datetime.datetime(2021, 9, 10, 17, 42, 42), 'DetailedStatus': None, 'LocalOrUtcTime': 2, 'ErrorCode': 32778, 'ErrorDescription': "'instance-00000095' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)\n\nNot enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)\n\n'instance-00000095' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91)", 'ErrorSummaryDescription': "'instance-00000095' failed to start.\n\nNot enough memory in the system to start the virtual machine instance-00000095.\n\nCould not initialize memory: Ran out of memory (0x8007000E)."}. 2021-09-10 17:42:42.738 4088 3038340489992 MainThread ERROR nova.virt.hyperv.vmops [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Failed to change vm state of instance-00000095 to 2: os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000095' failed to start. 2021-09-10 17:42:42.738 4088 3038340489992 MainThread INFO nova.virt.hyperv.vmops [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Got request to destroy instance 2021-09-10 17:42:42.761 4088 3038340491576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000095" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:42:42.761 4088 3038340491576 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "instance-00000095" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:42:42.761 4088 3038340491752 MainThread DEBUG nova.virt.driver [-] Emitting event Stopped> emit_event c:\openstack\build\nova\nova\virt\driver.py:1609 2021-09-10 17:42:42.761 4088 3038340491752 MainThread INFO nova.compute.manager [-] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] VM Stopped (Lifecycle Event) 2021-09-10 17:42:42.799 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-c2219a13-2520-4fd6-9bf7-c33c18efb13a - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Checking state _get_power_state c:\openstack\build\nova\nova\compute\manager.py:1564 2021-09-10 17:42:42.799 4088 3038340491752 MainThread DEBUG nova.virt.hyperv.vmops [req-c2219a13-2520-4fd6-9bf7-c33c18efb13a - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:42:42.848 4088 3038340491752 MainThread DEBUG nova.compute.manager [req-c2219a13-2520-4fd6-9bf7-c33c18efb13a - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 4 handle_lifecycle_event c:\openstack\build\nova\nova\compute\manager.py:1294 2021-09-10 17:42:42.874 4088 3038340491752 MainThread INFO nova.compute.manager [req-c2219a13-2520-4fd6-9bf7-c33c18efb13a - - - - -] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] During sync_power_state the instance has a pending task (spawning). Skip. 2021-09-10 17:42:43.444 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._run_pending_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:42:43.444 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10602 2021-09-10 17:42:43.458 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] There are 0 instances to clean _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10611 2021-09-10 17:42:44.553 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Power off instance power_off c:\openstack\build\nova\nova\virt\hyperv\vmops.py:832 2021-09-10 17:42:44.553 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Lock "instance-00000095" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:42:44.553 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Lock "instance-00000095" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:42:44.569 4088 3038340489992 MainThread DEBUG os_win.utils.compute.vmutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Successfully changed vm state of instance-00000095 to 3 set_vm_state c:\openstack\build\os-win\os_win\utils\compute\vmutils.py:698 2021-09-10 17:42:44.582 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Successfully changed state of VM instance-00000095 to: 3 _set_vm_state c:\openstack\build\nova\nova\virt\hyperv\vmops.py:878 2021-09-10 17:42:44.618 4088 3038340489992 MainThread DEBUG os_win.utils.jobutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Waiting for WMI job: {'InstanceID': '7319D163-00D9-47E8-8C31-F2ADF853D3AD', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is running', 'ElapsedTime': datetime.timedelta(microseconds=13994), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 0}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:94 2021-09-10 17:42:44.724 4088 3038340489992 MainThread DEBUG os_win.utils.jobutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] WMI job succeeded: {'InstanceID': '7319D163-00D9-47E8-8C31-F2ADF853D3AD', 'Description': 'Destroying Virtual Machine', 'ElementName': 'Destroying', 'JobStatus': 'Job is completed', 'ElapsedTime': datetime.timedelta(microseconds=106741), 'Cancellable': False, 'JobType': 3, 'Owner': 'CBCI-808474-1\\administrator', 'PercentComplete': 100}. _wait_for_job c:\openstack\build\os-win\os_win\utils\jobutils.py:124 2021-09-10 17:42:44.741 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Lock "instance-00000095" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:42:44.741 4088 3038340489992 MainThread DEBUG os_win.utils.pathutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Removing directory: C:\openstack\instances\instance-00000095 check_remove_dir c:\openstack\build\os-win\os_win\utils\pathutils.py:151 2021-09-10 17:42:44.741 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Lock "instance-00000095" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:42:44.741 4088 3038340489992 MainThread ERROR nova.compute.manager [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Instance failed to spawn: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000095' failed to start. Not enough memory in the system to start the virtual machine instance-00000095. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000095' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Not enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) 'instance-00000095' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Error code: 32778. 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Traceback (most recent call last): 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] return function(*args, **kwargs) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] admin_password, network_info, block_device_info) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] return function(self, *args, **kwds) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self.force_reraise() 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] raise self.value 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] should_plug_vifs=False) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 'req_state': req_state}) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self.force_reraise() 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] raise self.value 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] time.sleep(sleep_time) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self.force_reraise() 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] raise self.value 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] return f(*args, **kwargs) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] return self._wait_for_job(job_path) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] error_desc=err_desc) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000095' failed to start. 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Not enough memory in the system to start the virtual machine instance-00000095. 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000095' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Not enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 'instance-00000095' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Error code: 32778. 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] During handling of the above exception, another exception occurred: 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Traceback (most recent call last): 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\compute\manager.py", line 2638, in _build_resources 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] yield resources 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] accel_info=accel_info) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] return function(*args, **kwargs) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] admin_password, network_info, block_device_info) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] return function(self, *args, **kwds) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self.force_reraise() 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] raise self.value 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] should_plug_vifs=False) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 'req_state': req_state}) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self.force_reraise() 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] raise self.value 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] time.sleep(sleep_time) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self.force_reraise() 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] raise self.value 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] return f(*args, **kwargs) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] return self._wait_for_job(job_path) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] error_desc=err_desc) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000095' failed to start. 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Not enough memory in the system to start the virtual machine instance-00000095. 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000095' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Not enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 'instance-00000095' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Error code: 32778. 2021-09-10 17:42:44.741 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:44.741 4088 3038340489992 MainThread INFO nova.compute.manager [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Terminating instance 2021-09-10 17:42:44.741 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Start destroying the instance on the hypervisor. _shutdown_instance c:\openstack\build\nova\nova\compute\manager.py:2895 2021-09-10 17:42:44.741 4088 3038340489992 MainThread INFO nova.virt.hyperv.vmops [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Got request to destroy instance 2021-09-10 17:42:44.756 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Instance not found destroy c:\openstack\build\nova\nova\virt\hyperv\vmops.py:744 2021-09-10 17:42:44.756 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Lock "instance-00000095" acquired by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:42:44.756 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Lock "instance-00000095" released by "nova.virt.hyperv.serialconsoleops.instance_synchronized..wrapper..inner" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:42:44.756 4088 3038340489992 MainThread INFO nova.compute.manager [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Took 0.01 seconds to destroy the instance on the hypervisor. 2021-09-10 17:42:44.772 4088 3038340489992 MainThread DEBUG nova.compute.claims [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Aborting claim: abort c:\openstack\build\nova\nova\compute\claims.py:84 2021-09-10 17:42:44.772 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:42:44.850 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.hostops [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:42:44.874 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.hostops [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:42:45.068 4088 3038340489992 MainThread DEBUG nova.compute.provider_tree [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:42:45.085 4088 3038340489992 MainThread DEBUG nova.scheduler.client.report [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:42:45.085 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.312s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:42:45.085 4088 3038340489992 MainThread ERROR nova.compute.manager [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Failed to build and run instance: nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000095' failed to start. Not enough memory in the system to start the virtual machine instance-00000095. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000095' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Not enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) 'instance-00000095' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Error code: 32778. 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Traceback (most recent call last): 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] return function(*args, **kwargs) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] admin_password, network_info, block_device_info) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] return function(self, *args, **kwds) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self.force_reraise() 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] raise self.value 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] should_plug_vifs=False) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 'req_state': req_state}) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self.force_reraise() 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] raise self.value 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] time.sleep(sleep_time) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self.force_reraise() 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] raise self.value 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] return f(*args, **kwargs) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] return self._wait_for_job(job_path) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] error_desc=err_desc) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] os_win.exceptions.WMIJobFailed: WMI job failed with status 10. Error summary description: 'instance-00000095' failed to start. 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Not enough memory in the system to start the virtual machine instance-00000095. 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000095' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Not enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 'instance-00000095' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Error code: 32778. 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] During handling of the above exception, another exception occurred: 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Traceback (most recent call last): 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\compute\manager.py", line 2402, in _build_and_run_instance 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] accel_info=accel_info) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 67, in wrapper 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] raise exc.with_traceback(exc_info[2]) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 53, in wrapper 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] return function(*args, **kwargs) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\driver.py", line 163, in spawn 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] admin_password, network_info, block_device_info) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 81, in wrapper 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] return function(self, *args, **kwds) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 304, in spawn 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self.destroy(instance, network_info, block_device_info) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self.force_reraise() 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] raise self.value 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 301, in spawn 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] should_plug_vifs=False) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 868, in power_on 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self._set_vm_state(instance, os_win_const.HYPERV_VM_STATE_ENABLED) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 884, in _set_vm_state 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 'req_state': req_state}) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self.force_reraise() 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] raise self.value 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\nova\nova\virt\hyperv\vmops.py", line 874, in _set_vm_state 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self._vmutils.set_vm_state(instance_name, req_state) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\_utils.py", line 196, in inner 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] time.sleep(sleep_time) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self.force_reraise() 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\python37\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] raise self.value 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\_utils.py", line 149, in inner 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] return f(*args, **kwargs) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\utils\compute\vmutils.py", line 695, in set_vm_state 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] self._jobutils.check_ret_val(ret_val, job_path, [0, 32775]) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 73, in check_ret_val 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] return self._wait_for_job(job_path) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] File "c:\openstack\build\os-win\os_win\utils\jobutils.py", line 117, in _wait_for_job 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] error_desc=err_desc) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] nova.exception.NovaException: WMI job failed with status 10. Error summary description: 'instance-00000095' failed to start. 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Not enough memory in the system to start the virtual machine instance-00000095. 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000095' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Not enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 'instance-00000095' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Error code: 32778. 2021-09-10 17:42:45.085 4088 3038340489992 MainThread TRACE nova.compute.manager [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] 2021-09-10 17:42:45.085 4088 3038340489992 MainThread DEBUG nova.compute.utils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] WMI job failed with status 10. Error summary description: 'instance-00000095' failed to start. Not enough memory in the system to start the virtual machine instance-00000095. Could not initialize memory: Ran out of memory (0x8007000E).. Error descriptio notify_about_instance_usage c:\openstack\build\nova\nova\compute\utils.py:426 2021-09-10 17:42:45.085 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Build of instance 2423d019-a7f7-433a-9baf-c071866eaccd was re-scheduled: WMI job failed with status 10. Error summary description: 'instance-00000095' failed to start. Not enough memory in the system to start the virtual machine instance-00000095. Could not initialize memory: Ran out of memory (0x8007000E).. Error description: 'instance-00000095' failed to start. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Not enough memory in the system to start the virtual machine instance-00000095 with ram size 1024 megabytes. (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) 'instance-00000095' could not initialize memory: Ran out of memory (0x8007000E). (Virtual machine ID 3CAA6BFB-0CC5-4366-A431-30902C757B91) Error code: 32778. _do_build_and_run_instance c:\openstack\build\nova\nova\compute\manager.py:2243 2021-09-10 17:42:45.100 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Unplugging VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2750 2021-09-10 17:42:45.100 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Unplugged VIFs for instance _cleanup_allocated_networks c:\openstack\build\nova\nova\compute\manager.py:2786 2021-09-10 17:42:45.100 4088 3038340489992 MainThread DEBUG nova.compute.manager [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Deallocating network for instance _deallocate_network c:\openstack\build\nova\nova\compute\manager.py:2057 2021-09-10 17:42:45.100 4088 3038340489992 MainThread DEBUG nova.network.neutron [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] deallocate_for_instance() deallocate_for_instance c:\openstack\build\nova\nova\network\neutron.py:1672 2021-09-10 17:42:45.576 4088 3038340489992 MainThread DEBUG nova.network.neutron [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Updating instance_info_cache with network_info: [] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:42:45.616 4088 3038340489992 MainThread INFO nova.compute.manager [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] [instance: 2423d019-a7f7-433a-9baf-c071866eaccd] Took 0.52 seconds to deallocate network for instance. 2021-09-10 17:42:45.756 4088 3038340489992 MainThread INFO nova.scheduler.client.report [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Deleted allocations for instance 2423d019-a7f7-433a-9baf-c071866eaccd 2021-09-10 17:42:45.790 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [req-a1994e4e-8c3c-4dcf-a5b5-f9c1728dc4e5 10226e0397b7435499d0680801742547 3efd33abd6ee4c68bcbc61a4464c4134 - default default] Lock "2423d019-a7f7-433a-9baf-c071866eaccd" released by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 21.671s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:43:18.458 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:43:19.443 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:43:19.443 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:43:20.458 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:43:21.451 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:43:22.443 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:43:24.443 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:43:24.481 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:43:24.493 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:43:24.493 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:43:24.493 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:43:24.493 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:43:24.527 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:43:24.753 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2075MB free_disk=49GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:43:24.753 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:43:24.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:43:24.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:43:24.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:43:24.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:43:24.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:43:24.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:43:24.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:43:24.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:43:24.870 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:43:24.896 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:43:24.896 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:43:24.896 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:43:24.896 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:43:24.896 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:43:24.896 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:43:24.912 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:43:24.944 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:43:25.153 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:43:25.171 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:43:25.171 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:43:25.171 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:43:28.146 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:43:28.146 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:43:28.474 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:43:28.474 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:43:28.543 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-98da4c02-e4db-4a02-a807-c737f9038672" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:43:28.543 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:43:29.052 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Updating instance_info_cache with network_info: [{"id": "51e81291-5d40-4203-b72f-f016060edd87", "address": "fa:16:3e:82:36:43", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap51e81291-5d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:43:29.065 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-98da4c02-e4db-4a02-a807-c737f9038672" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:43:29.065 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:43:47.705 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:44:20.487 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:44:21.441 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:44:21.441 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:44:21.441 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:44:23.441 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:44:24.440 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:44:25.439 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:44:25.457 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:44:25.457 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:44:25.457 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:44:25.457 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:44:25.476 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:44:25.722 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=1961MB free_disk=49GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:44:25.722 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:44:25.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:44:25.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:44:25.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:44:25.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:44:25.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:44:25.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:44:25.860 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:44:25.860 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:44:25.860 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:44:25.860 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:44:25.860 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:44:25.860 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:44:25.860 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:44:25.860 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:44:25.860 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:44:25.878 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:44:25.894 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:44:26.098 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:44:26.128 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:44:26.128 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:44:26.128 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:44:28.128 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:44:28.440 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:44:28.441 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:44:28.503 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-359fd482-69f5-4194-9466-f46ea31258d3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:44:28.519 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:44:29.002 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Updating instance_info_cache with network_info: [{"id": "43904798-2eab-4ec0-9b1b-f79a929eba99", "address": "fa:16:3e:9c:26:60", "network": {"id": "7434a41e-b78f-4cb9-8ffe-b2514d097201", "bridge": null, "label": "tempest-LiveAutoBlockMigrationV225Test-1499875764-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91237ebda1b54d2dbc761e48fdd93516", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap43904798-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:44:29.018 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-359fd482-69f5-4194-9466-f46ea31258d3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:44:29.018 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:44:29.018 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:45:21.446 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:45:22.434 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:45:22.434 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:45:22.434 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:45:24.439 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:45:25.438 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:45:25.454 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:45:25.454 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:45:25.454 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:45:25.454 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:45:25.459 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:45:25.673 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2020MB free_disk=49GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:45:25.673 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:45:25.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:45:25.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:45:25.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:45:25.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:45:25.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:45:25.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:45:25.891 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:45:25.907 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:45:25.908 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:45:25.908 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:45:25.908 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:45:25.908 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:45:25.908 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:45:25.908 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:45:25.908 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:45:25.908 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:45:25.923 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:45:26.157 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:45:26.157 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:45:26.157 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:45:26.157 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:45:27.159 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:45:29.443 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:45:29.485 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:45:29.485 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:45:29.610 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-6a33a253-c7b1-44b1-bdc0-eca64733ab55" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:45:29.610 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:45:30.096 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Updating instance_info_cache with network_info: [{"id": "d98b48f6-4cb1-44c3-9950-b42769c9d93e", "address": "fa:16:3e:44:cf:f9", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapd98b48f6-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:45:30.096 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-6a33a253-c7b1-44b1-bdc0-eca64733ab55" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:45:30.096 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:45:30.096 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:45:30.440 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:45:52.701 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:46:23.477 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:46:23.477 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:46:23.477 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:46:24.436 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:46:26.436 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:46:27.431 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_shelved_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:46:27.431 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:46:27.431 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:46:27.431 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:46:27.451 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:46:27.451 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:46:27.483 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:46:27.686 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2020MB free_disk=49GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:46:27.717 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:46:27.842 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:46:27.842 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:46:27.842 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:46:27.842 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:46:27.842 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:46:27.842 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:46:27.842 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:46:27.842 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:46:27.842 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:46:27.842 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:46:27.842 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:46:27.842 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:46:27.842 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:46:27.842 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:46:27.842 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:46:27.842 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:46:27.865 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:46:28.077 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:46:28.077 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:46:28.077 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:46:28.077 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:46:29.076 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:46:29.467 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:46:30.436 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:46:30.436 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:46:30.514 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-592bb39a-81cb-43f8-a643-b04092bd9e8a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:46:30.514 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:46:30.999 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Updating instance_info_cache with network_info: [{"id": "2ef6a3e6-e7a5-4da7-941d-89a1d5c697b7", "address": "fa:16:3e:eb:d0:49", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2ef6a3e6-e7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:46:30.999 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-592bb39a-81cb-43f8-a643-b04092bd9e8a" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:46:30.999 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:46:32.451 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:47:23.433 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:47:23.433 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:47:24.435 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:47:26.433 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:47:27.433 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:47:28.449 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:47:28.464 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:47:28.464 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:47:28.464 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:47:28.464 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:47:28.499 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:47:28.715 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2015MB free_disk=49GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:47:28.715 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:47:28.855 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:47:28.855 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:47:28.855 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:47:28.855 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:47:28.855 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:47:28.855 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:47:28.855 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:47:28.855 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:47:28.855 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:47:28.855 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:47:28.855 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:47:28.871 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:47:28.871 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:47:28.871 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:47:28.871 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:47:28.886 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing inventories for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:757 2021-09-10 17:47:28.911 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Updating ProviderTree inventory for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 from _refresh_and_get_inventory using data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} _refresh_and_get_inventory c:\openstack\build\nova\nova\scheduler\client\report.py:723 2021-09-10 17:47:28.911 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Updating inventory in ProviderTree for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 with inventory: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:176 2021-09-10 17:47:28.931 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing aggregate associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, aggregates: None _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:766 2021-09-10 17:47:28.965 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing trait associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_VHD,COMPUTE_IMAGE_TYPE_VHDX,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:778 2021-09-10 17:47:28.965 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:47:28.985 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:47:29.199 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:47:29.214 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:47:29.214 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:47:29.214 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:47:30.215 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:47:30.433 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:47:30.433 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:47:30.574 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-9446e666-4364-4dcd-b041-405653a856bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:47:30.574 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:47:31.061 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Updating instance_info_cache with network_info: [{"id": "f581c585-39ab-4120-a040-5d92bb401a6c", "address": "fa:16:3e:da:9a:80", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf581c585-39", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:47:31.081 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-9446e666-4364-4dcd-b041-405653a856bd" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:47:31.081 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9446e666-4364-4dcd-b041-405653a856bd] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:47:31.440 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:47:32.428 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:47:32.683 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_power_states run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:47:32.730 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 18930e09-cd62-4d3e-b27f-e9541dfa3efc _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:47:32.730 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:47:32.730 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 66c5445c-c347-4833-8af8-58ba8ff6d95e _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:47:32.759 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:47:32.759 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9db39d70-5120-4de4-bb87-480a6efb8a3a _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:47:32.762 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 0e77fafa-3f8a-4513-bb64-518c77e99029 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:47:32.762 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 50586591-86ba-41be-b4e1-5004ea0d76dd _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:47:32.762 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 98da4c02-e4db-4a02-a807-c737f9038672 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:47:32.762 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 359fd482-69f5-4194-9466-f46ea31258d3 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:47:32.762 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 6a33a253-c7b1-44b1-bdc0-eca64733ab55 _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:47:32.762 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 592bb39a-81cb-43f8-a643-b04092bd9e8a _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:47:32.762 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9446e666-4364-4dcd-b041-405653a856bd _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:47:32.762 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Triggering sync for uuid 9bb2d354-2d76-40ea-8b9c-b18a21edefbb _sync_power_states c:\openstack\build\nova\nova\compute\manager.py:9748 2021-09-10 17:47:32.762 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:47:32.762 4088 3038340491752 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:47:32.762 4088 3038340489640 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:47:32.762 4088 3038340489640 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:47:32.762 4088 3038364922280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "359fd482-69f5-4194-9466-f46ea31258d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:47:32.762 4088 3038364922280 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 359fd482-69f5-4194-9466-f46ea31258d3] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:47:32.762 4088 3038364922632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:47:32.762 4088 3038364922632 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 592bb39a-81cb-43f8-a643-b04092bd9e8a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:47:32.762 4088 3038364922984 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:47:32.762 4088 3038364922984 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:47:32.762 4088 3038364922456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:47:32.762 4088 3038364922456 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 6a33a253-c7b1-44b1-bdc0-eca64733ab55] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:47:32.762 4088 3038364922808 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9446e666-4364-4dcd-b041-405653a856bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:47:32.762 4088 3038364922808 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 9446e666-4364-4dcd-b041-405653a856bd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:47:32.762 4088 3038364921928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:47:32.762 4088 3038364921928 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 50586591-86ba-41be-b4e1-5004ea0d76dd] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:47:32.780 4088 3038340489288 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.015s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:47:32.780 4088 3038340489288 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 9db39d70-5120-4de4-bb87-480a6efb8a3a] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:47:32.780 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:47:32.780 4088 3038340490696 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:47:32.780 4088 3038340491400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:47:32.780 4088 3038340491400 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:47:32.780 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:47:32.780 4088 3038340489992 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 0e77fafa-3f8a-4513-bb64-518c77e99029] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:47:32.780 4088 3038364922104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "98da4c02-e4db-4a02-a807-c737f9038672" acquired by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:47:32.780 4088 3038364922104 MainThread DEBUG nova.virt.hyperv.vmops [-] [instance: 98da4c02-e4db-4a02-a807-c737f9038672] get_info called for instance get_info c:\openstack\build\nova\nova\virt\hyperv\vmops.py:121 2021-09-10 17:47:32.903 4088 3038364922280 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "359fd482-69f5-4194-9466-f46ea31258d3" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.140s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:47:32.903 4088 3038340491752 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.140s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:47:32.933 4088 3038364922632 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "592bb39a-81cb-43f8-a643-b04092bd9e8a" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.172s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:47:32.933 4088 3038364922984 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9bb2d354-2d76-40ea-8b9c-b18a21edefbb" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.172s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:47:32.948 4088 3038364921928 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "50586591-86ba-41be-b4e1-5004ea0d76dd" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.187s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:47:32.964 4088 3038340489288 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9db39d70-5120-4de4-bb87-480a6efb8a3a" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.188s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:47:32.968 4088 3038364922808 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "9446e666-4364-4dcd-b041-405653a856bd" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.203s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:47:32.968 4088 3038340490696 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "66c5445c-c347-4833-8af8-58ba8ff6d95e" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.188s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:47:32.968 4088 3038340491400 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.188s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:47:32.968 4088 3038340489640 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "18930e09-cd62-4d3e-b27f-e9541dfa3efc" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.203s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:47:32.968 4088 3038340489992 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "0e77fafa-3f8a-4513-bb64-518c77e99029" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.188s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:47:32.968 4088 3038364922456 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "6a33a253-c7b1-44b1-bdc0-eca64733ab55" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.203s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:47:32.968 4088 3038364922104 MainThread DEBUG oslo_concurrency.lockutils [-] Lock "98da4c02-e4db-4a02-a807-c737f9038672" released by "nova.compute.manager.ComputeManager._sync_power_states.._sync..query_driver_power_state_and_sync" :: held 0.188s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:47:34.531 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:47:38.433 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_incomplete_migrations run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:47:38.433 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances with incomplete migration _cleanup_incomplete_migrations c:\openstack\build\nova\nova\compute\manager.py:10640 2021-09-10 17:47:40.448 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:47:47.463 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._run_pending_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:47:47.463 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10602 2021-09-10 17:47:47.479 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] There are 0 instances to clean _run_pending_deletes c:\openstack\build\nova\nova\compute\manager.py:10611 2021-09-10 17:47:52.714 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:48:24.471 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:48:25.447 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:48:25.447 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:48:28.463 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:48:29.431 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:48:29.431 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:48:29.431 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:48:29.431 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:48:29.431 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:48:29.431 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:48:29.469 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:48:29.712 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2030MB free_disk=49GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:48:29.712 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:48:29.837 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:48:29.837 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:48:29.837 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:48:29.837 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:48:29.837 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:48:29.837 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:48:29.837 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:48:29.852 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:48:29.853 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:48:29.853 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:48:29.853 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:48:29.853 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:48:29.853 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:48:29.853 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:48:29.853 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:48:29.853 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:48:29.853 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:48:30.072 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:48:30.072 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:48:30.072 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:48:30.072 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:48:31.071 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:48:31.431 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:48:31.431 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:48:31.509 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-9bb2d354-2d76-40ea-8b9c-b18a21edefbb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:48:31.509 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:48:31.977 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Updating instance_info_cache with network_info: [{"id": "cffb92ec-4239-478b-a7e3-533da175c554", "address": "fa:16:3e:61:8a:33", "network": {"id": "6762dff9-0e3f-42c6-a0d6-ae3571e9fc82", "bridge": null, "label": "tempest-AttachSCSIVolumeTestJSON-1567357011-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "10c929df49a24fb798e1b2d3f7414211", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcffb92ec-42", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:48:32.009 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-9bb2d354-2d76-40ea-8b9c-b18a21edefbb" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:48:32.009 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 9bb2d354-2d76-40ea-8b9c-b18a21edefbb] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:48:32.426 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:48:33.430 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:49:25.429 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:49:26.429 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:49:26.429 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:49:29.441 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:49:30.428 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:49:30.428 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:49:30.444 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:49:30.444 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:49:30.444 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:49:30.444 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:49:30.476 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:49:30.710 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2029MB free_disk=49GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:49:30.710 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:49:30.835 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:49:30.835 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:49:30.835 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:49:30.835 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:49:30.835 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:49:30.835 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:49:30.835 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:49:30.835 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:49:30.835 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:49:30.850 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:49:30.850 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:49:30.850 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:49:30.850 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:49:30.850 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:49:30.850 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:49:30.850 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:49:30.869 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:49:31.055 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:49:31.084 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:49:31.084 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:49:31.084 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:49:32.084 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:49:32.084 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:49:32.084 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9342 2021-09-10 17:49:32.179 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-18930e09-cd62-4d3e-b27f-e9541dfa3efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:49:32.179 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:49:32.179 4088 3038296676664 GreenThread-2 DEBUG nova.objects.instance [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lazy-loading 'info_cache' on Instance uuid 18930e09-cd62-4d3e-b27f-e9541dfa3efc obj_load_attr c:\openstack\build\nova\nova\objects\instance.py:1101 2021-09-10 17:49:32.694 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Updating instance_info_cache with network_info: [{"id": "829c891f-1877-4967-a719-113170bb7add", "address": "fa:16:3e:5d:ef:74", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap829c891f-18", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:49:32.710 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-18930e09-cd62-4d3e-b27f-e9541dfa3efc" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:49:32.710 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18930e09-cd62-4d3e-b27f-e9541dfa3efc] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:49:32.710 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:49:32.710 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:49:34.429 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:49:39.428 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:49:56.693 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:50:25.474 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:50:27.426 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:50:27.426 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:50:30.441 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:50:30.441 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:50:30.441 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:50:30.461 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:50:30.461 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:50:30.489 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:50:30.724 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=1995MB free_disk=49GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:50:30.724 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:50:30.988 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:50:30.988 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:50:30.988 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:50:30.988 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:50:30.988 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:50:30.988 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:50:30.988 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:50:30.988 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:50:30.988 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:50:30.988 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:50:30.988 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:50:30.988 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:50:30.988 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:50:30.988 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:50:30.988 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:50:31.005 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:50:31.020 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:50:31.223 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:50:31.234 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:50:31.234 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:50:31.234 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:50:32.222 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:50:32.426 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:50:32.426 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:50:32.426 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:50:32.504 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:50:32.504 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:50:33.254 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Updating instance_info_cache with network_info: [{"id": "e94d3f34-4aa5-46a2-9cf3-221c28446067", "address": "fa:16:3e:bd:9b:a0", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tape94d3f34-4a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:50:33.285 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-ef1cd05b-7bc8-4680-8159-f69d1e1f71a3" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:50:33.285 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: ef1cd05b-7bc8-4680-8159-f69d1e1f71a3] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:50:33.285 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:50:34.426 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:50:36.426 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:51:26.423 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:51:27.428 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:51:27.428 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:51:31.423 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:51:31.433 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:51:31.433 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:51:31.433 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:51:31.433 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:51:31.472 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:51:31.706 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=1946MB free_disk=49GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:51:31.706 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:51:31.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:51:31.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:51:31.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:51:31.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:51:31.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:51:31.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:51:31.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:51:31.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:51:31.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:51:31.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:51:31.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:51:31.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:51:31.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:51:31.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:51:31.846 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:51:31.846 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:51:31.862 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:51:32.083 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:51:32.083 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:51:32.102 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:51:32.102 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:51:33.090 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:51:33.425 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:51:33.425 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:51:33.425 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:51:33.501 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-66c5445c-c347-4833-8af8-58ba8ff6d95e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:51:33.501 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:51:33.985 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Updating instance_info_cache with network_info: [{"id": "fecb5a04-48f6-4c8b-bb0f-748b812daefa", "address": "fa:16:3e:2d:da:04", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfecb5a04-48", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:51:34.003 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-66c5445c-c347-4833-8af8-58ba8ff6d95e" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:51:34.003 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 66c5445c-c347-4833-8af8-58ba8ff6d95e] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:51:34.423 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:51:34.423 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:51:37.454 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:51:40.424 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:51:57.690 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:52:28.483 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:52:29.419 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:52:29.419 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes c:\openstack\build\nova\nova\compute\manager.py:9955 2021-09-10 17:52:31.432 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:52:31.432 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:52:31.432 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:52:31.432 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Auditing locally available compute resources for n-h2-808474-1 (node: n-h2-808474-1) update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:878 2021-09-10 17:52:31.452 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:52:31.468 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:52:31.689 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Hypervisor/Node resource view: name=n-h2-808474-1 free_ram=2149MB free_disk=49GB free_vcpus=6 pci_devices=[] _report_hypervisor_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1026 2021-09-10 17:52:31.689 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:359 2021-09-10 17:52:31.833 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18930e09-cd62-4d3e-b27f-e9541dfa3efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:52:31.833 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance ef1cd05b-7bc8-4680-8159-f69d1e1f71a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:52:31.833 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 66c5445c-c347-4833-8af8-58ba8ff6d95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:52:31.833 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:52:31.833 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9db39d70-5120-4de4-bb87-480a6efb8a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:52:31.833 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 0e77fafa-3f8a-4513-bb64-518c77e99029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:52:31.833 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 50586591-86ba-41be-b4e1-5004ea0d76dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:52:31.833 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 98da4c02-e4db-4a02-a807-c737f9038672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:52:31.833 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 6a33a253-c7b1-44b1-bdc0-eca64733ab55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:52:31.833 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 592bb39a-81cb-43f8-a643-b04092bd9e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:52:31.833 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 359fd482-69f5-4194-9466-f46ea31258d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:52:31.833 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9bb2d354-2d76-40ea-8b9c-b18a21edefbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:52:31.833 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Instance 9446e666-4364-4dcd-b041-405653a856bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 1024, 'VCPU': 1}}. _remove_deleted_instances_allocations c:\openstack\build\nova\nova\compute\resource_tracker.py:1532 2021-09-10 17:52:31.833 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Total usable vcpus: 6, total allocated vcpus: 13 _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1042 2021-09-10 17:52:31.833 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Final resource view: name=n-h2-808474-1 phys_ram=16383MB used_ram=13824MB phys_disk=79GB used_disk=13GB total_vcpus=6 used_vcpus=13 pci_stats=[] _report_final_resource_view c:\openstack\build\nova\nova\compute\resource_tracker.py:1064 2021-09-10 17:52:31.892 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing inventories for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:757 2021-09-10 17:52:31.939 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Updating ProviderTree inventory for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 from _refresh_and_get_inventory using data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} _refresh_and_get_inventory c:\openstack\build\nova\nova\scheduler\client\report.py:723 2021-09-10 17:52:31.939 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Updating inventory in ProviderTree for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 with inventory: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:176 2021-09-10 17:52:31.958 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing aggregate associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, aggregates: None _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:766 2021-09-10 17:52:31.999 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Refreshing trait associations for resource provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_VHD,COMPUTE_IMAGE_TYPE_VHDX,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE _refresh_associations c:\openstack\build\nova\nova\scheduler\client\report.py:778 2021-09-10 17:52:31.999 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] get_available_resource called get_available_resource c:\openstack\build\nova\nova\virt\hyperv\hostops.py:147 2021-09-10 17:52:32.020 4088 3038296676664 GreenThread-2 DEBUG nova.virt.hyperv.hostops [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Windows version: 10000 _get_hypervisor_version c:\openstack\build\nova\nova\virt\hyperv\hostops.py:107 2021-09-10 17:52:32.236 4088 3038296676664 GreenThread-2 DEBUG nova.compute.provider_tree [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed in ProviderTree for provider: 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 update_inventory c:\openstack\build\nova\nova\compute\provider_tree.py:180 2021-09-10 17:52:32.258 4088 3038296676664 GreenThread-2 DEBUG nova.scheduler.client.report [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Inventory has not changed for provider 29611d7d-a4ec-4e5d-951c-2dc30bb9df24 based on inventory data: {'VCPU': {'total': 6, 'reserved': 0, 'min_unit': 1, 'max_unit': 6, 'step_size': 1, 'allocation_ratio': 16.0}, 'MEMORY_MB': {'total': 16383, 'reserved': 512, 'min_unit': 1, 'max_unit': 16383, 'step_size': 1, 'allocation_ratio': 1.5}, 'DISK_GB': {'total': 79, 'reserved': 0, 'min_unit': 1, 'max_unit': 79, 'step_size': 1, 'allocation_ratio': 1.0}} set_inventory_for_provider c:\openstack\build\nova\nova\scheduler\client\report.py:894 2021-09-10 17:52:32.258 4088 3038296676664 GreenThread-2 DEBUG nova.compute.resource_tracker [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Compute_service record updated for n-h2-808474-1:n-h2-808474-1 _update_available_resource c:\openstack\build\nova\nova\compute\resource_tracker.py:977 2021-09-10 17:52:32.258 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Lock "compute_resources" released by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.578s inner c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:371 2021-09-10 17:52:33.247 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:52:33.421 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:52:33.421 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Starting heal instance info cache _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9338 2021-09-10 17:52:33.533 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Acquired lock "refresh_cache-18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:266 2021-09-10 17:52:33.533 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Forcefully refreshing network info cache for instance _get_instance_nw_info c:\openstack\build\nova\nova\network\neutron.py:1871 2021-09-10 17:52:34.023 4088 3038296676664 GreenThread-2 DEBUG nova.network.neutron [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Updating instance_info_cache with network_info: [{"id": "83b451dc-a198-4ccd-9f65-c8fe6343aea3", "address": "fa:16:3e:44:7f:92", "network": {"id": "f5731852-5afb-46d1-b2dd-91163c55904a", "bridge": null, "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.2"}}], "meta": {"injected": false, "tenant_id": "b066f936ad564c189113f73748329e33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap83b451dc-a1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] update_instance_cache_with_nw_info c:\openstack\build\nova\nova\network\neutron.py:118 2021-09-10 17:52:34.023 4088 3038296676664 GreenThread-2 DEBUG oslo_concurrency.lockutils [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Releasing lock "refresh_cache-18b04b0f-bbb0-445c-ae8b-6c7fe4c46954" lock c:\python37\lib\site-packages\oslo_concurrency\lockutils.py:282 2021-09-10 17:52:34.023 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] [instance: 18b04b0f-bbb0-445c-ae8b-6c7fe4c46954] Updated the network info_cache for instance _heal_instance_info_cache c:\openstack\build\nova\nova\compute\manager.py:9410 2021-09-10 17:52:36.025 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:52:36.427 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:52:36.427 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:52:37.424 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:52:40.436 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:52:45.423 4088 3038296676664 GreenThread-2 DEBUG oslo_service.periodic_task [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Running periodic task ComputeManager._cleanup_incomplete_migrations run_periodic_tasks c:\python37\lib\site-packages\oslo_service\periodic_task.py:211 2021-09-10 17:52:45.423 4088 3038296676664 GreenThread-2 DEBUG nova.compute.manager [req-9d01ff3a-9b06-485c-83a0-dcdac6af049c - - - - -] Cleaning up deleted instances with incomplete migration _cleanup_incomplete_migrations c:\openstack\build\nova\nova\compute\manager.py:10640